Chilkat HOME Android™ ASP Visual Basic VB.NET C# iOS (IPhone) Objective-C C++ C Unicode C++ Unicode C MFC Delphi DLL Delphi ActiveX FoxPro Java Perl PHP Extension PHP ActiveX Python PowerShell Ruby SQL Server VBScript
(VBScript) Getting Started Spidering a SiteThis is a very simple "getting started" example for spidering a web site. As you'll see in future examples, the Chilkat Spider library can be used to crawl the Web. For now, we'll concentrate on spidering a single site.
Dim fso, outFile Set fso = CreateObject("Scripting.FileSystemObject") Set outFile = fso.CreateTextFile("output.txt", True) ' The Chilkat Spider component/library is free. set spider = CreateObject("Chilkat.Spider") ' The spider object crawls a single web site at a time. As you'll see ' in later examples, you can collect outbound links and use them to ' crawl the web. For now, we'll simply spider 10 pages of chilkatsoft.com spider.Initialize "www.chilkatsoft.com" ' Add the 1st URL: spider.AddUnspidered "http://www.chilkatsoft.com/" ' Begin crawling the site by calling CrawlNext repeatedly. For i = 0 To 9 success = spider.CrawlNext() If (success = 1) Then ' Show the URL of the page just spidered. outFile.WriteLine(spider.LastUrl) ' The HTML is available in the LastHtml property Else ' Did we get an error or are there no more URLs to crawl? If (spider.NumUnspidered = 0) Then MsgBox "No more URLs to spider" Else MsgBox spider.LastErrorText End If End If ' Sleep 1 second before spidering the next URL. spider.SleepMs 1000 Next outFile.Close |
© 2000-2013 Chilkat Software, Inc. All Rights Reserved.