Xbase++
Xbase++
Setting a Maximum URL Length
See more Spider Examples
The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.Chilkat Xbase++ Downloads
LOCAL oSpider
oSpider := CreateObject("Chilkat.Spider")
oSpider:Initialize("www.chilkatsoft.com")
// Add the 1st URL:
oSpider:AddUnspidered("http://www.chilkatsoft.com/")
// This example demonstrates setting the MaxUrlLen property
// Do not add URLs longer than 250 characters to the "unspidered" queue:
oSpider:MaxUrlLen := 250
// ...
oSpider:destroy()