Sample code for 30+ languages & platforms
Xbase++

Setting a Maximum URL Length

See more Spider Examples

The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.

Chilkat Xbase++ Downloads

Xbase++
LOCAL oSpider

oSpider := CreateObject("Chilkat.Spider")

oSpider:Initialize("www.chilkatsoft.com")

//  Add the 1st URL:
oSpider:AddUnspidered("http://www.chilkatsoft.com/")

//  This example demonstrates setting the MaxUrlLen property
//  Do not add URLs longer than 250 characters to the "unspidered" queue:
oSpider:MaxUrlLen := 250

//  ...

oSpider:destroy()