Dart

Setting a Maximum URL Length

See more Spider Examples

The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300. Dart

import 'package:chilkat/chilkat.dart';

void main() {
  final spider = CkSpider();

  spider.initialize('www.chilkatsoft.com');

  // Add the 1st URL:
  spider.addUnspidered('http://www.chilkatsoft.com/');

  // This example demonstrates setting the MaxUrlLen property
  // Do not add URLs longer than 250 characters to the "unspidered" queue:
  spider.maxUrlLen = 250;

  // ...
}