(PHP Extension) Setting a Maximum Response Size

The MaxResponseSize property protects your spider from downloading a page that is too large. By default, MaxResponseSize = 0, which indicates that there is no maximum. You may set it to a number indicating the maximum number of bytes to download. URLs with response sizes larger than this will be skipped.

Chilkat PHP Downloads PHP Extension for Windows, Linux, MAC OS X, Alpine Linux, Solaris, OpenBSD, FreeBSD, and Linux armhf/aarch64

<?php

// The version number (9_5_0) should match version of the Chilkat extension used, omitting the micro-version number.
// For example, if using Chilkat v9.5.0.48, then include as shown here:
include("chilkat_9_5_0.php");

$spider = new CkSpider();

$spider->Initialize('www.chilkatsoft.com');

// Add the 1st URL:
$spider->AddUnspidered('http://www.chilkatsoft.com/');

// This example demonstrates setting the MaxResponseSize property
// Do not download anything with a response size greater than 100,000 bytes.
$spider->put_MaxResponseSize(100000);

?>