dimgraycat/pickurl

A simple PHP Web Url Pick.

PHP-PickUrl, a simple PHP Web Scraper

, _(*1)

Requirements

PHP-PickUrl depends on PHP 5.5+ and Goutte 1+ and Guzzle 6+., _(*2)

Installation

This library can be found on Packagist. The recommended way to install this is through composer., _(*3)

Edit your composer.json and add:, _(*4)

{
    "require": {
        "dimgraycat/pickurl": "*"
    }
}

And install dependencies:, _(*5)

$ curl -sS https://getcomposer.org/installer | php
$ php composer.phar install

Usage

Create a Pickurl\Spider Client instance:, _(*6)

```php:sample.php <?php $spider = new PickUrl\Spider(); $spider->addHook('before', function($crawler, $crawl_url) { print "$crawl_url\n"; }) ->addHook('after', function($crawler, $crawl_url, $searched_urls) { print_r($searched_urls); }) ->crawl('http://foo.sample.com');, <sub>(*7)</sub>

set UserAgent:
```php
$this->setUserAgent("MyCrawler 1.0");

set WaitTime:, <sub>(*8)</sub>

// default is 10sec. It can be shortened by setting.
$this->WaitTime(1);

License

PHP-PickUrl is licensed under the MIT license., <sub>(*9)</sub>