2017 © Pedro Peláez
 

library xcrawler

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

image

xcrawler/xcrawler

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  • Monday, June 25, 2018
  • by yan
  • Repository
  • 11 Watchers
  • 234 Stars
  • 115 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 39 Forks
  • 0 Open issues
  • 7 Versions
  • 0 % Grown

The README.md

XCrawler - 轻量级、易维护的PHP爬虫框架

特性

  • 极易上手,具备完善的文档和示例
  • 支持多并发爬取
  • 支持失败重试、代理、断点续爬
  • 完善的爬取进度日志
  • 支持基于xpath、css选择器解析内容
  • 支持模拟浏览器行为,如user-agent、cookie、提交表单
  • 健壮的底层库,HTTP客户端基于guzzle,dom解析基于symfony/dom-crawler库

安装

composer require xcrawler/xcrawler

文档地址

查看文档: https://xcrawler.yanshuju.com/docs/, (*1)

交流

XCrawler交流群: 790478771, (*2)

开源协议 (License)

XCrawler是基于MIT开源协议发布的。, (*3)

The Versions

25/06 2018

dev-master

9999999-dev

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

25/06 2018

1.0.4

1.0.4.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

24/06 2018

1.0.31

1.0.31.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

24/06 2018

1.0.3

1.0.3.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

21/06 2018

1.0.2

1.0.2.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

13/06 2018

1.0.0

1.0.0.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦

13/06 2018

1.0.1

1.0.1.0

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

  Sources   Download

MIT

The Requires

 

by 王彦