diggin/diggin-http-charset

Detecting based on header's charset and html meta charset. Automatically convert to UTF-8.

Diggin_Http_Charset

Automatically convert to UTF-8., _(*1)

Master: , _(*2)

Detecting based on header's charset & html meta charset., _(*3)

(handling several charset more carefully - SJIS-win, TIS-620 and others..), _(*4)

This library aims to used in web-scraping., _(*5)

Requirements

• PHP 5.3 or over
• mbstring and iconv

Usage

1. wrap response object:

<?php
use Diggin\Http\Charset\WrapperFactory;
$client = new Zend\Http\Client($url);
$response = $client->send();
$response = WrapperFactory::factory($response); // then, response getBody() return with converted UTF-8.

Please see more at demos/Diggin/Http/Charset ., _(*6)

Guzzle & Goutte

guzzle-plugin-AutoCharsetEncodingPlugin supports for using with Guzzle3., _(*7)

Usage of with Behat by @MugeSo, _(*8)

Technical Information

Diggin_Http_Charset is based on HTMLScraping., _(*9)

• http://www.rcdtokyo.com/etc/htmlscraping/

License

Diggin_Http_Charset is licensed under LGPL(GNU Lesser General Public License)., _(*10)

Similar library

• perl : HTTP::Response::Encoding
  • http://search.cpan.org/dist/HTTP-Response-Encoding/
  • http://blog.livedoor.jp/dankogai/archives/50811793.html
• python : Universal Encoding Detector
  • http://chardet.feedparser.org/

TODOs

• handling non text/html content types.
• better APIs & according ZF2 coding standard.
• struggle in more charset :-\