evheniy/robots-txt-bundle

The RobotsTxtBundle adds the ability to generate robots.txt file to your application.

RobotsTxtBundle

This bundle provides robots.txt generator for Symfony2, _(*1)

, _(*2)

, _(*3)

, _(*4)

Installation

$ composer require evheniy/robots-txt-bundle "1.*"

Or add to composer.json, _(*5)

"evheniy/robots-txt-bundle": "1.*"

AppKernel:, _(*6)

public function registerBundles()
    {
        $bundles = array(
            ...
            new Evheniy\RobotsTxtBundle\RobotsTxtBundle(),
            ...
        );
        ...
...

config.yml:, _(*7)

robots_txt:
  - 'User-agent: *'

Or with sitemap:, _(*8)

robots_txt:
  - 'User-agent: *'
  - 'Sitemap: http://test.com/sitemap.xml'

The last step, _(*9)

app/console robots.txt:dump

Using different environments

The main idea is to use robots.txt for different environments, for example: for dev hiding project from indexing robots like Google, _(*10)

config_prod.yml:, _(*11)

robots_txt:
  - 'User-agent: *'
  - 'Sitemap: http://test.com/sitemap.xml'

config_dev.yml:, _(*12)

robots_txt:
  - 'User-agent: *'
  - 'Disallow: /'

And run it for prod:, _(*13)

app/console robots.txt:dump --env=prod

And run it for dev:, _(*14)

app/console robots.txt:dump --env=dev

Or just, _(*15)

app/console robots.txt:dump

License

This bundle is under the MIT license., _(*16)

Документация на русском языке, _(*17)

Demo, _(*18)

[Build a robots.txt][4], _(*19)