realshadow/satis-control-panel

Satis Control Panel (SCP) is a simple web UI for managing your Satis Repository for Composer packages.

, _(*1)

Satis Control Panel

Satis Control Panel (SCP) is a simple web UI for managing your Satis Repository for Composer Packages., _(*2)

SCP backend is written in Laravel and with a React + Typescript combo., _(*3)

Features

• simple UI for managing your Satis configuration file for both - private packages and public packages mirrored from Packagist
• no database required - only PHP and optional Nodejs server for automatic generation of Satis configuration file
• RESTful API for integration with CI services
• SCP comes with Atlassian plugins for Bamboo and Stash to ease managing package building
• Cron job for automatic build of public packages mirrored from Packagist

Installation

You can install SCP directly with Composer by running, _(*4)

composer create-project realshadow/satis-control-panel [--stability-dev]

After that you can rename example.env to .env and set required configuration options., _(*5)

Building javascript

npm run build

// or

npm run build-win

During development you can start Webpack dev server with, _(*6)

npm start

or run Gulp watcher for less files with, _(*7)

gulp watch

Satis configuration file

In resources/ directory you will find satis.json.dist file which holds default Satis configuration, copy this file and rename it to satis.json and edit the name and homepage property., _(*8)

cp resources/satis.json.dist resources/satis.json

When you are done, you have to set correct permissions for your configuration file for web user. E.g. www-data, should be able to read/write this file). More in next Permissions section., _(*9)

Permissions

For building to work correctly you have to set correct permissions to few directories/directories:, _(*10)

• bootstrap/cache/
• storage/
• public/private/
• public/public/
• resources/satis.json

Each directory/file should be readable/writable by web user, e.g. www-data. For example:, _(*11)

chmod -R ug+rwx bootstrap/cache storage public/private public/public
chmod ug+rwx resources/satis.json

Webserver setup

Your document root should point to the public folder in the root as per default Laravel setup, _(*12)

Apache - example vhost

<VirtualHost *:80>
        ServerName satis.example.com

        DocumentRoot /var/www/html/satis.example.com/public
</VirtualHost>

Nginx - example vhost

server {
        listen   80 default_server;

        root /var/www/html/satis.example.com/public;
        index index.php index.html index.htm;

        location / {
             try_files $uri $uri/ /index.php$is_args$args;
        }

        # pass the PHP scripts to FastCGI server liste_ning on /var/run/php5-fpm.sock
        location ~ \.php$ {
                try_files $uri /index.php =404;
                fastcgi_pass unix:/var/run/php5-fpm.sock;
                fastcgi_index index.php;
                fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
                include fastcgi_params;
        }
}

Visiting your control panel and generated packages

The control panel is located at http://{host}/control-panel and the packages will be generated (after first build of course) at http://{host}/public and http://{host}/private respectively., _(*13)

Separating them like this adds a bit more configuration options. If for example you want to only use private packages, you can change the directory of private_repository configuration option to public instead of public/private and have your packages generated at http://{host} and still have a functioning control panel., _(*14)

Configuration options

Here is a list of configuration options that can be set in config/satis.php (some of them can be set in .env file as well for convenience):, _(*15)

Note: if you change the default directory, remember to set correct permissions for your new directory., _(*16)

How it works

SCP manages a single Satis configuration file which is generated on the fly when specific UI actions are performed. During each generation cycle the file is split into public and private repository configuration file, because private packages use funcionality that doesn't work well with Packagist (it will try to mirror whole Packagist repository)., _(*17)

Besides adding, editing and removing packages/repositories from configuration file, UI allows you to build/rebuild every package or run a complete rebuild of all registered packages/repositories., _(*18)

Build process can run synchronously or asynchronously (by redirecting output to /dev/null and spawning a new process). By default, all builds run asynchronously, except on Windows where they are forced to run synchronously. This can be also forced during during API request by setting async_mode to false., _(*19)

Missing or broken mirrored configuration files

Since the configuration files mirroring is triggered by any UI action, it is not always the correct behaviour. If you want to manually trigger config generation, for example when you make changes directly on the server, you can trigger the config generation with this artisan command, _(*20)

php artisan satis:make:config

UI State

During build process whole UI is locked. During asynchronous builds UI state is handled by Node server, but running it is completely optional., _(*21)

It can be started with, _(*22)

npm run server

and will run on port 9010 by default. This can be changed in node/config.json file., _(*23)

If for some reason UI will stay locked even though no packages are currently being build, it can be unlocked by running:, _(*24)

php artisan satis:persister:unlock

Composer auth

Composer file auth.json can be put in COMPOSER_HOME directory where you can put your Github token or credentials for needed for private repositories., _(*25)

Private packages

Private packages are identified by repository URL address. When you will add/edit a new repository you can choose its type. By default, all repositories are considered as VCS repository. Building and rebuilding is handled by partial update functionality introduced in this PR only repositories that have a URL can be managed in UI. Those include:, _(*26)

• vcs
• hg
• pear
• composer
• artifact
• path

Adding support for more repository types is planned in future., _(*27)

Private packages use the repositories config key with require-all options set to true, thus all known packages are taken out of registered repositories, which means that Packagist must be disabled by default. This is handled when configs are split into private public part., _(*28)

Public (packagist) packages

Public packages are used for mirroring of existing packages that can be installed from Packagist if you are behind a corporate proxy, thus speeding up overall development and deployment time., _(*29)

All packages added here are fully mirrored with all their dependencies (but we still skip dev-dependencies). Currently only one version constraint is used and that's * so we can get a complete packagist clone., _(*30)

Adding support for custom version constraints is planned in future., _(*31)

Since full rebuild in this case could potentionally take few hours, you can use provided Cron task for a daily rebuild (see Cron task section)., _(*32)

Note though that you should not try to mirror whole Packagist repository!, _(*33)

RESTful API

SCP comes with built in API for esier integration with your favorite CI solution., _(*34)

Private packages

Private packages use md5 encoded repository url as ID., _(*35)

• get all repositories

GET control-panel/api/repository

• get one repository

GET control-panel/api/repository/{repository_id}

• add new repository

POST control-panel/api/repository
{
    'url': 'foo',
    'type: 'bar'
}

• update existing repository

PUT control-panel/api/repository/{repository_id}
{
    'url': 'foo',
    'type: 'bar'
}

• delete existing repository

DELETE control-panel/api/repository/{repository_id}

All methods return HTTP 404 if no repository is found., _(*36)

Note: same API can be used for public packages as well by replacing repository by package. Although remote control of public packages is not necessary., _(*37)

Additional API options

During both POST and PUT requests two additional options can be provided:, _(*38)

• async_mode - true/false => if the build should run synchronously or asynchronously (all builds run asynchronously by default)
• disable_build - true/false => if set to true Satis build command won't be run

Logs

All logs can be found in storage/logs directory. Logs are divided into:, _(*39)

• api_request.log - logs all API requests
• builder_async.log - logs all builds that run asynchronously, keep in mind that each asynchronous build has its own log file in async subdirectory identified by its timestamp
• builder_sync.log - logs all builds that run synchronously
• cron.log - for cron task logs

Cron task

Since mirroring of public packages can take some time and running full rebuild from UI is not a good idea, because this will lock it during the build process, SCP comes with a built in cron task that runs daily and will rebuild all repositories. It can be triggered with a cron entry similar to this:, _(*40)

* * * * * php /path/to/satis-folder/artisan schedule:run >> /dev/null 2>&1

Alternatively, you can add this cron entry:, _(*41)

00 00 * * * curl --request POST --header "Content-Length: 0" --header "X-Requested-With: XMLHttpRequest" http://{scp-url-address}/control-panel/build-public

This can be used for private packages as well, _(*42)

00 00 * * * curl --request POST --header "Content-Length: 0" --header "X-Requested-With: XMLHttpRequest" http://{scp-url-address}/control-panel/build-private

Atlassian plugins

SCP was created in an environment which uses Atlassian Stash and Bamboo as part of CI and thus two plugins were needed to completely integrate Composer packages into our build process., _(*43)

• Stash Satis Build Hook - a post receive hook that will register and trigger a build/rebuild of your package in SCP (if you want to skip deployment process)
• Bamboo Satis Build - a deployment task for rebuilding currently deployed Composer package in Satis repository

Both use partial update functionality which was introduced in this PR., _(*44)

TODO

• option to import composer.lock file for public packages
• option to use more types of private packages
• option to write custom version constraints for public packages
• option to see what's going during long running builds of public packages
• better handling of race conditions during simultaneous writes/reads
• authentification? (this can be simply handled with htpasswd)
• ????

PR's are welcome, _(*45)

Alternatives

• Satis Go
• Toran proxy