klevialent/tarantool-queue-php

tarantool queue php

PHP Tarantool queue tools

Compatible with php7.
Used
tarantool-php/client
tarantool-php/queue
, _(*1)

Tarantool is a NoSQL database running in a Lua application server. It integrates Lua modules, called LuaRocks. This package provides PHP bindings for Tarantool Queue LuaRock., _(*2)

Installation

The recommended way to install the library is through Composer:, _(*3)

$ composer require klevialent/tarantool-queue-php

QueueProcessController compatible only with yii2, and if you want to use it:, _(*4)

$ composer require yiisoft/yii2

Before start

In order to use queue, you first need to make sure that your Tarantool instance is configured, up and running. The minimal required configuration might look like this:, _(*5)

-- queues.lua

box.cfg {listen=3301}

queue = require('queue')
queue.start()

queue.create_tube('foobar', 'fifo', { if_not_exists=true })

You can read more about the box configuration in the official Tarantool documentation. For more information about the queue configuration check out queue's README., _(*6)

To start the instance you need to copy (or symlink) queues.lua file into the /etc/tarantool/instances.enabled directory and run the following command:, _(*7)

$ sudo tarantoolctl start queues

Working with queue

See example-yii or read more., _(*8)

$queue = Yii::$app->queue->foobar;

ProsessQueue

Implement method process() of WorkerInterface and run it as demon.
If you use yii2, _(*9)

//add to config
    'controllerMap' => [
        'queue-process' => WebDevTeam\TarantoolQueuePhp\QueueProcessController::className(),
    ],

//console command
php yii queue-process foobar

Data types

Under the hood Tarantool uses MessagePack binary format to serialize/deserialize data being stored in a queue. This means that it's safe to use such data types as null, bool, int, float, string, binary string and array without any manual pre- or post-processing:, _(*10)

$queue->put('foo');
$queue->put(true);
$queue->put(42);
$queue->put(4.2);
$queue->put(['foo' => ['bar' => ['baz' => null]]]);

Tasks

Task::getId()
Task::getState() // States::READY, States::TAKEN, States::DONE, States::BURY or States::DELAYED
Task::getData()

And some sugar methods:, _(*11)

Task::isReady()
Task::isTaken()
Task::isDone()
Task::isBuried()
Task::isDelayed()

Producer API

As you've already seen, to insert a task into a queue you need to call put() method, which accepts two arguments: the data you want to process and optional array of task options, which this particular queue supports. For example, fifottl queue (which we defined earlier in our Lua config file), supports delay, ttl, ttr, pri and temporary options:, _(*12)

$queue->put('foo', ['delay' => 30]);
$queue->put('bar', ['ttl' => 5]);
$queue->put('baz', ['ttr' => 10, 'pri' => 42]);

See the full list of available options here., _(*13)

Consumer API

To reserve a task for execution, call take() method. It accepts an optional timeout parameter. If a timeout value is supplied the call will wait timeout seconds until a READY task appears in the queue. The method returns either a Task object or null:, _(*14)

$task = $queue->take();
// wait 2 seconds
$task = $queue->take(2);
// wait 100 milliseconds
$task = $queue->take(.1);

After successful execution, a task can be marked as acknowledged (that will also delete the task from a queue):, _(*15)

$data = $task->getData();

// process $data

$task = $queue->ack($task->getId());

Or put back into the queue in case it cannot be executed:, _(*16)

$task = $queue->release($task->getId());

// for ttl-like queues you can specify a delay
$task = $queue->release($task->getId(), ['delay' => 30]);

To look at a task without changing its state, use:, _(*17)

$task = $queue->peek($task->getId());

To bury (disable) a task:, _(*18)

$task = $queue->bury($task->getId());

To reset buried task(s) back to READY state:, _(*19)

$count = $queue->kick(3); // kick 3 buried tasks

A task (in any state) can be deleted permanently with delete():, _(*20)

$task = $queue->delete($task->getId());

To delete all tasks in a queue:, _(*21)

$queue->truncate();

For a detailed API documentation, please read the section "Using the queue module" of the queue's README., _(*22)

Statistics

The stats() method provides access to the statistical information accumulated since a queue was created:, _(*23)

$stats = $queue->stats();

The result of this call might look like this:, _(*24)

[
    'tasks' => [
        'taken'   => 1,
        'buried'  => 1,
        'ready'   => 1,
        'done'    => 0,
        'delayed' => 0,
        'total'   => 3,
    ],
    'calls' => [
        'bury' => 1,
        'put'  => 3,
        'take' => 1,
        ...
    ],
]

In addition, you can specify a key to return only a subset of the array:, _(*25)

$calls = $queue->stats('calls');
$total = $queue->stats('tasks.total');