RabbitMQ Queue driver for Laravel
, (*1)
Support Policy
Only the latest version will get new features. Bug fixes will be provided using the following scheme:, (*2)
| Package Version |
Laravel Version |
Bug Fixes Until |
|
| 13 |
9 |
August 8th, 2023 |
Documentation |
Installation
You can install this package via composer using this command:, (*3)
composer require vladimir-yuldashev/laravel-queue-rabbitmq
The package will automatically register itself., (*4)
Configuration
Add connection to config/queue.php:, (*5)
This is the minimal config for the rabbitMQ connection/driver to work., (*6)
'connections' => [
// ...
'rabbitmq' => [
'driver' => 'rabbitmq',
'hosts' => [
[
'host' => env('RABBITMQ_HOST', '127.0.0.1'),
'port' => env('RABBITMQ_PORT', 5672),
'user' => env('RABBITMQ_USER', 'guest'),
'password' => env('RABBITMQ_PASSWORD', 'guest'),
'vhost' => env('RABBITMQ_VHOST', '/'),
],
// ...
],
// ...
],
// ...
],
Optional Queue Config
Optionally add queue options to the config of a connection.
Every queue created for this connection, gets the properties., (*7)
When you want to prioritize messages when they were delayed, then this is possible by adding extra options., (*8)
- When max-priority is omitted, the max priority is set with 2 when used.
'connections' => [
// ...
'rabbitmq' => [
// ...
'options' => [
'queue' => [
// ...
'prioritize_delayed' => false,
'queue_max_priority' => 10,
],
],
],
// ...
],
When you want to publish messages against an exchange with routing-keys, then this is possible by adding extra options., (*9)
- When the exchange is omitted, RabbitMQ will use the
amq.direct exchange for the routing-key
- When routing-key is omitted the routing-key by default is the
queue name.
- When using
%s in the routing-key the queue_name will be substituted.
Note: when using an exchange with routing-key, you probably create your queues with bindings yourself., (*10)
'connections' => [
// ...
'rabbitmq' => [
// ...
'options' => [
'queue' => [
// ...
'exchange' => 'application-x',
'exchange_type' => 'topic',
'exchange_routing_key' => '',
],
],
],
// ...
],
In Laravel failed jobs are stored into the database. But maybe you want to instruct some other process to also do
something with the message.
When you want to instruct RabbitMQ to reroute failed messages to a exchange or a specific queue, then this is possible
by adding extra options., (*11)
- When the exchange is omitted, RabbitMQ will use the
amq.direct exchange for the routing-key
- When routing-key is omitted, the routing-key by default the
queue name is substituted with '.failed'.
- When using
%s in the routing-key the queue_name will be substituted.
Note: When using failed_job exchange with routing-key, you probably need to create your exchange/queue with bindings
yourself., (*12)
'connections' => [
// ...
'rabbitmq' => [
// ...
'options' => [
'queue' => [
// ...
'reroute_failed' => true,
'failed_exchange' => 'failed-exchange',
'failed_routing_key' => 'application-x.%s',
],
],
],
// ...
],
Horizon support
Starting with 8.0, this package supports Laravel Horizon out of the box. Firstly,
install Horizon and then set RABBITMQ_WORKER to horizon., (*13)
Horizon is depending on events dispatched by the worker.
These events inform Horizon what was done with the message/job., (*14)
This Library supports Horizon, but in the config you have to inform Laravel to use the QueueApi compatible with horizon., (*15)
'connections' => [
// ...
'rabbitmq' => [
// ...
/* Set to "horizon" if you wish to use Laravel Horizon. */
'worker' => env('RABBITMQ_WORKER', 'default'),
],
// ...
],
Use your own RabbitMQJob class
Sometimes you have to work with messages published by another application.
Those messages probably won't respect Laravel's job payload schema.
The problem with these messages is that, Laravel workers won't be able to determine the actual job or class to execute., (*16)
You can extend the build-in RabbitMQJob::class and within the queue connection config, you can define your own class.
When you specify a job key in the config, with your own class name, every message retrieved from the broker will get
wrapped by your own class., (*17)
An example for the config:, (*18)
'connections' => [
// ...
'rabbitmq' => [
// ...
'options' => [
'queue' => [
// ...
'job' => \App\Queue\Jobs\RabbitMQJob::class,
],
],
],
// ...
],
An example of your own job class:, (*19)
<?php
namespace App\Queue\Jobs;
use VladimirYuldashev\LaravelQueueRabbitMQ\Queue\Jobs\RabbitMQJob as BaseJob;
class RabbitMQJob extends BaseJob
{
/**
* Fire the job.
*
* @return void
*/
public function fire()
{
$payload = $this->payload();
$class = WhatheverClassNameToExecute::class;
$method = 'handle';
($this->instance = $this->resolve($class))->{$method}($this, $payload);
$this->delete();
}
}
Or maybe you want to add extra properties to the payload:, (*20)
<?php
namespace App\Queue\Jobs;
use VladimirYuldashev\LaravelQueueRabbitMQ\Queue\Jobs\RabbitMQJob as BaseJob;
class RabbitMQJob extends BaseJob
{
/**
* Get the decoded body of the job.
*
* @return array
*/
public function payload()
{
return [
'job' => 'WhatheverFullyQualifiedClassNameToExecute@handle',
'data' => json_decode($this->getRawBody(), true)
];
}
}
If you want to handle raw message, not in JSON format or without 'job' key in JSON,
you should add stub for getName method:, (*21)
<?php
namespace App\Queue\Jobs;
use Illuminate\Support\Facades\Log;
use VladimirYuldashev\LaravelQueueRabbitMQ\Queue\Jobs\RabbitMQJob as BaseJob;
class RabbitMQJob extends BaseJob
{
public function fire()
{
$anyMessage = $this->getRawBody();
Log::info($anyMessage);
$this->delete();
}
public function getName()
{
return '';
}
}
Use your own Connection
You can extend the built-in PhpAmqpLib\Connection\AMQPStreamConnection::class
or PhpAmqpLib\Connection\AMQPSLLConnection::class and within the connection config, you can define your own class.
When you specify a connection key in the config, with your own class name, every connection will use your own class., (*22)
An example for the config:, (*23)
'connections' => [
// ...
'rabbitmq' => [
// ...
'connection' = > \App\Queue\Connection\MyRabbitMQConnection::class,
],
// ...
],
Use your own Worker class
If you want to use your own RabbitMQQueue::class this is possible by
extending VladimirYuldashev\LaravelQueueRabbitMQ\Queue\RabbitMQQueue.
and inform laravel to use your class by setting RABBITMQ_WORKER to \App\Queue\RabbitMQQueue::class., (*24)
Note: Worker classes must extend VladimirYuldashev\LaravelQueueRabbitMQ\Queue\RabbitMQQueue, (*25)
'connections' => [
// ...
'rabbitmq' => [
// ...
/* Set to a class if you wish to use your own. */
'worker' => \App\Queue\RabbitMQQueue::class,
],
// ...
],
<?php
namespace App\Queue;
use VladimirYuldashev\LaravelQueueRabbitMQ\Queue\RabbitMQQueue as BaseRabbitMQQueue;
class RabbitMQQueue extends BaseRabbitMQQueue
{
// ...
}
For Example: A reconnect implementation., (*26)
If you want to reconnect to RabbitMQ, if the connection is dead.
You can override the publishing and the createChannel methods., (*27)
Note: this is not best practice, it is an example., (*28)
<?php
namespace App\Queue;
use PhpAmqpLib\Exception\AMQPChannelClosedException;
use PhpAmqpLib\Exception\AMQPConnectionClosedException;
use VladimirYuldashev\LaravelQueueRabbitMQ\Queue\RabbitMQQueue as BaseRabbitMQQueue;
class RabbitMQQueue extends BaseRabbitMQQueue
{
protected function publishBasic($msg, $exchange = '', $destination = '', $mandatory = false, $immediate = false, $ticket = null): void
{
try {
parent::publishBasic($msg, $exchange, $destination, $mandatory, $immediate, $ticket);
} catch (AMQPConnectionClosedException|AMQPChannelClosedException) {
$this->reconnect();
parent::publishBasic($msg, $exchange, $destination, $mandatory, $immediate, $ticket);
}
}
protected function publishBatch($jobs, $data = '', $queue = null): void
{
try {
parent::publishBatch($jobs, $data, $queue);
} catch (AMQPConnectionClosedException|AMQPChannelClosedException) {
$this->reconnect();
parent::publishBatch($jobs, $data, $queue);
}
}
protected function createChannel(): AMQPChannel
{
try {
return parent::createChannel();
} catch (AMQPConnectionClosedException) {
$this->reconnect();
return parent::createChannel();
}
}
}
Default Queue
The connection does use a default queue with value 'default', when no queue is provided by laravel.
It is possible to change te default queue by adding an extra parameter in the connection config., (*29)
'connections' => [
// ...
'rabbitmq' => [
// ...
'queue' => env('RABBITMQ_QUEUE', 'default'),
],
// ...
],
Heartbeat
By default, your connection will be created with a heartbeat setting of 0.
You can alter the heartbeat settings by changing the config., (*30)
'connections' => [
// ...
'rabbitmq' => [
// ...
'options' => [
// ...
'heartbeat' => 10,
],
],
// ...
],
SSL Secure
If you need a secure connection to rabbitMQ server(s), you will need to add these extra config options., (*31)
'connections' => [
// ...
'rabbitmq' => [
// ...
'secure' = > true,
'options' => [
// ...
'ssl_options' => [
'cafile' => env('RABBITMQ_SSL_CAFILE', null),
'local_cert' => env('RABBITMQ_SSL_LOCALCERT', null),
'local_key' => env('RABBITMQ_SSL_LOCALKEY', null),
'verify_peer' => env('RABBITMQ_SSL_VERIFY_PEER', true),
'passphrase' => env('RABBITMQ_SSL_PASSPHRASE', null),
],
],
],
// ...
],
Events after Database commits
To instruct Laravel workers to dispatch events after all database commits are completed., (*32)
'connections' => [
// ...
'rabbitmq' => [
// ...
'after_commit' => true,
],
// ...
],
Lazy Connection
By default, your connection will be created as a lazy connection.
If for some reason you don't want the connection lazy you can turn it off by setting the following config., (*33)
'connections' => [
// ...
'rabbitmq' => [
// ...
'lazy' = > false,
],
// ...
],
Network Protocol
By default, the network protocol used for connection is tcp.
If for some reason you want to use another network protocol, you can add the extra value in your config options.
Available protocols : tcp, ssl, tls, (*34)
'connections' => [
// ...
'rabbitmq' => [
// ...
'network_protocol' => 'tcp',
],
// ...
],
Octane support
Starting with 13.3.0, this package supports Laravel Octane out of the box.
Firstly, install Octane and don't forget to warm 'rabbitmq' connection in the octane config., (*35)
See: https://github.com/vyuldashev/laravel-queue-rabbitmq/issues/460#issuecomment-1469851667, (*36)
Laravel Usage
Once you completed the configuration you can use the Laravel Queue API. If you used other queue drivers you do not
need to change anything else. If you do not know how to use the Queue API, please refer to the official Laravel
documentation: http://laravel.com/docs/queues, (*37)
Lumen Usage
For Lumen usage the service provider should be registered manually as follow in bootstrap/app.php:, (*38)
$app->register(VladimirYuldashev\LaravelQueueRabbitMQ\LaravelQueueRabbitMQServiceProvider::class);
Consuming Messages
There are two ways of consuming messages., (*39)
-
queue:work command which is Laravel's built-in command. This command utilizes basic_get. Use this if you want to consume multiple queues., (*40)
-
rabbitmq:consume command which is provided by this package. This command utilizes basic_consume and is more performant than basic_get by ~2x, but does not support multiple queues., (*41)
Testing
Setup RabbitMQ using docker-compose:, (*42)
docker compose up -d
To run the test suite you can use the following commands:, (*43)
# To run both style and unit tests.
composer test
# To run only style tests.
composer test:style
# To run only unit tests.
composer test:unit
If you receive any errors from the style tests, you can automatically fix most,
if not all the issues with the following command:, (*44)
composer fix:style
Contribution
You can contribute to this package by discovering bugs and opening issues. Please, add to which version of package you
create pull request or issue. (e.g. [5.2] Fatal error on delayed job), (*45)
Wallogit.com
