aol/offload

Simplify cached PHP tasks: background refresh, last-known-good, and single writer.

Offload

Simplify cached PHP tasks: background refresh, last-known-good, and single writer., _(*1)

, _(*2)

Example:, _(*3)

$offload = new OffloadManager(/* ... */);

// Fetch a result and repopulate it if necessary.
$data = $offload->fetch('task-key', function () {

  // Perform a time consuming task...
  return $data;

})->getData();

This will run a task in the background and cache the returned $data under the task-key. If the data is requested again, it will be returned immediately if in cache and a repopulation will be offload if the cache is stale., _(*4)

How's This Work?

Offload caches data with two timeframes, fresh and stale. These TTLs can be controlled using options, see Offload Options., _(*5)

• Fresh (cache hit): Data is immediately returned with no repopulation.
• Stale (cache hit, stale): Data is immediately returned and a repopulation is queued.
• No Data (cache miss): Forces the repopulation to run immediately and that data is then cached and returned.

Offload uses a task queue to keep track of stale cache hits that need to be repopulated. When $offload->drain() is called, all tasks are run and the cache is repopulated. This is best to do once the request is completed so that the overhead of repopulating cache does not interfere with returning a response to the client quickly. See Draining the Offload Queue., _(*6)

The OffloadManager can take any cache store implementing OffloadCacheInterface., _(*7)

Exclusive Tasks

Tasks are run as exclusive by default. This behavior can be changed using options, see Offload Options., _(*8)

Exclusive task repopulation means there will ever only be a single concurrent stale repopulation for a given key. This avoids the rush to repopulate cache that happens when a cached item expires., _(*9)

The OffloadManager uses a lock implementation to provide this capability and can take any lock implementing OffloadLockInterface., _(*10)

Initialization

Here is an example of using a memcached instance for caching and a redis instance for locking:, _(*11)

// Setup a cache.
$cache = new OffloadCacheMemcached($memcached_instance);

// Setup a lock.
$lock = new OffloadLockRedis($predis_instance);

// Default options for offload manager:
$default_options = [
  'ttl_fresh'          => 5,    // Cache time in seconds
  'ttl_stale'          => 5,    // Stale cache time in seconds
  'exclusive'          => true, // Whether to run tasks exclusively by key (no concurrent repopulates for the same key)
  'background'         => true, // Whether to run tasks in the background
  'background_timeout' => 5,    // Timeout for exclusive background repopulates in seconds
];

// Create the offload manager.
$offload = new OffloadManager($cache, $lock, $default_options);

Draining the Offload Queue

To drain the offload queue properly, it is best to setup a PHP shutdown handler. This ensures the offload tasks will always be run at the end of the request. Example:, _(*12)

// ...

register_shutdown_function(function () use ($offload) {
  if ($offload->hasWork()) {

    // Flush all buffers.
    while (ob_get_level()) {
      ob_end_flush();
    }
    flush();

    // End the request if possible (under PHP FPM).
    if (function_exists('fastcgi_finish_request')) {
      fastcgi_finish_request();
    }

    // Run all tasks in the queue.
    $offload->drain();
  }
});

Deferreds

Offload supports returning deferred tasks from the repopulate callable. This allows several tasks to run in parallel when the offload queue is drained., _(*13)

For example, using Guzzle Async Requests:, _(*14)

$data = $offload->fetch('task-key', function () {

  // ...

  $promise = $guzzle_client->getAsync('http://www.example.com');

  return new OffloadDeferred([$promise, 'wait']);

})->getData();

The OffloadDeferred class takes a single callable that will wait for the result. In the above example, $promise->wait() waits for the HTTP request to complete and returns the result., _(*15)

The repopulate callable can return any class that implements the OffloadDeferredInterface, so you can make adapters for custom async handling., _(*16)

API

The OffloadManager implements OffloadManagerInterface and exposes the following methods:, _(*17)

See below for more details on the above methods., _(*18)

See Offload Options for more information on the $options that can be provided. See Offload Result for more information on what OffloadResult details are returned., _(*19)

Fetching Data

fetch

fetch($key, callable $repopulate, array $options = []): OffloadResult, _(*20)

Check cache for data for the given $key. If the data is in cache, return it immediately. If the data is stale, schedule a repopulate to run when the offload manager is drained., _(*21)

$result = $offload->fetch($key, function () {
  // Perform long running task...
  return $data;
});

fetchCached

fetchCached($key, $ttl_fresh, callable $repopulate, array $options = []): OffloadResult, _(*22)

Same as fetch. The following are equivalent:, _(*23)

$result = $offload->fetch($key, $repopulate, ['ttl_fresh' => 5]);
// is the same as:
$result = $offload->fetchCached($key, 5, $repopulate);

Queuing Tasks

queue

queue($key, callable $repopulate, array $options = []): void, _(*24)

Queue a repopuate task to be run. Do not check cache. Takes similar options as fetch., _(*25)

queueCached

queueCached($key, $ttl_fresh, callable $repopulate, array $options = []): void, _(*26)

Same as queue. The following are equivalent:, _(*27)

$result = $offload->queue($key, $repopulate, ['ttl_fresh' => 5]);
// is the same as:
$result = $offload->queueCached($key, 5, $repopulate);

Fetch/Queue Arguments

Marking a Result as "Bad"

Sometimes results returned from a repopulate are not in a good state and should not be cached., _(*28)

The offload manager provides a OffloadRun instance to the repopulate callable that can be used to mark the result as bad, for example:, _(*29)

$offload->fetch($key, function (OffloadRun $run) {

  // Get some data from a service...
  $object = $this->service->get($arguments);
  if (!$object->isValid()) {

    // If the data returned is not valid, mark the result as bad.
    // This will tell the offload manager *not to cache* the data.
    $run->setBad();

  }

});

Offload Options

Offload options are provided as an array, for example:, _(*30)

$options = [
  'ttl_fresh'  => 5,
  'ttl_stale'  => 10,
  'background' => true,
  // ...
];
$result = $offload->fetch($key, function () { /* ... */ }, $options);

Offload Result

The OffloadResult class provides the following methods:, _(*31)

Encoders

By default, offload will use OffloadEncoderStandard (which does simple PHP serialization) to encode and decode data stored in cache. You can change this by implementing OffloadEncoderInterface and setting the encoder on the OffloadManagerCache instance., _(*32)

class CustomEncoder implements OffloadEncoderInterface
{
    // ...

    public function encode($object)
    {
        // ... Encode the value ...
        return $string_value;
    }

    public function decode($string)
    {
        // ... Decode the value ...
        return $object_value;
    }
}

// ...

$offload = new OffloadManager(/* ... */);

// Change the encoder.
$offload->getCache()->setEncoder(new CustomEncoder(/* ... */));

By default offload will use the encoder you set to decode as well. You can change the decoding to use a separate instance by calling setDecoder:, _(*33)

$offload->getCache()->setEncoder(new FooEncoder(/* ... */));
$offload->getCache()->setDecoder(new BarEncoder(/* ... */));

Encryption

Offload ships with an encryption encoder that leverages AES-256 encryption. It wraps any other encoder implementing OffloadEncoderInterface To use it simply set it as the encoder on the offload cache:, _(*34)

// Get the base encoder.
$base_encoder = $offload->getCache()->getEncoder();

// Wrap it with an encrypting encoder.
$encrypting_encoder = new OffloadEncoderEncryptedAes256(
    $base_encoder,
    // The key ID for the encryption.
    'foo',
    // Secret keys by ID. This enables key cycling.
    [
        'foo' => 'my_secret_key'
    ]
)

$offload->getCache()->setEncoder($encrypting_encoder);

Custom Encryption

You can implement custom encryption by simply extending the abstract class OffloadEncoderEncrypted., _(*35)

class CustomEncryptionEncoder extends OffloadEncoderEncrypted
{
    // ...

    protected function encrypt($string, $key)
    {
        // ... return encrypted string ..
    }

    protected function decrypt($string, $key)
    {
        // ... return decrypted string ..
    }
}

License

BSD-3-Clause, _(*36)