trismegiste/dokudoki

Schemaless database layer for MongoDB and helpers for schemaless capabilities

DokudokiBundle

What

It's a bundle based on [Yuurei][20], a micro database layer with automatic mapping., _(*1)

This bundle adds multiple features aside from the original mapping of Yuurei : 3 others mapping systems (full magic, aliasing and mix of both), form components to handle MongoDate and uploaded files, DataCollector for WebProfiler and of course, a lot of services injected in the DiC of symfony2., _(*2)

I try to make an agnostic DBAL which helps you in the process to build an app regardless the model is finished or not. So there is also migration tools., _(*3)

How

Use Composer like any other PHP package :, _(*4)

For Symfony 2.3

    "require": {
        "trismegiste/dokudoki": "dev-master"
    },

Legacy for Symfony 2.x

    "require": {
        "trismegiste/dokudoki": "dev-Symfony2.x"
    },

Why

Because, like the cake, "ODM is a lie". Turning MongoDB into an ORM-like abstraction is the worst thing you can do against a NoSQL database., _(*5)

I'm fed up by both CRUD antipattern and anemic model produced by ORM and code generators. In the end, you realized that you must model your classes for the ORM and not for the business. I wanted to restore the Domain Driven Development philosophy developed in Symfony2 and ruined by Doctrine2., _(*6)

Guidances

• Rich documents by Hell ! You have atomicity.
• Stop to think 1 entity = 1 table
• Only a few root entities : 2, 3 or 4, 10 max for a full e-commerce app, not 200 !
• 1 app = 1 collection
• Forget 1NF, 2NF and 3NF. It's easier to deal with denormalized data in MongoDB than to too many LEFT JOIN in MySQL
• Think like serialize/unserialize
• Don't try to reproduce a search engine with your database : use Elastic Search
• Don't try to store everything in collections : use XML files

So, you make a model divided in few parts without circular reference, and you store it. It's like serialization but in MongoDB., _(*7)

All non static properties are stored in a way you can query easily with the powerfull (but very strange I admit) language of MongoDB., _(*8)

See the PHPUnit tests for examples., _(*9)

Four modes of working

This DBAL has 4 stages, regarding the completion of the model classes., _(*10)

The trick is you can migrate between these stages when you develop your app and, for example, don't need to start over after a dirty prototype. You even can generate a model from the data you had stored into collections when you don't have one., _(*11)

See Examples of using this dbal in PHPUnit Tests, _(*12)

Black Magic is black

If you have no model and a lot of forms to design, start with the "BlackMagic" stage. If an anemic model is enough for you, don't create one. It is full of magic methods, magic mapping and magic documents, it's like working with mockup., _(*13)

But be warned : it is for prototyping and your database can turn back against you if you are not careful. That's what I call "Form Driven Development"., _(*14)

See full example in unit test, _(*15)

// construct a form
$form = $this->formFactory
        ->createBuilder('magic_form', null, array('class_key' => 'product'))
        ->add('title')
        ->add('price')
        ->getForm();
// bind data to the form
$form->bind(array('title' => 'EF-85 L', 'price' => 2000));
$doc = $form->getData();
// getting the magic document
$this->assertInstanceOf('Trismegiste\DokudokiBundle\Magic\Document', $doc);
$this->assertEquals('product', $doc->getClassName());
$this->assertEquals('EF-85 L', $doc->getTitle());
// persistence with blackmagic repository
$this->blackmagic->persist($doc);
// restoring with blackmagic repository
$restore = $this->blackmagic->findByPk((string) $doc->getId());
$this->assertInstanceOf('Trismegiste\DokudokiBundle\Magic\Document', $restore);
$this->assertEquals('product', $restore->getClassName());
$this->assertEquals('EF-85 L', $restore->getTitle());

Serialization could be enough

This is the original mapping system from Yuurei. If you have a lot of nearly complete model classes and don't want configure anything, use the "Invocation" stage. Only magic mapping and strict typing between objects and documents., _(*16)

But if you need to make complex queries or map-reduce, it can be very dirty. This stage is usefull for RESTful app without GUI., _(*17)

See full example in unit test, _(*18)

// simple object
$doc = new \Some\Sample\Product('EF-85 L', 2000);
// persisting
$this->invocation->persist($doc);
// restoring with invocation repository
$restore = $this->invocation->findByPk((string) $doc->getId());
$this->assertInstanceOf('Some\Sample\Product', $restore);
// retrieving the content in the MongoDB
$dump = $this->collection->findOne(array('_id' => $doc->getId()));
$this->assertEquals('Some\Sample\Product', $dump['-fqcn']);  // we store the FQCN
$this->assertEquals('EF-85 L', $dump['title']);
$this->assertEquals(2000, $dump['price']);

White Magic is for Lawful Good

If you have a good model and the time to carefully alias classes in the database, use the "WhiteMagic" stage. There is automapping but without surprise, your model cannot turn into chaos. Any non-aliased class will generate an exception., _(*19)

See full example in unit test, _(*20)

// simple object
$doc = new \Some\Sample\Product('EF-85 L', 2000);
// persisting
$this->whitemagic->persist($doc);
// restoring with whitemagic repository
$restore = $this->whitemagic->findByPk((string) $doc->getId());
$this->assertInstanceOf('Some\Sample\Product', $restore);
// retrieving the content in the MongoDB
$dump = $this->collection->findOne(array('_id' => $doc->getId()));
$this->assertEquals('product', $dump['-class']);  // here is the aliasing
$this->assertEquals('EF-85 L', $dump['title']);
$this->assertEquals(2000, $dump['price']);

Hoodoo child

If you need to evolve the model above, you can use "Hoodoo" stage, a "WhiteMagic" stage mixed with some magic from "BlackMagic" stage. There is a safety net to prevent some "real" classes to become "fake" classes. This lowers the rate of WTF per minutes and you choose the level of magic., _(*21)

About performance

I have not fully tested this dbal but the hydration is the slowest part of this layer. For example, one document with 100 entities (think about a customer, with his addresses, past orders with products etc...) takes about 100 ms to be stored on a standard dual-core desktop without APC., _(*22)

It is not very efficient but when you seek high performance, you can forget about ORM, ODM and so on., _(*23)

FAQ

Is Symfony2 mandatory ?

No, the DBAL can work in standalone mode. Anyway you miss a lot of features with forms and black magic stage. The full framework itself is not mandatory, only some components. And almost all unit tests don't need any symfony component. For example, you could easily make a provider for silex and pimple., _(*24)

What are the requirements ?

• PHP >= 5.4
• PECL Mongo extension >= 1.3
• The dev-master runs with Symfony2.3 and there are branches for 2.1 and 2.2

How to map properties ?

All object's properties are stored. You have only one thing to do : The root classes must implement the Persistable interface (there is a trait for implementing this interface). You don't need to extend any particuliar class, therefore you can follow the DDD without constraint., _(*25)

What is a "root class" ?

It is a class stored in the collection, which contains the MongoId in the key '_id'. All other agregated objects in this class don't need to implement Persistable, they are recursively stored., _(*26)

How can I remove some transient properties ?

You can't. But you can have a transient class with the interface Skippable. Use Decorator pattern or a State Pattern. Your model can do that., _(*27)

Can I make some cleaning before persistence ?

Like serialization, you can implement Cleanable with 2 methods : wakeup and sleep, _(*28)

How can I query for listing ?

Use the MongoCollection, you can't be more efficient than this low level layer, _(*29)

How can I store pictures or PDF ?

Use a MongoBinData in your model, it is stored as is, _(*30)

Can I use something else than MongoId for primary key ?

No, _(*31)

What about MongoDate ?

Any DateTime are converted into MongoDate and vice versa., _(*32)

I see you're using mongo types in your classes model, what about abstraction ?

Seriously, have you ever switch an app to another database ?, _(*33)

Is there any lazy loading or proxy classes for DBRef ?

Fly, you fools, _(*34)

Why this silly name ?

Well, I'm not good at finding names, that's why I tend to keep the most ridiculous than the most serious. It stands for Docu(ment) + doki to recall "dokidoki" (loosely means "excitment", sounds like heartbeats) in japanese. This one, I'm pretty sure it is unique ^_^, _(*35)