2014-10-28 22:44:28 +00:00
|
|
|
|
Quick start
|
|
|
|
|
|
-----------
|
|
|
|
|
|
|
|
|
|
|
|
Requirements
|
|
|
|
|
|
............
|
|
|
|
|
|
|
2015-04-10 23:57:13 +00:00
|
|
|
|
- Django 1.7 or 1.8
|
|
|
|
|
|
- Python 2.7, 3.2, 3.3, or 3.4
|
2014-12-14 09:12:38 +00:00
|
|
|
|
- a cache configured as ``'default'`` with one of these backends:
|
2014-12-08 02:47:11 +00:00
|
|
|
|
|
|
|
|
|
|
- `django-redis <https://github.com/niwibe/django-redis>`_
|
|
|
|
|
|
- `memcached <https://docs.djangoproject.com/en/1.7/topics/cache/#memcached>`_
|
2015-04-10 23:57:13 +00:00
|
|
|
|
(using either python-memcached or pylibmc)
|
2014-12-08 02:47:11 +00:00
|
|
|
|
- `filebased <https://docs.djangoproject.com/en/1.7/topics/cache/#filesystem-caching>`_
|
|
|
|
|
|
- `locmem <https://docs.djangoproject.com/en/1.7/topics/cache/#local-memory-caching>`_
|
2015-10-25 19:08:18 +00:00
|
|
|
|
(but it’s not shared between processes, see :ref:`locmem limits <Locmem>`)
|
2014-12-08 02:47:11 +00:00
|
|
|
|
|
2014-12-13 19:05:39 +00:00
|
|
|
|
- one of these databases:
|
|
|
|
|
|
|
|
|
|
|
|
- PostgreSQL
|
|
|
|
|
|
- SQLite
|
|
|
|
|
|
- MySQL (but you probably don’t need django-cachalot in this case,
|
2015-10-25 19:08:18 +00:00
|
|
|
|
see :ref:`MySQL limits <MySQL>`)
|
2014-10-28 22:44:28 +00:00
|
|
|
|
|
|
|
|
|
|
Usage
|
|
|
|
|
|
.....
|
|
|
|
|
|
|
|
|
|
|
|
#. ``pip install django-cachalot``
|
|
|
|
|
|
#. Add ``'cachalot',`` to your ``INSTALLED_APPS``
|
2015-10-24 22:47:24 +00:00
|
|
|
|
#. If you use multiple servers with a common cache server,
|
|
|
|
|
|
:ref:`double check their clock synchronisation <multiple servers>`
|
2015-10-25 19:08:18 +00:00
|
|
|
|
#. If you modify data outside Django
|
|
|
|
|
|
– typically after restoring a SQL database –, run
|
|
|
|
|
|
``./manage.py invalidate_cachalot``
|
2015-10-24 22:47:24 +00:00
|
|
|
|
#. Be aware of :ref:`the few other limits <limits>`
|
2014-12-08 21:00:08 +00:00
|
|
|
|
#. If you use
|
|
|
|
|
|
`django-debug-toolbar <https://github.com/django-debug-toolbar/django-debug-toolbar>`_,
|
2014-12-13 19:05:39 +00:00
|
|
|
|
you can add ``'cachalot.panels.CachalotPanel',``
|
|
|
|
|
|
to your ``DEBUG_TOOLBAR_PANELS``
|
2014-10-28 22:44:28 +00:00
|
|
|
|
#. Enjoy!
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-10-25 19:08:18 +00:00
|
|
|
|
.. _Settings:
|
|
|
|
|
|
|
2014-10-28 22:44:28 +00:00
|
|
|
|
Settings
|
|
|
|
|
|
........
|
|
|
|
|
|
|
2014-10-30 03:17:48 +00:00
|
|
|
|
``CACHALOT_ENABLED``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``True``
|
|
|
|
|
|
:Description: If set to ``False``, disables SQL caching but keeps invalidating
|
|
|
|
|
|
to avoid stale cache
|
|
|
|
|
|
|
|
|
|
|
|
``CACHALOT_CACHE``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``'default'``
|
|
|
|
|
|
:Description: Alias of the cache from |CACHES|_ used by django-cachalot
|
2014-10-28 22:44:28 +00:00
|
|
|
|
|
|
|
|
|
|
.. |CACHES| replace:: ``CACHES``
|
|
|
|
|
|
.. _CACHES: https://docs.djangoproject.com/en/1.7/ref/settings/#std:setting-CACHES
|
|
|
|
|
|
|
2014-10-30 03:17:48 +00:00
|
|
|
|
``CACHALOT_CACHE_RANDOM``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``False``
|
|
|
|
|
|
:Description: If set to ``True``, caches random queries
|
|
|
|
|
|
(those with ``order_by('?')``)
|
|
|
|
|
|
|
2014-11-04 00:17:35 +00:00
|
|
|
|
.. _CACHALOT_INVALIDATE_RAW:
|
|
|
|
|
|
|
|
|
|
|
|
``CACHALOT_INVALIDATE_RAW``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``True``
|
|
|
|
|
|
:Description: If set to ``False``, disables automatic invalidation on raw
|
2015-10-25 19:08:18 +00:00
|
|
|
|
SQL queries – read :ref:`raw queries limits <Raw SQL queries>` for more info
|
2014-11-04 00:17:35 +00:00
|
|
|
|
|
2015-10-05 18:09:10 +00:00
|
|
|
|
|
|
|
|
|
|
``CACHALOT_ONLY_CACHABLE_TABLES``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``frozenset()``
|
|
|
|
|
|
:Description:
|
|
|
|
|
|
Sequence of SQL table names that will be the only ones django-cachalot
|
|
|
|
|
|
will cache. Only queries with a subset of these tables will be cached.
|
2015-10-24 22:47:24 +00:00
|
|
|
|
The sequence being empty (as it is by default) doesn’t mean that no table
|
|
|
|
|
|
can be cached: it disables this setting, so any table can be cache.
|
|
|
|
|
|
:ref:`CACHALOT_UNCACHABLE_TABLES` has more weight than this:
|
|
|
|
|
|
if you add a table to both settings, it will never be cached.
|
2015-10-05 18:09:10 +00:00
|
|
|
|
Use a frozenset over other sequence types for a tiny performance boost.
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-10-04 16:35:44 +00:00
|
|
|
|
.. _CACHALOT_UNCACHABLE_TABLES:
|
|
|
|
|
|
|
2015-06-17 19:24:49 +00:00
|
|
|
|
``CACHALOT_UNCACHABLE_TABLES``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``frozenset(('django_migrations',))``
|
|
|
|
|
|
:Description:
|
|
|
|
|
|
Sequence of SQL table names that will be ignored by django-cachalot.
|
|
|
|
|
|
Queries using a table mentioned in this setting will not be cached.
|
|
|
|
|
|
Always keep ``'django_migrations'`` in it, otherwise you may face
|
|
|
|
|
|
some issues, especially during tests.
|
|
|
|
|
|
Use a frozenset over other sequence types for a tiny performance boost.
|
|
|
|
|
|
|
2014-10-30 03:17:48 +00:00
|
|
|
|
``CACHALOT_QUERY_KEYGEN``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``'cachalot.utils.get_query_cache_key'``
|
|
|
|
|
|
:Description: Python module path to the function that will be used to generate
|
|
|
|
|
|
the cache key of a SQL query
|
|
|
|
|
|
|
|
|
|
|
|
``CACHALOT_TABLE_KEYGEN``
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
|
|
|
|
|
:Default: ``'cachalot.utils.get_table_cache_key'``
|
|
|
|
|
|
:Description: Python module path to the function that will be used to generate
|
|
|
|
|
|
the cache key of a SQL table
|
|
|
|
|
|
|
2014-11-04 00:17:35 +00:00
|
|
|
|
.. _Dynamic overriding:
|
|
|
|
|
|
|
2014-10-30 03:17:48 +00:00
|
|
|
|
Dynamic overriding
|
|
|
|
|
|
~~~~~~~~~~~~~~~~~~
|
|
|
|
|
|
|
2014-12-08 18:43:43 +00:00
|
|
|
|
Django-cachalot is built so that its settings can be dynamically changed.
|
|
|
|
|
|
For example:
|
2014-10-28 22:44:28 +00:00
|
|
|
|
|
|
|
|
|
|
.. code:: python
|
|
|
|
|
|
|
2014-12-08 18:43:43 +00:00
|
|
|
|
from django.conf import settings
|
|
|
|
|
|
from django.test.utils import override_settings
|
2014-10-28 22:44:28 +00:00
|
|
|
|
|
2014-12-08 18:43:43 +00:00
|
|
|
|
with override_settings(CACHALOT_ENABLED=False):
|
2014-10-28 22:44:28 +00:00
|
|
|
|
# SQL queries are not cached in this block
|
|
|
|
|
|
|
2014-12-08 18:43:43 +00:00
|
|
|
|
@override_settings(CACHALOT_CACHE='another_alias')
|
2014-10-28 22:44:28 +00:00
|
|
|
|
def your_function():
|
|
|
|
|
|
# What’s in this function uses another cache
|
|
|
|
|
|
|
|
|
|
|
|
# Globally disables SQL caching until you set it back to True
|
2014-12-08 18:43:43 +00:00
|
|
|
|
settings.CACHALOT_ENABLED = False
|
2015-04-17 18:06:18 +00:00
|
|
|
|
|
|
|
|
|
|
|
2015-10-25 19:08:18 +00:00
|
|
|
|
.. _Template tag:
|
|
|
|
|
|
|
2015-10-24 22:47:24 +00:00
|
|
|
|
Template tag
|
|
|
|
|
|
............
|
|
|
|
|
|
|
|
|
|
|
|
`Caching template fragments <https://docs.djangoproject.com/en/1.8/topics/cache/#template-fragment-caching>`_
|
|
|
|
|
|
can be extremely powerful to speedup a Django application. However, it often
|
|
|
|
|
|
means you have to adapt your models to get a relevant cache key, typically
|
|
|
|
|
|
by adding a timestamp that refers to the last modification of the object.
|
|
|
|
|
|
|
|
|
|
|
|
But modifying your models and caching template fragments leads
|
|
|
|
|
|
to stale contents most of the time. There’s a simple reason to that: we rarely
|
|
|
|
|
|
only display the data from one model, we often want to display related data,
|
|
|
|
|
|
such as the number of books written by someone, display a quote from a book
|
|
|
|
|
|
of this author, display similar authors, etc. In such situations,
|
|
|
|
|
|
**it’s impossible to cache template fragments and avoid stale rendered data**.
|
|
|
|
|
|
|
|
|
|
|
|
Fortunately, django-cachalot provides an easy way to fix this issue,
|
|
|
|
|
|
by simply checking when was the last time data changed in the given models
|
|
|
|
|
|
or tables. The API function
|
|
|
|
|
|
:meth:`get_last_invalidation <cachalot.api.get_last_invalidation>` does that,
|
|
|
|
|
|
and we provided a ``get_last_invalidation`` template tag to directly
|
|
|
|
|
|
use it in templates. It works exactly the same as the API function.
|
|
|
|
|
|
|
|
|
|
|
|
Example of a quite heavy nested loop with a lot of SQL queries
|
|
|
|
|
|
(considering no prefetch has been done)::
|
|
|
|
|
|
|
|
|
|
|
|
{% load cachalot cache %}
|
|
|
|
|
|
|
|
|
|
|
|
{% get_last_invalidation 'auth.User' 'library.Book' 'library.Author' as last_invalidation %}
|
|
|
|
|
|
{% cache 3600 short_user_profile last_invalidation %}
|
|
|
|
|
|
{{ user }} has borrowed these books:
|
|
|
|
|
|
{% for book in user.borrowed_books.all %}
|
|
|
|
|
|
<div class="book">
|
|
|
|
|
|
{{ book }} ({{ book.pages.count }} pages)
|
|
|
|
|
|
<span class="authors">
|
|
|
|
|
|
{% for author in book.authors.all %}
|
|
|
|
|
|
{{ author }}{% if not forloop.last %},{% endif %}
|
|
|
|
|
|
{% endfor %}
|
|
|
|
|
|
</span>
|
|
|
|
|
|
</div>
|
|
|
|
|
|
{% endfor %}
|
|
|
|
|
|
{% endcache %}
|
|
|
|
|
|
|
|
|
|
|
|
``cache_alias`` and ``db_alias`` keywords arguments of this template tag
|
|
|
|
|
|
are also available (see
|
|
|
|
|
|
:meth:`cachalot.api.get_last_invalidation`).
|
|
|
|
|
|
|
|
|
|
|
|
|
2015-10-25 19:08:18 +00:00
|
|
|
|
.. _Signal:
|
|
|
|
|
|
|
2015-04-17 18:06:18 +00:00
|
|
|
|
Signal
|
|
|
|
|
|
......
|
|
|
|
|
|
|
|
|
|
|
|
``cachalot.signals.post_invalidation`` is available if you need to do something
|
|
|
|
|
|
just after a cache invalidation (when you modify something in a SQL table).
|
|
|
|
|
|
``sender`` is the name of the SQL table invalidated, and a keyword argument
|
|
|
|
|
|
``db_alias`` explains which database is affected by the invalidation.
|
|
|
|
|
|
Be careful when you specify ``sender``, as it is sensible to string type.
|
|
|
|
|
|
To be sure, use ``Model._meta.db_table``.
|
|
|
|
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
|
|
|
|
|
|
|
.. code:: python
|
|
|
|
|
|
|
|
|
|
|
|
from cachalot.signals import post_invalidation
|
|
|
|
|
|
from django.dispatch import receiver
|
|
|
|
|
|
from django.core.mail import mail_admins
|
|
|
|
|
|
from django.contrib.auth import *
|
|
|
|
|
|
|
|
|
|
|
|
# This prints a message to the console after each table invalidation
|
|
|
|
|
|
def invalidation_debug(sender, **kwargs):
|
|
|
|
|
|
db_alias = kwargs['db_alias']
|
|
|
|
|
|
print('%s was invalidated in the DB configured as %s'
|
|
|
|
|
|
% (sender, db_alias))
|
|
|
|
|
|
|
|
|
|
|
|
post_invalidation.connect(invalidation_debug)
|
|
|
|
|
|
|
|
|
|
|
|
# Using the `receiver` decorator is just a nicer way
|
|
|
|
|
|
# to write the same thing as `signal.connect`.
|
|
|
|
|
|
# Here we specify `sender` so that the function is executed only if
|
|
|
|
|
|
# the table invalidated is the one specified.
|
|
|
|
|
|
# We also connect it several times to be executed for several senders.
|
|
|
|
|
|
@receiver(post_invalidation, sender=User.groups.through._meta.db_table)
|
|
|
|
|
|
@receiver(post_invalidation, sender=User.user_permissions.through._meta.db_table)
|
|
|
|
|
|
@receiver(post_invalidation, sender=Group.permissions.through._meta.db_table)
|
|
|
|
|
|
def warn_admin(sender, **kwargs):
|
|
|
|
|
|
mail_admins('User permissions changed',
|
|
|
|
|
|
'Someone probably gained or lost Django permissions.')
|