22
May
2016
Distributed Celery Workers
I'm working a lot with Django and Celery recently. By the way, awesome Open Source projects! Celery is a simple, flexible and reliable distributed system to process vast amounts of messages.
For my project I have multiple celery workers, whose resides on different maschines, so called a distributed setup. Now the tasks which celery will execute are not deployed on the task calling maschine itself. therefore the task schedules needs some tuning how they are being called.
A typical celery task example from the docs is to import the task functions or classes and apply .delay() on them...