From 7cbf4cf7f918bc754f61b0560679d95be7417b0d Mon Sep 17 00:00:00 2001 From: brettlangdon Date: Thu, 9 Oct 2014 17:37:59 -0400 Subject: [PATCH] add better description of flow of jobs through queues --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index f3b84d6..a54a2b5 100644 --- a/README.md +++ b/README.md @@ -38,6 +38,10 @@ manager = Manager('__main__.target') ### Queues There are a few different queues that are used. The job queues are just redis lists, manager/worker lists are sets and jobs are hashes. +A worker picks up a job from either `all:jobs`, `:jobs` or `:jobs`, pulls the corresponding `job:` key and +processes it with the provided `target`, after processing it will then remove the `job:` key as well as the job id from +the `:jobs` queue. + * `all:managers` - a set of all managers * `all:jobs` - a queue that all workers can pull jobs from, the values are just the job ids * `job:` - a hash of the job data