#celery

hi all

i'm having issues queueing up a sub-task from a parent task

(yes, i've read the doc regarding avoiding synchronous tasks)

but i think I am not understanding the flow correctly

basically i have a task that generates several chains of child tasks

for each chain, I call apply_async(), and try to collect results

the child chains have a different queue argument set, so I expect them to be queued up in redis, and the other workers to pick them up

but it looks like it parent task hangs there forever instead after apply_async(queue='foo')

which makes me think the child chain is being executed in same process (?)

instead of being queued up and picked up by the parallel child worker

the child queue worker is sitting there and not seeing any new jobs coming in

i'm really not sure how to debug this

i'm pretty sure i am misunderstanding something horribly

I need help with some intermittent errors when using redis as the broker, backend with celery

Every so often, I see a TimeoutError('Timeout reading from socket')

When I look through the logs, I see the task has finished execution successfully but the client code blocking on a .get() of a celery task, times out

Here is some more info related to the error https://github.com/celery/celery/issues/3761

Are there any plans for next celery version beyond 4.0.2 ? We are thinking about upgrading from 3.x and want to know if a new version is planned.