If I use chain and subtask without registering the task on the celery_app I'll get this exception
yopiti has quit
asksol
italorossi: obviously the task can not be properly registered in the worker, or it is registered with an object that does not have a .run method
abe_music joined the channel
italorossi
Did you saw the last pastebin link?
mdan has quit
asksol
yes, but defining the task in the client does not have any effect on the worker, so you must be doing something wrong
italorossi
I have no idea what's wrong.. but this code just works with the task defined on the client. Commenting out the tasks definition on the client generates NotImplementedError in the worker
mdan joined the channel
italorossi has quit
italorossi joined the channel
Guest30791 has quit
bwreilly joined the channel
asksol
italorossi: then maybe you're sending the wrong name? See the list of registered tasks at worker startup (needs -l info)
italorossi
asksol: i've double checked, the names are correct.. (there is a minor copy/paste issue on the pastebin version, just ignore..)
steeve joined the channel
asksol: Can you try running the example I've posted early?
yopiti joined the channel
I'll be back in a few hours
mher has quit
italorossi has quit
maximilianoo has quit
rcleere joined the channel
jlucci has quit
steeve_ joined the channel
steeve_ has quit
yopiti has quit
steeve has quit
yopiti joined the channel
frodopwns joined the channel
anuvrat joined the channel
bwreilly has quit
Guest30791 joined the channel
enlavin_ joined the channel
rcleere has quit
enlavin has quit
rcleere joined the channel
italorossi joined the channel
yopiti has quit
atom32k has quit
aimatt has quit
aimatt joined the channel
Guest30791 has quit
Guest30791 joined the channel
bwreilly joined the channel
Guest30791 has quit
bkuberek joined the channel
asksol: Hi, did you figured out what's wrong on that example?
asksol: Hey… do you have a few mins to talk about the rate limiting system?
asksol: We've been going back and forth on it here at the office, and we're a little unsure about how parts of it work.
asksol: Imagine a scenario where we have a queue with 5000 EmailTasks and 2000 HelloWorld tasks all intermixed. We limit the EmailTasks to 10/minute and we leave no limit on the HelloWorld tasks. My understanding of the current system is that our celery workers will pull down a task (they dont know what they're getting until they get it, right?), and if its an EmailTask .. and if the rate that they're being sent is > 10/minute, that worker will hold the task
asksol: Am I correct about that?
mike_n joined the channel
asksol
sure, it must consume the message to know what task it is
mher has quit
idreamussr joined the channel
to keep more tasks limits you have to increase the prefetch multiplier
keep more tasks in the worker*
idreamussr
who can tell me. my celery workers suddenly stop processштп tasks.
aimatt
asksol: I'm about to submit an issue, but maybe you could squash it instead
basically I'm starting two workers, one processes and one gevent, but it doesn't work
celery multi says it started them OK but they are not running
if I do celery multi show I do not see the "start" arg printed out
if I add start and run each worker manually they run fine
even if I set the second worker to -P processes it still doesn't help
Diranged
asksol: In the event that we have a worker pull down 10 tasks at a time via the prefetch, if it decides that Task #1 needs to be throttled, the code implies that the worker will block there on a sleep() timer. Right?
Coalpaw_ joined the channel
Coalpaw has quit
wintron
hey all - trying to receive task-sent events, can anyone give me some pointers?