#celery

looking for some help on how to configure log path and log file for celery flower

I see "logging" for the log level, but how to define flower log path

Hi all: i am trying to put a rate limit on celery queue. Anyone know how to do this.

viki_, you can't

but its mentioned here u can

"To enforce a global rate limit .. you must restrict to a given queue."

viki_, this rate limit is for all queues

@malinoff : ok thanks. Also is there a way to put a rate limit on a task for all worker collectively..

that means that you should run N workers with -Q Qi instead of one worker with -Q Q1,Q2,...,QN

viki_, no, rate limit is consumer-related

if task consumer consumes from N queues, rate limit will be applied to all of them

but it will be applicable individually if i am getting it right..

what i need is say 1 task T runs 3 times per minute even if it has 2 or 4 workers..

is that possible ??

viki_, only by applying this task 3 times per minute

afaik

ok cool thanks for the help malinoff :)

btw i think this is a very important piece that is missing from Celery ..

and there is very little data available about this online.. :(

viki_, it's not about celery, it's how rabbitmq works

ok.

if you need to limit rate for specific queue, you should run only one worker with only this queue configured

I think i can adjust my requirement enough to suit this condition..

can you tell me whats the use case for TokenBucketQueue. link to an example would also be fine :)

thanks malinoff. Gota say this is my first time on a IRC and i am loving the pace of response.. :)

i posted this question on stackoverflow : http://stackoverflow.com/questions/28231392/how...

viki_, that's why i love irc too

you can post the same answer there..

so others will be helped .. :)

viki_, my english skills are low to hang on SO, unfortunately

Today is my bug day, already reported 2 bugs in zope.interface and pylint :(

cool

not really, the latter causes pylint to hang for 3 minutes and to report my code quality as -3/10 :)

where 0 should be the lowest possible value, of course

celery/celery#2414 (3.1 - f96dbb6 : Ionel Cristian Mărieș): The build was broken.

Change view : https://github.com/celery/celery/compare/5e6245...

Build details : http://travis-ci.org/celery/celery/builds/48877583

ionelmc, 3.1.18?:) I was sure 3.2 will be the next

celery/celery#2414 (3.1 - f96dbb6 : Ionel Cristian Mărieș): The build passed.

Change view : https://github.com/celery/celery/compare/5e6245...

Build details : http://travis-ci.org/celery/celery/builds/48877583

malinoff: just a small bugfix

with the django fixup (bad conn management)

asksol: pong