#celery

how to know if celery task has fininshed?

I'm thinking about running my complete python/celery app in docker. I have very limited experience with docker. Is Docker and Celery a good fit? Im worried that reading logfiles might be a problem. (also; I cant use supervisor to make sure celery is running)

m27: I've run Celery with docker and is pretty easy to do. Log files shouldn't be a problem. You can write to anything/anywhere you want by configuring your logger correctly.

There are docker logs, but those are more about what's going on on the container. For applications running in the container you could either just log everything to stdout/stderr and see those logs with journalctl or syslog.

If you can't use supervisord then I would suggest to run one worker per container and use docker-compose.

Then, you can set auto restart on your docker-compose.yml file. So, if a worker fails docker-compose will automatically restart that container.

Thanks for laying out how to set up Docker and celery!

If I understand you correctly, it's actually quite simple. Run the celery worker as a 'front process', and monitor the STDOUT.

m27: Exactly. That way nothign is "docker specific" and your setup is somewhat docker (or other like that) agnostic. I mean, as much as one can do that.

so we're having a discussion at work about why celery was named celery, does anyone know the history?

mush: Ah, good question. I have no idea haha

I want to say its because of rabbitmq.

and rabbits eat celery.

Getting push back cause folks are saying they should have named it `carrot`.

mush: That's a good guess. Although looking at the initial commit it used to be called "crunchy" so maybe it has to do with rabbit and then something else happened?

Hmm.

That's interesting.. Didn't know that.

Thanks

mush: Wait, there is a reference to a carrot package

So, that's probably on point

Also I thikn celery was first developed for Django only. So that makes sense. Ask Solem probably couldn't name it carrot because there was already a carrot package so he went for something "crunchy" until eventually celery.

I'm only guessing here hah

well I'm convinced. Thanks!~