Verified, I've compiled the _billiard.so binary and I'm using github's celery/billiard at master
also, I'm using celery 3.1.0rc3
(also from master)
It's using _multiprocessing.Connection, which doesn't seem to have that attribute in python 2.7
…so I guess that "if is_pypy:" in billiard connection should also include python 2.x
ionelmc
Kronuz: make a bug report then
can't help you more :)
or you could try to fix it, can't be that hard to remove that if statement
domino14 has quit
Cromulent|2 joined the channel
bwreilly joined the channel
Cromulent|2 is now known as Cromulent
ionelmc has quit
kennethreitz joined the channel
celhead has quit
celhead joined the channel
domino14 joined the channel
bwreilly has quit
gauthier_ joined the channel
gauthierm has quit
domino14 has quit
Orteko_Work__ joined the channel
Orteko_Work_ has quit
Orteko_Work has quit
DctrWatson has quit
Orteko_Work joined the channel
dlanger has quit
ianawilson has quit
echos has quit
dlanger joined the channel
ianawilson_ joined the channel
echos joined the channel
DctrWatson joined the channel
ianawilson_ is now known as ianawilson
kennethreitz has quit
celhead1 joined the channel
celhead has quit
alazylearner joined the channel
Orteko_Work_ joined the channel
alazylearner has quit
gauthier_ has quit
gauthierm joined the channel
Orteko_Work has quit
dlanger has quit
dlanger joined the channel
kennethreitz joined the channel
Cromulent has quit
dlanger has quit
dlanger joined the channel
domino14 joined the channel
vince_prignano joined the channel
Katafalkas joined the channel
Katafalkas has quit
dlitvak has quit
Katafalkas joined the channel
johnraz joined the channel
the_rat joined the channel
koobs joined the channel
domino14 has quit
domino14 joined the channel
vince_prignano has quit
Katafalkas has quit
Browser joined the channel
Katafalkas joined the channel
Cromulent joined the channel
Katafalkas has quit
Spark23 joined the channel
Spark23 has quit
backjlack has quit
backjlack joined the channel
Katafalkas joined the channel
the_rat has quit
the_rat joined the channel
Katafalkas has quit
the_rat has quit
backjlack has quit
Cromulent has quit
Katafalkas joined the channel
sebleier has quit
sebleier joined the channel
Browser has quit
Browser joined the channel
backjlack joined the channel
Katafalkas has quit
Cromulent joined the channel
Katafalkas joined the channel
Cromulent has quit
fission6 joined the channel
the_rat joined the channel
DctrWatson has quit
echos has quit
dlanger has quit
bobsporren has quit
jvolkman has quit
DctrWatson joined the channel
echos joined the channel
dlanger joined the channel
jvolkman joined the channel
jvolkman has quit
jvolkman joined the channel
bobsporren joined the channel
souradeep joined the channel
souradeep has quit
italorossi joined the channel
souradeep joined the channel
mher joined the channel
the_rat has quit
the_rat joined the channel
souradeep has quit
the_rat has quit
fission6 has quit
Spark23 joined the channel
zmsmith joined the channel
fission6 joined the channel
Kronuz
Good morning
I'm using celery 3.1.0rc3, and after finding some problems with billiard.connection when I try to start a non-solo celery worker with multiple processes (it was saying _multiprocessing.Connection doesn't have setblocking attribute, under python 2.7)... I "fixed" that by also monkeypatching Connection to add setblocking (the same way it's done for pypy in the module billiard.connection). However...
I then encountered another (arguably bigger) error which segfaults 11 the whole thing when it tries to access the connection pool during the start up of the processes (this is in the billiard repository in GitHub, using master)
...I then went ahead and hunted the problem, it's definitely in the Connection object. So what I did was making billiard.connection use _connection3 for python3 and made a few minor adjustments in that module to make it python 2.7 compatible
zmsmith has quit
That seemingly fixes all the problems for me now, I will make a pull request in the billiard repository for that...
gkmngrgn joined the channel
gkmngrgn has quit
gkmngrgn joined the channel
Still, I have this question: is _billiard module not used in python 3? Are there any performance or otherwise disadvantages on using _connection3.Connection vs _billiard.Connection?