#pypy on 2020-01-16 — irc logs at freenode.irclog.whitequark.org

2019-08-29 19:33 cfbolz changed the topic of #pypy to: PyPy, the flexible snake (IRC logs: https://quodlibet.duckdns.org/irc/pypy/latest.log.html#irc-end ) | use cffi for calling C | if a pep adds a mere 25-30 [C-API] functions or so, it's a drop in the ocean (cough) - Armin

00:04 adamholmberg has quit [Remote host closed the connection]

00:07 Smigwell has quit [Read error: Connection reset by peer]

00:17 ctismer has quit [Read error: Connection reset by peer]

00:18 cfbolz has quit [Read error: Connection reset by peer]

00:18 DRMacIver has quit [Read error: Connection reset by peer]

00:18 jvesely has quit [Quit: jvesely]

00:18 Alex_Gaynor has quit [Read error: Connection reset by peer]

00:18 rguillebert has quit [Read error: Connection reset by peer]

00:18 fijal has quit [Read error: Connection reset by peer]

00:18 lauren has quit [Read error: Connection reset by peer]

00:19 rguillebert has joined #pypy

00:19 lauren has joined #pypy

00:19 fijal has joined #pypy

00:19 ctismer has joined #pypy

00:19 Alex_Gaynor has joined #pypy

00:20 cfbolz has joined #pypy

00:20 DRMacIver has joined #pypy

00:20 altendky has joined #pypy

00:21 speeder39_ has joined #pypy

00:21 petronny has joined #pypy

00:24 graingert has joined #pypy

00:25 speeder39_ has quit [Client Quit]

00:28 xcm has quit [Ping timeout: 265 seconds]

00:32 michelp has joined #pypy

00:36 CrazyPython has quit [Read error: Connection reset by peer]

00:42 DRMacIver has quit [Read error: Connection reset by peer]

00:42 altendky has quit [Ping timeout: 260 seconds]

00:42 lauren has quit [Ping timeout: 258 seconds]

00:42 michelp has quit [Ping timeout: 246 seconds]

00:42 EWDurbin has quit [Ping timeout: 252 seconds]

00:43 ctismer has quit [Ping timeout: 258 seconds]

00:43 graingert has quit [Ping timeout: 272 seconds]

00:43 fijal has quit [Ping timeout: 268 seconds]

00:43 Alex_Gaynor has quit [Ping timeout: 245 seconds]

00:43 rguillebert has quit [Ping timeout: 258 seconds]

00:44 fijal has joined #pypy

00:44 petronny has quit [Ping timeout: 260 seconds]

00:44 samth has quit [Ping timeout: 248 seconds]

00:45 jeroud has quit [Ping timeout: 260 seconds]

00:45 cfbolz has quit [Ping timeout: 245 seconds]

00:45 avakdh has quit [Ping timeout: 245 seconds]

00:45 reaperhulk has quit [Ping timeout: 252 seconds]

00:45 string has quit [Ping timeout: 252 seconds]

00:45 krono has quit [Ping timeout: 272 seconds]

00:46 phlebas has quit [Ping timeout: 245 seconds]

00:46 idnar has quit [Ping timeout: 260 seconds]

00:51 ctismer has joined #pypy

00:51 fijal has quit [Ping timeout: 260 seconds]

00:52 CrazyPython has joined #pypy

00:53 wallet42 has quit [Ping timeout: 245 seconds]

00:53 stillinbeta has quit [Ping timeout: 245 seconds]

00:55 ctismer has quit [Ping timeout: 246 seconds]

00:55 adamholmberg has joined #pypy

01:02 msjyoo has quit [Ping timeout: 248 seconds]

01:05 starlord has quit [Ping timeout: 260 seconds]

01:15 jvesely has joined #pypy

01:16 jeroud has joined #pypy

01:19 CrazyPython has quit [Read error: Connection reset by peer]

01:33 epony has joined #pypy

01:36 krono has joined #pypy

01:41 jeroud has quit [Ping timeout: 245 seconds]

01:45 krono has quit [Ping timeout: 260 seconds]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/5666 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/4838 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/6733 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/7956 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/own-linux-aarch64/builds/305 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-32/builds/6925 [py3.6]

02:00 <bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/4838 [py3.6]

02:00 <bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-aarch64/builds/303 [py3.6]

02:09 xcm has joined #pypy

02:19 CrazyPython has joined #pypy

02:28 adamholmberg has quit [Remote host closed the connection]

02:28 adamholmberg has joined #pypy

02:29 adamholmberg has quit [Remote host closed the connection]

02:29 adamholmberg has joined #pypy

02:30 adamholmberg has quit [Remote host closed the connection]

02:30 adamholmberg has joined #pypy

02:30 adamholmberg has quit [Remote host closed the connection]

02:31 adamholmberg has joined #pypy

02:31 adamholmberg has quit [Remote host closed the connection]

02:31 adamholmberg has joined #pypy

02:32 adamholmberg has quit [Remote host closed the connection]

02:32 adamholmberg has joined #pypy

02:32 <jacob22> Dejan: According to the pypy compatibilty list, you need psycopg2cffi instead of psycopg2.

02:33 adamholmberg has quit [Remote host closed the connection]

02:33 dddddd has quit [Ping timeout: 265 seconds]

02:33 adamholmberg has joined #pypy

02:34 adamholmberg has quit [Remote host closed the connection]

02:34 adamholmberg has joined #pypy

02:34 adamholmberg has quit [Remote host closed the connection]

02:35 adamholmberg has joined #pypy

02:35 adamholmberg has quit [Remote host closed the connection]

02:35 adamholmberg has joined #pypy

02:36 adamholmberg has quit [Remote host closed the connection]

02:36 adamholmberg has joined #pypy

02:37 adamholmberg has quit [Remote host closed the connection]

02:38 CrazyPython has quit [Read error: Connection reset by peer]

02:42 krono has joined #pypy

02:47 krono has quit [Read error: Connection reset by peer]

02:50 krono has joined #pypy

02:58 <bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/7956 [py3.6]

02:58 krono has quit [Ping timeout: 260 seconds]

03:02 krono has joined #pypy

03:09 krono has quit [Ping timeout: 272 seconds]

03:10 <bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-32/builds/6925 [py3.6]

03:14 adamholmberg has joined #pypy

03:14 CrazyPython has joined #pypy

03:17 krono has joined #pypy

03:18 <bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/5666 [py3.6]

03:19 <bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/6733 [py3.6]

03:24 krono has quit [Ping timeout: 240 seconds]

03:39 xcm has quit [Ping timeout: 272 seconds]

03:42 kcr has joined #pypy

03:42 xcm has joined #pypy

03:48 kcr has quit [Ping timeout: 272 seconds]

04:03 inhahe has quit []

04:09 CrazyPython has quit [Read error: Connection reset by peer]

04:14 jcea has quit [Quit: jcea]

04:15 inhahe has joined #pypy

04:17 <bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-aarch64/builds/305 [py3.6]

04:24 <kenaan> mattip benchmarks 52af1db49be7 /: fix sqlite3 benchmark

04:27 inhahe has quit []

04:30 CrazyPython has joined #pypy

04:41 CrazyPython has quit [Read error: Connection reset by peer]

04:46 adamholmberg has quit [Remote host closed the connection]

04:52 inhahe has joined #pypy

05:29 michelp has joined #pypy

05:43 michelp has quit [Ping timeout: 260 seconds]

05:56 idnar has joined #pypy

06:00 <bbot2> Started: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2844

06:07 idnar has quit [Ping timeout: 272 seconds]

06:18 avakdh has joined #pypy

06:29 avakdh has quit [Ping timeout: 245 seconds]

06:38 starlord has joined #pypy

06:44 starlord has quit [Ping timeout: 246 seconds]

06:48 starlord has joined #pypy

06:49 idnar has joined #pypy

06:52 michelp has joined #pypy

06:53 graingert has joined #pypy

06:53 avakdh has joined #pypy

06:54 <bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-aarch64/builds/303 [py3.6]

06:54 jeroud has joined #pypy

06:56 wallet42 has joined #pypy

06:56 petronny has joined #pypy

06:59 stillinbeta has joined #pypy

06:59 cfbolz has joined #pypy

06:59 reaperhulk has joined #pypy

06:59 phlebas has joined #pypy

06:59 samth has joined #pypy

07:00 ctismer has joined #pypy

07:00 msjyoo has joined #pypy

07:01 DRMacIver has joined #pypy

07:02 krono has joined #pypy

07:04 fijal has joined #pypy

07:05 kcr has joined #pypy

07:07 EWDurbin has joined #pypy

07:09 xcm has quit [Remote host closed the connection]

07:11 xcm has joined #pypy

07:13 string has joined #pypy

07:32 lauren has joined #pypy

07:36 rguillebert has joined #pypy

07:39 rubdos has quit [Quit: WeeChat 2.4]

07:44 jvesely has quit [Quit: jvesely]

07:55 Alex_Gaynor has joined #pypy

08:06 rubdos has joined #pypy

08:13 <bbot2> Success: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2844

08:13 <bbot2> Started: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2845 [mattip: force build, py3.6]

09:27 zmt01 has quit [Ping timeout: 260 seconds]

09:44 <Dejan> jacob22, that is terrible because then I need to maintain two separate requirement lists, one for CPython, and other for PyPy...

09:48 <Dejan> psycopg2cffi uses a different package name

09:51 <bbot2> Failure: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2845 [mattip: force build, py3.6]

09:56 xcm has quit [Remote host closed the connection]

09:58 xcm has joined #pypy

10:07 zmt00 has joined #pypy

10:24 <Dejan> I wonder would adding PyCodec_Encoder and PyCodec_Decoder to the codecs.py solve the psycopg2 issues?

10:28 <ammar2> psycopg2cffi works on both CPython and PyPy

10:34 <Dejan> if psycopg2cffi was a drop-in replacement for psycopg2-binary, then sure I would use it

10:34 <Dejan> but it is not

10:36 <Dejan> also I do not control some of the 10+ dependencies that also rely on psycopg2-binary... they are developed by other teams

10:37 <Dejan> psycopg2cffi should contain the same packages as psycopg2-binary ...

10:37 <Dejan> then it would be useful to me

10:41 dddddd has joined #pypy

11:33 zoomorph has joined #pypy

12:06 <cfbolz> antocuni: I suspect this is probably another issue related to pypy3 io slowness: https://bitbucket.org/pypy/pypy/issues/3153/pypy3-performance-regression-vs-pypy2

12:31 <kenaan> cfbolz py3.7-call-changes e00970e45d4b /pypy/interpreter/astcompiler/: limit the maximum stack size when doing calls with huge arguments the _make_call method is slowly beco...

12:31 <kenaan> cfbolz py3.7-call-changes 8169d516e6b1 /pypy/interpreter/astcompiler/: what I actually wanted to achieve: support calls with arbitrary many arguments

13:16 <antocuni> cfbolz: ouch :(

13:16 <antocuni> is it because of the new io stack?

13:18 <cfbolz> antocuni: I haven't investigated in detail yet

13:41 adamholmberg has joined #pypy

13:54 Smigwell has joined #pypy

14:06 lritter has joined #pypy

14:15 jcea has joined #pypy

14:17 <cfbolz> antocuni: the benchmark reduces to "pip is slow on pypy3"

14:28 jcea has quit [Remote host closed the connection]

14:28 jcea has joined #pypy

14:35 jvesely has joined #pypy

14:41 jacob22 has quit [Ping timeout: 265 seconds]

14:42 <ronan> cfbolz: what do you mean? I'm not seeing much time spent in pip itself

14:42 <cfbolz> ronan: eg try this on the toplevel of the virtualenv checkout:

14:42 <cfbolz> pip wheel -w /tmp/tmpwt2xea_r/wheel-store --no-deps .

14:42 <cfbolz> sorry, use some suitable tmp dir

14:43 <cfbolz> I get:

14:43 <cfbolz> https://www.irccloud.com/pastebin/sYPK2Ksg/

14:44 <cfbolz> (jit on or off makes no diff)

14:44 <cfbolz> wait, reload the paste, had a copy-paste error

14:44 <cfbolz> the script calls out to a new executable running pip 62 times

14:45 <cfbolz> each call is a tiny bit slower than on cpython

14:47 jacob22 has joined #pypy

14:48 <ronan> right, but IIUC most of the runtime of the script is spent in the parent process

14:48 <cfbolz> ronan: not for me

14:49 <cfbolz> I see almost all time spent in the run_suppress_output function

14:50 <ronan> how do you measure that?

14:52 altendky_ has joined #pypy

14:54 <cfbolz> ronan: wrote a small decorator

14:54 altendky_ has quit [Client Quit]

14:54 <cfbolz> https://www.irccloud.com/pastebin/6pVqUram/make_zipapp.py

14:55 altendky_ has joined #pypy

14:55 altendky_ has quit [Client Quit]

14:56 altendky has joined #pypy

14:56 <cfbolz> wait, I am confused

14:57 <cfbolz> ronan: looking at the new messages, what's slow is maybe not calling make_zipapp.py, but the test test_zipapp_help

15:01 <ronan> cfbolz: I see, I got confused by looking at vmprof results

15:01 <cfbolz> right :-(

15:05 <cfbolz> ronan: I wonder whether those are even the times running under coverage?

15:06 <cfbolz> ronan: those, I mean: https://bitbucket.org/pypy/pypy/issues/3153/pypy3-performance-regression-vs-pypy2#comment-55734346

15:07 <ronan> cfbolz: yes, they probably are. The whole test suite is run under coverage

15:08 <cfbolz> then it's kind of a known issue

15:08 <cfbolz> but maybe it's indeed the case that coverage is a lot slower on pypy3

15:10 <cfbolz> nedbat: coverage uses an extension module on cpython, right?

15:12 <nedbat> cfbolz: yes, and pure python on pypy

15:12 <cfbolz> right

15:15 jacob22 has quit [Quit: Konversation terminated!]

15:34 <cfbolz> ronan: are you getting anywhere?

15:34 <cfbolz> it's not coverage, fwiw

15:39 <ronan> cfbolz: not really. I can't see where the massive slowdown on Azure comes from

15:42 <cfbolz> Right 😑

16:00 jacob22 has joined #pypy

16:59 fryguybob has quit [Ping timeout: 265 seconds]

17:24 zmt00 has quit [Quit: Leaving]

17:25 xcm has quit [Remote host closed the connection]

17:28 zmt00 has joined #pypy

17:28 xcm has joined #pypy

17:39 Ai9zO5AP has quit [Ping timeout: 260 seconds]

18:38 jvesely has quit [Quit: jvesely]

19:17 Ai9zO5AP has joined #pypy

19:48 fryguybob has joined #pypy

19:56 xcm has quit [Remote host closed the connection]

19:57 jvesely has joined #pypy

19:59 xcm has joined #pypy

20:08 jacob22 has quit [Read error: Connection reset by peer]

20:12 jacob22 has joined #pypy

20:39 zoomorph has quit [Quit: Leaving.]

20:58 jvesely has quit [Quit: jvesely]

21:28 <kenaan> mattip benchmarks b5639ac3c520 /: try to make sending more robust

21:28 <bbot2> Started: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2846 [mattip: force build, py3.6]

22:37 jvesely has joined #pypy

22:58 adamholmberg has quit [Remote host closed the connection]

22:58 adamholmberg has joined #pypy

23:05 <bbot2> Success: http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/2846 [mattip: force build, py3.6]

23:06 adamholmberg has quit [Remote host closed the connection]

23:07 adamholmberg has joined #pypy

23:13 adamholmberg has quit [Remote host closed the connection]

23:13 adamholmberg has joined #pypy

23:17 adamholmberg has quit [Remote host closed the connection]

23:18 adamholmberg has joined #pypy

23:27 Smigwell has quit [Read error: Connection reset by peer]