From: Soam V. <soa...@ya...> - 2010-03-29 23:15:40
|
Hi all, A question about a difference in Jython 2.5 and 2.2 performance. I created the following python script: ------- import datetime total = datetime.timedelta(0) def f(): a = range(1,1000000) t1 = datetime.datetime.today() a.reverse() a.sort() t2 = datetime.datetime.today() global total total = total + (t2-t1) print (t2-t1) n_iter = 600 for i in range(1,n_iter): f() print "i = ", i, "average = ", (total/i) ------- And I run this script using jython.bat two releases, Jython 2.5.1 and 2.2.1. Both are being run on the same JVM, Sun JRE 1.6.0_13. On my machine, Jython 2.5.1 averages to about 3.4 sec per call to f. Jython 2.2.1 averages to about 0.15 seconds. This is probably not the best benchmark, but the difference between Jython 2.2.1 and 2.5.1 is very big, so I'm wondering if I'm missing something. So: 1. Is the speed difference between the two releases of Jython well known and expected, and/or is this benchmark flawed in some way? 2. Is there any tuning that can be done with running Jython 2.5.1 to make it faster? 3. Is it possible to compile the script to java bytecode under jython 2.5.1? Would that improve the running time? Thanks! -Soam |
From: Philip J. <pj...@un...> - 2010-03-30 00:29:57
|
On Mar 29, 2010, at 4:15 PM, Soam Vasani wrote: > Hi all, > A question about a difference in Jython 2.5 and 2.2 performance. > > I created the following python script: > > ------- > import datetime > > total = datetime.timedelta(0) > > def f(): > a = range(1,1000000) > t1 = datetime.datetime.today() > a.reverse() > a.sort() > t2 = datetime.datetime.today() > global total > total = total + (t2-t1) > print (t2-t1) > > > n_iter = 600 > > for i in range(1,n_iter): > f() > print "i = ", i, "average = ", (total/i) > ------- > > And I run this script using jython.bat two releases, Jython 2.5.1 and 2.2.1. > > Both are being run on the same JVM, Sun JRE 1.6.0_13. > > On my machine, Jython 2.5.1 averages to about 3.4 sec per call to f. > Jython 2.2.1 averages to about 0.15 seconds. > > This is probably not the best benchmark, but the difference between Jython 2.2.1 and 2.5.1 is very big, so I'm wondering if I'm missing something. > So: > > 1. Is the speed difference between the two releases of Jython well known and expected, and/or is this benchmark flawed in some way? > 2. Is there any tuning that can be done with running Jython 2.5.1 to make it faster? > 3. Is it possible to compile the script to java bytecode under jython 2.5.1? Would that improve the running time? You should use time.time instead of datetime.today. Generating solid benchmarks on the JVM is challenging, you especially need to take into account warmup of the JIT. With that being said we may indeed be slower than 2.2 on this bench because our list implementation was rewritten for 2.5 to be based on ArrayList. The reverse method probably hasn't changed much so the culprit is likely sorting In 2.5 we no longer use a port of CPython's timsort, mostly because it's not easily adapted to the new list implementation. timsort is well known for having incredible performance on pre-sorted lists like in this benchmark. We now use the JVM's default sort instead. The good news is Java 7 has adopted the better timsort as its own default sort. We could port the Java 7 timsort implementation for use in earlier JVMs but IIRC we couldn't make it as efficient for in-place sorting as Java 7 does. That's because we can't directly access the underlying array of ArrayLists. -- Philip Jenvey |
From: Philip J. <pj...@un...> - 2010-03-30 01:00:44
|
On Mar 29, 2010, at 5:00 PM, Philip Jenvey wrote: > > In 2.5 we no longer use a port of CPython's timsort, mostly because it's not easily adapted to the new list implementation. timsort is well known for having incredible performance on pre-sorted lists like in this benchmark. > My mistake, it's not pre-sorted with the reverse. It may be due to timsort better handling that case anyway, but I can't say that for sure without more specific benchmarks -- Philip Jenvey |
From: Anamitra B. <abh...@us...> - 2010-03-30 03:11:19
|
Hi Does anyone in the list know when jython 2.5.2 is coming out? I am kind of waiting on some fixes on jsr 223 side which should be in that release. thanks Anamitra |
From: Alan K. <jyt...@xh...> - 2010-03-30 11:09:56
|
[Anamitra] > Does anyone in the list know when jython 2.5.2 is coming out? I am kind of > waiting on some fixes on jsr 223 side which should be in that release. I don't have an answer as to when 2.5.2 will be released. But if you need some functionality present in trunk, can you build your own jython from trunk? Is this possible for you? Regards, Alan. |
From: Nicholas R. <nj...@il...> - 2010-03-30 13:46:33
|
In article <4a9...@ma...>, Alan Kennedy <jyt...@xh...> wrote: > But if you need some functionality present in trunk, can you build > your own jython from trunk? Is this possible for you? Anamitra let me know via email that it is not possible for him to use a prerelease Jython. If the people who have the ability to make a 2.5.2 release are too busy, perhaps they could give access to people who are less busy? -- Nicholas Riley <nj...@il...> |
From: Frank W. <fwi...@gm...> - 2010-03-31 18:40:36
|
On Tue, Mar 30, 2010 at 9:30 AM, Nicholas Riley <nj...@il...> wrote: > Anamitra let me know via email that it is not possible for him to use a > prerelease Jython. > > If the people who have the ability to make a 2.5.2 release are too busy, > perhaps they could give access to people who are less busy? It is most definitely time to start the process of releasing a 2.5.2. Everything I wanted isn't there yet, but there is always time for another release... I'd be happy to give interested committers the keys to the release process, so let me know if you are volunteering Nicholas :) but before we do that, we should look at the bug tracker and decide on what the critical bugs are -- I think Jim saw about 10 the last time he checked. Of course if an alpha release works for the OP, that could be a good starting point even before we do the triaging. -Frank |
From: Nicholas R. <nj...@il...> - 2010-04-01 00:56:06
|
On Mar 31, 2010, at 1:40 PM, Frank Wierzbicki wrote: > > I'd be happy to give interested committers the keys to the release > process, so let me know if you are volunteering Nicholas :) I wish I had time, just trying to prod TPTB, looks like it worked :) > but before we do that, we should look at the bug tracker and decide on > what the critical bugs are -- I think Jim saw about 10 the last time > he checked. That sounds like a great thing to post; I wasn't aware there were any release blockers. -- Nicholas Riley <nj...@il...> |
From: Oti <oh...@gm...> - 2010-05-02 18:10:42
|
On Wed, Mar 31, 2010 at 8:40 PM, Frank Wierzbicki <fwi...@gm...> wrote: > It is most definitely time to start the process of releasing a 2.5.2. > Everything I wanted isn't there yet, but there is always time for > another release... > > I'd be happy to give interested committers the keys to the release > process, so let me know if you are volunteering Nicholas :) > > but before we do that, we should look at the bug tracker and decide on > what the critical bugs are -- I think Jim saw about 10 the last time > he checked. > > Of course if an alpha release works for the OP, that could be a good > starting point even before we do the triaging. > > -Frank If there isn't anybody else, I'd volunteer for the release process. But I probably would need good assistance on how to :-) Oti. |
From: Soam V. <soa...@ya...> - 2010-03-30 18:30:14
|
From: Philip Jenvey <pj...@un...> > In 2.5 we no longer use a port of CPython's timsort, mostly because > it's not easily adapted to the new list implementation. timsort is > well known for having incredible performance on pre-sorted lists > like in this benchmark. Thanks Philip, that helps. Sorting a randomly shuffled array shows the two implementations to be much closer. -soam |
From: Frank W. <fwi...@gm...> - 2010-05-05 16:16:58
|
On Tue, May 4, 2010 at 12:41 PM, Oti <oh...@gm...> wrote: > Frank, > > On Tue, May 4, 2010 at 3:16 PM, Frank Wierzbicki <fwi...@gm...> wrote: >> Hi Oti, >> >> I'm happy to do the release myself - it's about time that I started >> back into Jython stuff a bit since I've had time to acclimate to a >> startup. > > very good news to hear you're back! > >> However, if you would like to do it, I'd also be happy to >> help you do it! It's probably a good idea to have more people who have >> the experience of doing a release. >> >> Let me know, >> -Frank > > i'd really like to learn how it works, and having you as mentor sounds great! > In German we say "shared burden is half burden"... Sounds fantastic. When things are ready we'll figure out the timing. -Frank |
From: Anamitra B. <abh...@us...> - 2010-05-05 16:30:42
|
Hi Frank Do you have any date in mind by which you must get the jython 2.5.2 out? I have a lot of stuff riding on this release and if I can get some "by this" date it will help us plan better. thanks Anamitra |------------> | From: | |------------> >----------------------------------------------------------------------------------------------------------------------------------------| |Frank Wierzbicki <fwi...@gm...> | >----------------------------------------------------------------------------------------------------------------------------------------| |------------> | To: | |------------> >----------------------------------------------------------------------------------------------------------------------------------------| |Oti <oh...@gm...> | >----------------------------------------------------------------------------------------------------------------------------------------| |------------> | Cc: | |------------> >----------------------------------------------------------------------------------------------------------------------------------------| |Nicholas Riley <nj...@il...>, jython-users <jyt...@li...> | >----------------------------------------------------------------------------------------------------------------------------------------| |------------> | Date: | |------------> >----------------------------------------------------------------------------------------------------------------------------------------| |05/05/2010 12:18 PM | >----------------------------------------------------------------------------------------------------------------------------------------| |------------> | Subject: | |------------> >----------------------------------------------------------------------------------------------------------------------------------------| |Re: [Jython-users] jython 2.5.2 | >----------------------------------------------------------------------------------------------------------------------------------------| On Tue, May 4, 2010 at 12:41 PM, Oti <oh...@gm...> wrote: > Frank, > > On Tue, May 4, 2010 at 3:16 PM, Frank Wierzbicki <fwi...@gm...> wrote: >> Hi Oti, >> >> I'm happy to do the release myself - it's about time that I started >> back into Jython stuff a bit since I've had time to acclimate to a >> startup. > > very good news to hear you're back! > >> However, if you would like to do it, I'd also be happy to >> help you do it! It's probably a good idea to have more people who have >> the experience of doing a release. >> >> Let me know, >> -Frank > > i'd really like to learn how it works, and having you as mentor sounds great! > In German we say "shared burden is half burden"... Sounds fantastic. When things are ready we'll figure out the timing. -Frank ------------------------------------------------------------------------------ _______________________________________________ Jython-users mailing list Jyt...@li... https://lists.sourceforge.net/lists/listinfo/jython-users |
From: Frank W. <fwi...@gm...> - 2010-05-04 13:17:07
|
On Sun, May 2, 2010 at 2:10 PM, Oti <oh...@gm...> wrote: > If there isn't anybody else, I'd volunteer for the release process. > But I probably would need good assistance on how to :-) Hi Oti, I'm happy to do the release myself - it's about time that I started back into Jython stuff a bit since I've had time to acclimate to a startup. However, if you would like to do it, I'd also be happy to help you do it! It's probably a good idea to have more people who have the experience of doing a release. Let me know, -Frank |
From: Alex G. <ale...@ne...> - 2010-05-04 14:17:10
|
4.5.2010 16:16, Frank Wierzbicki kirjoitti: > On Sun, May 2, 2010 at 2:10 PM, Oti<oh...@gm...> wrote: > >> If there isn't anybody else, I'd volunteer for the release process. >> But I probably would need good assistance on how to :-) >> > Hi Oti, > > I'm happy to do the release myself - it's about time that I started > back into Jython stuff a bit since I've had time to acclimate to a > startup. However, if you would like to do it, I'd also be happy to > help you do it! It's probably a good idea to have more people who have > the experience of doing a release. > To both of you -- remember to get it uploaded to Maven as well! The lack of an up-to-date, working Jython release in Maven has (allegedly) been quite a problem for those dependent on it. > Let me know, > > -Frank > > ------------------------------------------------------------------------------ > _______________________________________________ > Jython-users mailing list > Jyt...@li... > https://lists.sourceforge.net/lists/listinfo/jython-users > |
From: Leo S. M. <leo...@gm...> - 2010-05-04 14:34:21
|
2010/5/4 Alex Grönholm <ale...@ne...>: [...] > To both of you -- remember to get it uploaded to Maven as well! > The lack of an up-to-date, working Jython release in Maven has > (allegedly) been quite a problem for those dependent on it. ...And if we get into releasing maven artifacts, it would be a great idea to have one for the "standalone" version that includes the stdlib in the jar -- Leo Soto M. http://blog.leosoto.com |
From: Oti <oh...@gm...> - 2010-05-04 16:41:16
|
Frank, On Tue, May 4, 2010 at 3:16 PM, Frank Wierzbicki <fwi...@gm...> wrote: > Hi Oti, > > I'm happy to do the release myself - it's about time that I started > back into Jython stuff a bit since I've had time to acclimate to a > startup. very good news to hear you're back! > However, if you would like to do it, I'd also be happy to > help you do it! It's probably a good idea to have more people who have > the experience of doing a release. > > Let me know, > -Frank i'd really like to learn how it works, and having you as mentor sounds great! In German we say "shared burden is half burden"... Oti. |
From: Anamitra B. <abh...@us...> - 2010-12-01 20:00:08
|
Hi Is there a date for the final release of jython 2.5.2 - a ball park [like end of Dec or end of Jan] would help. thanks Anamitra |