jython-dev — Discussion of developing and enhancing Jython itself(!) (not how to use Jython)

[Jython-dev] JDK 9 EA Build 170 is available on jdk.java.net

[Rory O'D. <ror...@or...>]

Hi Alan,

*
JDK 9 Early Access*  build 170  is available at the new location : - 
jdk.java.net/9/

A summary of all the changes in this build are listed here 
<http://download.java.net/java/jdk9/changes/jdk-9+170.html>.

Changes which were introduced since the last availability email that may 
be of interest :

  * b168 - JDK-8175814: Update default HttpClient protocol version and
    optional request version
      o related to JEP 110  : HTTP/2 Client.
  * b169 - JDK-8178380 : Module system implementation refresh (5/2017)
      o changes in command line options
  * b170 - JDK-8177153  : LambdaMetafactory has default
    constructorIncompatible change,
      o release note:  JDK-8180035

*New Proposal - Mark Reinhold has asked for comments on the jigsaw-dev 
mailing list *[1]

  * Proposal: Allow illegal reflective access by default in JDK 9

    In short, the existing "big kill switch" of the `--permit-illegal-access`
    option [1] will become the default behavior of the JDK 9 run-time system,
    though without as many warnings.  The current behavior of JDK 9, in which
    illegal reflective-access operations from code on the class path are not
    permitted, will become the default in a future release.  Nothing will
    change at compile time.


Rgds,Rory

[1] http://mail.openjdk.java.net/pipermail/jigsaw-dev/2017-May/012673.html

-- 
Rgds,Rory O'Donnell
Quality Engineering Manager
Oracle EMEA , Dublin, Ireland

Re: [Jython-dev] Unicode user and file names (and v2.7.1)

[Jeff A. <ja...@fa...>]

Hi Darjus.

On inclusion, I'm happy to go with the community view, as always. On one 
of the related tickets (http://bugs.jython.org/issue1839), Jim said we'd 
get it in if timing allowed and there was some user support.

I'm very keen to see a 2.7.1 too. The last (soft) RC was unsuccessful, 
and we're still making changes, so I assume we're talking about another 
RC first rather than a release?

The UTF-8 work is nearly there, but not quite: one Linux defect to fix, 
as noted on the same issue by James against the "latin-1" version. After 
all the additions in the last couple of weeks (to get full BMP support), 
I'm happy to find from my Linux laptop that it is still the only thing I 
have to do. It looks trivial. I've been unable code at all for a few 
days, so haven't looked into a solution, but now I'm back I expect to 
nail it for us today or tomorrow.

I can, of course, merge all this myself and will. I shared your 
hesitancy initially, hence the fork repository, but it's turned out so 
well I feel it's now low risk, as long as we still have a few days.

I will now dive under the desk and wire up my Linux dev box.

Jeff Allen

On 16/05/2017 21:46, Darjus Loktevic wrote:
> Hey Jeff,
>
> It seems your last commit to this branch is of three days ago. Is this 
> ready for review? BTW, your changes look good to me.
> I'm a little hesitant to merge this since we've had an RC and REALLY 
> have to release 2.7.1 It's miles better than 2.7.0.
>
> Cheers,
> Darjus
>
> On Mon, May 1, 2017 at 6:34 AM Jeff Allen <ja...@fa... 
> <mailto:ja...@fa...>> wrote:
>
>     I went for sys.getfilesystemencoding() == 'utf-8' and it works pretty
>     well. Rather than just push directly I have published to here:
>
>     https://bitbucket.org/tournesol/jython-utf8
>
>     I write to ask for a second or third pair of eyes on it. Please
>     tell me
>     you can see it and whether it breaks things you care about.
>
>     I touched a lot of files in the core and import system: quite a lot of
>     tricky stuff with loaders and search paths has been adjusted. I
>     think it
>     a good sign that I changed hardly anything in the standard library we
>     inherit from CPython, that we hadn't already specialised.
>
>     By "works pretty well" above, I mean that the regression tests run
>     cleanly for me when my user name is "Épreuve", where previously Jython
>     died horribly. The launcher works from a Chinese user name too, as
>     long
>     as I localise Windows to China (CPython 2.7 feature). I can use the
>     prompt and runs some tests with that setup, but I can't run the
>     regression test yet, and printing a stack dump is fatal, so there's a
>     bit more to do for Chinese.
>
>     I think this means we have solid support for "latin-1" languages, but
>     there are still places where we fatally assume bytes are Unicode code
>     points.
>
>     Jeff Allen
>
>     On 05/04/2017 08:57, Jeff Allen wrote:
>     > I've been working on http://bugs.jython.org/issue2356 which I'd
>     like to
>     > get in 2.7.1 -- it seems rather poor that Jython simply does not
>     run for
>     > users whose names have an un-American character ;). I know this
>     issue is
>     > not a blocker in most minds.
>     >
>     > I've made pretty good progress by allowing file names to be unicode
>     > objects more often than they would be in CPython 2, which usually
>     > returns them as bytes in some encoding that we may not know.
>     I've got
>     > the launcher to work properly, and straightened the logic in our
>     > printing of trace-backs and exceptions from Java. Unicode file names
>     > seems the way to go for Jython because:
>     >
>     >   1. Java gives us competently decoded unicode file names, from
>     >      java.io.File, etc.. Re-encoding the result will be a pain (and
>     >      overlooked).
>     >   2. We appear not to have the codec we need ('mbcs'), that CPython
>     >      reports on Windows via sys.getfilesystemencoding().
>     >   3. We do this already. In 2.7.0, os.getcwd() returns unicode
>     if necessary.
>     >
>     > Most regression tests pass. However, I'm struggling with
>     test_doctest.
>     > Problems arise when mixing unicode and bytes when one byte is
>     128 and
>     > over. This happens in ''.join(list) and formatted output like
>     "%s %s" %
>     > (ustr, bstr). The behaviour of these is identical with CPython: they
>     > raise UnicodeDecodeError because the bytes are promoted to
>     characters
>     > with a strict ascii interpretation. This happens a lot in
>     doctest.py and
>     > traceback.py, for example, where file paths and stack dumps that
>     include
>     > them, are now frequently unicode, while other inputs are byte data
>     > containing file paths presented in the console encoding.
>     >
>     > I can beat this into submission with enough customisation of the
>     stdlib
>     > modules, but that always makes me uncomfortable. I usually see
>     that as a
>     > hint that user code might also need to change. This may be
>     unfounded. I
>     > can probably ensure no impact to users of only ascii paths, and the
>     > others seem unable to run Jython at all (in the scope of this
>     issue).
>     > However, I'm seriously wondering if I should pursue the approach
>     where
>     > file names from Java are re-encoded to bytes (maybe as utf-8
>     > everywhere), but that's grim.
>     >
>     > Thoughts?
>     >
>
>
>     ------------------------------------------------------------------------------
>     Check out the vibrant tech community on one of the world's most
>     engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>     _______________________________________________
>     Jython-dev mailing list
>     Jyt...@li...
>     <mailto:Jyt...@li...>
>     https://lists.sourceforge.net/lists/listinfo/jython-dev
>

Re: [Jython-dev] Mirror process for github broken

[Darjus L. <da...@gm...>]

Yeah, I'd love us to get rid of binaries. I have a basic Gradle build
mostly working. Ideally we'd get rid of the binaries before we load into
Github properly, but that raises concerns (like pulling an older version,
history rewriting, etc.). Thoughts?

On Sun, Feb 26, 2017 at 2:34 PM Jim Baker <jim...@py...> wrote:

> Darjus,
>
>
> On Sun, Feb 26, 2017 at 2:00 PM, Darjus Loktevic <da...@gm...> wrote:
>
>> Hey Guys,
>>
>> The GCE instance that does the periodic sync was down for some reason.
>> This should be fixed now.
>>
>
> Darjus, thanks for doing the resync. Everything looks good now on
> https://github.com/jythontools/jython/
>
>
>> We should seriously consider just moving to github with CPython in the
>> process already.
>>
>
> Agreed about moving to GitHub as primary and specifically using the org we
> have for this (https://github.com/jython). CPython's recent support of GH
> with core-workflow should be mature enough for us to jump on this workflow
> as well.
>
> We should get 2.7.1 out (maybe recent Windows improvements from Stefan are
> sufficient? we do have a missing file in the latest trunk, so will need
> some confirmation). At this point, maybe the best thing to do is use a
> temporary repo while we move from Ant to a Gradle + Ant custom task build;
> then switch to fully being on https://github.com/jython/jython as the
> reference location. I believe the args for having stripped out all of the
> jars from source are compelling reasons to do this; 2.7.2 and Jython 3 will
> have enough breathing room for us to make this transition.
>
> - Jim
>

Re: [Jython-dev] Jython sprint next weekend (6th and 7th of May, 2017)

[Darjus L. <da...@gm...>]

Hey Stefan,

Sorry could not join, traveling. How did it go?

Cheers,
Darjus

On Tue, May 2, 2017 at 9:44 AM Stefan Richthofer <Ste...@gm...>
wrote:

> Dear Jython developers and users,
>
> I will be leading a Jython sprint at "Python Meeting Düsseldorf"'s overall
> Python sprint, http://www.pyddf.de/sprint2017 next weekend. (6th and 7th
> of May in Düsseldorf, Germany)
> I'm aware that hardly anyone from this list can make it there in person
> (if so, even better!), but please feel encouraged to participate remotely
> via Jython's IRC-channel irc://irc.freenode.net/#jython. We will be
> online there 11.00-17.30 CEST each day (and hopefully fill it with more
> activity than usual).
>
> Potential topics include:
>
> Using Jython:
> - Jython basics / getting started
> - Python/Java integration (e.g. calling Java from Python and vice versa)
> - scripting Java with Jython
> - GUI with JavaFX in Python
>
> Developing Jython:
> - Jython internals / getting started
> - Bugfixes in Jython core - Can we fix some actual bugs?
> (I will especially look into current release blockers
> http://bugs.jython.org/issue2487 and http://bugs.jython.org/issue2570)
>
> Experimental stuff (What is already workable? Let's try!):
> - JyNI (e.g. NumPy, ctypes)
> - Jython 3
>
> Individual stuff:
> - You have some project or usecase for Jython and need advice?
> - There is some specific gap keeping you from using Jython? -- Maybe we
> can fix it or work around.
> -- Maybe even if it involves a C-Extension (let's tweak JyNI)
>
> Looking forward to work with you!
>
> -Stefan
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Jython-dev mailing list
> Jyt...@li...
> https://lists.sourceforge.net/lists/listinfo/jython-dev
>

Re: [Jython-dev] Unicode user and file names (and v2.7.1)

[Darjus L. <da...@gm...>]

Hey Jeff,

It seems your last commit to this branch is of three days ago. Is this
ready for review? BTW, your changes look good to me.
I'm a little hesitant to merge this since we've had an RC and REALLY have
to release 2.7.1 It's miles better than 2.7.0.

Cheers,
Darjus

On Mon, May 1, 2017 at 6:34 AM Jeff Allen <ja...@fa...> wrote:

> I went for sys.getfilesystemencoding() == 'utf-8' and it works pretty
> well. Rather than just push directly I have published to here:
>
> https://bitbucket.org/tournesol/jython-utf8
>
> I write to ask for a second or third pair of eyes on it. Please tell me
> you can see it and whether it breaks things you care about.
>
> I touched a lot of files in the core and import system: quite a lot of
> tricky stuff with loaders and search paths has been adjusted. I think it
> a good sign that I changed hardly anything in the standard library we
> inherit from CPython, that we hadn't already specialised.
>
> By "works pretty well" above, I mean that the regression tests run
> cleanly for me when my user name is "Épreuve", where previously Jython
> died horribly. The launcher works from a Chinese user name too, as long
> as I localise Windows to China (CPython 2.7 feature). I can use the
> prompt and runs some tests with that setup, but I can't run the
> regression test yet, and printing a stack dump is fatal, so there's a
> bit more to do for Chinese.
>
> I think this means we have solid support for "latin-1" languages, but
> there are still places where we fatally assume bytes are Unicode code
> points.
>
> Jeff Allen
>
> On 05/04/2017 08:57, Jeff Allen wrote:
> > I've been working on http://bugs.jython.org/issue2356 which I'd like to
> > get in 2.7.1 -- it seems rather poor that Jython simply does not run for
> > users whose names have an un-American character ;). I know this issue is
> > not a blocker in most minds.
> >
> > I've made pretty good progress by allowing file names to be unicode
> > objects more often than they would be in CPython 2, which usually
> > returns them as bytes in some encoding that we may not know. I've got
> > the launcher to work properly, and straightened the logic in our
> > printing of trace-backs and exceptions from Java. Unicode file names
> > seems the way to go for Jython because:
> >
> >   1. Java gives us competently decoded unicode file names, from
> >      java.io.File, etc.. Re-encoding the result will be a pain (and
> >      overlooked).
> >   2. We appear not to have the codec we need ('mbcs'), that CPython
> >      reports on Windows via sys.getfilesystemencoding().
> >   3. We do this already. In 2.7.0, os.getcwd() returns unicode if
> necessary.
> >
> > Most regression tests pass. However, I'm struggling with test_doctest.
> > Problems arise when mixing unicode and bytes when one byte is 128 and
> > over. This happens in ''.join(list) and formatted output like "%s %s" %
> > (ustr, bstr). The behaviour of these is identical with CPython: they
> > raise UnicodeDecodeError because the bytes are promoted to characters
> > with a strict ascii interpretation. This happens a lot in doctest.py and
> > traceback.py, for example, where file paths and stack dumps that include
> > them, are now frequently unicode, while other inputs are byte data
> > containing file paths presented in the console encoding.
> >
> > I can beat this into submission with enough customisation of the stdlib
> > modules, but that always makes me uncomfortable. I usually see that as a
> > hint that user code might also need to change. This may be unfounded. I
> > can probably ensure no impact to users of only ascii paths, and the
> > others seem unable to run Jython at all (in the scope of this issue).
> > However, I'm seriously wondering if I should pursue the approach where
> > file names from Java are re-encoded to bytes (maybe as utf-8
> > everywhere), but that's grim.
> >
> > Thoughts?
> >
>
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Jython-dev mailing list
> Jyt...@li...
> https://lists.sourceforge.net/lists/listinfo/jython-dev
>

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-05-05 - 2017-05-12)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     310 ( +4)
  closed  2300 ( +0)
  total   2610 ( +4)

Open issues with patches: 28   


Issues opened (4)
=================

#2588: test_io failure in concurrent access to a buffered file
http://bugs.jython.org/issue2588  opened by jeff.allen

#2589: Two copies of jansi DLL created per invocation of Jython
http://bugs.jython.org/issue2589  opened by jeff.allen

#2590: 'org.python.core.io.StreamIO' object has no attribute '_regist
http://bugs.jython.org/issue2590  opened by BjarkeBB

#2591: Unable to execute directory or zip file (test_cmd_line_script)
http://bugs.jython.org/issue2591  opened by jeff.allen



Most recent 15 issues with no replies (15)
==========================================

#2591: Unable to execute directory or zip file (test_cmd_line_script)
http://bugs.jython.org/issue2591

#2589: Two copies of jansi DLL created per invocation of Jython
http://bugs.jython.org/issue2589

#2584: netty threads not terminated during regrtest
http://bugs.jython.org/issue2584

#2581: getmro omits classes of the same name
http://bugs.jython.org/issue2581

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embeds other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842

#1796: Jython doesn't support jar dir with colon's in it
http://bugs.jython.org/issue1796



Top 10 most discussed issues (2)
================================

#2588: test_io failure in concurrent access to a buffered file
http://bugs.jython.org/issue2588   3 msgs

#2590: 'org.python.core.io.StreamIO' object has no attribute '_regist
http://bugs.jython.org/issue2590   3 msgs

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-04-28 - 2017-05-05)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     306 ( +4)
  closed  2300 ( +0)
  total   2606 ( +4)

Open issues with patches: 28   


Issues opened (4)
=================

#2584: netty threads not terminated during regrtest
http://bugs.jython.org/issue2584  opened by jamesmudd

#2585: test_ssl failure due to Netty exception mapping
http://bugs.jython.org/issue2585  opened by jamesmudd

#2586: test_mailbox fails on Linux
http://bugs.jython.org/issue2586  opened by stefan.richthofer

#2587: test failures on Linux  due to file permissions on NTFS partit
http://bugs.jython.org/issue2587  opened by stefan.richthofer



Most recent 15 issues with no replies (15)
==========================================

#2587: test failures on Linux  due to file permissions on NTFS partit
http://bugs.jython.org/issue2587

#2584: netty threads not terminated during regrtest
http://bugs.jython.org/issue2584

#2581: getmro omits classes of the same name
http://bugs.jython.org/issue2581

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embeds other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842

#1796: Jython doesn't support jar dir with colon's in it
http://bugs.jython.org/issue1796



Top 10 most discussed issues (3)
================================

#1839: sys.getfilesystemencoding() is None although java.lang.System.
http://bugs.jython.org/issue1839   6 msgs

#2585: test_ssl failure due to Netty exception mapping
http://bugs.jython.org/issue2585   5 msgs

#2536: deadlocks in regrtests due to StackOverflowError in finally bl
http://bugs.jython.org/issue2536   3 msgs

Re: [Jython-dev] Google Summer of Code projects announced - JyNI on Windows support

[Jeff A. <ja...@fa...>]

Congratulations indeed! And good luck with the sprints this w/e too.

Jeff Allen

On 04/05/2017 21:16, Jim Baker wrote:
> Today the Google Summer of Code projects were announced, and Stefan 
> Richthofer's project  on JyNI support on Windows is one of them:
> https://summerofcode.withgoogle.com/projects/#4931062149939200
>
> Congratulations!!!
>
> I'm really happy about this summer funding to help support Stefan in 
> this valuable work. Every time Stefan has worked on JyNI, it has 
> inevitably led to improvements to Jython itself; and JyNI support 
> itself is course is highly useful. Such work is also something that we 
> will be readily able to use for Jython 3, once we are ready.
>
> Frank, Darjus, and I all look forward to help mentor Stefan in this 
> work; and it's also something we as a community of developers can do. 
> Mentorship here doesn't mean so much help on code — Stefan is 
> obviously awesome there. Instead it's a chance to provide feedback on 
> design and prioritization, much as we do for each other, when we have 
> a chance.
>
> - Jim
>

[Jython-dev] Google Summer of Code projects announced - JyNI on Windows support

[Jim B. <jim...@py...>]

Today the Google Summer of Code projects were announced, and Stefan
Richthofer's project  on JyNI support on Windows is one of them:
https://summerofcode.withgoogle.com/projects/#4931062149939200

Congratulations!!!

I'm really happy about this summer funding to help support Stefan in this
valuable work. Every time Stefan has worked on JyNI, it has inevitably led
to improvements to Jython itself; and JyNI support itself is course is
highly useful. Such work is also something that we will be readily able to
use for Jython 3, once we are ready.

Frank, Darjus, and I all look forward to help mentor Stefan in this work;
and it's also something we as a community of developers can do. Mentorship
here doesn't mean so much help on code — Stefan is obviously awesome there.
Instead it's a chance to provide feedback on design and prioritization,
much as we do for each other, when we have a chance.

- Jim

[Jython-dev] Jython sprint next weekend (6th and 7th of May, 2017)

[Stefan R. <Ste...@gm...>]

Dear Jython developers and users,

I will be leading a Jython sprint at "Python Meeting Düsseldorf"'s overall Python sprint, http://www.pyddf.de/sprint2017 next weekend. (6th and 7th of May in Düsseldorf, Germany)
I'm aware that hardly anyone from this list can make it there in person (if so, even better!), but please feel encouraged to participate remotely via Jython's IRC-channel irc://irc.freenode.net/#jython. We will be online there 11.00-17.30 CEST each day (and hopefully fill it with more activity than usual).

Potential topics include:

Using Jython:
- Jython basics / getting started
- Python/Java integration (e.g. calling Java from Python and vice versa)
- scripting Java with Jython
- GUI with JavaFX in Python

Developing Jython:
- Jython internals / getting started
- Bugfixes in Jython core - Can we fix some actual bugs?
(I will especially look into current release blockers http://bugs.jython.org/issue2487 and http://bugs.jython.org/issue2570)

Experimental stuff (What is already workable? Let's try!):
- JyNI (e.g. NumPy, ctypes)
- Jython 3

Individual stuff:
- You have some project or usecase for Jython and need advice?
- There is some specific gap keeping you from using Jython? -- Maybe we can fix it or work around.
-- Maybe even if it involves a C-Extension (let's tweak JyNI)

Looking forward to work with you!

-Stefan

Re: [Jython-dev] Unicode user and file names (and v2.7.1)

[Jeff A. <ja...@fa...>]

I went for sys.getfilesystemencoding() == 'utf-8' and it works pretty 
well. Rather than just push directly I have published to here:

https://bitbucket.org/tournesol/jython-utf8

I write to ask for a second or third pair of eyes on it. Please tell me 
you can see it and whether it breaks things you care about.

I touched a lot of files in the core and import system: quite a lot of 
tricky stuff with loaders and search paths has been adjusted. I think it 
a good sign that I changed hardly anything in the standard library we 
inherit from CPython, that we hadn't already specialised.

By "works pretty well" above, I mean that the regression tests run 
cleanly for me when my user name is "Épreuve", where previously Jython 
died horribly. The launcher works from a Chinese user name too, as long 
as I localise Windows to China (CPython 2.7 feature). I can use the 
prompt and runs some tests with that setup, but I can't run the 
regression test yet, and printing a stack dump is fatal, so there's a 
bit more to do for Chinese.

I think this means we have solid support for "latin-1" languages, but 
there are still places where we fatally assume bytes are Unicode code 
points.

Jeff Allen

On 05/04/2017 08:57, Jeff Allen wrote:
> I've been working on http://bugs.jython.org/issue2356 which I'd like to
> get in 2.7.1 -- it seems rather poor that Jython simply does not run for
> users whose names have an un-American character ;). I know this issue is
> not a blocker in most minds.
>
> I've made pretty good progress by allowing file names to be unicode
> objects more often than they would be in CPython 2, which usually
> returns them as bytes in some encoding that we may not know. I've got
> the launcher to work properly, and straightened the logic in our
> printing of trace-backs and exceptions from Java. Unicode file names
> seems the way to go for Jython because:
>
>   1. Java gives us competently decoded unicode file names, from
>      java.io.File, etc.. Re-encoding the result will be a pain (and
>      overlooked).
>   2. We appear not to have the codec we need ('mbcs'), that CPython
>      reports on Windows via sys.getfilesystemencoding().
>   3. We do this already. In 2.7.0, os.getcwd() returns unicode if necessary.
>
> Most regression tests pass. However, I'm struggling with test_doctest.
> Problems arise when mixing unicode and bytes when one byte is 128 and
> over. This happens in ''.join(list) and formatted output like "%s %s" %
> (ustr, bstr). The behaviour of these is identical with CPython: they
> raise UnicodeDecodeError because the bytes are promoted to characters
> with a strict ascii interpretation. This happens a lot in doctest.py and
> traceback.py, for example, where file paths and stack dumps that include
> them, are now frequently unicode, while other inputs are byte data
> containing file paths presented in the console encoding.
>
> I can beat this into submission with enough customisation of the stdlib
> modules, but that always makes me uncomfortable. I usually see that as a
> hint that user code might also need to change. This may be unfounded. I
> can probably ensure no impact to users of only ascii paths, and the
> others seem unable to run Jython at all (in the scope of this issue).
> However, I'm seriously wondering if I should pursue the approach where
> file names from Java are re-encoded to bytes (maybe as utf-8
> everywhere), but that's grim.
>
> Thoughts?
>

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-04-21 - 2017-04-28)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     302 ( +3)
  closed  2300 ( +1)
  total   2602 ( +4)

Open issues with patches: 28   


Issues opened (3)
=================

#2580: __pyclasspath__ can break inspect.getmodule
http://bugs.jython.org/issue2580  opened by stefan.richthofer

#2581: getmro omits classes of the same name
http://bugs.jython.org/issue2581  opened by jaraco

#2582: No >>> prompt with JDK 9, seems to be caused by illegal access
http://bugs.jython.org/issue2582  opened by alanb



Most recent 15 issues with no replies (15)
==========================================

#2581: getmro omits classes of the same name
http://bugs.jython.org/issue2581

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484

#2482: Publish U.S. ECCN for Jython
http://bugs.jython.org/issue2482

#2422: test_classpathimporter fauls on Linux
http://bugs.jython.org/issue2422



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embeds other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842

#1796: Jython doesn't support jar dir with colon's in it
http://bugs.jython.org/issue1796



Top 10 most discussed issues (1)
================================

#2579: Pyc files are not loading for too large modules if path contai
http://bugs.jython.org/issue2579   6 msgs



Issues closed (1)
=================

#2583: ❤Re: just take a look at that
http://bugs.jython.org/issue2583  closed by stefan.richthofer

[Jython-dev] JDK 9 EA Build 167 and JDK 8u152 build 03 are available on jdk.java.net

[Rory O'D. <ror...@or...>]

Hi Alan,

*JDK 9 Early Access*  build 167  is available at the new location : - 
jdk.java.net/9/

A summary of all the changes in this build are listed here 
<http://download.java.net/java/jdk9/changes/jdk-9+167.html>. One change 
that maybe of interest is :

  *    JEP 291: Deprecate the Concurrent Mark Sweep (CMS) Garbage
    Collector [1]

*
*

*JDK 8u152 Early Access* build 03 is available at the new location : - 
jdk.java.net/8/ <http://jdk.java.net/8/>

More information on the change of location for Early Access builds. [2]

NOTE: - Oracle's JRE and JDK Cryptographic Roadmap has been updated 
since last availability email [3]

Rgds,Rory

[1] http://mail.openjdk.java.net/pipermail/jdk9-dev/2017-April/005766.html
[2] 
http://mail.openjdk.java.net/pipermail/adoption-discuss/2017-April/001610.html
[3] https://www.java.com/en/jre-jdk-cryptoroadmap.html

-- 
Rgds,Rory O'Donnell
Quality Engineering Manager
Oracle EMEA , Dublin, Ireland

[Jython-dev] How to access (non-exposed) Java-API of exposed (core-)classes from Python code?

[Stefan R. <Ste...@gm...>]

Hi all,

is there a way to access Java-API of Jython's (core-)classes that are exposed via the expose mechanism (i.e. using @ExposedType, @ExposedGet etc) from Python code? I mean Java methods or fields that are not annotated with @ExposedX.

Accessing Java-API of ordinary Java objects is trivial in Jython, but ironically this seems to be not true for Jython's own Java-API. So far I only found a way where you need to write plain Java-code.
It seems not even to be possible via reflection, because the relevant Class objects are inherently mapped to PyType objects, which don't feature API crucial for reflection like getField, getMethod, etc.

Some things I tried:
(tb is a traceback object)

from org.python.core import Py, PyTraceback, PyObject, PyJavaType

print tb.toString()
print Py.tojava(tb, PyTraceback).toString()
print Py.tojava(tb, PyTraceback.__class__).toString()
print Py.tojava(tb, 'org.python.core.PyTraceback').toString()
print Py.tojava(tb, 'java.lang.Object').toString()
print Py.tojava(tb, PyJavaType).toString()
print Py.tojava(tb, 'org.python.core.PyJavaType').toString()
print Class.forName('org.python.core.PyTraceback').getMethod('toString')

I can use reflection if I write plain Java code, e.g.
public class ReflectHelper {
  public static Method getMethod(Object prototype, String name, Class<?>... parameterTypes) throws NoSuchMethodException {
    return prototype.getClass().getMethod(name, parameterTypes);
  }
}

Then I can call it like

ReflectHelper.getMethod(tb, 'toString').call(tb)

which would be okay for me, except that I would have to bundle Java-code, eventually class-file as well.
I agree that for exposed objects, Java-level API should be somewhat hidden on Python-level, but I think you should be able to access it if you know what you're doing. Especially given that it is possible anyway via plain Java-code.

If someone knows a proper way how to do it (or any "pure" Python-code level way in Jython at all), please tell me! What option do I overlook?


Best

Stefan

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-04-14 - 2017-04-21)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     299 ( -1)
  closed  2299 ( +3)
  total   2598 ( +2)

Open issues with patches: 28   


Issues opened (1)
=================

#2579: Pyc files are not loading for too large modules
http://bugs.jython.org/issue2579  opened by psterdale



Most recent 15 issues with no replies (15)
==========================================

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484

#2482: Publish U.S. ECCN for Jython
http://bugs.jython.org/issue2482

#2422: test_classpathimporter fauls on Linux
http://bugs.jython.org/issue2422

#2418: test_chdir subprocess tests fail on Windows
http://bugs.jython.org/issue2418



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embeds other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842

#1796: Jython doesn't support jar dir with colon's in it
http://bugs.jython.org/issue1796



Issues closed (3)
=================

#2537: test_java_integration hangs during regrtest
http://bugs.jython.org/issue2537  closed by stefan.richthofer

#2565: test_jy_internal deadlock on Windows
http://bugs.jython.org/issue2565  closed by stefan.richthofer

#2578: professional FPC supplier in China
http://bugs.jython.org/issue2578  closed by jeff.allen

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-04-07 - 2017-04-14)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     300 ( +0)
  closed  2296 ( +1)
  total   2596 ( +1)

Open issues with patches: 29   


Most recent 15 issues with no replies (15)
==========================================

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484

#2482: Publish U.S. ECCN for Jython
http://bugs.jython.org/issue2482

#2422: test_classpathimporter fauls on Linux
http://bugs.jython.org/issue2422

#2418: test_chdir subprocess tests fail on Windows
http://bugs.jython.org/issue2418



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2565: test_jy_internal deadlock on Windows
http://bugs.jython.org/issue2565

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embeds other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842



Issues closed (1)
=================

#2577: surprising
http://bugs.jython.org/issue2577  closed by jeff.allen

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-03-31 - 2017-04-07)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     300 ( +3)
  closed  2295 ( -1)
  total   2595 ( +2)

Open issues with patches: 29   


Issues opened (3)
=================

#2487: PyType.fromClass publication bug on slow systems (travis, circ
http://bugs.jython.org/issue2487  reopened by zyasoft

#2575: Overloaded int and boolean method incorrectly called
http://bugs.jython.org/issue2575  opened by jamesmudd

#2576: pip install -r requirements.txt fails with RE recursion limit
http://bugs.jython.org/issue2576  opened by pjac



Most recent 15 issues with no replies (15)
==========================================

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484

#2482: Publish U.S. ECCN for Jython
http://bugs.jython.org/issue2482

#2422: test_classpathimporter fauls on Linux
http://bugs.jython.org/issue2422

#2418: test_chdir subprocess tests fail on Windows
http://bugs.jython.org/issue2418



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2565: test_jy_internal deadlock on Windows
http://bugs.jython.org/issue2565

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embedd other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842



Top 10 most discussed issues (1)
================================

#2536: test_logging deadlocks during regrtest
http://bugs.jython.org/issue2536   6 msgs

[Jython-dev] JDK 9 Developer Preview is now available on java.net

[Rory O'D. <ror...@or...>]

Hi Alan,


      *JDK 9 Developer Preview is now available on java.net [1]
      *

Developer Preview milestone: - A reasonably stable build suitable for 
broad testing by the developer community is available.
JDK 9 Builds 163 and higher include all planned features.


*Attention annotation processing users and authors - * Request for 
feedback on annotation processing API changes made in JDK 9.

As has been done previously during Java SE 7 and Java SE 8, the JSR 269 
annotation processing API is undergoing a maintenance review (MR) as 
part of Java SE 9. Details of the changes in JDK 9 Early Access build 
163 & build 164 available here [2]

Please report experiences running processors under JDK 9 and feedback on 
the API changes to the compiler-dev mailing list.
(If you haven’t already subscribed to that list then please do so first, 
otherwise your message will be discarded as spam.)


Rgds, Rory

[1] https://jdk9.java.net/download/
[2] 
http://mail.openjdk.java.net/pipermail/compiler-dev/2017-April/010896.html

-- 
Rgds,Rory O'Donnell
Quality Engineering Manager

[Jython-dev] Unicode user and file names (and v2.7.1)

[Jeff A. <ja...@fa...>]

I've been working on http://bugs.jython.org/issue2356 which I'd like to 
get in 2.7.1 -- it seems rather poor that Jython simply does not run for 
users whose names have an un-American character ;). I know this issue is 
not a blocker in most minds.

I've made pretty good progress by allowing file names to be unicode 
objects more often than they would be in CPython 2, which usually 
returns them as bytes in some encoding that we may not know. I've got 
the launcher to work properly, and straightened the logic in our 
printing of trace-backs and exceptions from Java. Unicode file names 
seems the way to go for Jython because:

 1. Java gives us competently decoded unicode file names, from
    java.io.File, etc.. Re-encoding the result will be a pain (and
    overlooked).
 2. We appear not to have the codec we need ('mbcs'), that CPython
    reports on Windows via sys.getfilesystemencoding().
 3. We do this already. In 2.7.0, os.getcwd() returns unicode if necessary.

Most regression tests pass. However, I'm struggling with test_doctest. 
Problems arise when mixing unicode and bytes when one byte is 128 and 
over. This happens in ''.join(list) and formatted output like "%s %s" % 
(ustr, bstr). The behaviour of these is identical with CPython: they 
raise UnicodeDecodeError because the bytes are promoted to characters 
with a strict ascii interpretation. This happens a lot in doctest.py and 
traceback.py, for example, where file paths and stack dumps that include 
them, are now frequently unicode, while other inputs are byte data 
containing file paths presented in the console encoding.

I can beat this into submission with enough customisation of the stdlib 
modules, but that always makes me uncomfortable. I usually see that as a 
hint that user code might also need to change. This may be unfounded. I 
can probably ensure no impact to users of only ascii paths, and the 
others seem unable to run Jython at all (in the scope of this issue). 
However, I'm seriously wondering if I should pursue the approach where 
file names from Java are re-encoded to bytes (maybe as utf-8 
everywhere), but that's grim.

Thoughts?

-- 
Jeff Allen

[Jython-dev] Summary of Jython tracker Issues

[Jython t. <st...@bu...>]

ACTIVITY SUMMARY (2017-03-24 - 2017-03-31)
Jython tracker at http://bugs.jython.org/

To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.

Issues counts and deltas:
  open     297 (-16)
  closed  2296 (+16)
  total   2593 ( +0)

Open issues with patches: 29   


Most recent 15 issues with no replies (15)
==========================================

#2567: System state lost during JSR-223 initialisation
http://bugs.jython.org/issue2567

#2562: Windows: OSError: unlink(): an unknown error occurred
http://bugs.jython.org/issue2562

#2543: broken links for mailing list website
http://bugs.jython.org/issue2543

#2540: settrace doesn't notice "with" statements
http://bugs.jython.org/issue2540

#2531: Support SNI for SSL/TLS server sockets
http://bugs.jython.org/issue2531

#2525: Jython incorrectly buffers file pipe output with Subprocess(co
http://bugs.jython.org/issue2525

#2520: Jython does NOT support socket.listen(0) for accepting only on
http://bugs.jython.org/issue2520

#2512: Values in built-in modules's __dict__ are “<reflected field 
http://bugs.jython.org/issue2512

#2510: TypeError when monkey-patching time.time with an unbound funct
http://bugs.jython.org/issue2510

#2507: Run "invokeFunction" in a thread does not inherit the "ScriptC
http://bugs.jython.org/issue2507

#2494: Support for pydoc_data
http://bugs.jython.org/issue2494

#2484: Codec encodings can exhaust permgen
http://bugs.jython.org/issue2484

#2482: Publish U.S. ECCN for Jython
http://bugs.jython.org/issue2482

#2422: test_classpathimporter fauls on Linux
http://bugs.jython.org/issue2422

#2418: test_chdir subprocess tests fail on Windows
http://bugs.jython.org/issue2418



Most recent 15 issues waiting for review (15)
=============================================

#2566: inspect does not recognize code objects from bytecode files
http://bugs.jython.org/issue2566

#2565: test_jy_internal deadlock on Windows
http://bugs.jython.org/issue2565

#2545: help() does not work on Java-implemented modules
http://bugs.jython.org/issue2545

#2429: cStringIO does not work with mutable objects implementing the 
http://bugs.jython.org/issue2429

#2367: Jython ignores custom __eq__ when hashing dict subclasses
http://bugs.jython.org/issue2367

#2330: full-build fails to copy CPython License
http://bugs.jython.org/issue2330

#2230: Jython evaluation blocks under heavy load with high multi-core
http://bugs.jython.org/issue2230

#2143: site-packages support in standalone jar
http://bugs.jython.org/issue2143

#2142: Set Thread classloader when entering Jython context
http://bugs.jython.org/issue2142

#2121: Jython jar on Maven central embedd other third party libraries
http://bugs.jython.org/issue2121

#2077: marshal doesn't raise error when fed unmarshalable object
http://bugs.jython.org/issue2077

#1925: Support loading java.sql.Drivers that aren't on the boot class
http://bugs.jython.org/issue1925

#1917: No ctypes.c_char
http://bugs.jython.org/issue1917

#1866: Parser does not have mismatch token error messages caught by B
http://bugs.jython.org/issue1866

#1842: Add IBM i support to Jython
http://bugs.jython.org/issue1842



Top 10 most discussed issues (2)
================================

#2536: test_logging deadlocks during regrtest
http://bugs.jython.org/issue2536  10 msgs

#2356: java.lang.IllegalArgumentException while startup jython on Win
http://bugs.jython.org/issue2356   3 msgs

Re: [Jython-dev] Support for sys._current_frames

[Stefan R. <Ste...@gm...>]

<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>
<div>I just added a version of sys._current_frames that skips null-frames. See https://hg.python.org/jython/rev/b051f30c4cd4.</div>

<div>So this will be in Jython 2.7.1. Feel free to test it from current trunk version.</div>

<div>&nbsp;</div>

<div>-Stefan</div>

<div>&nbsp;</div>

<div>&nbsp;
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div style="margin:0 0 10px 0;"><b>Gesendet:</b>&nbsp;Donnerstag, 30. M&auml;rz 2017 um 20:22 Uhr<br/>
<b>Von:</b>&nbsp;&quot;Fabio Zadrozny&quot; &lt;fa...@gm...&gt;<br/>
<b>An:</b>&nbsp;&quot;Stefan Richthofer&quot; &lt;Ste...@gm...&gt;<br/>
<b>Cc:</b>&nbsp;&quot;Jython Developers&quot; &lt;jyt...@li...&gt;<br/>
<b>Betreff:</b>&nbsp;Re: [Jython-dev] Support for sys._current_frames</div>

<div name="quoted-content">
<div>
<div class="gmail_default" style="color: rgb(0,0,0);">Thank you all for the comments.</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default" style="color: rgb(0,0,0);">Given the sample code, I was able to implement a replacement in PyDev, in pure-Python, while Jython itself provides no sys._current_frames (given that it seems simple to implement, it&#39;d be nice to have this in a Jython release sooner rather than later, as my implementation replacement has to access a private attribute -- which is different from the latest 2.7.0 in the downloads to the current development version -- and it&#39;ll probably stop working as Jython itself moves forward.</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default" style="color: rgb(0,0,0);">@Stefan: Regarding having None frames, I think that this shouldn&#39;t be allowed (not that I couldn&#39;t change PyDev to deal with it, but this is not the behavior CPython gives, so, I think the return should be protected to disallow None values -- there are other uses for sys._current_frames, for instance, on PyVmMonitor I use it to gather stack information, and I bet there are other uses out there which wouldn&#39;t protect from receiving a None there).</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default" style="color: rgb(0,0,0);">The pure-python replacement I&#39;m using if sys._current_frames is not found is below (may also be seen at:&nbsp;<a href="https://github.com/fabioz/PyDev.Debugger/commit/a4a58179dab9f9fb93559066f0ef22ac59c59e04" target="_blank">https://github.com/fabioz/PyDev.Debugger/commit/a4a58179dab9f9fb93559066f0ef22ac59c59e04</a>).</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default" style="color: rgb(0,0,0);">Thanks,</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default" style="color: rgb(0,0,0);">Fabio</div>

<div class="gmail_default" style="color: rgb(0,0,0);">&nbsp;</div>

<div class="gmail_default">
<div class="gmail_default">
<div class="gmail_default"><font color="#000000" face="monospace, monospace">from java.lang import NoSuchFieldException</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">from org.python.core import ThreadStateMapping</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">try:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; cachedThreadState = ThreadStateMapping.getDeclaredField(&#39;globalThreadStates&#39;) # Dev version</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">except NoSuchFieldException:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; cachedThreadState = ThreadStateMapping.getDeclaredField(&#39;cachedThreadState&#39;) # Release Jython 2.7.0</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">cachedThreadState.accessible = True</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">thread_states = cachedThreadState.get(ThreadStateMapping)</font></div>

<div class="gmail_default">&nbsp;</div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">def _current_frames():</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; as_array = thread_states.entrySet().toArray()</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; ret = {}</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; for thread_to_state in as_array:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; thread = thread_to_state.getKey()</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; if thread is None:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; continue</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; thread_state = thread_to_state.getValue()</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; if thread_state is None:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; continue</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; frame = thread_state.frame</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; if frame is None:</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; continue</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; &nbsp; &nbsp; ret[thread.getId()] = frame</font></div>

<div class="gmail_default"><font color="#000000" face="monospace, monospace">&nbsp; &nbsp; return ret</font></div>
</div>

<div style="color: rgb(0,0,0);">&nbsp;</div>
</div>
</div>

<div class="gmail_extra">&nbsp;
<div class="gmail_quote">On Wed, Mar 29, 2017 at 6:08 PM, Stefan Richthofer <span>&lt;<a href="mailto:Ste...@gm..." onclick="parent.window.location.href=&#39;Ste...@gm...&#39;; return false;" target="_blank">Ste...@gm...</a>&gt;</span> wrote:

<blockquote class="gmail_quote" style="margin: 0 0 0 0.8ex;border-left: 1.0px rgb(204,204,204) solid;padding-left: 1.0ex;"><span>&gt; Your elements array should be twice as long, I think?</span><br/>
Obviously it should ;)<br/>
<br/>
Agreed on all points. I just tested the implementation and observed that<br/>
an entry in globalThreadStates yields a null-PyFrame. How should we deal<br/>
with that?<br/>
<br/>
a) Is it a bug and we should investigate how it can be null and solve it?<br/>
b) set the frame to None in result of _current_frames<br/>
c) skip such elements and let _current_frames only return a reduced dict?<br/>
<br/>
@Fabio regarding b), would PyDev be robust against None-values here?<br/>
<br/>
Despite this, the result looks rather much like in CPython.<br/>
<br/>
<br/>
&gt; Gesendet: Mittwoch, 29. M&auml;rz 2017 um 22:04 Uhr<br/>
&gt; Von: &quot;Jeff Allen&quot; &lt;<a href="mailto:ja...@fa..." onclick="parent.window.location.href=&#39;ja...@fa...&#39;; return false;" target="_blank">ja...@fa...</a>&gt;<br/>
&gt; An: <a href="mailto:jyt...@li..." onclick="parent.window.location.href=&#39;jyt...@li...&#39;; return false;" target="_blank">jyt...@li...</a><br/>
&gt; Betreff: Re: [Jython-dev] Support for sys._current_frames
<div class="HOEnZb">
<div class="h5">&gt;<br/>
&gt; This seems to be a faithful equivalent to the CPython implementation.<br/>
&gt; That is wrapped in a synchronisation construct, but globalThreadStates<br/>
&gt; is of a thread-safe class, I see. However, as the number of threads<br/>
&gt; might change between the call to size() and the call to toArray(), I<br/>
&gt; think it would be better to let toArray() always allocate the array<br/>
&gt; (i.e. give it a zero-length prototype).<br/>
&gt;<br/>
&gt; Your elements array should be twice as long, I think?<br/>
&gt;<br/>
&gt; The way we manage ThreadState and interpreters leaves me uneasy, but<br/>
&gt; that&#39;s not a criticism against this proposal, except for the risk of<br/>
&gt; change when the penny finally drops.<br/>
&gt;<br/>
&gt; Oh, and thanks to Fabio for continuing to support Jython in PyDev.<br/>
&gt;<br/>
&gt; Jeff Allen<br/>
&gt;<br/>
&gt; On 29/03/2017 17:30, Stefan Richthofer wrote:<br/>
&gt; &gt; I suggest this could be implemented in ThreadStateMapping like this:<br/>
&gt; &gt; (on top of that an implementation in PySystemState is straight forward)<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp;public static PyObject _current_frames() {<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;@SuppressWarnings(&quot;unchecked&quot;)<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Map.Entry&lt;Thread, ThreadState&gt;[] entries = new<br/>
&gt; &gt; Map.Entry[globalThreadStates.size()];<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;entries = globalThreadStates.entrySet().toArray(entries);<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;PyObject elements[] = new PyObject[entries.length];<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;int pos = 0;<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;for (Map.Entry&lt;Thread, ThreadState&gt; entry: entries) {<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;elements[pos++] = Py.newInteger(entry.getKey().getId());<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;elements[pos++] = entry.getValue().frame;<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;}<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;return new PyDictionary(elements);<br/>
&gt; &gt;&nbsp; &nbsp; &nbsp;}<br/>
&gt; &gt; Opinions?<br/>
&gt; &gt; -Stefan<br/>
&gt; &gt; *Gesendet:* Mittwoch, 29. M&auml;rz 2017 um 17:30 Uhr<br/>
&gt; &gt; *Von:* &quot;Fabio Zadrozny&quot; &lt;<a href="mailto:fa...@gm..." onclick="parent.window.location.href=&#39;fa...@gm...&#39;; return false;" target="_blank">fa...@gm...</a>&gt;<br/>
&gt; &gt; *An:* &quot;Jython Developers&quot; &lt;<a href="mailto:jyt...@li..." onclick="parent.window.location.href=&#39;jyt...@li...&#39;; return false;" target="_blank">jyt...@li...</a>&gt;<br/>
&gt; &gt; *Betreff:* [Jython-dev] Support for sys._current_frames<br/>
&gt; &gt; Hi Jython devs,<br/>
&gt; &gt; I&#39;ve just updated the PyDev debugger to drop support for older Python<br/>
&gt; &gt; versions and it seems I ended up breaking debugging in the current<br/>
&gt; &gt; Jython version because of it...<br/>
&gt; &gt; The issue is that PyDev now requires sys._current_frames to be<br/>
&gt; &gt; implemented by the interpreter (available since Python 2.5), but it<br/>
&gt; &gt; seems this is not available for Jython -- this is needed so that the<br/>
&gt; &gt; debugger can be faster (i.e.: it runs with untraced frames until some<br/>
&gt; &gt; breakpoint is actually added -- at that point it gets the current<br/>
&gt; &gt; frames and sets the tracing in them).<br/>
&gt; &gt; So, I&#39;d like to check how feasible it&#39;d be to have this support in Jython.<br/>
&gt; &gt; Thanks,<br/>
&gt; &gt; Fabio<br/>
&gt; &gt; ------------------------------------------------------------------------------<br/>
&gt; &gt; Check out the vibrant tech community on one of the world&#39;s most<br/>
&gt; &gt; engaging tech sites, Slashdot.org!<br/>
&gt; &gt; <a href="http://sdm.link/slashdot_______________________________________________" target="_blank">http://sdm.link/slashdot_______________________________________________</a><br/>
&gt; &gt; Jython-dev mailing list <a href="mailto:Jyt...@li..." onclick="parent.window.location.href=&#39;Jyt...@li...&#39;; return false;" target="_blank">Jyt...@li...</a><br/>
&gt; &gt; <a href="https://lists.sourceforge.net/lists/listinfo/jython-dev" target="_blank">https://lists.sourceforge.net/lists/listinfo/jython-dev</a><br/>
&gt; &gt;<br/>
&gt; &gt;<br/>
&gt; &gt; ------------------------------------------------------------------------------<br/>
&gt; &gt; Check out the vibrant tech community on one of the world&#39;s most<br/>
&gt; &gt; engaging tech sites, Slashdot.org! <a href="http://sdm.link/slashdot" target="_blank">http://sdm.link/slashdot</a><br/>
&gt; &gt;<br/>
&gt; &gt;<br/>
&gt; &gt; _______________________________________________<br/>
&gt; &gt; Jython-dev mailing list<br/>
&gt; &gt; <a href="mailto:Jyt...@li..." onclick="parent.window.location.href=&#39;Jyt...@li...&#39;; return false;" target="_blank">Jyt...@li...</a><br/>
&gt; &gt; <a href="https://lists.sourceforge.net/lists/listinfo/jython-dev" target="_blank">https://lists.sourceforge.net/lists/listinfo/jython-dev</a><br/>
&gt;<br/>
&gt;<br/>
&gt; ------------------------------------------------------------------------------<br/>
&gt; Check out the vibrant tech community on one of the world&#39;s most<br/>
&gt; engaging tech sites, Slashdot.org! <a href="http://sdm.link/slashdot" target="_blank">http://sdm.link/slashdot</a><br/>
&gt; _______________________________________________<br/>
&gt; Jython-dev mailing list<br/>
&gt; <a href="mailto:Jyt...@li..." onclick="parent.window.location.href=&#39;Jyt...@li...&#39;; return false;" target="_blank">Jyt...@li...</a><br/>
&gt; <a href="https://lists.sourceforge.net/lists/listinfo/jython-dev" target="_blank">https://lists.sourceforge.net/lists/listinfo/jython-dev</a><br/>
&gt;<br/>
<br/>
------------------------------------------------------------------------------<br/>
Check out the vibrant tech community on one of the world&#39;s most<br/>
engaging tech sites, Slashdot.org! <a href="http://sdm.link/slashdot" target="_blank">http://sdm.link/slashdot</a><br/>
_______________________________________________<br/>
Jython-dev mailing list<br/>
<a href="mailto:Jyt...@li..." onclick="parent.window.location.href=&#39;Jyt...@li...&#39;; return false;" target="_blank">Jyt...@li...</a><br/>
<a href="https://lists.sourceforge.net/lists/listinfo/jython-dev" target="_blank">https://lists.sourceforge.net/lists/listinfo/jython-dev</a></div>
</div>
</blockquote>
</div>
</div>
------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world&#39;s most engaging tech sites, Slashdot.org! <a href="http://sdm.link/slashdot_______________________________________________" target="_blank">http://sdm.link/slashdot_______________________________________________</a> Jython-dev mailing list Jyt...@li... <a href="https://lists.sourceforge.net/lists/listinfo/jython-dev" target="_blank">https://lists.sourceforge.net/lists/listinfo/jython-dev</a></div>
</div>
</div>
</div></div></body></html>

Re: [Jython-dev] Support for sys._current_frames

[Fabio Z. <fa...@gm...>]

Thank you all for the comments.

Given the sample code, I was able to implement a replacement in PyDev, in
pure-Python, while Jython itself provides no sys._current_frames (given
that it seems simple to implement, it'd be nice to have this in a Jython
release sooner rather than later, as my implementation replacement has to
access a private attribute -- which is different from the latest 2.7.0 in
the downloads to the current development version -- and it'll probably stop
working as Jython itself moves forward.

@Stefan: Regarding having None frames, I think that this shouldn't be
allowed (not that I couldn't change PyDev to deal with it, but this is not
the behavior CPython gives, so, I think the return should be protected to
disallow None values -- there are other uses for sys._current_frames, for
instance, on PyVmMonitor I use it to gather stack information, and I bet
there are other uses out there which wouldn't protect from receiving a None
there).

The pure-python replacement I'm using if sys._current_frames is not found
is below (may also be seen at:
https://github.com/fabioz/PyDev.Debugger/commit/a4a58179dab9f9fb93559066f0ef22ac59c59e04
).

Thanks,

Fabio

from java.lang import NoSuchFieldException
from org.python.core import ThreadStateMapping
try:
    cachedThreadState =
ThreadStateMapping.getDeclaredField('globalThreadStates') # Dev version
except NoSuchFieldException:
    cachedThreadState =
ThreadStateMapping.getDeclaredField('cachedThreadState') # Release Jython
2.7.0
cachedThreadState.accessible = True
thread_states = cachedThreadState.get(ThreadStateMapping)

def _current_frames():
    as_array = thread_states.entrySet().toArray()
    ret = {}
    for thread_to_state in as_array:
        thread = thread_to_state.getKey()
        if thread is None:
            continue
        thread_state = thread_to_state.getValue()
        if thread_state is None:
            continue

        frame = thread_state.frame
        if frame is None:
            continue

        ret[thread.getId()] = frame
    return ret


On Wed, Mar 29, 2017 at 6:08 PM, Stefan Richthofer <Ste...@gm...
> wrote:

> > Your elements array should be twice as long, I think?
> Obviously it should ;)
>
> Agreed on all points. I just tested the implementation and observed that
> an entry in globalThreadStates yields a null-PyFrame. How should we deal
> with that?
>
> a) Is it a bug and we should investigate how it can be null and solve it?
> b) set the frame to None in result of _current_frames
> c) skip such elements and let _current_frames only return a reduced dict?
>
> @Fabio regarding b), would PyDev be robust against None-values here?
>
> Despite this, the result looks rather much like in CPython.
>
>
> > Gesendet: Mittwoch, 29. März 2017 um 22:04 Uhr
> > Von: "Jeff Allen" <ja...@fa...>
> > An: jyt...@li...
> > Betreff: Re: [Jython-dev] Support for sys._current_frames
> >
> > This seems to be a faithful equivalent to the CPython implementation.
> > That is wrapped in a synchronisation construct, but globalThreadStates
> > is of a thread-safe class, I see. However, as the number of threads
> > might change between the call to size() and the call to toArray(), I
> > think it would be better to let toArray() always allocate the array
> > (i.e. give it a zero-length prototype).
> >
> > Your elements array should be twice as long, I think?
> >
> > The way we manage ThreadState and interpreters leaves me uneasy, but
> > that's not a criticism against this proposal, except for the risk of
> > change when the penny finally drops.
> >
> > Oh, and thanks to Fabio for continuing to support Jython in PyDev.
> >
> > Jeff Allen
> >
> > On 29/03/2017 17:30, Stefan Richthofer wrote:
> > > I suggest this could be implemented in ThreadStateMapping like this:
> > > (on top of that an implementation in PySystemState is straight forward)
> > >     public static PyObject _current_frames() {
> > >         @SuppressWarnings("unchecked")
> > >         Map.Entry<Thread, ThreadState>[] entries = new
> > > Map.Entry[globalThreadStates.size()];
> > >         entries = globalThreadStates.entrySet().toArray(entries);
> > >         PyObject elements[] = new PyObject[entries.length];
> > >         int pos = 0;
> > >         for (Map.Entry<Thread, ThreadState> entry: entries) {
> > >             elements[pos++] = Py.newInteger(entry.getKey().getId());
> > >             elements[pos++] = entry.getValue().frame;
> > >         }
> > >         return new PyDictionary(elements);
> > >     }
> > > Opinions?
> > > -Stefan
> > > *Gesendet:* Mittwoch, 29. März 2017 um 17:30 Uhr
> > > *Von:* "Fabio Zadrozny" <fa...@gm...>
> > > *An:* "Jython Developers" <jyt...@li...>
> > > *Betreff:* [Jython-dev] Support for sys._current_frames
> > > Hi Jython devs,
> > > I've just updated the PyDev debugger to drop support for older Python
> > > versions and it seems I ended up breaking debugging in the current
> > > Jython version because of it...
> > > The issue is that PyDev now requires sys._current_frames to be
> > > implemented by the interpreter (available since Python 2.5), but it
> > > seems this is not available for Jython -- this is needed so that the
> > > debugger can be faster (i.e.: it runs with untraced frames until some
> > > breakpoint is actually added -- at that point it gets the current
> > > frames and sets the tracing in them).
> > > So, I'd like to check how feasible it'd be to have this support in
> Jython.
> > > Thanks,
> > > Fabio
> > > ------------------------------------------------------------
> ------------------
> > > Check out the vibrant tech community on one of the world's most
> > > engaging tech sites, Slashdot.org!
> > > http://sdm.link/slashdot____________________________________
> ___________
> > > Jython-dev mailing list Jyt...@li...
> > > https://lists.sourceforge.net/lists/listinfo/jython-dev
> > >
> > >
> > > ------------------------------------------------------------
> ------------------
> > > Check out the vibrant tech community on one of the world's most
> > > engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> > >
> > >
> > > _______________________________________________
> > > Jython-dev mailing list
> > > Jyt...@li...
> > > https://lists.sourceforge.net/lists/listinfo/jython-dev
> >
> >
> > ------------------------------------------------------------
> ------------------
> > Check out the vibrant tech community on one of the world's most
> > engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> > _______________________________________________
> > Jython-dev mailing list
> > Jyt...@li...
> > https://lists.sourceforge.net/lists/listinfo/jython-dev
> >
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Jython-dev mailing list
> Jyt...@li...
> https://lists.sourceforge.net/lists/listinfo/jython-dev
>

Re: [Jython-dev] AArch64 support

[Andrew H. <ap...@re...>]

On 30/03/17 15:33, Stefan Richthofer wrote:
> Andrew, thanks for checking this out!
> Adding jffi-aarch64-Linux.jar sounds reasonable to me.
> You will have to edit build.xml somewhere right after line 592
> appropriately. Maybe there are more spots to adjust, I cannot
> tell right now. I suggest to try adding the jar and editing
> build.xml; if it doesn't work, I'd recommend to file an issue
> at bugs.jython.org, so we can keep track and discuss further
> steps there.

That seems to have mostly fixed things, but Mercurial doesn't work:
having said that, I don't know if Mercurial should work with jython
and jdk8.  I can't think of any reason why not, but

I ran the tests, and all is mostly cool up to here:

clean_py_class_files:

init:
    [mkdir] Created dir: /home/aph/jython/tests/modjy/build

do_test:
     [echo] Running tests against JDK 1.5, Servlet j2ee1.3
    [javac] /home/aph/jython/tests/modjy/build.xml:59: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
    [javac] Compiling 13 source files to /home/aph/jython/tests/modjy/build
     [java] .E.............F.....E....................E..
     [java] .............E....E................E...E....E.
     [java] ................E..E.........
     [java] Time: 108.483
     [java] There were 10 errors:
     [java] 1) testHelloWorld(com.xhaus.modjy.ModjyTestBase)java.lang.NoClassDefFoundError: org/w3c/dom/ElementTraversal
     [java]     at java.lang.ClassLoader.defineClass1(Native Method)
     [java]     at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
     [java]     at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
     ...

I guess this means that the testsuite wants jaxp to be installed
somewhere.  But I have no idea where.

Andrew.

Re: [Jython-dev] AArch64 support

[Stefan R. <Ste...@gm...>]

Andrew, thanks for checking this out!
Adding jffi-aarch64-Linux.jar sounds reasonable to me.
You will have to edit build.xml somewhere right after line 592
appropriately. Maybe there are more spots to adjust, I cannot
tell right now. I suggest to try adding the jar and editing
build.xml; if it doesn't work, I'd recommend to file an issue
at bugs.jython.org, so we can keep track and discuss further
steps there.

-Stefan

> Gesendet: Donnerstag, 30. März 2017 um 15:13 Uhr
> Von: "Andrew Haley" <ap...@re...>
> An: jyt...@li...
> Betreff: Re: [Jython-dev] AArch64 support
>
> On 30/03/17 13:31, Andrew Haley wrote:
> > Do I need to do anything more than simply copy
> > jffi-i386-Linux.jar into extlibs? 
> 
> Err, jffi-aarch64-Linux.jar  :-)
> 
> Andrew.
> 
> 
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Jython-dev mailing list
> Jyt...@li...
> https://lists.sourceforge.net/lists/listinfo/jython-dev
>

Re: [Jython-dev] AArch64 support

[Andrew H. <ap...@re...>]

On 30/03/17 13:31, Andrew Haley wrote:
> Do I need to do anything more than simply copy
> jffi-i386-Linux.jar into extlibs? 

Err, jffi-aarch64-Linux.jar  :-)

Andrew.