jython-bugs — Private bug notification list. Do not post to this list.

[Jython-bugs] [issue2878] java.lang.OutOfMemoryError: Java heap space

[wang <re...@bu...>]

New submission from wang <hao...@16...>:

C:\Users\86176>jython -m pip install -i https://pypi.tuna.tsinghua.edu.cn/simple synonyms
DEPRECATION: A future version of pip will drop support for Python 2.7.
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting synonyms
[?25l  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/3e/47/065b8f34aad7bbf34447df72e4188a5ac6ae7106af5e2f91f5a0ed33f4e0/synonyms-3.10.2.tar.gz (54.5MB)
     |████████████████████████████████| 54.5MB 487kB/s eta 0:00:01D:\learn\jython2.7.2\Lib\_io.py:334: RuntimeWarning: PyTableCode.call caught a Throwable that is not an Exception:
java.lang.OutOfMemoryError: Java heap space
Jython internals might be in a bad state now that can cause deadlocks later on.
See http://bugs.jython.org/issue2536 for details.
  return bytes(self._buffer)
WARNING: You are using pip version 19.1, however version 20.0.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Traceback (most recent call last):
  File "D:\learn\jython2.7.2\Lib\runpy.py", line 161, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "D:\learn\jython2.7.2\Lib\runpy.py", line 72, in _run_code
    exec code in run_globals
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\__main__.py", line 19, in <module>
    sys.exit(_main())
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\__init__.py", line 78, in main
    return command.main(cmd_args)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\cli\base_command.py", line 178, in main
    status = self.run(options, args)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\cli\base_command.py", line 178, in main
    status = self.run(options, args)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\commands\install.py", line 352, in run
    resolver.resolve(requirement_set)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\commands\install.py", line 352, in run
    resolver.resolve(requirement_set)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\resolve.py", line 130, in resolve
    discovered_reqs.extend(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\resolve.py", line 130, in resolve
    discovered_reqs.extend(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\resolve.py", line 294, in _resolve_one
    abstract_dist = self._get_abstract_dist_for(req_to_install)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\resolve.py", line 240, in _get_abstract_dist_for
    abstract_dist = self.preparer.prepare_linked_requirement(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\operations\prepare.py", line 349, in prepare_linked_requirement
    unpack_url(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\operations\prepare.py", line 349, in prepare_linked_requirement
    unpack_url(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 880, in unpack_url
    unpack_http_url(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 742, in unpack_http_url
    from_path, content_type = _download_http_url(link,
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 954, in _download_http_url
    _download_url(resp, link, content_file, hashes, progress_bar)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 683, in _download_url
    hashes.check_against_chunks(downloaded_chunks)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\utils\hashes.py", line 62, in check_against_chunks
    for chunk in chunks:
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 651, in written_chunks
    for chunk in chunks:
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\utils\ui.py", line 156, in iter
    for x in it:
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 616, in resp_read
    for chunk in resp.raw.stream(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_internal\download.py", line 616, in resp_read
    for chunk in resp.raw.stream(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\urllib3\response.py", line 494, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\urllib3\response.py", line 442, in read
    data = self._fp.read(amt)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\cachecontrol\filewrapper.py", line 65, in read
    self._close()
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\cachecontrol\filewrapper.py", line 52, in _close
    self.__callback(self.__buf.getvalue())
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\cachecontrol\controller.py", line 299, in cache_response
    self.cache.set(
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\cachecontrol\serialize.py", line 72, in dumps
    return b",".join([b"cc=4", msgpack.dumps(data, use_bin_type=True)])
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\msgpack\__init__.py", line 47, in packb
    return Packer(**kwargs).pack(o)
  File "D:\learn\jython2.7.2\Lib\site-packages\pip\_vendor\msgpack\fallback.py", line 858, in pack
    ret = self._buffer.getvalue()
  File "D:\learn\jython2.7.2\Lib\_io.py", line 334, in getvalue
    return bytes(self._buffer)
java.lang.OutOfMemoryError: Java heap space
        at org.python.core.BaseBytes.asString(BaseBytes.java:1121)
        at org.python.core.PyByteArray.bytearray_str(PyByteArray.java:2018)
        at org.python.core.PyByteArray.__str__(PyByteArray.java:2013)
        at org.python.core.PyString.str_new(PyString.java:172)
        at org.python.core.PyString$exposed___new__.new_impl(Unknown Source)
        at org.python.core.PyType.invokeNew(PyType.java:1119)
        at org.python.core.PyType.type___call__(PyType.java:2399)
        at org.python.core.PyType.__call__(PyType.java:2389)
        at org.python.core.PyObject.__call__(PyObject.java:461)
        at org.python.core.PyObject.__call__(PyObject.java:465)
        at _io$py.getvalue$32(D:/learn/jython2.7.2/Lib/_io.py:334)
        at _io$py.call_function(D:/learn/jython2.7.2/Lib/_io.py)
        at org.python.core.PyTableCode.call(PyTableCode.java:173)
        at org.python.core.PyBaseCode.call(PyBaseCode.java:134)
        at org.python.core.PyFunction.__call__(PyFunction.java:416)
        at org.python.core.PyMethod.__call__(PyMethod.java:126)
        at pip._vendor.msgpack.fallback$py.pack$34(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\msgpack\fallback.py:863)
        at pip._vendor.msgpack.fallback$py.call_function(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\msgpack\fallback.py)
        at org.python.core.PyTableCode.call(PyTableCode.java:173)
        at org.python.core.PyBaseCode.call(PyBaseCode.java:150)
        at org.python.core.PyFunction.__call__(PyFunction.java:426)
        at org.python.core.PyMethod.__call__(PyMethod.java:141)
        at pip._vendor.msgpack$py.packb$4(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\msgpack\__init__.py:47)
        at pip._vendor.msgpack$py.call_function(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\msgpack\__init__.py)
        at org.python.core.PyTableCode.call(PyTableCode.java:173)
        at org.python.core.PyBaseCode.call(PyBaseCode.java:306)
        at org.python.core.PyFunction.function___call__(PyFunction.java:474)
        at org.python.core.PyFunction.__call__(PyFunction.java:469)
        at pip._vendor.cachecontrol.serialize$py.dumps$4(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\cachecontrol\serialize.py:72)
        at pip._vendor.cachecontrol.serialize$py.call_function(C:\Users\86176\AppData\Local\Temp\pip-install-7tzluu\pip\pip\_vendor\cachecontrol\serialize.py)
        at org.python.core.PyTableCode.call(PyTableCode.java:173)
        at org.python.core.PyBaseCode.call(PyBaseCode.java:306)
java.lang.OutOfMemoryError: java.lang.OutOfMemoryError: Java heap space

----------
components: None
messages: 13030
milestone: Jython 2.7.2
nosy: hao...@16...
severity: normal
status: open
title: java.lang.OutOfMemoryError: Java heap space
type: behaviour
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2878>
_______________________________________

[Jython-bugs] [issue2876] Null pointer exception PyModule.java

[Sunil <re...@bu...>]

New submission from Sunil <sun...@gm...>:

I am trying to integrate jython in my spring boot project. It is working for me in with Intellij but when I deploy jar for testing I keep getting null pointer exception from the library.

I am using java 8.

Exception:
java.lang.NullPointerException: null
at org.python.core.PyModule.module___init__(PyModule.java:64) ~[jython-standalone-2.7.2.jar!\/:2.7.2]
at org.python.core.PyModule.<init>(PyModule.java:47) ~[jython-standalone-2.7.2.jar!\/:2.7.2]
at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:104) ~[jython-standalone-2.7.2.jar!\/:2.7.2]
at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:93) ~[jython-standalone-2.7.2.jar!\/:2.7.2]
at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:70)


JythonFactoryFile:
public class JythonObjectFactory {
    private static JythonObjectFactory instance = null;
    private static PyObject pyObject = null;

    protected JythonObjectFactory() {
    }

    public static JythonObjectFactory getInstance(){
        if(instance == null){
            instance = new JythonObjectFactory();
        }

        return instance;
    }

    public Object createObject(Object interfaceType, String moduleName){
        Object javaInt = null;
        PythonInterpreter interpreter = new PythonInterpreter();
        interpreter.exec("from " + moduleName + " import " + moduleName);

        pyObject = interpreter.get(moduleName);

        try {

            PyObject newObj = pyObject.__call__();

            javaInt = newObj.__tojava__(Class.forName(interfaceType.toString().substring(
                    interfaceType.toString().indexOf(" ")+1, interfaceType.toString().length())));
        } catch (ClassNotFoundException ex) {
            log.error(JythonObjectFactory.class.getName() + " error: " + ex.getMessage(), ex);
        }

        return javaInt;
    }
}

----------
components: Library
messages: 13028
nosy: Sunil1993
severity: urgent
status: open
title: Null pointer exception PyModule.java
type: behaviour
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2876>
_______________________________________

[Jython-bugs] [issue2874] EBCDIC endo

[Gil <re...@bu...>]

New submission from Gil <gcr...@us...>:

Hi,

We're trying to debug an issue with Jython 2.7 in z/OS. 
To recreate, we use 2 files
test.py file has:
======
import sys

sys.setdefaultencoding('ascii')

import test2
======


The test2.py file has:
========
import sys

sys.setdefaultencoding('ascii')

print "I am test2 file"
=======

When executing test.py, we get the following error:

com.ibm.bsf.BSFException: exception from Jython:
Traceback (most recent call last):
File "<string>", line 1, in <module>
SyntaxError: Non-ASCII character in file '/local/bvt/bvt_was/test2.py',
but no encoding declared; see http://www.python.org/peps/pep-0263.html

We've tried executing with "script.encoding=Cp1047" added but that still fails with the above exception. For what it's worth, it seems to work when we use Jython 2.1. Is there we're missing on this? Or is this a bug (or change of behavior) with how encoding works in version 2.7?

Thanks!

----------
components: Core
messages: 13026
nosy: Rodriguez
severity: normal
status: open
title: EBCDIC endo
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2874>
_______________________________________

[Jython-bugs] [issue2872] -m option does not search modules from current directory

[rad164 <re...@bu...>]

Change by rad164 <rad164@teapot-lab.space>:


----------
nosy: rad164
severity: normal
status: open
title: -m option does not search modules from current directory
type: behaviour
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2872>
_______________________________________

[Jython-bugs] [issue2870] PrePy.getJarFileNameFromURL fails hard when Jython jar is embedded in another jar

[Maku <re...@bu...>]

Change by Maku <mar...@fl...>:


----------
components: Core
milestone: Jython 2.7.2
nosy: maku
severity: major
status: open
title: PrePy.getJarFileNameFromURL fails hard when Jython jar is embedded in another jar
type: crash
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2870>
_______________________________________

[Jython-bugs] [issue2868] Value of `sys.stdout.encoding` changed in some cases on Windows

[Pekka K. <re...@bu...>]

New submission from Pekka Klärck <pe...@ik...>:

While running our projects acceptance tests with Jython 2.7.2rc1 we noticed that the value of `sys.stdout.encoding` is different to what it was with earlier versions if using Windows, the current code page is different to the default code page, and stdout is redirected.

For example, on my Windows machine the default code page is 850 and by default the output of both of these commands is cp850:

  jython -c "import sys; print sys.stdout.encoding"
  jython -c "import sys; print sys.stdout.encoding"  > out.txt

If I change the code page to 437 with `chcp 437`, then the first command above correctly prints cp437  but output of the latter is cp850. With earlier Jython versions the result was cp437 in both cases.

It seems that when output is redirected, `sys.stdout.encoding` always returns the system wide code page when it should return the code page the console is using. We actually had a similar bug in our code base and there the problem was that we used Windows API function GetOEMCP when we should have used GetConsoleOutputCP.

----------
messages: 13010
nosy: pekka.klarck
severity: normal
status: open
title: Value of `sys.stdout.encoding` changed in some cases on Windows

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2868>
_______________________________________

[Jython-bugs] [issue2866] Interface default methods disregarded by the method resolver

[Nicolas F. <re...@bu...>]

New submission from Nicolas Falliere <ni...@pn...>:

Per https://www.jython.org/jython-old-sites/archive/221/archive/22/userguide.html#overloaded-java-method-signatures: "Java methods are allowed to be overloaded for different signatures (types and number of arguments). When different versions of the method differ in the number of arguments that they expect, the appropriate method can be easily determined from the number of arguments passed to the method."

With Jyhon 2.7 (2.7.1, and the current RC of 2.7.2 as well), this works fine for regular class methods, eg:
class A {
  void f(int a) {
    return a + 1;
  }
  void f(int a, int b) {
    return a+b;
  }
}

in Jython:
A().f(4)     # will select the proper overload
A().f(1, 2)  # will select the proper overload  

However, for interfaces:
interface I {
  default void f(int a) {
    return f(a, 1);
  }
  void f(int a, int b);
}
class A implements I {
  void f(int a, int b) {
    return a+b;
  }
}

in Jython:
x = someMethodReturningAnObjectImplementingI()
x.f(4)     # fail, complains that method should receive 2 args

So it looks like default methods, a language addition of Java 8, may not be seen by the Jython interpreter. Any chance to get that added in a future 2.7.x maintenance release?

----------
components: Core
messages: 13008
nosy: nfalliere
severity: normal
status: open
title: Interface default methods disregarded by the method resolver
type: behaviour

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2866>
_______________________________________

[Jython-bugs] [issue2864] Importing second instance of httplib causes an error

[rses <re...@bu...>]

New submission from rses <rs...@ex...>:

I seem to have a very odd issue. If I use two PythonInterpreters to make two calls into httplib, the second invocation causes an error:

The Java usage of PythonInterpreter is:

    public static void main(String[] args) {
        try {
            PythonInterpreter pythonInterpreter = new PythonInterpreter();
            pythonInterpreter.exec("import httplib");
            pythonInterpreter.exec("print 'first invocation'");
            pythonInterpreter.exec("con = httplib.HTTPSConnection('slack.com')");
            pythonInterpreter.exec("con.request('GET', '/intl/en-gb/?eu_nc=1')");
            pythonInterpreter.close();

            pythonInterpreter = new PythonInterpreter();
            pythonInterpreter.exec("import httplib");
            pythonInterpreter.exec("print 'second invocation'");
            pythonInterpreter.exec("con = httplib.HTTPSConnection('slack.com')");
            pythonInterpreter.exec("con.request('GET', '/intl/en-gb/?eu_nc=1')");
            pythonInterpreter.close();
        } catch (Exception e) {
            System.out.println("Failed:");
            e.printStackTrace();
        }
    }


Results in:

first invocation
second invocation
org.python.netty.channel.AbstractChannel WARNING Force-closing a channel whose registration task was not accepted by an event loop: [id: 0x584e978d]
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 1042, in request
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 1082, in _send_request
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 1038, in endheaders
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 882, in _send_output
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 844, in send
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 1255, in connect
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/httplib$py.class", line 820, in connect
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/_socket$py.class", line 1581, in create_connection
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/_socket$py.class", line 1581, in create_connection
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/_socket$py.class", line 1457, in meth
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/_socket$py.class", line 951, in connect
  File "/home/rs/.m2/repository/org/python/jython-standalone/2.7.2rc1/jython-standalone-2.7.2rc1.jar/Lib/_socket$py.class", line 919, in _connect
	at org.python.netty.util.concurrent.SingleThreadEventExecutor.reject(SingleThreadEventExecutor.java:926)
	at org.python.netty.util.concurrent.SingleThreadEventExecutor.offerTask(SingleThreadEventExecutor.java:353)
	at org.python.netty.util.concurrent.SingleThreadEventExecutor.addTask(SingleThreadEventExecutor.java:346)
	at org.python.netty.util.concurrent.SingleThreadEventExecutor.execute(SingleThreadEventExecutor.java:828)
	at org.python.netty.util.concurrent.SingleThreadEventExecutor.execute(SingleThreadEventExecutor.java:818)
	at org.python.netty.channel.AbstractChannel$AbstractUnsafe.register(AbstractChannel.java:471)
	at org.python.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:87)
	at org.python.netty.channel.SingleThreadEventLoop.register(SingleThreadEventLoop.java:81)
	at org.python.netty.channel.MultithreadEventLoopGroup.register(MultithreadEventLoopGroup.java:86)
	at org.python.netty.bootstrap.AbstractBootstrap.initAndRegister(AbstractBootstrap.java:315)
	at org.python.netty.bootstrap.AbstractBootstrap.doBind(AbstractBootstrap.java:264)
	at org.python.netty.bootstrap.AbstractBootstrap.bind(AbstractBootstrap.java:260)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
java.util.concurrent.RejectedExecutionException: java.util.concurrent.RejectedExecutionException: event executor terminated
Failed:

Essentially, the second call to 'con.request()' results in the exception: java.util.concurrent.RejectedExecutionException: java.util.concurrent.RejectedExecutionException: event executor terminated


Can someone help me please?

----------
components: Core
messages: 13006
nosy: rses
severity: normal
status: open
title: Importing second instance of httplib causes an error
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2864>
_______________________________________

[Jython-bugs] [issue2862] Jython fails on Linux for normal user when installed by root

[Roland W. <re...@bu...>]

New submission from Roland Walter <rol...@gm...>:

OS: RHEL 7, openSUSE 15.1
Java 1.8.0 

I created a snapshot installer build on 2020-02-05. I used that to install jython in /usr/local/jython2.7.2b3-rwalter20200205.

Calling jython as root works. Calling jython as user roland fails with

Exception in thread "main" 
Exception: org.python.core.PyException thrown from the UncaughtExceptionHandler in thread "main"

A workaround is to remove all *$py.class files from the Lib directory of the jython installation.

This error was not there in snapshot builds before 2020-01-20.

----------
components: Core
messages: 12986
nosy: r_walter
severity: normal
status: open
title: Jython fails on Linux for normal user when installed by root
versions: Jython 2.7.3

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2862>
_______________________________________

[Jython-bugs] [issue2860] from some_java_lib import * does not import all names

[Gunter <re...@bu...>]

New submission from Gunter <gu...@ba...>:

For some imports like this

from javax.xml.parsers import *

not all names are imported.

With jython 2.7.1 it worked and 

DocumentBuilderFactory

was available.

With jython2.7.2 it is not in my context.

I will try to add code to reproduce since on the REPL this works fine in 2.7.2

----------
components: Core
messages: 12978
nosy: gbach
severity: normal
status: open
title: from some_java_lib import * does not import all names
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2860>
_______________________________________

[Jython-bugs] [issue2858] test_ssl failure due to shading Bouncy Castle JAR

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

In a newly-installed v2.7.2b2 or b3, test_ssl fails like this:

test test_ssl_jy failed -- Traceback (most recent call last):
  File "...\inst\Lib\test\test_ssl.py", line 940, in test_load_cert_chain
    ctx.load_cert_chain(CERTFILE_PROTECTED, password=KEY_PASSWORD)

  ...

  File "...\inst\Lib\_sslcerts.py", line 281, in _read_pem_cert_from_data
    key_pair = key_converter.getKeyPair(obj.decryptKeyPair(provider))
PEMException: org.python.bouncycastle.openssl.PEMException: Unable to create OpenSSL PBDKF: PBKDF-OpenSSL SecretKeyFactory not available


This does not happen in the development configuration, nor if I introduce the Bouncy Castle JARs to the class path. It began after upgrading the JARs.

It seems likely the cause is the shading of the JAR that we do when embedding it in jython.jar during the Ant build. We do not do this shading to all the JARs we depend on. Some we name-translate:

    org/python/apache/commons/compress
    org/python/bouncycastle

And some we just copy:

    com/ziclix/python/sql
    jnr/ffi

Options appear to be:

1. hope the cause is within our library and fix it. (But maybe it is a BC feature?)
2. include the library unshaded. (Not known if this would be a problem.)

----------
components: Library
keywords: test failure causes
messages: 12972
milestone: Jython 2.7.2
nosy: jeff.allen
priority: high
severity: normal
status: open
title: test_ssl failure due to shading Bouncy Castle JAR
type: crash
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2858>
_______________________________________

[Jython-bugs] [issue2856] WARNING: An illegal reflective access operation has occurred

[SAROJ P. <re...@bu...>]

New submission from SAROJ PANDA <sar...@gm...>:

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/C:/STFX/Tutoring/CS%20128/Jython%20Installer/jython2.7.1/jython.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Jython 2.7.1 (default:0df7adb1b397, Jun 30 2017, 19:02:43)
[Java HotSpot(TM) 64-Bit Server VM (Oracle Corporation)] on java11.0.2
Type "help", "copyright", "credits" or "license" for more information.

----------
components: Jythonc compiler
messages: 12932
nosy: panda
severity: normal
status: open
title: WARNING: An illegal reflective access operation has occurred
type: behaviour
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2856>
_______________________________________

[Jython-bugs] [issue2854] from module import * leads to wild goose chase

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

I noticed when tracing through the statement:

from javax.swing.text.Utilities import *

that once having found (created) the module (a PyJavaType) for "javax.swing.text.Utilities" the thread dives into org.python.core.imp.importAll(PyObject, PyFrame) to populate the locals of the frame with the attributes of the module. So far, so good.

A couple of things are worthy of question:

1. module.__dir__() involves (what seems to be) an inordinately repetitive traversal through the bases (and bases of bases) of the class to collect the names: why not just the MRO?

2. For every name collected in step 1, and not starting "_", we call module.__findattr__(sname), which may return null. (How often?) The first example is attribute "class" (a bean accessor from java.lang.Object.getClass()). __findattr__("class") returns null, and this triggers a call to __builtin__.__import__(), here to look for a module called "Utilities.class" with default (level=-1) semantics. This involves looking in quite a few places, twice.


Parking my suspicions here for later investigation.

----------
components: Core
messages: 12906
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: from module import * leads to wild goose chase
type: behaviour
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2854>
_______________________________________

[Jython-bugs] [issue2852] Unable to import requests module in Jython

[yogita <re...@bu...>]

New submission from yogita <yog...@gm...>:

Hi Team,

I want to import requests, json module in my java code .
I have installed Jpython on unix & also installed requests module as well .
My code is like :
pythonInterp.exec("sys.path.append(\"/home/ec2-user/yogita/jpython/Lib/site-packages\")");
		pythonInterp.exec("print (sys.path)");
		pythonInterp.exec("import requests");

And output is like 
['/home/ec2-user/yogita/jpython/Lib', '/home/ec2-user/yogita/jpython/Lib', '__classpath__', '__pyclasspath__/', '/home/ec2-user/yogita/jpython/Lib/site-packages', '/home/ec2-user/yogita/jpython/Lib/site-packages']
Exception while importing python module: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named requests
 

/home/ec2-user/yogita/jpython/Lib/site-packages
[ec2-user@ip-10-111-111-111 site-packages]$ ll
total 80
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:25 certifi
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:25 certifi-2019.11.28.dist-info
drwxrwxr-x  3 ec2-user ec2-user 4096 Dec 18 11:25 chardet
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:25 chardet-3.0.4.dist-info
-rw-rw-r--  1 ec2-user ec2-user  126 Dec 18 08:59 easy_install.py
-rw-rw-r--  1 ec2-user ec2-user 2901 Dec 18 08:59 easy_install$py.class
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:25 idna
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:25 idna-2.8.dist-info
drwxrwxr-x 10 ec2-user ec2-user 4096 Dec 18 08:59 pip
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 08:59 pip-9.0.1.dist-info
drwxrwxr-x  4 ec2-user ec2-user 4096 Dec 18 08:59 pkg_resources
-rw-rw-r--  1 ec2-user ec2-user  119 Jun 30  2017 README
drwxrwxr-x  2 ec2-user ec2-user 4096 Dec 18 11:26 requests

----------
components: Library
messages: 12854
milestone: Jython 2.7.1
nosy: Vikhe
severity: urgent
status: open
title: Unable to import requests module in Jython
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2852>
_______________________________________

[Jython-bugs] [issue2850] Exception while creating python interpreter

[yogita <re...@bu...>]

New submission from yogita <yog...@gm...>:

Hi Team,

I am using Jpython standalone jar to execute webapp on benstalk But its giving me error :

Exception while creating python interpreter: ImportError: Cannot import site module and its dependencies: No module named site
Determine if the following attributes are correct:
  * sys.path: [/var/app/current/BOOT-INF/lib/jython-standalone-2.7.1.jar/Lib, __classpath__, __pyclasspath__/]
    This attribute might be including the wrong directories, such as from CPython
  * sys.prefix: /var/app/current/BOOT-INF/lib/jython-standalone-2.7.1.jar
    This attribute is set by the system property python.home, although it can
    be often automatically determined by the location of the Jython jar file

You can use the -S option or python.import.site=false to not import the site module
:
Please find my code :

PythonInterpreter pythonInterp = null;

		PyObject x = null;



		

	    try{

	            Properties p = new Properties();

	            p.setProperty("python.path", "/lib/jython-standalone-2.7.1.jar");
PythonInterpreter.initialize(System.getProperties(), p, new String[] {});

	            pythonInterp = new PythonInterpreter();

	    }catch(Exception ex){

	        System.out.println("Exception while creating python interpreter: "+ex.toString());

	        ex.printStackTrace();

	    }

		System.out.println("Initialed PythonInterpreter in... ");

		

		pythonInterp.exec("print 'Hello Yogita '");

I check by benstalk app .the Jar is at BOOT-INF/lib/jython-standalone-2.7.1.jar &

----------
components: Library
messages: 12852
milestone: Jython 2.7.1
nosy: Vikhe
severity: urgent
status: open
title: Exception while creating python interpreter
type: behaviour
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2850>
_______________________________________

[Jython-bugs] [issue2848] Inconsistent results under concurrency in org.w3c.dom

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

Raised by Gunter (gbach) as possible recurrence of #2487, but I think it is something else. See details there initially to reproduce. (We should transfer the key information here.)

----------
components: Core
messages: 12836
milestone: Jython 2.7.2
nosy: gbach, jeff.allen
priority: high
severity: normal
status: open
title: Inconsistent results under concurrency in org.w3c.dom
type: behaviour

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2848>
_______________________________________

[Jython-bugs] [issue2846] Wrong name of the top-level scope when running Jython under Java Scripting API

[A. G. <re...@bu...>]

New submission from A. Gobbo <ale...@ps...>:

Both in Jython 2.7.1 ands 2.7.2b2 the name of the top-level scope is wrong when running Jython under Java Scripting API.

If you execute:
   org.python.util.PythonInterpreter interp = new org.python.util.PythonInterpreter();
   interp.exec("print __name__");

You get the familiar:
   __main__

However, executing: 
   javax.script.ScriptEngine engine = new javax.script.ScriptEngineManager().getEngineByName("python");
   engine.eval("print __name__");
You get:
   __builtin__

This creates of course a lot of problems. 
Many people do local workarounds like in their code:
  if __name__ in ['__builtin__', '__main__']:

I make a more global workaround to cope with code within libraries checking __name__. 
Just after initialising the engine I do:
   engine.put("__name__", "__main__");
   engine.eval("import sys");
   engine.eval("sys.modules['__main__']=sys.modules['__builtin__']"); 

This solve some issues, but not all. 
In particularly it is a show stopper for unittest, which does not work at all under Java Scripting API.


Note: This is an old bug, which has been reported in other places, but I didn't find it in bugs.jython:
   https://github.com/scijava/scripting-jython/issues/9
   https://forum.image.sc/t/jython-isssue-with-if---name-----main--/5544

----------
components: Core
messages: 12822
nosy: alexgobbo
severity: normal
status: open
title: Wrong name of the top-level scope when running Jython under Java Scripting API
type: behaviour
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2846>
_______________________________________

[Jython-bugs] [issue2844] PyServlet not working anymore

[Gunter <re...@bu...>]

New submission from Gunter <gu...@ba...>:

When updating a working webapplication from jython 2.7.1 to jython 2.7.2b2 (because of issue2487) it does not start anymore without any error or log-entry.
The container (tomcat 7) only tells me that the "Deployment of web application directory ... has finished" but the servlet is not setup.

I can reproduce this behaviour with the help of this guide: https://seanmcgrath.blogspot.com/JythonWebAppTutorialPart1.html.

I get:

HTTP Status 500 – Internal Server Error

Type Exception Report

Message Servlet.init() for servlet PyServlet threw exception

Description The server encountered an unexpected condition that prevented it from fulfilling the request.

Exception

javax.servlet.ServletException: Servlet.init() for servlet PyServlet threw exception
	org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:444)
	org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
	org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
	org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
	org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1137)
	org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
	org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:317)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	java.lang.Thread.run(Thread.java:748)

Root Cause

java.lang.NoClassDefFoundError: Could not initialize class org.python.core.PySystemState
	org.python.util.PyServlet.createInterpreter(PyServlet.java:123)
	org.python.util.PyServlet.reset(PyServlet.java:170)
	org.python.util.PyServlet.init(PyServlet.java:90)
	javax.servlet.GenericServlet.init(GenericServlet.java:158)
	org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:444)
	org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
	org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
	org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
	org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1137)
	org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
	org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:317)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	java.lang.Thread.run(Thread.java:748)

Note The full stack trace of the root cause is available in the server logs.
Apache Tomcat/7.0.96


----
Java is jdk-8u231-linux-x64
Tomcat is apache-tomcat-7.0.96
Jython is jython-installer-2.7.2b2

----------
components: Core
messages: 12820
nosy: gbach
severity: urgent
status: open
title: PyServlet not working anymore
type: crash
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2844>
_______________________________________

[Jython-bugs] [issue2842] Jython converts None to null when calling put(), but not when setting item with Python syntax

[doublep <re...@bu...>]

New submission from doublep <pog...@gm...>:

I'm not 100% sure it is a bug, but:

m = HashMap()
m.put (1, None) # => {1=null}

m = HashMap()
m[1] = None # => {1=None}

The latter of course causes exceptions when Java code bumps into a Jython object where it doesn't expect it.

Or is it intended that None is converted to null only when invoking a Java method?

----------
components: Core
messages: 12812
nosy: doublep
severity: normal
status: open
title: Jython converts None to null when calling put(), but not when setting item with Python syntax
type: behaviour
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2842>
_______________________________________

[Jython-bugs] [issue2840] smtplib.sendmail() does not work for mails bigger than 64 KiB

[Roland W. <re...@bu...>]

New submission from Roland Walter <r_w...@us...>:

I tried to send an email with jython 2.7.1 and jython 2.7.2b2 with the attached mytest_smtplib.py. The attached image is 85 KiB in size.
The OS is openSUSE Leap 15.1. The java version is 1.8.0_222.

The program fails with:

Traceback (most recent call last):
  File "mytest_smtplib.py", line 40, in <module>
    s.sendmail(sender, receiver, msg.as_string())
  File "/usr/local/jython2.7.1/Lib/smtplib.py", line 745, in sendmail
    self.rset()
  File "/usr/local/jython2.7.1/Lib/smtplib.py", line 469, in rset
    return self.docmd("rset")
  File "/usr/local/jython2.7.1/Lib/smtplib.py", line 393, in docmd
    self.putcmd(cmd, args)
  File "/usr/local/jython2.7.1/Lib/smtplib.py", line 341, in putcmd
    self.send(str)
  File "/usr/local/jython2.7.1/Lib/smtplib.py", line 331, in send
    raise SMTPServerDisconnected('Server not connected')
smtplib.SMTPServerDisconnected: Server not connected

The log of the postfix mailserver shows:

2019-11-25T15:15:58.762073+01:00 dios postfix/smtpd[14421]: connect from localhost[127.0.0.1]
2019-11-25T15:15:59.066917+01:00 dios postfix/smtpd[14421]: 104A2A08C1: client=localhost[127.0.0.1]
2019-11-25T15:15:59.126283+01:00 dios postfix/cleanup[14434]: 104A2A08C1: message-id=<201...@di...>
2019-11-25T15:20:59.227259+01:00 dios postfix/smtpd[14421]: timeout after DATA (65507 bytes) from localhost[127.0.0.1]
2019-11-25T15:20:59.227865+01:00 dios postfix/smtpd[14421]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=0/1 commands=3/4


But the same program works with python.

----------
components: Core, Library
files: mytest_smtplib.py
messages: 12796
nosy: r_walter
severity: normal
status: open
title: smtplib.sendmail() does not work for mails bigger than 64 KiB
type: crash
versions: Jython 2.7.1, Jython 2.7.2
Added file: https://bugs.jython.org/file1679/mytest_smtplib.py

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2840>
_______________________________________

[Jython-bugs] [issue2838] Java List and Python list semantic divergence

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

Benoit Cantin makes the following observation on 2.7.2b2:
"""
from java.util import ArrayList
test = ArrayList()
test.remove("aaa")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ValueError: aaa is not in list

The same code returns False with Jython 2.7b3 which is correct according to the documentation: https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/ArrayList.html#remove(java.lang.Object)

If I remember correctly, a teammate also found this bug in version 2.7.1.
"""

This (I suppose) is because we have given ArrayList some behaviour that is Python-like. We have noted in #2645 the  behaviour of LinkedList.pop(), which is surprising (to some) in that it removes from the opposite end from Python list.pop().

The idea that we dress Java containers as their Python near-equivalents is attractive because we will often be able to pass an object returned from Java directly to Python code expecting (say) a list. Unfortunately, it creates these surprises. If the receiving Python code expects pop() to work as advertised, it will get the wrong result. We have perhaps wrapped remove() in order that Python code doesn't malfunction that calls remove() expecting this behaviour of list.remove.

I think that an object claiming to have Java type should work as that type, and where we want it to behave as a Python list, it should be wrapped to do so, explicit being better than implicit here.

----------
components: Core
messages: 12790
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: Java List and Python list semantic divergence
type: behaviour
versions: Jython 2.7.1, Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2838>
_______________________________________

[Jython-bugs] [issue2836] Java Swing library works only in interactive jython session

[Roland W. <re...@bu...>]

New submission from Roland Walter <r_w...@us...>:

When calling the swing demo simple.py with jython 2.7.2b2 the window with the button stays only open when I call jython with the '-i' switch.

sys.version = '2.7.2b2 (v2.7.2b2:b9b60766cabe, Nov 1 2019, 07:46:45) \n[OpenJDK 64-Bit Server VM ()]'

OS is Windows 10 64 bit.
Java is OpenJDK 1.8.0_232 from ojdkbuild project on github.

----------
components: Core
messages: 12782
nosy: r_walter
severity: normal
status: open
title: Java Swing library works only in interactive jython session
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2836>
_______________________________________

[Jython-bugs] [issue2834] import of Java classes is not threadsafe, probably because of PyJavaType

[Martin G. <re...@bu...>]

New submission from Martin Ginkel <mar...@we...>:

We have short Jython scripts executed on multiple threads embedded in Java. Some of these import all methods from a Java class:
from x.y.z.AJavaClass import *

in multi-threaded executions this often fails because the PyJavaType for the class is still built on one Thread, while some other thread already accesses the PyJavaType and does not find necessary methods.

This is a regression from Jython 2.7.1, the scripts worked reliably on the old system.

----------
components: Core
messages: 12780
nosy: FraOrolo
severity: critical
status: open
title: import of Java classes is not threadsafe, probably because of PyJavaType
type: crash
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2834>
_______________________________________

[Jython-bugs] [issue2832] Regression error on module import

[Ruud v. d. B. <re...@bu...>]

New submission from Ruud van den Brink <ru...@si...>:

There seems to be something broken with file handling in modules; below I isolated the problem:
 - create a subfolder 'test'
 - in the folder test, touch an __init__.py 
 - in the folder test, create a file 'trial.py' with the following contents:

from __future__ import print_function
def hello():
    print('Hello world!')

Now run Jython:
java -Dpython.console -jar Jython-standalone-2.7.2b2.jar
>>> import test
>>> test.trial.hello()
Traceback (most recent call last):
  File "<stdin>", line 1 in <module>
AttributeError: module' object has no attribute 'trial'

With Jython 2.7.1 (or 2.7.2a1):
java -Dpython.console -jar Jython-standalone-2.7.1.jar
>>> import test
>>> test.trial.hello()
Hello World!
>>> 


Using Jython standalone on [Java HotSpot(TM) 64-Bit Server VM (Oracle Corporation)] on java1.8.0_231 / Windows 7

----------
messages: 12778
nosy: ruud
severity: major
status: open
title: Regression error on module import
type: crash
versions: Jython 2.7.2

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2832>
_______________________________________

[Jython-bugs] [issue2830] Unable to run Jython on Windows Server 2008 R2

[marcuswongkl <re...@bu...>]

New submission from marcuswongkl <mar...@ho...>:

Hi, we try to run Jython 2.7.1 on following environment but receiving error code 14001 upon executing jython.exe

Error message: Error loading Python DLL: D:\{folder}\jython2.7.1\bin\python27.dll (error code 14001)

OS: Windows Server 2008 R2 Enterprise
Java: version "1.8.0_161"
Java(TM) SE Runtime Environment (build 8.0.5.10 - pwi3280sr5fp10-20180214_01(SR5 FP10))

Wonder if there is any compatibility issue with above configurations.

Any advice would be much appreciated.

Regards,
Marcus

----------
components: Core
messages: 12768
nosy: marcuswongkl
severity: normal
status: open
title: Unable to run Jython on Windows Server 2008 R2
type: crash
versions: Jython 2.7.1

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2830>
_______________________________________