jython-bugs — Private bug notification list. Do not post to this list.

[Jython-bugs] [issue2728] jython-standalone 2.7.1 fails vulnerability check because of guava 22

[najibk <re...@bu...>]

New submission from najibk <naj...@ca...>:

Jython fails vulnerability check because of a vulnerability in the guava dependency.

Unbounded memory allocation in Google Guava 11.0 through 24.x before 24.1.1 allows remote attackers to conduct denial of service attacks against servers that depend on this library and deserialize attacker-provided data, because the AtomicDoubleArray class (when serialized with Java serialization) and the CompoundOrdering class (when serialized with GWT serialization) perform eager allocation without appropriate checks on what a client has sent and whether the data size is reasonable.

CVE-2018-10237 (https://nvd.nist.gov/vuln/detail/CVE-2018-10237)

Using jython-standalone 2.7.1 in a maven project

is there a way to update the version of guava in the jython jar ?

Thanks

----------
components: Library
messages: 12252
milestone: Jython 2.7.1
nosy: najibk
severity: urgent
status: open
title: jython-standalone 2.7.1 fails vulnerability check because of guava 22
type: security
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2728>
_______________________________________

[Jython-bugs] [issue2726] platform.system() return java.lang.IllegalArgumentException

[k870611 <re...@bu...>]

New submission from k870611 <k8...@gm...>:

In Jython 2.7.1, I just simply use the code 

>>>import platform
>>>platform.system()

and it return Error

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\jython2.7.1\Lib\platform.py", line 1396, in system
    return uname()[0]
  File "C:\jython2.7.1\Lib\platform.py", line 1213, in uname
    machine = os.uname()[4]
        at org.python.core.PyString.<init>(PyString.java:57)
        at org.python.core.PyString.<init>(PyString.java:70)
        at org.python.core.PyString.<init>(PyString.java:74)
        at org.python.core.Py.newString(Py.java:647)
        at org.python.modules.posix.PosixModule.uname(PosixModule.java:1173)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
java.lang.IllegalArgumentException: java.lang.IllegalArgumentException: Cannot create PyString with non-byte value

----------
components: Core
messages: 12218
milestone: Jython 2.7.1
nosy: k870611
severity: urgent
status: open
title: platform.system() return java.lang.IllegalArgumentException
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2726>
_______________________________________

[Jython-bugs] [issue2724] Mail Gateway Test

[Ernest W. D. I. <re...@bu...>]

New submission from Ernest W. Durbin III <er...@py...>:

Mail Gateway Test

----------
files: unnamed
messages: 12216
nosy: EWDurbin
severity: normal
status: open
title: Mail Gateway Test
Added file: https://bugs.jython.org/file1657/unnamed

_______________________________________
Jython tracker <re...@bu...>
<https://bugs.jython.org/issue2724>
_______________________________________

[Jython-bugs] [issue2723] Unusual behavior in SimpleCookie when '=' and '@' is used in nested object

[rsmith31415 <re...@bu...>]

Change by rsmith31415 <rsm...@gm...>:


----------
components: None
nosy: rsmith31415
severity: normal
status: open
title: Unusual behavior in SimpleCookie when '=' and '@'  is used in nested object
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2723>
_______________________________________

[Jython-bugs] [issue2722] run-time issue while trying to reach external endpoint (Weather API) via Java/Jython

[Vaishnavi <re...@bu...>]

New submission from Vaishnavi <rav...@gm...>:

This is my code:

import java.util.Properties;
import org.python.util.PythonInterpreter;

public class GenerateWeather {

	@SuppressWarnings("resource")
	public static void main(final String[] args) throws ScriptException {
		System.setProperty("python.cachedir.skip", "true");
		Properties p = new Properties();
		p.setProperty("python.path",
				"/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar");
		p.setProperty("python.home",
				"/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar");
		p.setProperty("python.prefix",
				"/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar");
		PythonInterpreter.initialize(System.getProperties(), p, new String[] {});

		PythonInterpreter interpreter = new PythonInterpreter();

		interpreter.exec("import sys");
		interpreter.exec("sys.path.append(\"/usr/local/lib/python2.7/site-packages\")");
		interpreter.execfile("/Users/<user>/GenerateWeatherReport/python/current_and_forecast.py");
	}
}

*******
current_and_forecast.py works great when invoked in stand-alone mode "python current_and_forecast.py" however fails with Jython with the following stack-trace:


Exception in thread "MainThread" Traceback (most recent call last):
  File "/Users/<user>/GenerateWeatherReport/python/current_and_forecast.py", line 64, in <module>
    current_weather()
  File "/Users/<user>/GenerateWeatherReport/python/current_and_forecast.py", line 21, in current_weather
    cw = requests.get('http://api.openweathermap.org/data/2.5/weather?q=' + city + ',' + country + '&appid=' + api_key)
  File "/usr/local/lib/python2.7/site-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/requests/api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/requests/sessions.py", line 524, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/site-packages/requests/sessions.py", line 637, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python2.7/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 597, in urlopen
    httplib_response = self._make_request(conn, method, url,
  File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 597, in urlopen
    httplib_response = self._make_request(conn, method, url,
  File "/usr/local/lib/python2.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/httplib.py", line 1042, in request
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/httplib.py", line 1082, in _send_request
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/httplib.py", line 1038, in endheaders
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/httplib.py", line 882, in _send_output
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/httplib.py", line 858, in send
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/_socket.py", line 1441, in meth
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/_socket.py", line 382, in handle_exception
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/_socket.py", line 382, in handle_exception
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/_socket.py", line 382, in handle_exception
  File "/Users/<user>/.m2/repository/org/python/jython-standalone/2.7.1/jython-standalone-2.7.1.jar/Lib/_socket.py", line 1193, in send
AttributeError: 'org.python.netty.channel.socket.nio.NioSocketChann' object has no attribute 'bytesBeforeUnwritable'

*********
when checked with Weather API or urllib3, the suggestions were to reach out to Jython because of some native issue with sockets.

Pls can you help me out here. Thanks.

----------
components: Core
messages: 12212
nosy: vaishnavihravi
severity: normal
status: open
title: run-time issue while trying to reach external endpoint (Weather API) via Java/Jython
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2722>
_______________________________________

[Jython-bugs] [issue2721] cannot invoke Python from Java

[Navneeth <re...@bu...>]

New submission from Navneeth <tec...@gm...>:

Here is the stack-trace when running the below Java program to invoke simple python code:
************
Exception in thread "main" Traceback (most recent call last):
  File "/Users/<user>/Downloads/jython-standalone-2.7.1.jar/Lib/site.py", line 68, in <module>
  File "/Users/<user>/Downloads/jython-standalone-2.7.1.jar/Lib/os.py", line 426, in <module>
java.lang.IllegalAccessError: tried to access method org.python.core.PyList.getList()Ljava/util/List; from class org.python.core.PyShadowString
	at org.python.core.PyShadowString.isTarget(PyShadowString.java:108)
	at org.python.core.PyShadowString.__eq__(PyShadowString.java:170)
	at org.python.core.PyObject._eq(PyObject.java:1525)
	at org.python.core.PyObject.equals(PyObject.java:318)
	at org.python.core.PyObject.object___contains__(PyObject.java:1769)
	at org.python.core.PyObject.__contains__(PyObject.java:1764)
	at org.python.core.PyObject._in(PyObject.java:1744)
	at os$py.f$0(/Users/<user>/Downloads/jython-standalone 2.7.1.jar/Lib/os.py:726)
	at os$py.call_function(/Users/<user>/Downloads/jython-standalone-2.7.1.jar/Lib/os.py)
	at org.python.core.PyTableCode.call(PyTableCode.java:167)
	at org.python.core.PyCode.call(PyCode.java:18)
	at org.python.core.imp.createFromCode(imp.java:436)
	at org.python.core.util.importer.importer_load_module(importer.java:109)
	at org.python.modules.zipimport.zipimporter.zipimporter_load_module(zipimporter.java:163)
	at org.python.modules.zipimport.zipimporter$zipimporter_load_module_exposer.__call__(Unknown Source)
	at org.python.core.PyBuiltinMethodNarrow.__call__(PyBuiltinMethodNarrow.java:46)
	at org.python.core.imp.loadFromLoader(imp.java:587)
	at org.python.core.imp.find_module(imp.java:537)
	at org.python.core.imp.import_next(imp.java:840)
	at org.python.core.imp.import_module_level(imp.java:959)
	at org.python.core.imp.importName(imp.java:1062)
	at org.python.core.ImportFunction.__call__(__builtin__.java:1280)
	at org.python.core.PyObject.__call__(PyObject.java:431)
	at org.python.core.__builtin__.__import__(__builtin__.java:1232)
	at org.python.core.imp.importOne(imp.java:1081)
	at site$py.f$0(/Users/<user>/Downloads/jython-standalone-2.7.1.jar/Lib/site.py:637)
	at site$py.call_function(/Users/<user>/Downloads/jython-standalone-2.7.1.jar/Lib/site.py)
	at org.python.core.PyTableCode.call(PyTableCode.java:167)
	at org.python.core.PyCode.call(PyCode.java:18)
	at org.python.core.imp.createFromCode(imp.java:436)
	at org.python.core.util.importer.importer_load_module(importer.java:109)
	at org.python.modules.zipimport.zipimporter.zipimporter_load_module(zipimporter.java:163)
	at org.python.modules.zipimport.zipimporter$zipimporter_load_module_exposer.__call__(Unknown Source)
	at org.python.core.PyBuiltinMethodNarrow.__call__(PyBuiltinMethodNarrow.java:46)
	at org.python.core.imp.loadFromLoader(imp.java:587)
	at org.python.core.imp.find_module(imp.java:537)
	at org.python.core.imp.import_next(imp.java:840)
	at org.python.core.imp.import_first(imp.java:861)
	at org.python.core.imp.load(imp.java:716)
	at org.python.core.Py.importSiteIfSelected(Py.java:1558)
	at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:116)
	at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:94)
	at org.python.util.PythonInterpreter.<init>(PythonInterpreter.java:71)
	at PythonInJava.main(PythonInJava.java:17)
java.lang.IllegalAccessError: java.lang.IllegalAccessError: tried to access method org.python.core.PyList.getList()Ljava/util/List; from class org.python.core.PyShadowString

*********** JAVA ************
import java.util.Properties;
import org.python.util.PythonInterpreter;

public class PythonInJava {

        @SuppressWarnings("resource")
        public static void main(final String[] args) throws Exception {
                System.setProperty("python.cachedir.skip", "true");

                Properties p = new Properties();
                p.setProperty("python.path","/Users/<user>/Downloads/jython-standalone-2.7.1.jar");
                p.setProperty("python.home","/Users/<user>/Downloads/jython-standalone-2.7.1.jar");
                p.setProperty("python.prefix","/Users/<user>/Downloads/jython-standalone-2.7.1.jar");
                PythonInterpreter.initialize(System.getProperties(), p, new String[] {});
                PythonInterpreter interpreter = new PythonInterpreter();
                interpreter.exec("import sys");
                interpreter.exec("sys.path.append(\"/Library/Python/2.7/site-packages\")");
                interpreter.execfile("/Users/<user>/test.py");
        }
}

----------
components: Jythonc compiler
messages: 12208
milestone: Jython 2.7.0
nosy: navneethnarendra
severity: major
status: open
title: cannot invoke Python from Java
type: crash
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2721>
_______________________________________

[Jython-bugs] [issue2720] wrap_scoket_exception: 'module' object has no attribute 'OP_NO_TLSv1_1'

[arvind <re...@bu...>]

New submission from arvind <arv...@gm...>:

I am creating thread based https server with few disabled protocols(I am disabling TLSv1.1) in ssl context.

There are two issues which i am facing . 
When using jython-standalone-2.7.1.jar, TLS handshake just hangs forever. 

I used same code with jython-standalone-2.7.1b3.jar which gives different error. 
wrap_scoket_exception: 'module' object has no attribute 'OP_NO_TLSv1_1'

Below is sample code 

class ThreadedHTTPServer(ThreadingMixIn, BaseHTTPServer.HTTPServer):
    def __init__(self, server_address, RequestHandlerClass, bind_and_activate=True):
        BaseHTTPServer.HTTPServer.__init__(self, server_address, RequestHandlerClass, bind_and_activate)
    def wrap_thread_socket(self, cert):
		context = ssl.SSLContext(ssl.PROTOCOL_SSLv23)
		context.options |= ssl.OP_NO_TLSv1_1
		context.load_cert_chain(cert)
		self.socket = context.wrap_socket(self.socket,  server_side=False)

httpd = ThreadedHTTPServer(("", getTLSPort()), Handler)
httpd.wrap_thread_socket(tlsCertificate)


This totally works with python version 2.7 and code runs smooth.
Please help.

----------
components: Core
messages: 12205
milestone: Jython 2.7.1
nosy: arao
severity: major
status: open
title: wrap_scoket_exception: 'module' object has no attribute 'OP_NO_TLSv1_1'
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2720>
_______________________________________

[Jython-bugs] [issue2719] Divergence of __str__ and __repr__ from CPython

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

I'm raising this to cover what (I think) https://github.com/jythontools/jython/pull/126 aims to fix.

The following simple function probes str() and repr() behaviour for a supplied instance:

def dump(a):
    print type(a).__name__

    print "  repr(a):     ", repr(a)
    if hasattr(a, '__repr__'):
        print "  a.__repr__():", a.__repr__()
    else:
        print "  a.__repr__(): not defined"

    print "  str(a):      ", str(a)
    if hasattr(a, '__str__'):
        print "  a.__str__(): ", a.__str__()
    else:
        print "  a.__str__():  not defined"

In CPython:
>>> dump(buffer('hello'))
buffer
  repr(a):      <read-only buffer for 0x0000000002EA0238, size -1, offset 0 at 0x0000000002DCED88>
  a.__repr__(): <read-only buffer for 0x0000000002EA0238, size -1, offset 0 at 0x0000000002DCED88>
  str(a):       hello
  a.__str__():  hello
>>> def g(): pass
...
>>> dump(g)
function
  repr(a):      <function g at 0x0000000002E9C198>
  a.__repr__(): <function g at 0x0000000002E9C198>
  str(a):       <function g at 0x0000000002E9C198>
  a.__str__():  <function g at 0x0000000002E9C198>

While in Jython:
>>> dump(buffer('hello'))
buffer
  repr(a):      <read-only buffer for 0x8, size -1, offset 0 at 0x0x9>
  a.__repr__(): <buffer object at 0x9>
  str(a):       hello
  a.__str__():  <read-only buffer for 0x8, size -1, offset 0 at 0x0x9>
>>> def g(): pass
...
>>> dump(g)
function
  repr(a):      <function g at 0xa>
  a.__repr__(): <function object at 0xa>
  str(a):       <function g at 0xa>
  a.__str__():  <function g at 0xa>

Apart from the bovine superfluity in repr for buffer (one 0x too many), the main bug is that __repr__ and __str__ do not match expectations. The GitHub PR blames the curious and unexplained cross-wiring of __str__ and __repr__ as exposed from PyObject, without which there is apparently a stack overflow when new-style classes are defined. (This happens because PyObjectDerived.toString calls __repr__.)

While the cross-wiring doesn't lead to these errors directly, it makes them more difficult to understand and solve. The PR seeks to eliminate this confusion, defuse the recursion another way, and fix the substantive errors.

----------
assignee: jeff.allen
components: Core
messages: 12203
nosy: jeff.allen, rfe...@de...
priority: normal
severity: normal
status: open
title: Divergence of __str__ and __repr__ from CPython
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2719>
_______________________________________

[Jython-bugs] [issue2718] Jython not built for IBM Linux on POWER (ppc64el) systems

[Timothy P. <re...@bu...>]

New submission from Timothy Pearson <tpe...@ra...>:

Since the Jython standalone JAR includes platform-specific libraries, it should be built to include support for the ppc64el platform.  We have been having to rebuild the sources into a standalone JAR on our POWER boxes, which breaks downstream consumers that assume the standalone official Jython JAR includes the needed platform support.

----------
components: Library
messages: 12200
nosy: tpearson-raptor
severity: major
status: open
title: Jython not built for IBM Linux on POWER (ppc64el) systems
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2718>
_______________________________________

[Jython-bugs] [issue2717] passing**kwargs form java to python using Jython

[mohamad <re...@bu...>]

New submission from mohamad <moh...@gm...>:

how to pass **kwargs form java to python using Jython .

The python method :

def start_trex (self, f, d, block_to_success = True, timeout = 40, user = None, trex_development = False, **trex_cmd_options):

My java code :

Map<String, Object> kwargs = new HashMap<>();
kwargs.put("cfg","/etc/trex_cfg_stf.yaml");
boolean z =objectTrex.start_trex("astf/http_simple.py",20,true,40,"momham",true,kwargs);
I'm getting the following error :

Exception in thread "MainThread" TypeError: start_trex() takes at most 7 arguments (8 given)

although i passing just 7 arguments I think the problem with the way of passing the **kwargs argument

----------
components: None
messages: 12183
nosy: mohamad.mahajna
severity: normal
status: open
title: passing**kwargs form java to python using Jython
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2717>
_______________________________________

[Jython-bugs] [issue2716] why '==' return true but 'is' return false

[k870611 <re...@bu...>]

New submission from k870611 <k8...@gm...>:

for example, In python
a = "hello", b = "hello", "a is b" and "a == b" will return True.

but In jython2.7.0 "a is b" return False, "a == b" return True

----------
components: Core
messages: 12176
milestone: Jython 2.7.0
nosy: k870611
severity: critical
status: open
title: why '==' return true but 'is' return false
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2716>
_______________________________________

[Jython-bugs] [issue2715] Over-stretched array.array support for buffer protocol

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

Jython array.array supports the buffer protocol experimentally. However, it only creates byte views of the data, which is incorrect (and has to be readonly) for anything that is not actually byte data.

Support for plain byte data is essentially the same as bytearray, and reliable. Beyond 'b', I suggest it should claim not to support the action.

This was observed first in https://github.com/jythontools/jython/pull/119, alongside a problem with unicode, but the offered solution there is not satisfactory for the array.array issue.

----------
assignee: jeff.allen
components: Core
messages: 12167
nosy: jeff.allen, rfe...@de...
priority: normal
severity: normal
status: open
title: Over-stretched array.array support for buffer protocol
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2715>
_______________________________________

[Jython-bugs] [issue2714] Locale and java version failures in test_os_jy

[Adam B. <re...@bu...>]

New submission from Adam Burke <ada...@gm...>:

test_os_jy has some Turkish and Japanese failures on my windows and cygwin environment.

Platform:
    'Java-10.0.2-Java_HotSpot-TM-_64-Bit_Server_VM,_10.0.2+13,_-Oracle_Corporation-on-Windows_10-10.0-amd64'

======================================================================
ERROR: test_turkish_locale_posix_module (test.test_os_jy.LocaleTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython2\dist\Lib\test\test_os_jy.py", line 353, in test_turkish_locale_posix_module
    self.assertEqual(
  File "C:\Users\Adam\jython\jython2\dist\Lib\subprocess.py", line 586, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['C:\\Users\\Adam\\jython\\jython2\\dist\\bin\\jython.exe', '-c', "import sys; assert 'posix' in sys.builtin_module_names"]' returned non-zero exit status 1

======================================================================
FAIL: test_strftime_japanese_locale (test.test_os_jy.LocaleTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython2\dist\Lib\test\test_os_jy.py", line 399, in test_strftime_japanese_locale
    self.assertEqual(
AssertionError: "'\\xe6\\x97\\xa5 3\\xe6\\x9c\\x88 29 14:55:13 2015'\r\n" != "'\\xe6\\x97\\xa5 3 29 14:55:13 2015'\n"

======================================================================
FAIL: test_strptime_locale (test.test_os_jy.LocaleTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython2\dist\Lib\test\test_os_jy.py", line 387, in test_strptime_locale
    self.assertEqual(
AssertionError: '2015-01-22 00:00:00\r\n' != '2015-01-22 00:00:00\n'

======================================================================
FAIL: test_turkish_locale_string_lower_upper (test.test_os_jy.LocaleTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython2\dist\Lib\test\test_os_jy.py", line 365, in test_turkish_locale_string_lower_upper
    self.assertIn(
AssertionError: "['i', u'i', 'I', u'I']\r\n" not found in ["['i', u'\\u0131', 'I', u'\\u0130']\n", "['i', u'i', 'I', u'I']\n"]

----------------------------------------------------------------------
Ran 27 tests in 23.689s

Some of these are failures only on cygwin, some on Java 8, some on Java 10. The Java 10 failures are due to Japanese local changes.

I have a patch locally, which I will share as a PR.

----------
components: Library
messages: 12166
nosy: adamburke
severity: normal
status: open
title: Locale and java version failures in test_os_jy
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2714>
_______________________________________

[Jython-bugs] [issue2713] Rounding a float field causes test_cpickle to fail

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

In a newly-created repo on Windows I observed this failure:

======================================================================
FAIL: test_structseq (test.test_cpickle.cPickleTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Jeff\Documents\Eclipse\jython-raymond\dist\Lib\test\pickletester.py", line 652, in test_structseq
    self.assertEqual(t, u)
AssertionError: nt.stat_result(st_mode=16895, st_ino=0, st_dev=0L, st_nlink=0, st_uid=0, st_gid=0, st_size=24576, st_atime=1540644042, st_mtime=1540644042, st_ctime=1540618526) != nt.stat_result(st_mode=16895, st_ino=0, st_dev=0L, st_nlink=0, st_uid=0, st_gid=0, st_size=24576, st_atime=1540644042, st_mtime=1540644042, st_ctime=1540618527)

(The st_ctime differs by 1 in the print out.)

test_xpickle fails the same way. I think the problem is that the time at which I created the folder rounds differently in two places. The actual ctime in the PyStateResult is 1.540618526999464E9, which in the original rounds to 1540618526, but in the pickled data it is written out rounded as "aF1540618527.0". This reveals a problem pickling a "Java struct". A synthetic example is surely necessary to debug this, rather than unlucky timing.

----------
components: Library
keywords: test failure causes
messages: 12165
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: Rounding a float field causes test_cpickle to fail
type: behaviour

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2713>
_______________________________________

[Jython-bugs] [issue2712] jython interpreter can't parse source from standard input

[mete0r <re...@bu...>]

New submission from mete0r <me...@sa...>:

Example 1: pyinfo.py[1]
---------------------
def pyinfo():
    import sys
<BLANK>
    return {"version_info": tuple(sys.version_info), "sysplatform": sys.platform}
<BLANK>
print(pyinfo())
---------------------------------

1) If you run this file like:

    jython pyinfo.py

it just runs fine, i.e.

    {'version_info': (2, 7, 1, 'final', 0), 'sysplatform': 'java1.7.0_181 ( ==linux2 for targets )'}

2) But if you feed the file into the interpreter standard input stream,

    jython < pyinfo.py

it spits out syntax error:

      File "<stdin>", line 1
        return {"version_info": tuple(sys.version_info), "sysplatform": sys.platform}
        ^
    SyntaxError: no viable alternative at input '    '

3) If you remove the first blank line, i.e.

    def pyinfo():
        import sys
        return {"version_info": tuple(sys.version_info), "sysplatform": sys.platform}
    <BLANK>
    print(pyinfo())

you can run the code by giving file name as an argument AND by feeding into standard input.

This problem prevents using a Jython interpreter in tox environment.

Testing environment
-------------------
Debian 8.11 Jessie
OpenJDK 1.7.0_181
OpenJDK Runtime Environment (IcedTea 2.6.14) (7u181-2.6.14-1~deb8u1)
OpenJDK 64-Bit Server VM (build 24.181-b01, mixed mode)
Jython 2.7.1

------
[1] tox feed this code into python interpreter's standard input

----------
components: Core
messages: 12163
nosy: mete0r
severity: normal
status: open
title: jython interpreter can't parse source from standard input

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2712>
_______________________________________

[Jython-bugs] [issue2711] Dictionaries fail test of atomicity

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

Tests in test_dict and test_dict_jy fail as follows on versions from Java 9. I'm raising this issue to track the failure, while inserting skips to turn the bots green.


======================================================================
FAIL: test_setdefault_atomic (__main__.PyStringMapTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Jeff\Documents\Eclipse-O\jython-jvm9\dist\Lib\test\test_dict.py", line 339, in test_setdefault_atomic
    self.assertEqual(hashed1.eq_count + hashed2.eq_count, 1)
AssertionError: 2 != 1


======================================================================
FAIL: test_setdefault_atomic (__main__.DictTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Jeff\Documents\Eclipse-O\jython-jvm9\dist\Lib\test\test_dict.py", line 339, in test_setdefault_atomic
    self.assertEqual(hashed1.eq_count + hashed2.eq_count, 1)
AssertionError: 2 != 1

----------
components: Core
keywords: Java Roadmap, test failure causes
messages: 12158
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: Dictionaries fail test of atomicity
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2711>
_______________________________________

[Jython-bugs] Did You Get My Email?

[Abdwabbo M. <de...@da...>]

 - This mail is in HTML. Some elements may be ommited in plain text. -

Dear,
You said you received my message but i never got yours. Please get
back to me its very urgent.
AbdWabbo Maddah

[Jython-bugs] [issue2710] Key protection algorithm not found

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

In test_ssl I notice that in a couple of places we have disabled tests when running on Java 9 or beyond (in BasicSocketTests.test_errors and ContextTests.test_load_cert_chain). I am experiencing what looks to be the same failure in test_socket_jy (on Java 9) in SSLSocketConnectTest.test_connect_ex_workout .

test_ssl contains the comment:
# Possible FIXME similar issue as seen in
# test_load_cert_chain - apparently this RSA 1024 cert is too weak and gets a
# java.security.KeyStoreException: Key protection  algorithm not found before the
# ValueError raised on earlier versions of Java;
# but we need to confirm this is truly the case on Java 9
(The test is supposed to raise a ValueError but fails creating the socket, I think.)

I'm raising it as an issue here so we do not just forget it. I cannot tell yet whether this is just a problem with the test material or a real problem in use.

----------
components: Library
keywords: Java Roadmap, test failure causes
messages: 12148
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: Key protection algorithm not found
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2710>
_______________________________________

[Jython-bugs] [issue2709] test_chdir shortname failures on some later Windows filesystems

[Adam B. <re...@bu...>]

New submission from Adam Burke <ada...@gm...>:

Am seeing failures of test_chdir.test_windows_chdir_dos_path on my Windows machine. Reproducible from Windows 10, using windows cmd and cygwin command lines on JDK 8 and 10. 

JDK 8 example:

c:\working\working>%JY%\dist\bin\jython.exe -m test.regrtest -v test_chdir
== 2.7.2a1+ (, Oct 16 2018, 11:40:48)
== [Java HotSpot(TM) 64-Bit Server VM (Oracle Corporation)]
== platform: java1.8.0_111
== encodings: stdin=cp850, stdout=cp850, FS=utf-8
== locale: default=('en_AU', 'windows-1252'), actual=(None, None)
test_chdir
test_chdir (test.test_chdir.ChdirTestCase) ... ok
...
======================================================================
ERROR: test_windows_chdir_dos_path (test.test_chdir.WindowsChdirTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython\dist\Lib\test\test_chdir.py", line 193, in test_windows_chdir_dos_path
    os.chdir(dos_name)
OSError: [Errno 2] No such file or directory: 'C:\\Users\\Adam\\AppData\\Local\\Temp\\tmpbd0rjl\\progra~1'

----------------------------------------------------------------------
Ran 42 tests in 0.778s

FAILED (errors=1)
test test_chdir failed -- Traceback (most recent call last):
  File "C:\Users\Adam\jython\jython\dist\Lib\test\test_chdir.py", line 193, in test_windows_chdir_dos_path
    os.chdir(dos_name)
OSError: [Errno 2] No such file or directory: 'C:\\Users\\Adam\\AppData\\Local\\Temp\\tmpbd0rjl\\progra~1'

1 test failed:
    test_chdir
1 fail unexpected:
    test_chdir
 
The immediate cause seems to be the otherwise reasonable re-inclusion of this test for windows in the fix for http://bugs.jython.org/issue2646

That seems to be failing because, as I have learned, it is no longer universal for all windows files and directories to have equivalent short DOS ("8dot3") names.

https://docs.microsoft.com/en-us/windows/desktop/fileio/naming-a-file

https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/fsutil-8dot3name

The setting lives at a filesystem level, and can be read from the command line with the fsutil command

C:\Users\Adam\jython\jython>fsutil 8dot3name query
The registry state is: 1 (Disable 8dot3 name creation on all volumes).

I have a potential fix which basically involves some checks for validity in the unit test itself. I will raise a github PR.

----------
components: Library
messages: 12140
nosy: adamburke, jamesmudd, jeff.allen
severity: normal
status: open
title: test_chdir shortname failures on some later Windows filesystems
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2709>
_______________________________________

[Jython-bugs] [issue2708] test_urllib2net fails (on Travis CI)

[Stefan R. <re...@bu...>]

New submission from Stefan Richthofer <ste...@jy...>:

I noticed that rather recently (some months ago) test_urllib2net started to fail on TravisCI. I went through the github commit history to identity the satrting point of failure.
It seems to be this commit:
https://github.com/jythontools/jython/commit/2f4c2928b617a10aa99bb5de98926015500481d8
where it consequently starts failing.
One commit earlier (https://github.com/jythontools/jython/commit/52eb2fbae077036f9488a2ee9b78ed1630f2d306) the test still went well.

Routinely breaking tests make TravisCI less useful for us, so this should be cleaned up.

Given that the "breaking" PR is titled "Refactor PyJavaType.init for readability (no material change)." I suspect this issue might be induced some change in Travis CI. Traditionally, networking tests were not so reliable anyway. However also in this case we should consider to skip this test or better only the broken bit.

Any ideas what actually goes wrong?

----------
messages: 12135
nosy: jamesmudd, jeff.allen, stefan.richthofer
severity: normal
status: open
title: test_urllib2net fails (on Travis CI)

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2708>
_______________________________________

[Jython-bugs] [issue2707] jython.py shebang line invalid on Linux

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

jython.py appears broken on Linux by the shebang line:

#!/usr/bin/env python2.7 -E

This doesn't work because a shebang is not processed like a shell command (see https://unix.stackexchange.com/questions/63979/shebang-line-with-usr-bin-env-command-argument-fails-on-linux). env receives everything after the space as one argument and you get the message that it cannot find the file "python2.7 -E".

An option -S (--split-string) is documented that addresses the problem, but it doesn't work on my Linux system. I could maybe install a later env, but then it will fail for anyone who hasn't done that with "invalid option -- 'S'".

This mostly does not show in a development environment because dist/bin/jython means the shell script version, but it fails in tests that explicitly ask for jython.py (test_jython_launcher).

----------
keywords: test failure causes
messages: 12121
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: jython.py shebang line invalid on Linux
type: crash
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2707>
_______________________________________

[Jython-bugs] [issue2706] Use python.path instead of JYTHONPATH

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

The environment variable JYTHONPATH determines the search path for Python code outside the standard library, in the way PYTHONPATH does for CPython. Incorrectly, it is not ignored when the -E option is given to the jython command. I propose to move its initialisation to org.python.util.jython at the same stage other variables are handled coverted to registry entries.

This will have the side effect that JYTHONPATH will no longer affect Java applications that create their own interpreter (only the property python.path does that). I think this is good, but may also be an unexpected change.

Rationale:

TL;DR: consistency; original design intent.

It its original design, Jython took configuration only from the Java Properties (read from the registry files and java -D options), not from environment variables. Published books tell us this is how it works, and Java discourages reliance on environment variables (https://docs.oracle.com/javase/tutorial/essential/environment/env.html). And it is mostly still true, except that JYTHONPATH is sampled in the middle of initialisation, in all circumstances, and overrides any -Dpython.path=value given to Java. For a pure Java application to rid itself of an inappropriate external JYTHONPATH it has to set python.path in the "post-properties" during initialisation.

It seems ok that jython.main() should pay attention to (certain) environment variables: it's a command used from the shell, and users can turn it off with the -E option. The similarity to CPython is good. There is a well-defined place for environment variables in the "pecking order" with other sources which JYTHONPATH slightly diverges from.

----------
messages: 12118
nosy: jeff.allen, zyasoft
priority: normal
severity: minor
status: open
title: Use python.path instead of JYTHONPATH
type: behaviour
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2706>
_______________________________________

[Jython-bugs] [issue2705] Illegal reflective access

[Thad G. <re...@bu...>]

New submission from Thad Guidry <tha...@gm...>:

Hi we use the Jython standalone jar in our OpenRefine project and have begun to notice these kinds of errors.  I saw previous issues by Jeff Allen, but do not know if this one is internal or external related.  So feel free to close and let us know the best course of action.

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.google.common.base.internal.Finalizer (file:/E:/Downloads/openrefine-win-3.1-SNAPSHOT/openrefine-3.1-SNAPSHOT/webapp/extensions/jython/module/MOD-INF/lib/jython-standalone-2.5.4-rc1.jar) to field java.lang.Thread.inheritableThreadLocals
WARNING: Please consider reporting this to the maintainers of org.python.google.common.base.internal.Finalizer
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations

----------
messages: 12116
nosy: thadguidry
severity: normal
status: open
title: Illegal reflective access
versions: Jython 2.5

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2705>
_______________________________________

[Jython-bugs] [issue2704] wlst jython argparse

[Tig <re...@bu...>]

New submission from Tig <tig...@gm...>:

If I try to import argparse i get syntax error.

#Evidence:

/opt/weblogic$ wlst

Initializing WebLogic Scripting Tool (WLST) ...

Welcome to WebLogic Server Administration Scripting Shell

Type help() for help on available commands

wls:/offline> sys.path.append("/opt/weblogic/jython/Lib")
wls:/offline> import argparse

Traceback (innermost last):
  File "<console>", line 1, in ?
  File "/opt/weblogic/jython/Lib/argparse.py", line 611
                        yield subaction
                              ^
SyntaxError: invalid syntax

----------
components: Library
messages: 12105
nosy: Tig
severity: normal
status: open
title: wlst jython argparse
versions: Jython 2.7

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2704>
_______________________________________

[Jython-bugs] [issue2703] JycompileAntTask cannot find org.python.apache.tools.ant.taskdefs.MatchingTask

[Jeff A. <re...@bu...>]

New submission from Jeff Allen <ja...@fa...>:

As raised on GitHub: https://github.com/jythontools/jython/issues/109, it looks like we have transformed references to some libraries we depend on, but have not supplied transformed libraries to match, in the distributable JARs. In this case it's ant.jar, but as the fault is probably that we rename org.apache.** wholesale, it may not stop there.

Either we should be more refined in our selection of packages to rename in the jar-complete target, or include ant in our JAR. (Probably the former.)

----------
components: Core
messages: 12094
nosy: jeff.allen
priority: normal
severity: normal
status: open
title: JycompileAntTask cannot find org.python.apache.tools.ant.taskdefs.MatchingTask

_______________________________________
Jython tracker <re...@bu...>
<http://bugs.jython.org/issue2703>
_______________________________________