webware-devel — Discussion for those who develop Webware.

[Webware-devel] Webware has moved to GitHub

[Christoph Z. <ci...@on...>]

Some news from the Webware for Python project:

As announced already last year, I have finally moved the Webware for 
Python project from the old private server provided by Tummy to GitHub. 
The homepage is now served by GitHub as well.

* The new repository is at: https://github.com/Cito/w4py

* The new homepage is at: https://cito.github.io/w4py/

Don’t worry, I will continue to maintain Webware for Python and create 
new releases with updated and more modern code and documentation. In 
fact, slimming down the project infrastructure and moving stuff to 
GitHub is the first step for me to make the project manageable again and 
restart development on a clean slate.

The old repository with the full history and the old documentation has 
been preserved under https://github.com/Cito/w4py-olde-docs,
the old Webware for Python Wiki has been frozen and archived under 
https://github.com/Cito/w4py-olde-wiki.

I want to thank Tummy (https://www.tummy.com/) again for generously 
providing a server for the Webware project over all these years.

-- Christoph

Re: [Webware-devel] make mod_webkit errors out

[Mark P. <mar...@mo...>]

On Nov 28, 2015, at 10:31 AM, Christoph Zwerschke <ci...@on...> wrote:
> 
> Am 28.11.2015 um 18:49 schrieb Mark Phillips:
>> I do have a gcc related question. I see a file named mod_webkit.so in
>> the directory .libs and the “make install” terminated normally. Given
>> that gcc issued warnings, is it risky to assume the mod_webkit.so
>> file produced will function as desired?
> 
> The warnings are normal. mod_webkit2 works fine for me even on modern 
> Linux versions like openSUSE Leap 42.
> 
> — Christoph

Thank you, Christoph.

Regards,

 - Mark

Re: [Webware-devel] make mod_webkit errors out

[Christoph Z. <ci...@on...>]

Am 28.11.2015 um 18:49 schrieb Mark Phillips:
> I do have a gcc related question. I see a file named mod_webkit.so in
> the directory .libs and the “make install” terminated normally. Given
> that gcc issued warnings, is it risky to assume the mod_webkit.so
> file produced will function as desired?

The warnings are normal. mod_webkit2 works fine for me even on modern 
Linux versions like openSUSE Leap 42.

-- Christoph

Re: [Webware-devel] make mod_webkit errors out

[Mark P. <mar...@mo...>]

> On Nov 28, 2015, at 9:23 AM, Christoph Zwerschke <ci...@on...> wrote:
> 
> Am 28.11.2015 um 17:30 schrieb Mark Phillips:
>> I would greatly appreciate advice on how to work around or through this.
>> 
>> Installing on Centos 6, with gcc and apxs installed.
>> 
>> [root mod_webkit2]# make
> 
> Can you try with the latest version from trunk?
> I think this has been fixed already:
> 
> http://svn.w4py.org/Webware/trunk/WebKit/Adapters/mod_webkit2/
> 
> A new release of Webware is still somewhere on my todo list…

Yes, I will give that a try.

I do have a gcc related question. I see a file named mod_webkit.so in the directory .libs and the “make install” terminated normally. Given that gcc issued warnings, is it risky to assume the mod_webkit.so file produced will function as desired?

 - Mark

Re: [Webware-devel] make mod_webkit errors out

[Mark P. <mar...@mo...>]

> On Nov 28, 2015, at 9:23 AM, Christoph Zwerschke <ci...@on...> wrote:
> Can you try with the latest version from trunk?
> I think this has been fixed already:
> 
> http://svn.w4py.org/Webware/trunk/WebKit/Adapters/mod_webkit2/

I copied two lines from the file in trunk into the file mod_webkit.c. Both “make” and “make install” completed normally without warnings. 

Thanks!

 - Mark

Re: [Webware-devel] make mod_webkit errors out

[Christoph Z. <ci...@on...>]

Am 28.11.2015 um 17:30 schrieb Mark Phillips:
> I would greatly appreciate advice on how to work around or through this.
>
> Installing on Centos 6, with gcc and apxs installed.
>
> [root mod_webkit2]# make

Can you try with the latest version from trunk?
I think this has been fixed already:

http://svn.w4py.org/Webware/trunk/WebKit/Adapters/mod_webkit2/

A new release of Webware is still somewhere on my todo list...

-- Christoph

[Webware-devel] make mod_webkit errors out

[Mark P. <mar...@mo...>]

I would greatly appreciate advice on how to work around or through this. 

Installing on Centos 6, with gcc and apxs installed.

[root mod_webkit2]# make
/usr/sbin/apxs -c -Wc,"" -o mod_webkit.la  mod_webkit.c marshal.c 
/usr/lib64/apr-1/build/libtool --silent --mode=compile gcc -prefer-pic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wformat-security -fno-strict-aliasing  -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/httpd  -I/usr/include/apr-1   -I/usr/include/apr-1    -c -o mod_webkit.lo mod_webkit.c && touch mod_webkit.slo
mod_webkit.c: In function ‘wksock_open’:
mod_webkit.c:265: warning: format not a string literal and no format arguments
mod_webkit.c: In function ‘webkit_handler’:
mod_webkit.c:596: warning: format not a string literal and no format arguments
/usr/lib64/apr-1/build/libtool --silent --mode=compile gcc -prefer-pic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wformat-security -fno-strict-aliasing  -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -pthread -I/usr/include/httpd  -I/usr/include/apr-1   -I/usr/include/apr-1    -c -o marshal.lo marshal.c && touch marshal.slo
/usr/lib64/apr-1/build/libtool --silent --mode=link gcc -o mod_webkit.la  -rpath /usr/lib64/httpd/modules -module -avoid-version    marshal.lo mod_webkit.lo
[root mod_webkit2]#

Re: [Webware-devel] "pip install mypy" fails with "ImportError: Python 3.4 is not supported by DBUtils."

[Christoph Z. <ci...@on...>]

Yes, the Python 3 support is not yet official. I plan to eventually move 
it to Github this year and create a new release that officially supports 
Python 3.

-- Chris


Am 04.07.2015 um 10:30 schrieb Mark Lawrence:
> <output>
> C:\Users\Mark\Documents\Cash\Python>pip install mypy
> ...
> Collecting dbutils (from sqlbean>=0.490->mypy)
>     Downloading DBUtils-1.1.tar.gz (109kB)
>       100% |################################| 110kB 72kB/s
>       Complete output from command python setup.py egg_info:
>       Traceback (most recent call last):
>         File "<string>", line 20, in <module>
>         File
> "C:\Users\Mark\AppData\Local\Temp\pip-build-1pb2zvhs\dbutils\setup.py",
> line 11, in <module>
>           raise ImportError('Python %d.%d is not supported by DBUtils.' %
> py_version)
>       ImportError: Python 3.4 is not supported by DBUtils.
>
>       ----------------------------------------
> Command "python setup.py egg_info" failed with error code 1 in
> C:\Users\Mark\AppData\Local\Temp\pip-build-1pb2zvhs\dbutils
> </output>

[Webware-devel] "pip install mypy" fails with "ImportError: Python 3.4 is not supported by DBUtils."

[Mark L. <bre...@ya...>]

<output>
C:\Users\Mark\Documents\Cash\Python>pip install mypy
...
Collecting dbutils (from sqlbean>=0.490->mypy)
   Downloading DBUtils-1.1.tar.gz (109kB)
     100% |################################| 110kB 72kB/s
     Complete output from command python setup.py egg_info:
     Traceback (most recent call last):
       File "<string>", line 20, in <module>
       File 
"C:\Users\Mark\AppData\Local\Temp\pip-build-1pb2zvhs\dbutils\setup.py", 
line 11, in <module>
         raise ImportError('Python %d.%d is not supported by DBUtils.' % 
py_version)
     ImportError: Python 3.4 is not supported by DBUtils.

     ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in 
C:\Users\Mark\AppData\Local\Temp\pip-build-1pb2zvhs\dbutils
</output>

The code has already been updated in trunk according to 
http://www.mail-archive.com/web...@li.../msg02766.html 
so I'd assume only the Python version check needs changing.

-- 
My fellow Pythonistas, ask not what our language can do for you, ask
what you can do for our language.

Mark Lawrence

Re: [Webware-devel] Changing HTTPRequest.py to allow multiple file uploads.

[Gary P. <gar...@as...>]

Hi, Christoph.

I just tested it, and it seems to work perfectly.

Thanks!
-Gary



> On Jun 7, 2015, at 5:13, Christoph Zwerschke <ci...@on...> wrote:
> 
> Am 28.05.2015 um 18:10 schrieb Gary Perez:
>> I'm not in a rush, so whenever you are done with vacation, here are
>> the relevant parts (complete with inane comments):
> 
> Thanks, I simplified the code and committed the change to the trunk:
> 
> http://svn.w4py.org/Webware/trunk/WebKit/HTTPRequest.py
> 
> Let me know if this works for you.
> 
> -- Christoph
> 
> ------------------------------------------------------------------------------
> _______________________________________________
> Webware-devel mailing list
> Web...@li...
> https://lists.sourceforge.net/lists/listinfo/webware-devel

Re: [Webware-devel] Changing HTTPRequest.py to allow multiple file uploads.

[Christoph Z. <ci...@on...>]

Am 28.05.2015 um 18:10 schrieb Gary Perez:
> I'm not in a rush, so whenever you are done with vacation, here are
> the relevant parts (complete with inane comments):

Thanks, I simplified the code and committed the change to the trunk:

http://svn.w4py.org/Webware/trunk/WebKit/HTTPRequest.py

Let me know if this works for you.

-- Christoph

Re: [Webware-devel] Changing HTTPRequest.py to allow multiple file uploads.

[Gary P. <gar...@as...>]

Hi, Christoph.

I'm not in a rush, so whenever you are done with vacation, here are the relevant parts (complete with inane comments):

# Webware 1.1.1, HTTPRequest.py, Lines 118-133  ##############################

        if fieldItems:
            for value in fieldItems:
                fields.setdefault(value.name, []).append(value)
            getValue = attrgetter('value')
            for key, value in fields.iteritems():
                if len(value) > 1:
                    value = map(getValue, value)
                else:
                    value = value[0]
                    if value.filename:
                        if debug:
                            print "Uploaded file found:", value.filename
                    else:
                        value = value.value
                fields[key] = value
        self._fieldStorage, self._fields = fieldStorage, fields

# My proposed changes, starting Line 118  ##############################

        if fieldItems:
            for value in fieldItems:
                fields.setdefault(value.name, []).append(value)
            getValue = attrgetter('value')

            for key, value in fields.iteritems():
                # IMPORTANT! value here is *always* a list, but it may contain only 1 member.
                # Are there multiple values for same key in the form?
                # This could be series of date pulldowns, or multiple file uploads.
                if len(value) > 1:
                    # Analyze members of this list, set flag as appropriate
                    IS_UPLOADS = False
                    for listitem in value:
                        try:
                            if listitem.filename: # True for an uploaded file
                                IS_UPLOADS = True
                        except AttributeError: # [str].filename throws this
                            pass

                    # Check flag
                    if IS_UPLOADS:
                        # The existing list of FieldStorage objects is exactly what we want, so we alter nothing here.
                        pass
                    else:
                        # Append the regular strings to the key's list.
                        value = map(getValue, value)

                else: # Only one value for this key
                    value = value[0]
                    # Now, is this an upload?
                    try:
                        if value.filename:
                            if debug:
                                print "Uploaded file found:", value.filename
                        else:
                            value = value.value
                    except AttributeError: # [str].filename throws this
                        value = value.value

                fields[key] = value
        self._fieldStorage, self._fields = fieldStorage, fields




Enjoy your holiday! Thanks,
-Gary


> On May 28, 2015, at 11:56, Christoph Zwerschke <ci...@on...> wrote:
> 
> Hi Gary,
> 
> thanks for the suggestion. I'm still maintaining Webware and will look 
> into any suggestion made here, though it may take some time (currently 
> on vacation).
> 
> You can also post patches and requests to
> http://sourceforge.net/p/webware/feature-requests/
> 
> -- Christoph
> 
> ------------------------------------------------------------------------------
> _______________________________________________
> Webware-devel mailing list
> Web...@li...
> https://lists.sourceforge.net/lists/listinfo/webware-devel

Re: [Webware-devel] Changing HTTPRequest.py to allow multiple file uploads.

[Christoph Z. <ci...@on...>]

Hi Gary,

thanks for the suggestion. I'm still maintaining Webware and will look 
into any suggestion made here, though it may take some time (currently 
on vacation).

You can also post patches and requests to
http://sourceforge.net/p/webware/feature-requests/

-- Christoph

[Webware-devel] Changing HTTPRequest.py to allow multiple file uploads.

[Gary P. <gar...@as...>]

I don't know if anyone is watching this list, but I thought I'd give it a shot.

We use Webware for Python to run our business Intranet. One new requirement is the ability to upload multiple files simultaneously.

I've changed the "if fieldItems" portion of HTTPRequest.py in WebKit to allow this.

In the existing 1.1.1 code:

A single upload using enctype=multipart/form-data returns:
{keyname: FieldStorage(file_object)}

A multiple file upload returns:
{keyname: [file_contents_as_string, other_file_contents_as_string]}

It loses the FieldStorage objects because of a map() function.

My change looks at the nature of the form values to see if file objects exist. If so, I avoid the map(), and maintain the original list of FieldStorage objects, which then is returned to the form handler for iteration & treatment as in a single file upload.

How can I go about getting this reviewed, and into the official distribution? If at all?

Please advise. Thank you.
-Gary

Re: [Webware-devel] DBUtils not supported for Python 3.1+

[Christoph Z. <ci...@on...>]

Am 22.08.2014 um 00:57 schrieb Jolitz Ben - bjolit:
> The following patch will make it install from pip quite fine on current
> Python 3 versions.

Thanks for the tip, Ben. DBUtils was not developed with Python 3 in 
mind, and I only tested and used it with Python 2, so I was amazed to 
see that this works without further modifications. I've now run the test 
suite on Python 3.4 and indeed it only found a minor problem that I've 
already fixed in trunk. If you find any other issues, let me know.

-- Christoph

[Webware-devel] DBUtils not supported for Python 3.1+

[Jolitz B. - b. <Ben...@ac...>]

The following patch will make it install from pip quite fine on current Python 3 versions.

I set the minor for Python 3 to ’10' as there are no expected major syntax changes to Python 3 planned and it is reasonable to assume this package will function well with 2to3 being run, but it really is just a number.

Cheers,
Ben Jolitz


diff -Naur DBUtils-1.1/setup.py DBUtils-1.1-fix/setup.py
--- DBUtils-1.1/setup.py 2011-08-14 05:01:30.000000000 -0700
+++ DBUtils-1.1-fix/setup.py 2014-08-21 15:55:04.000000000 -0700
@@ -7,7 +7,7 @@
 from sys import version_info

 py_version = version_info[:2]
-if not (2, 3) <= py_version < (3, 0):
+if not (2, 3) <= py_version < (3, 10):
     raise ImportError('Python %d.%d is not supported by DBUtils.' % py_version)

 import warnings
@@ -66,5 +66,6 @@
     license='Open Software License',
     packages=['DBUtils', 'DBUtils.Examples', 'DBUtils.Tests'],
     package_data={'DBUtils': ['Docs/*']},
-    zip_safe=0
+    zip_safe=0,
+    use_2to3 = True
 )
***************************************************************************
The information contained in this communication is confidential, is
intended only for the use of the recipient named above, and may be legally
privileged.

If the reader of this message is not the intended recipient, you are
hereby notified that any dissemination, distribution or copying of this
communication is strictly prohibited.

If you have received this communication in error, please resend this
communication to the sender and delete the original message or any copy
of it from your computer system.

Thank You.
****************************************************************************

Re: [Webware-devel] Can't compile mod_webkit2

[Andreas P. <a.p...@ac...>]

* Christoph Zwerschke <ci...@on...> [25.07.2014 14:40]:

> this has been fixed in the trunk:
> 
> http://svn.w4py.org/Webware/trunk/WebKit/Adapters/mod_webkit2/

Great, thanks a lot!

-- 
Bye, Andreas

Re: [Webware-devel] Can't compile mod_webkit2

[Christoph Z. <ci...@on...>]

Am 25.07.2014 um 14:03 schrieb Andreas Poisel:
> I can't compile mod_webkit2 (Webware 1.1.1) on Ubuntu Server 14.04:

Hi Andreas,

this has been fixed in the trunk:

http://svn.w4py.org/Webware/trunk/WebKit/Adapters/mod_webkit2/

-- Christoph

[Webware-devel] Can't compile mod_webkit2

[Andreas P. <a.p...@ac...>]

Hi!

I can't compile mod_webkit2 (Webware 1.1.1) on Ubuntu Server 14.04:

8<----------------------------------------------------------------------

% make
apxs2 -c -Wc,"" -o mod_webkit.la  mod_webkit.c marshal.c
/usr/share/apr-1.0/build/libtool --silent --mode=compile --tag=disable-static x86_64-linux-gnu-gcc -std=gnu99 -prefer-pic -pipe -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security  -D_FORTIFY_SOURCE=2   -DLINUX -D_REENTRANT -D_GNU_SOURCE  -pthread  -I/usr/include/apache2  -I/usr/include/apr-1.0   -I/usr/include/apr-1.0 -I/usr/include   -c -o mod_webkit.lo mod_webkit.c && touch mod_webkit.slo
mod_webkit.c: In function ‘wksock_open’:
mod_webkit.c:265:17: error: format not a string literal and no format arguments [-Werror=format-security]
                 log_error(sbuf, r->server);
                 ^
mod_webkit.c: In function ‘webkit_handler’:
mod_webkit.c:596:9: error: format not a string literal and no format arguments [-Werror=format-security]
         log_error(msgbuf, r->server);
         ^
cc1: some warnings being treated as errors
apxs:Error: Command failed with rc=65536
.
make: *** [mod_webkit.la] Error 1

8<----------------------------------------------------------------------

Any suggestions?  Thank you!

-- 
Bye, Andreas

Re: [Webware-devel] Compiling wkcgi on OpenBSD 5.4

[Jeff S. <je...@j-...>]

On Sunday, May 11, 2014 10:10:25 am Christoph Zwerschke wrote:
> Am 11.05.2014 03:30, schrieb Jeff Simmons:
> > Probably needs a small change in the Makefile, but I'm not enough of a C
> > programmer to know what. Any help would be appreciated.
> 
> As far as I see, the problem may be that the "make" of OpenBSD does not
> support $^ internal macro as GNU/Linux does.
> 
> Try to replace the $(^F) with the full list of prerequisites, i.e.:
> wkcgi.o marshal.o environ.o wkcommon.o parsecfg.o
> 
> -- Christoph

I've tried various variations on this, and was unable to get the Makefile to 
work. Must be some other things they don't support.

Fortunately, manually compiling and linking the various *.c files produces a 
working program.

-- 
Jeff Simmons			               je...@j-...
Simmons Consulting - Network Engineering, Administration, Security

Re: [Webware-devel] Compiling wkcgi on OpenBSD 5.4

[Christoph Z. <ci...@on...>]

Am 11.05.2014 03:30, schrieb Jeff Simmons:
> Probably needs a small change in the Makefile, but I'm not enough of a C
> programmer to know what. Any help would be appreciated.

As far as I see, the problem may be that the "make" of OpenBSD does not 
support $^ internal macro as GNU/Linux does.

Try to replace the $(^F) with the full list of prerequisites, i.e.:
wkcgi.o marshal.o environ.o wkcommon.o parsecfg.o

-- Christoph

[Webware-devel] Compiling wkcgi on OpenBSD 5.4

[Jeff S. <je...@j-...>]

Hello, list. Sorry to bother you.

Trying to compile wkcgi on OpenBSD 5.4 I get the following:

proxy:/usr/local/src/Webware-1.1.1/WebKit/Adapters/wkcgi# make
cc -O2 -c wkcgi.c
cc -O2 -c ../common/marshal.c
cc -O2 -c ../common/environ.c
cc -O2 -c ../common/wkcommon.c
cc -O2 -c ../common/parsecfg.c
cc   -o ./wkcgi
cc: no input files
*** Error 1 in /usr/local/src/Webware-1.1.1/WebKit/Adapters/wkcgi (Makefile:14 
'wkcgi')

Probably needs a small change in the Makefile, but I'm not enough of a C 
programmer to know what. Any help would be appreciated.

-- 
Jeff Simmons			               je...@j-...
Simmons Consulting - Network Engineering, Administration, Security

Re: [Webware-devel] Strange Webware Appserver failures - I need ideas

[Christoph Z. <ci...@on...>]

Am 30.04.2014 18:32, schrieb F. Behrens:
> for the first time in many years, a webware project for a customer has
> developed constant failure conditions. I do, however, have problems to
> isolate possible causes.

Never came across this kind of error. Maybe there is a memory leak and 
it happens your server is running out of memory? I would monitor memory 
usage and look if this is correlated.

-- Christoph

[Webware-devel] Strange Webware Appserver failures - I need ideas

[F. B. <web...@sp...>]

Hi all,

for the first time in many years, a webware project for a customer has
developed constant failure conditions. I do, however, have problems to
isolate possible causes.

Webware runs with mod_webware in apache. In irggualr intervals, the
following happens:

Exception in worker thread
-- CMDERR: cmd: ['CONNECT', 669L, 0] -> reply: Connection already active.
Traceback (most recent call last):
  File "/opt/webware/WebKit/ThreadedAppServer.py", line 688, in threadloop
---------> Duplicate connect requests from 84.153.216.42 and
80.145.254.106 ??
    handler.handleRequest()
  File "/opt/webware/WebKit/ThreadedAppServer.py", line 1134, in
handleRequest
    requestDict = self.receiveDict()
  File "/opt/webware/WebKit/ThreadedAppServer.py", line 916, in receiveDict
    block = self._sock.recv(missing)
error: [Errno 9] Bad file descriptor

[ ... 200-300 more of these tracebacks, then a lot of consecutive
"Exception in worker thread" lines, then more tracebacks and so on ...]

As I see it, the failure point is in AppServer, while trying to receive
parts of a request header in dictionary format - apparently from a
socket that has somehow become invalid. Interesting enough it can happen
that some hours(!) later, the AppServer suddenly continues to work
properly, without restart.

When I restart the Appserver completely, the problem is gone immediately.

I'd appreciate any hint on where to begin the investigation and what to
look after.

Thank you for reading!

Re: [Webware-devel] dos/unix line endings on 1.1.1

[Roger H. <cro...@ya...>]

You are correct.  The .bat files look OK.  Thanks for your help.

Roger Haase


________________________________
 From: Christoph Zwerschke <ci...@on...>
To: web...@li... 
Sent: Sunday, September 8, 2013 12:34 PM
Subject: Re: [Webware-devel] dos/unix line endings on 1.1.1
 

Am 08.09.2013 18:47, schrieb Roger Haase:
> I noticed a few inconsistencies on line endings on the 1.1.1 release.

Thanks Roger, I fixed the .py files in the repository now.

The .config and .bat files seem to be ok in the distributed archive, 
though. Can you check again?

-- Christoph



------------------------------------------------------------------------------
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
_______________________________________________
Webware-devel mailing list
Web...@li...
https://lists.sourceforge.net/lists/listinfo/webware-devel