babeldoc-devel

[Babeldoc-devel] Question regarding FTP scanner

[David G. <dg...@co...>]

Gentlemen,

I'm trying to set up the FtpScanner, but it is crashing.  The stack trace and 
config filre are shown below.  The stack trace show that MsFtpFileListParser 
was called,and the source code indicates that the FtpScanner has been 
optimized for Microsoft FTP.  Does the FtpScanner also work with 
non-Microsoft FTP servers?  The one I'm accessing is on an AS/400, but I've 
used manual FTP clients to it prevously without problems.


Thanks,

David


=== CONFIG.PROPERTIES ===
#scan ftp site every 1 hour for files to place into the outbound pipeline
ftpscan.type=ftp
#ftpscan.period=3600000
ftpscan.period=10000
ftpscan.ftpHost=as400
ftpscan.ftpUsername=AMUSER
ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to shoot you otherwise
ftpscan.pipeline=test
ftpscan.filter=EBPRDIMP.EBPRDRR

=== STACK TRACE ===
<2003-10-17 12:44:02,550> ERROR [ftpscan] :  [ScannerWorker.process] Error 
scanning...
java.lang.NumberFormatException: For input string: "10/07/03"
        at 
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
        at java.lang.Long.parseLong(Long.java:332)
        at java.lang.Long.parseLong(Long.java:381)
        at 
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry(Unknown 
Source)
        at 
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileList(Unknown 
Source)
        at org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
        at org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
        at com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown 
Source)
        at com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown Source)
        at com.babeldoc.scanner.ScannerWorker.process(Unknown Source)
        at com.babeldoc.scanner.ScannerThread.run(Unknown Source)

-- 
David Glick
Transmit Consulting, Inc
619-475-4052
dg...@tr...

Re: [Babeldoc-devel] Question regarding FTP scanner

[Dejan K. <dej...@ya...>]

Hi David,
FtpScanner is using Jakarta Commons Net 1.0 package
(ex ORO Net Components 3.8.1) for ftp scannong. This
component was mad to work with Unix based servers and
you were supposed to implement support for other
servers. Since I needed to use it for MS FTP server I
have implement support for it.
AFAIK, Commons Net is improving and they have changed
the way how server listing is parsed, and also they
should support other systems (MS for example).
However, the code for that was not released yet but I
think it will be released very soon (actualy the
voting for Commons Net 1.1 relesase has already been
started on Jakarta's mailing list).

So you have three options:
- Try to implement AS/400 support by yourself. You
need to parse your server's output to extract
filenames, etc  look at the code for
MsFtpFileListParser.
- wait for Commons Net 1.1
- use Commons Net CVS snapshot

Note that  AS/400 might left unsupported by Commons
Net 1.1. Try to look at their CVS, there are parsers
for most systems... 

Dejan

--- David Glick <dg...@co...> wrote:
> Gentlemen,
> 
> I'm trying to set up the FtpScanner, but it is
> crashing.  The stack trace and 
> config filre are shown below.  The stack trace show
> that MsFtpFileListParser 
> was called,and the source code indicates that the
> FtpScanner has been 
> optimized for Microsoft FTP.  Does the FtpScanner
> also work with 
> non-Microsoft FTP servers?  The one I'm accessing is
> on an AS/400, but I've 
> used manual FTP clients to it prevously without
> problems.
> 
> 
> Thanks,
> 
> David
> 
> 
> === CONFIG.PROPERTIES ===
> #scan ftp site every 1 hour for files to place into
> the outbound pipeline
> ftpscan.type=ftp
> #ftpscan.period=3600000
> ftpscan.period=10000
> ftpscan.ftpHost=as400
> ftpscan.ftpUsername=AMUSER
> ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> shoot you otherwise
> ftpscan.pipeline=test
> ftpscan.filter=EBPRDIMP.EBPRDRR
> 
> === STACK TRACE ===
> <2003-10-17 12:44:02,550> ERROR [ftpscan] : 
> [ScannerWorker.process] Error 
> scanning...
> java.lang.NumberFormatException: For input string:
> "10/07/03"
>         at 
>
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
>         at java.lang.Long.parseLong(Long.java:332)
>         at java.lang.Long.parseLong(Long.java:381)
>         at 
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry(Unknown
> 
> Source)
>         at 
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileList(Unknown
> 
> Source)
>         at
>
org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
>         at
>
org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
>         at
>
com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> 
> Source)
>         at
>
com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> Source)
>         at
> com.babeldoc.scanner.ScannerWorker.process(Unknown
> Source)
>         at
> com.babeldoc.scanner.ScannerThread.run(Unknown
> Source)
> 
> -- 
> David Glick
> Transmit Consulting, Inc
> 619-475-4052
> dg...@tr...
> 
> 
> 
>
-------------------------------------------------------
> This SF.net email sponsored by: Enterprise Linux
> Forum Conference & Expo
> The Event For Linux Datacenter Solutions &
> Strategies in The Enterprise 
> Linux in the Boardroom; in the Front Office; & in
> the Server Room 
> http://www.enterpriselinuxforum.com
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
>
https://lists.sourceforge.net/lists/listinfo/babeldoc-devel


__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [Babeldoc-devel] Question regarding FTP scanner

[David G. <dg...@co...>]

Thanks, Dejan.  I downloaded and tested the latest snapshot directly using the 
ftp example, and it worked like a charm.  Since I'm now on a tight deadline, 
I need to decide whether it will be easier to integrate the newest version 
back into Babeldoc, or just run it externally for my needs...

Life is ALWAYS interesting at crunch time!

David


On Friday 17 October 2003 3:15 pm, Dejan Krsmanovic wrote:
> Hi David,
> FtpScanner is using Jakarta Commons Net 1.0 package
> (ex ORO Net Components 3.8.1) for ftp scannong. This
> component was mad to work with Unix based servers and
> you were supposed to implement support for other
> servers. Since I needed to use it for MS FTP server I
> have implement support for it.
> AFAIK, Commons Net is improving and they have changed
> the way how server listing is parsed, and also they
> should support other systems (MS for example).
> However, the code for that was not released yet but I
> think it will be released very soon (actualy the
> voting for Commons Net 1.1 relesase has already been
> started on Jakarta's mailing list).
>
> So you have three options:
> - Try to implement AS/400 support by yourself. You
> need to parse your server's output to extract
> filenames, etc  look at the code for
> MsFtpFileListParser.
> - wait for Commons Net 1.1
> - use Commons Net CVS snapshot
>
> Note that  AS/400 might left unsupported by Commons
> Net 1.1. Try to look at their CVS, there are parsers
> for most systems...
>
> Dejan
>
> --- David Glick <dg...@co...> wrote:
> > Gentlemen,
> >
> > I'm trying to set up the FtpScanner, but it is
> > crashing.  The stack trace and
> > config filre are shown below.  The stack trace show
> > that MsFtpFileListParser
> > was called,and the source code indicates that the
> > FtpScanner has been
> > optimized for Microsoft FTP.  Does the FtpScanner
> > also work with
> > non-Microsoft FTP servers?  The one I'm accessing is
> > on an AS/400, but I've
> > used manual FTP clients to it prevously without
> > problems.
> >
> >
> > Thanks,
> >
> > David
> >
> >
> > === CONFIG.PROPERTIES ===
> > #scan ftp site every 1 hour for files to place into
> > the outbound pipeline
> > ftpscan.type=ftp
> > #ftpscan.period=3600000
> > ftpscan.period=10000
> > ftpscan.ftpHost=as400
> > ftpscan.ftpUsername=AMUSER
> > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> > shoot you otherwise
> > ftpscan.pipeline=test
> > ftpscan.filter=EBPRDIMP.EBPRDRR
> >
> > === STACK TRACE ===
> > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > [ScannerWorker.process] Error
> > scanning...
> > java.lang.NumberFormatException: For input string:
> > "10/07/03"
> >         at
>
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:4
>8)
>
> >         at java.lang.Long.parseLong(Long.java:332)
> >         at java.lang.Long.parseLong(Long.java:381)
> >         at
>
> com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry(Unk
>nown
>
> > Source)
> >         at
>
> com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileList(
>Unknown
>
> > Source)
> >         at
>
> org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
>
> >         at
>
> org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
>
> >         at
>
> com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
>
> > Source)
> >         at
>
> com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
>
> > Source)
> >         at
> > com.babeldoc.scanner.ScannerWorker.process(Unknown
> > Source)
> >         at
> > com.babeldoc.scanner.ScannerThread.run(Unknown
> > Source)
> >
> > --
> > David Glick
> > Transmit Consulting, Inc
> > 619-475-4052
> > dg...@tr...
>
> -------------------------------------------------------
>
> > This SF.net email sponsored by: Enterprise Linux
> > Forum Conference & Expo
> > The Event For Linux Datacenter Solutions &
> > Strategies in The Enterprise
> > Linux in the Boardroom; in the Front Office; & in
> > the Server Room
> > http://www.enterpriselinuxforum.com
> > _______________________________________________
> > Babeldoc-devel mailing list
> > Bab...@li...
>
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
>
>
> __________________________________
> Do you Yahoo!?
> The New Yahoo! Shopping - with improved product search
> http://shopping.yahoo.com

-- 
David Glick
Transmit Consulting, Inc
619-475-4052
dg...@tr...

Re: [Babeldoc-devel] Question regarding FTP scanner

[Bruce M. <br...@mc...>]

Integrate.  This is what we need to get babeldoc stable.  We can build the 
future in 1.3.  Dejan, can you check if your application still works with the 
new code.  Anyone else check please.   

Ps.  I will be doing a release tonight !prior!  to the 

On Friday 17 October 2003 07:57 pm, David Glick wrote:
> Thanks, Dejan.  I downloaded and tested the latest snapshot directly using
> the ftp example, and it worked like a charm.  Since I'm now on a tight
> deadline, I need to decide whether it will be easier to integrate the
> newest version back into Babeldoc, or just run it externally for my
> needs...
>
> Life is ALWAYS interesting at crunch time!
>
> David
>
> On Friday 17 October 2003 3:15 pm, Dejan Krsmanovic wrote:
> > Hi David,
> > FtpScanner is using Jakarta Commons Net 1.0 package
> > (ex ORO Net Components 3.8.1) for ftp scannong. This
> > component was mad to work with Unix based servers and
> > you were supposed to implement support for other
> > servers. Since I needed to use it for MS FTP server I
> > have implement support for it.
> > AFAIK, Commons Net is improving and they have changed
> > the way how server listing is parsed, and also they
> > should support other systems (MS for example).
> > However, the code for that was not released yet but I
> > think it will be released very soon (actualy the
> > voting for Commons Net 1.1 relesase has already been
> > started on Jakarta's mailing list).
> >
> > So you have three options:
> > - Try to implement AS/400 support by yourself. You
> > need to parse your server's output to extract
> > filenames, etc  look at the code for
> > MsFtpFileListParser.
> > - wait for Commons Net 1.1
> > - use Commons Net CVS snapshot
> >
> > Note that  AS/400 might left unsupported by Commons
> > Net 1.1. Try to look at their CVS, there are parsers
> > for most systems...
> >
> > Dejan
> >
> > --- David Glick <dg...@co...> wrote:
> > > Gentlemen,
> > >
> > > I'm trying to set up the FtpScanner, but it is
> > > crashing.  The stack trace and
> > > config filre are shown below.  The stack trace show
> > > that MsFtpFileListParser
> > > was called,and the source code indicates that the
> > > FtpScanner has been
> > > optimized for Microsoft FTP.  Does the FtpScanner
> > > also work with
> > > non-Microsoft FTP servers?  The one I'm accessing is
> > > on an AS/400, but I've
> > > used manual FTP clients to it prevously without
> > > problems.
> > >
> > >
> > > Thanks,
> > >
> > > David
> > >
> > >
> > > === CONFIG.PROPERTIES ===
> > > #scan ftp site every 1 hour for files to place into
> > > the outbound pipeline
> > > ftpscan.type=ftp
> > > #ftpscan.period=3600000
> > > ftpscan.period=10000
> > > ftpscan.ftpHost=as400
> > > ftpscan.ftpUsername=AMUSER
> > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> > > shoot you otherwise
> > > ftpscan.pipeline=test
> > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > >
> > > === STACK TRACE ===
> > > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > > [ScannerWorker.process] Error
> > > scanning...
> > > java.lang.NumberFormatException: For input string:
> > > "10/07/03"
> > >         at
> >
> > java.lang.NumberFormatException.forInputString(NumberFormatException.java
> >:4 8)
> >
> > >         at java.lang.Long.parseLong(Long.java:332)
> > >         at java.lang.Long.parseLong(Long.java:381)
> > >         at
> >
> > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry(U
> >nk nown
> >
> > > Source)
> > >         at
> >
> > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileLis
> >t( Unknown
> >
> > > Source)
> > >         at
> >
> > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
> >
> > >         at
> >
> > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
> >
> > >         at
> >
> > com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> >
> > > Source)
> > >         at
> >
> > com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> >
> > > Source)
> > >         at
> > > com.babeldoc.scanner.ScannerWorker.process(Unknown
> > > Source)
> > >         at
> > > com.babeldoc.scanner.ScannerThread.run(Unknown
> > > Source)
> > >
> > > --
> > > David Glick
> > > Transmit Consulting, Inc
> > > 619-475-4052
> > > dg...@tr...
> >
> > -------------------------------------------------------
> >
> > > This SF.net email sponsored by: Enterprise Linux
> > > Forum Conference & Expo
> > > The Event For Linux Datacenter Solutions &
> > > Strategies in The Enterprise
> > > Linux in the Boardroom; in the Front Office; & in
> > > the Server Room
> > > http://www.enterpriselinuxforum.com
> > > _______________________________________________
> > > Babeldoc-devel mailing list
> > > Bab...@li...
> >
> > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > The New Yahoo! Shopping - with improved product search
> > http://shopping.yahoo.com

Re: [Babeldoc-devel] Question regarding FTP scanner

[Dejan K. <dej...@ya...>]

I agree. Commons Net 1.1 final will not be different
from current CVS snapshot version. Only bugfixes are
expexted - no API changes. So we will be able to
switch   to final version without code modification.
In fact, it will make FtpScanner's code easer since
MsFtpFileListParser class that I made as a workaround
for MS Ftp server, will became unnecessary. I can
remove that code later, but I think it will work with
it, too. 
As I can remeber FtpScanner first tries to list files
with default settings of Commons Net (which worked for
most Unix bases systems). If that fails, then it tries
with MsFtpFileListParser. That worked for my case  but
it won't work for other systems. Anyway, new Commons
Net should be more clever - it will recognize type of
server by itself and will use appropriate parser which
are now already implemented (contrary to 1.0 version
where user is expected to implement non-defulat
parsers). 
Listing files with Net 1.1 will always be successfull
and mine MsFtpFileListParser will never be used so the
code should work equally with or without it. 
So David, you can commit Commons Net CVS snapshot
version instead of current version that we use now.

And Bruce, I don't use Windows as Ftp server anymore!
I learned my lesson! ;) But I will try to test it when
I have time...

Dejan 


--- Bruce McDonald <br...@mc...> wrote:
> Integrate.  This is what we need to get babeldoc
> stable.  We can build the 
> future in 1.3.  Dejan, can you check if your
> application still works with the 
> new code.  Anyone else check please.   
> 
> Ps.  I will be doing a release tonight !prior!  to
> the 
> 
> On Friday 17 October 2003 07:57 pm, David Glick
> wrote:
> > Thanks, Dejan.  I downloaded and tested the latest
> snapshot directly using
> > the ftp example, and it worked like a charm. 
> Since I'm now on a tight
> > deadline, I need to decide whether it will be
> easier to integrate the
> > newest version back into Babeldoc, or just run it
> externally for my
> > needs...
> >
> > Life is ALWAYS interesting at crunch time!
> >
> > David
> >
> > On Friday 17 October 2003 3:15 pm, Dejan
> Krsmanovic wrote:
> > > Hi David,
> > > FtpScanner is using Jakarta Commons Net 1.0
> package
> > > (ex ORO Net Components 3.8.1) for ftp scannong.
> This
> > > component was mad to work with Unix based
> servers and
> > > you were supposed to implement support for other
> > > servers. Since I needed to use it for MS FTP
> server I
> > > have implement support for it.
> > > AFAIK, Commons Net is improving and they have
> changed
> > > the way how server listing is parsed, and also
> they
> > > should support other systems (MS for example).
> > > However, the code for that was not released yet
> but I
> > > think it will be released very soon (actualy the
> > > voting for Commons Net 1.1 relesase has already
> been
> > > started on Jakarta's mailing list).
> > >
> > > So you have three options:
> > > - Try to implement AS/400 support by yourself.
> You
> > > need to parse your server's output to extract
> > > filenames, etc  look at the code for
> > > MsFtpFileListParser.
> > > - wait for Commons Net 1.1
> > > - use Commons Net CVS snapshot
> > >
> > > Note that  AS/400 might left unsupported by
> Commons
> > > Net 1.1. Try to look at their CVS, there are
> parsers
> > > for most systems...
> > >
> > > Dejan
> > >
> > > --- David Glick <dg...@co...> wrote:
> > > > Gentlemen,
> > > >
> > > > I'm trying to set up the FtpScanner, but it is
> > > > crashing.  The stack trace and
> > > > config filre are shown below.  The stack trace
> show
> > > > that MsFtpFileListParser
> > > > was called,and the source code indicates that
> the
> > > > FtpScanner has been
> > > > optimized for Microsoft FTP.  Does the
> FtpScanner
> > > > also work with
> > > > non-Microsoft FTP servers?  The one I'm
> accessing is
> > > > on an AS/400, but I've
> > > > used manual FTP clients to it prevously
> without
> > > > problems.
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > David
> > > >
> > > >
> > > > === CONFIG.PROPERTIES ===
> > > > #scan ftp site every 1 hour for files to place
> into
> > > > the outbound pipeline
> > > > ftpscan.type=ftp
> > > > #ftpscan.period=3600000
> > > > ftpscan.period=10000
> > > > ftpscan.ftpHost=as400
> > > > ftpscan.ftpUsername=AMUSER
> > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have
> to
> > > > shoot you otherwise
> > > > ftpscan.pipeline=test
> > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > >
> > > > === STACK TRACE ===
> > > > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > > > [ScannerWorker.process] Error
> > > > scanning...
> > > > java.lang.NumberFormatException: For input
> string:
> > > > "10/07/03"
> > > >         at
> > >
> > >
>
java.lang.NumberFormatException.forInputString(NumberFormatException.java
> > >:4 8)
> > >
> > > >         at
> java.lang.Long.parseLong(Long.java:332)
> > > >         at
> java.lang.Long.parseLong(Long.java:381)
> > > >         at
> > >
> > >
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry(U
> > >nk nown
> > >
> > > > Source)
> > > >         at
> > >
> > >
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileLis
> > >t( Unknown
> > >
> > > > Source)
> > > >         at
> > >
> > >
>
org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
> > >
> > > >         at
> > >
> > >
>
org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
> > >
> > > >         at
> > >
> > >
>
com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> > >
> > > > Source)
> > > >         at
> > >
> > >
>
com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> > >
> > > > Source)
> > > >         at
> > > >
> com.babeldoc.scanner.ScannerWorker.process(Unknown
> > > > Source)
> > > >         at
> > > > com.babeldoc.scanner.ScannerThread.run(Unknown
> > > > Source)
> > > >
> > > > --
> > > > David Glick
> > > > Transmit Consulting, Inc
> > > > 619-475-4052
> > > > dg...@tr...
> > >
> > >
>
-------------------------------------------------------
> > >
> > > > This SF.net email sponsored by: Enterprise
> Linux
> > > > Forum Conference & Expo
> > > > The Event For Linux Datacenter Solutions &
> > > > Strategies in The Enterprise
> > > > Linux in the Boardroom; in the Front Office; &
> in
> > > > the Server Room
> > > > http://www.enterpriselinuxforum.com
> > > >
> _______________________________________________
> > > > Babeldoc-devel mailing list
> > > > Bab...@li...
> > >
> > >
>
https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> > >
> > >
> > > __________________________________
> > > Do you Yahoo!?
> > > The New Yahoo! Shopping - with improved product
> search
> 
=== message truncated ===


__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [Babeldoc-devel] Question regarding FTP scanner

[David G. <dg...@co...>]

Hi Bruce,

Sorry, I didn't explain myself well.  I'll certainly integrate the newest 
commons net in when I get a chance.  The question was whether to integrate it 
into the 'go-live' version Babeldoc we're using on Production (1.1.8-dev)..  
We've fully tested on it, and therefore we won't be upgrading to the 'real' 
release until after go-live.  The FTP piece is pretty isolated, so if I can 
drop it into 1.1.8-dev and everything starts working, that 's a level of 
integration I can handle.  If it doesn't work, I don't know if I'll have time 
to troubleshoot it, so I may end up calling the ftp transfer as an 'external 
to Babeldoc' process just to get over this hump.

Regardless, I will integrate it into the current Babeldoc (after I get a 
reasonable amount of sleep... :-)).


David


On Friday 17 October 2003 10:08 pm, Bruce McDonald wrote:
> Integrate.  This is what we need to get babeldoc stable.  We can build the
> future in 1.3.  Dejan, can you check if your application still works with
> the new code.  Anyone else check please.
>
> Ps.  I will be doing a release tonight !prior!  to the
>
> On Friday 17 October 2003 07:57 pm, David Glick wrote:
> > Thanks, Dejan.  I downloaded and tested the latest snapshot directly
> > using the ftp example, and it worked like a charm.  Since I'm now on a
> > tight deadline, I need to decide whether it will be easier to integrate
> > the newest version back into Babeldoc, or just run it externally for my
> > needs...
> >
> > Life is ALWAYS interesting at crunch time!
> >
> > David
> >
> > On Friday 17 October 2003 3:15 pm, Dejan Krsmanovic wrote:
> > > Hi David,
> > > FtpScanner is using Jakarta Commons Net 1.0 package
> > > (ex ORO Net Components 3.8.1) for ftp scannong. This
> > > component was mad to work with Unix based servers and
> > > you were supposed to implement support for other
> > > servers. Since I needed to use it for MS FTP server I
> > > have implement support for it.
> > > AFAIK, Commons Net is improving and they have changed
> > > the way how server listing is parsed, and also they
> > > should support other systems (MS for example).
> > > However, the code for that was not released yet but I
> > > think it will be released very soon (actualy the
> > > voting for Commons Net 1.1 relesase has already been
> > > started on Jakarta's mailing list).
> > >
> > > So you have three options:
> > > - Try to implement AS/400 support by yourself. You
> > > need to parse your server's output to extract
> > > filenames, etc  look at the code for
> > > MsFtpFileListParser.
> > > - wait for Commons Net 1.1
> > > - use Commons Net CVS snapshot
> > >
> > > Note that  AS/400 might left unsupported by Commons
> > > Net 1.1. Try to look at their CVS, there are parsers
> > > for most systems...
> > >
> > > Dejan
> > >
> > > --- David Glick <dg...@co...> wrote:
> > > > Gentlemen,
> > > >
> > > > I'm trying to set up the FtpScanner, but it is
> > > > crashing.  The stack trace and
> > > > config filre are shown below.  The stack trace show
> > > > that MsFtpFileListParser
> > > > was called,and the source code indicates that the
> > > > FtpScanner has been
> > > > optimized for Microsoft FTP.  Does the FtpScanner
> > > > also work with
> > > > non-Microsoft FTP servers?  The one I'm accessing is
> > > > on an AS/400, but I've
> > > > used manual FTP clients to it prevously without
> > > > problems.
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > David
> > > >
> > > >
> > > > === CONFIG.PROPERTIES ===
> > > > #scan ftp site every 1 hour for files to place into
> > > > the outbound pipeline
> > > > ftpscan.type=ftp
> > > > #ftpscan.period=3600000
> > > > ftpscan.period=10000
> > > > ftpscan.ftpHost=as400
> > > > ftpscan.ftpUsername=AMUSER
> > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> > > > shoot you otherwise
> > > > ftpscan.pipeline=test
> > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > >
> > > > === STACK TRACE ===
> > > > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > > > [ScannerWorker.process] Error
> > > > scanning...
> > > > java.lang.NumberFormatException: For input string:
> > > > "10/07/03"
> > > >         at
> > >
> > > java.lang.NumberFormatException.forInputString(NumberFormatException.ja
> > >va
> > >
> > >:4 8)
> > >:
> > > >         at java.lang.Long.parseLong(Long.java:332)
> > > >         at java.lang.Long.parseLong(Long.java:381)
> > > >         at
> > >
> > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEntry
> > >(U nk nown
> > >
> > > > Source)
> > > >         at
> > >
> > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFileL
> > >is t( Unknown
> > >
> > > > Source)
> > > >         at
> > >
> > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
> > >
> > > >         at
> > >
> > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
> > >
> > > >         at
> > >
> > > com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> > >
> > > > Source)
> > > >         at
> > >
> > > com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> > >
> > > > Source)
> > > >         at
> > > > com.babeldoc.scanner.ScannerWorker.process(Unknown
> > > > Source)
> > > >         at
> > > > com.babeldoc.scanner.ScannerThread.run(Unknown
> > > > Source)
> > > >
> > > > --
> > > > David Glick
> > > > Transmit Consulting, Inc
> > > > 619-475-4052
> > > > dg...@tr...
> > >
> > > -------------------------------------------------------
> > >
> > > > This SF.net email sponsored by: Enterprise Linux
> > > > Forum Conference & Expo
> > > > The Event For Linux Datacenter Solutions &
> > > > Strategies in The Enterprise
> > > > Linux in the Boardroom; in the Front Office; & in
> > > > the Server Room
> > > > http://www.enterpriselinuxforum.com
> > > > _______________________________________________
> > > > Babeldoc-devel mailing list
> > > > Bab...@li...
> > >
> > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> > >
> > >
> > > __________________________________
> > > Do you Yahoo!?
> > > The New Yahoo! Shopping - with improved product search
> > > http://shopping.yahoo.com

-- 
David Glick
Transmit Consulting, Inc
619-475-4052
dg...@tr...

Re: [Babeldoc-devel] Question regarding FTP scanner

[Bruce M. <br...@mc...>]

Moving to the "external application module" is good enough to get things 
working assuming you have a decent shell (you use linux - so you are ok 
there).

On Saturday 18 October 2003 08:44 am, David Glick wrote:
> Hi Bruce,
>
> Sorry, I didn't explain myself well.  I'll certainly integrate the newest
> commons net in when I get a chance.  The question was whether to integrate
> it into the 'go-live' version Babeldoc we're using on Production
> (1.1.8-dev).. We've fully tested on it, and therefore we won't be upgrading
> to the 'real' release until after go-live.  The FTP piece is pretty
> isolated, so if I can drop it into 1.1.8-dev and everything starts working,
> that 's a level of integration I can handle.  If it doesn't work, I don't
> know if I'll have time to troubleshoot it, so I may end up calling the ftp
> transfer as an 'external to Babeldoc' process just to get over this hump.
>
> Regardless, I will integrate it into the current Babeldoc (after I get a
> reasonable amount of sleep... :-)).
>
>
> David
>
> On Friday 17 October 2003 10:08 pm, Bruce McDonald wrote:
> > Integrate.  This is what we need to get babeldoc stable.  We can build
> > the future in 1.3.  Dejan, can you check if your application still works
> > with the new code.  Anyone else check please.
> >
> > Ps.  I will be doing a release tonight !prior!  to the
> >
> > On Friday 17 October 2003 07:57 pm, David Glick wrote:
> > > Thanks, Dejan.  I downloaded and tested the latest snapshot directly
> > > using the ftp example, and it worked like a charm.  Since I'm now on a
> > > tight deadline, I need to decide whether it will be easier to integrate
> > > the newest version back into Babeldoc, or just run it externally for my
> > > needs...
> > >
> > > Life is ALWAYS interesting at crunch time!
> > >
> > > David
> > >
> > > On Friday 17 October 2003 3:15 pm, Dejan Krsmanovic wrote:
> > > > Hi David,
> > > > FtpScanner is using Jakarta Commons Net 1.0 package
> > > > (ex ORO Net Components 3.8.1) for ftp scannong. This
> > > > component was mad to work with Unix based servers and
> > > > you were supposed to implement support for other
> > > > servers. Since I needed to use it for MS FTP server I
> > > > have implement support for it.
> > > > AFAIK, Commons Net is improving and they have changed
> > > > the way how server listing is parsed, and also they
> > > > should support other systems (MS for example).
> > > > However, the code for that was not released yet but I
> > > > think it will be released very soon (actualy the
> > > > voting for Commons Net 1.1 relesase has already been
> > > > started on Jakarta's mailing list).
> > > >
> > > > So you have three options:
> > > > - Try to implement AS/400 support by yourself. You
> > > > need to parse your server's output to extract
> > > > filenames, etc  look at the code for
> > > > MsFtpFileListParser.
> > > > - wait for Commons Net 1.1
> > > > - use Commons Net CVS snapshot
> > > >
> > > > Note that  AS/400 might left unsupported by Commons
> > > > Net 1.1. Try to look at their CVS, there are parsers
> > > > for most systems...
> > > >
> > > > Dejan
> > > >
> > > > --- David Glick <dg...@co...> wrote:
> > > > > Gentlemen,
> > > > >
> > > > > I'm trying to set up the FtpScanner, but it is
> > > > > crashing.  The stack trace and
> > > > > config filre are shown below.  The stack trace show
> > > > > that MsFtpFileListParser
> > > > > was called,and the source code indicates that the
> > > > > FtpScanner has been
> > > > > optimized for Microsoft FTP.  Does the FtpScanner
> > > > > also work with
> > > > > non-Microsoft FTP servers?  The one I'm accessing is
> > > > > on an AS/400, but I've
> > > > > used manual FTP clients to it prevously without
> > > > > problems.
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > David
> > > > >
> > > > >
> > > > > === CONFIG.PROPERTIES ===
> > > > > #scan ftp site every 1 hour for files to place into
> > > > > the outbound pipeline
> > > > > ftpscan.type=ftp
> > > > > #ftpscan.period=3600000
> > > > > ftpscan.period=10000
> > > > > ftpscan.ftpHost=as400
> > > > > ftpscan.ftpUsername=AMUSER
> > > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> > > > > shoot you otherwise
> > > > > ftpscan.pipeline=test
> > > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > > >
> > > > > === STACK TRACE ===
> > > > > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > > > > [ScannerWorker.process] Error
> > > > > scanning...
> > > > > java.lang.NumberFormatException: For input string:
> > > > > "10/07/03"
> > > > >         at
> > > >
> > > > java.lang.NumberFormatException.forInputString(NumberFormatException.
> > > >ja va
> > > >
> > > >:4 8)
> > > >:
> > > > >         at java.lang.Long.parseLong(Long.java:332)
> > > > >         at java.lang.Long.parseLong(Long.java:381)
> > > > >         at
> > > >
> > > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseEnt
> > > >ry (U nk nown
> > > >
> > > > > Source)
> > > > >         at
> > > >
> > > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseFil
> > > >eL is t( Unknown
> > > >
> > > > > Source)
> > > > >         at
> > > >
> > > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
> > > >
> > > > >         at
> > > >
> > > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
> > > >
> > > > >         at
> > > >
> > > > com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> > > >
> > > > > Source)
> > > > >         at
> > > >
> > > > com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> > > >
> > > > > Source)
> > > > >         at
> > > > > com.babeldoc.scanner.ScannerWorker.process(Unknown
> > > > > Source)
> > > > >         at
> > > > > com.babeldoc.scanner.ScannerThread.run(Unknown
> > > > > Source)
> > > > >
> > > > > --
> > > > > David Glick
> > > > > Transmit Consulting, Inc
> > > > > 619-475-4052
> > > > > dg...@tr...
> > > >
> > > > -------------------------------------------------------
> > > >
> > > > > This SF.net email sponsored by: Enterprise Linux
> > > > > Forum Conference & Expo
> > > > > The Event For Linux Datacenter Solutions &
> > > > > Strategies in The Enterprise
> > > > > Linux in the Boardroom; in the Front Office; & in
> > > > > the Server Room
> > > > > http://www.enterpriselinuxforum.com
> > > > > _______________________________________________
> > > > > Babeldoc-devel mailing list
> > > > > Bab...@li...
> > > >
> > > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> > > >
> > > >
> > > > __________________________________
> > > > Do you Yahoo!?
> > > > The New Yahoo! Shopping - with improved product search
> > > > http://shopping.yahoo.com

Re: [Babeldoc-devel] Question regarding FTP scanner

[David G. <dg...@co...>]

Actually, I threw together a Java-based shell and dropped it into my utility 
jar.  Works like a charm.  FYI, it works just fine with the 1.0 commons-net 
jar, so something else is problematic with the FtpScanner.  I'll (hopefully!) 
have time to look at it middle of next week.

David


On Sunday 19 October 2003 12:17 pm, Bruce McDonald wrote:
> Moving to the "external application module" is good enough to get things
> working assuming you have a decent shell (you use linux - so you are ok
> there).
>
> On Saturday 18 October 2003 08:44 am, David Glick wrote:
> > Hi Bruce,
> >
> > Sorry, I didn't explain myself well.  I'll certainly integrate the newest
> > commons net in when I get a chance.  The question was whether to
> > integrate it into the 'go-live' version Babeldoc we're using on
> > Production (1.1.8-dev).. We've fully tested on it, and therefore we won't
> > be upgrading to the 'real' release until after go-live.  The FTP piece is
> > pretty isolated, so if I can drop it into 1.1.8-dev and everything starts
> > working, that 's a level of integration I can handle.  If it doesn't
> > work, I don't know if I'll have time to troubleshoot it, so I may end up
> > calling the ftp transfer as an 'external to Babeldoc' process just to get
> > over this hump.
> >
> > Regardless, I will integrate it into the current Babeldoc (after I get a
> > reasonable amount of sleep... :-)).
> >
> >
> > David
> >
> > On Friday 17 October 2003 10:08 pm, Bruce McDonald wrote:
> > > Integrate.  This is what we need to get babeldoc stable.  We can build
> > > the future in 1.3.  Dejan, can you check if your application still
> > > works with the new code.  Anyone else check please.
> > >
> > > Ps.  I will be doing a release tonight !prior!  to the
> > >
> > > On Friday 17 October 2003 07:57 pm, David Glick wrote:
> > > > Thanks, Dejan.  I downloaded and tested the latest snapshot directly
> > > > using the ftp example, and it worked like a charm.  Since I'm now on
> > > > a tight deadline, I need to decide whether it will be easier to
> > > > integrate the newest version back into Babeldoc, or just run it
> > > > externally for my needs...
> > > >
> > > > Life is ALWAYS interesting at crunch time!
> > > >
> > > > David
> > > >
> > > > On Friday 17 October 2003 3:15 pm, Dejan Krsmanovic wrote:
> > > > > Hi David,
> > > > > FtpScanner is using Jakarta Commons Net 1.0 package
> > > > > (ex ORO Net Components 3.8.1) for ftp scannong. This
> > > > > component was mad to work with Unix based servers and
> > > > > you were supposed to implement support for other
> > > > > servers. Since I needed to use it for MS FTP server I
> > > > > have implement support for it.
> > > > > AFAIK, Commons Net is improving and they have changed
> > > > > the way how server listing is parsed, and also they
> > > > > should support other systems (MS for example).
> > > > > However, the code for that was not released yet but I
> > > > > think it will be released very soon (actualy the
> > > > > voting for Commons Net 1.1 relesase has already been
> > > > > started on Jakarta's mailing list).
> > > > >
> > > > > So you have three options:
> > > > > - Try to implement AS/400 support by yourself. You
> > > > > need to parse your server's output to extract
> > > > > filenames, etc  look at the code for
> > > > > MsFtpFileListParser.
> > > > > - wait for Commons Net 1.1
> > > > > - use Commons Net CVS snapshot
> > > > >
> > > > > Note that  AS/400 might left unsupported by Commons
> > > > > Net 1.1. Try to look at their CVS, there are parsers
> > > > > for most systems...
> > > > >
> > > > > Dejan
> > > > >
> > > > > --- David Glick <dg...@co...> wrote:
> > > > > > Gentlemen,
> > > > > >
> > > > > > I'm trying to set up the FtpScanner, but it is
> > > > > > crashing.  The stack trace and
> > > > > > config filre are shown below.  The stack trace show
> > > > > > that MsFtpFileListParser
> > > > > > was called,and the source code indicates that the
> > > > > > FtpScanner has been
> > > > > > optimized for Microsoft FTP.  Does the FtpScanner
> > > > > > also work with
> > > > > > non-Microsoft FTP servers?  The one I'm accessing is
> > > > > > on an AS/400, but I've
> > > > > > used manual FTP clients to it prevously without
> > > > > > problems.
> > > > > >
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > David
> > > > > >
> > > > > >
> > > > > > === CONFIG.PROPERTIES ===
> > > > > > #scan ftp site every 1 hour for files to place into
> > > > > > the outbound pipeline
> > > > > > ftpscan.type=ftp
> > > > > > #ftpscan.period=3600000
> > > > > > ftpscan.period=10000
> > > > > > ftpscan.ftpHost=as400
> > > > > > ftpscan.ftpUsername=AMUSER
> > > > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd have to
> > > > > > shoot you otherwise
> > > > > > ftpscan.pipeline=test
> > > > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > > > >
> > > > > > === STACK TRACE ===
> > > > > > <2003-10-17 12:44:02,550> ERROR [ftpscan] :
> > > > > > [ScannerWorker.process] Error
> > > > > > scanning...
> > > > > > java.lang.NumberFormatException: For input string:
> > > > > > "10/07/03"
> > > > > >         at
> > > > >
> > > > > java.lang.NumberFormatException.forInputString(NumberFormatExceptio
> > > > >n. ja va
> > > > >
> > > > >:4 8)
> > > > >:
> > > > > >         at java.lang.Long.parseLong(Long.java:332)
> > > > > >         at java.lang.Long.parseLong(Long.java:381)
> > > > > >         at
> > > > >
> > > > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseE
> > > > >nt ry (U nk nown
> > > > >
> > > > > > Source)
> > > > > >         at
> > > > >
> > > > > com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseF
> > > > >il eL is t( Unknown
> > > > >
> > > > > > Source)
> > > > > >         at
> > > > >
> > > > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1933)
> > > > >
> > > > > >         at
> > > > >
> > > > > org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:1964)
> > > > >
> > > > > >         at
> > > > >
> > > > > com.babeldoc.scanner.worker.FtpScanner.processFtpFolder(Unknown
> > > > >
> > > > > > Source)
> > > > > >         at
> > > > >
> > > > > com.babeldoc.scanner.worker.FtpScanner.doScan(Unknown
> > > > >
> > > > > > Source)
> > > > > >         at
> > > > > > com.babeldoc.scanner.ScannerWorker.process(Unknown
> > > > > > Source)
> > > > > >         at
> > > > > > com.babeldoc.scanner.ScannerThread.run(Unknown
> > > > > > Source)
> > > > > >
> > > > > > --
> > > > > > David Glick
> > > > > > Transmit Consulting, Inc
> > > > > > 619-475-4052
> > > > > > dg...@tr...
> > > > >
> > > > > -------------------------------------------------------
> > > > >
> > > > > > This SF.net email sponsored by: Enterprise Linux
> > > > > > Forum Conference & Expo
> > > > > > The Event For Linux Datacenter Solutions &
> > > > > > Strategies in The Enterprise
> > > > > > Linux in the Boardroom; in the Front Office; & in
> > > > > > the Server Room
> > > > > > http://www.enterpriselinuxforum.com
> > > > > > _______________________________________________
> > > > > > Babeldoc-devel mailing list
> > > > > > Bab...@li...
> > > > >
> > > > > https://lists.sourceforge.net/lists/listinfo/babeldoc-devel
> > > > >
> > > > >
> > > > > __________________________________
> > > > > Do you Yahoo!?
> > > > > The New Yahoo! Shopping - with improved product search
> > > > > http://shopping.yahoo.com

-- 
David Glick
Transmit Consulting, Inc
619-475-4052
dg...@tr...

Re: [Babeldoc-devel] Question regarding FTP scanner

[Dejan K. <dej...@ya...>]

In current ftpScanner implementation with Commons Net
1.0 library there is only one problematic operation -
listing directory. This is because different servers
return different outputs that is not always parsed
correctly. Other operations like getting files,
changing directory, etc. works OK with all servers. 

Dejan


--- David Glick <dg...@co...> wrote:
> Actually, I threw together a Java-based shell and
> dropped it into my utility 
> jar.  Works like a charm.  FYI, it works just fine
> with the 1.0 commons-net 
> jar, so something else is problematic with the
> FtpScanner.  I'll (hopefully!) 
> have time to look at it middle of next week.
> 
> David
> 
> 
> On Sunday 19 October 2003 12:17 pm, Bruce McDonald
> wrote:
> > Moving to the "external application module" is
> good enough to get things
> > working assuming you have a decent shell (you use
> linux - so you are ok
> > there).
> >
> > On Saturday 18 October 2003 08:44 am, David Glick
> wrote:
> > > Hi Bruce,
> > >
> > > Sorry, I didn't explain myself well.  I'll
> certainly integrate the newest
> > > commons net in when I get a chance.  The
> question was whether to
> > > integrate it into the 'go-live' version Babeldoc
> we're using on
> > > Production (1.1.8-dev).. We've fully tested on
> it, and therefore we won't
> > > be upgrading to the 'real' release until after
> go-live.  The FTP piece is
> > > pretty isolated, so if I can drop it into
> 1.1.8-dev and everything starts
> > > working, that 's a level of integration I can
> handle.  If it doesn't
> > > work, I don't know if I'll have time to
> troubleshoot it, so I may end up
> > > calling the ftp transfer as an 'external to
> Babeldoc' process just to get
> > > over this hump.
> > >
> > > Regardless, I will integrate it into the current
> Babeldoc (after I get a
> > > reasonable amount of sleep... :-)).
> > >
> > >
> > > David
> > >
> > > On Friday 17 October 2003 10:08 pm, Bruce
> McDonald wrote:
> > > > Integrate.  This is what we need to get
> babeldoc stable.  We can build
> > > > the future in 1.3.  Dejan, can you check if
> your application still
> > > > works with the new code.  Anyone else check
> please.
> > > >
> > > > Ps.  I will be doing a release tonight !prior!
>  to the
> > > >
> > > > On Friday 17 October 2003 07:57 pm, David
> Glick wrote:
> > > > > Thanks, Dejan.  I downloaded and tested the
> latest snapshot directly
> > > > > using the ftp example, and it worked like a
> charm.  Since I'm now on
> > > > > a tight deadline, I need to decide whether
> it will be easier to
> > > > > integrate the newest version back into
> Babeldoc, or just run it
> > > > > externally for my needs...
> > > > >
> > > > > Life is ALWAYS interesting at crunch time!
> > > > >
> > > > > David
> > > > >
> > > > > On Friday 17 October 2003 3:15 pm, Dejan
> Krsmanovic wrote:
> > > > > > Hi David,
> > > > > > FtpScanner is using Jakarta Commons Net
> 1.0 package
> > > > > > (ex ORO Net Components 3.8.1) for ftp
> scannong. This
> > > > > > component was mad to work with Unix based
> servers and
> > > > > > you were supposed to implement support for
> other
> > > > > > servers. Since I needed to use it for MS
> FTP server I
> > > > > > have implement support for it.
> > > > > > AFAIK, Commons Net is improving and they
> have changed
> > > > > > the way how server listing is parsed, and
> also they
> > > > > > should support other systems (MS for
> example).
> > > > > > However, the code for that was not
> released yet but I
> > > > > > think it will be released very soon
> (actualy the
> > > > > > voting for Commons Net 1.1 relesase has
> already been
> > > > > > started on Jakarta's mailing list).
> > > > > >
> > > > > > So you have three options:
> > > > > > - Try to implement AS/400 support by
> yourself. You
> > > > > > need to parse your server's output to
> extract
> > > > > > filenames, etc  look at the code for
> > > > > > MsFtpFileListParser.
> > > > > > - wait for Commons Net 1.1
> > > > > > - use Commons Net CVS snapshot
> > > > > >
> > > > > > Note that  AS/400 might left unsupported
> by Commons
> > > > > > Net 1.1. Try to look at their CVS, there
> are parsers
> > > > > > for most systems...
> > > > > >
> > > > > > Dejan
> > > > > >
> > > > > > --- David Glick <dg...@co...> wrote:
> > > > > > > Gentlemen,
> > > > > > >
> > > > > > > I'm trying to set up the FtpScanner, but
> it is
> > > > > > > crashing.  The stack trace and
> > > > > > > config filre are shown below.  The stack
> trace show
> > > > > > > that MsFtpFileListParser
> > > > > > > was called,and the source code indicates
> that the
> > > > > > > FtpScanner has been
> > > > > > > optimized for Microsoft FTP.  Does the
> FtpScanner
> > > > > > > also work with
> > > > > > > non-Microsoft FTP servers?  The one I'm
> accessing is
> > > > > > > on an AS/400, but I've
> > > > > > > used manual FTP clients to it prevously
> without
> > > > > > > problems.
> > > > > > >
> > > > > > >
> > > > > > > Thanks,
> > > > > > >
> > > > > > > David
> > > > > > >
> > > > > > >
> > > > > > > === CONFIG.PROPERTIES ===
> > > > > > > #scan ftp site every 1 hour for files to
> place into
> > > > > > > the outbound pipeline
> > > > > > > ftpscan.type=ftp
> > > > > > > #ftpscan.period=3600000
> > > > > > > ftpscan.period=10000
> > > > > > > ftpscan.ftpHost=as400
> > > > > > > ftpscan.ftpUsername=AMUSER
> > > > > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd
> have to
> > > > > > > shoot you otherwise
> > > > > > > ftpscan.pipeline=test
> > > > > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > > > > >
> > > > > > > === STACK TRACE ===
> > > > > > > <2003-10-17 12:44:02,550> ERROR
> [ftpscan] :
> > > > > > > [ScannerWorker.process] Error
> > > > > > > scanning...
> > > > > > > java.lang.NumberFormatException: For
> input string:
> > > > > > > "10/07/03"
> > > > > > >         at
> > > > > >
> > > > > >
>
java.lang.NumberFormatException.forInputString(NumberFormatExceptio
> > > > > >n. ja va
> > > > > >
> > > > > >:4 8)
> > > > > >:
> > > > > > >         at
> java.lang.Long.parseLong(Long.java:332)
> > > > > > >         at
> java.lang.Long.parseLong(Long.java:381)
> > > > > > >         at
> > > > > >
> > > > > >
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseE
> > > > > >nt ry (U nk nown
> > > > > >
> > > > > > > Source)
> > > > > > >         at
> > > > > >
> > > > > >
>
com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseF
> > > > > >il eL is t( Unknown
> > > > > >
> > > > > > > Source)
> 
=== message truncated ===


__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [Babeldoc-devel] Question regarding FTP scanner

[David G. <dg...@co...>]

Thanks, Dejan.  I'll concentrate on that when I review it.

On Sunday 19 October 2003 1:55 pm, Dejan Krsmanovic wrote:
> In current ftpScanner implementation with Commons Net
> 1.0 library there is only one problematic operation -
> listing directory. This is because different servers
> return different outputs that is not always parsed
> correctly. Other operations like getting files,
> changing directory, etc. works OK with all servers.
>
> Dejan
>
> --- David Glick <dg...@co...> wrote:
> > Actually, I threw together a Java-based shell and
> > dropped it into my utility
> > jar.  Works like a charm.  FYI, it works just fine
> > with the 1.0 commons-net
> > jar, so something else is problematic with the
> > FtpScanner.  I'll (hopefully!)
> > have time to look at it middle of next week.
> >
> > David
> >
> >
> > On Sunday 19 October 2003 12:17 pm, Bruce McDonald
> >
> > wrote:
> > > Moving to the "external application module" is
> >
> > good enough to get things
> >
> > > working assuming you have a decent shell (you use
> >
> > linux - so you are ok
> >
> > > there).
> > >
> > > On Saturday 18 October 2003 08:44 am, David Glick
> >
> > wrote:
> > > > Hi Bruce,
> > > >
> > > > Sorry, I didn't explain myself well.  I'll
> >
> > certainly integrate the newest
> >
> > > > commons net in when I get a chance.  The
> >
> > question was whether to
> >
> > > > integrate it into the 'go-live' version Babeldoc
> >
> > we're using on
> >
> > > > Production (1.1.8-dev).. We've fully tested on
> >
> > it, and therefore we won't
> >
> > > > be upgrading to the 'real' release until after
> >
> > go-live.  The FTP piece is
> >
> > > > pretty isolated, so if I can drop it into
> >
> > 1.1.8-dev and everything starts
> >
> > > > working, that 's a level of integration I can
> >
> > handle.  If it doesn't
> >
> > > > work, I don't know if I'll have time to
> >
> > troubleshoot it, so I may end up
> >
> > > > calling the ftp transfer as an 'external to
> >
> > Babeldoc' process just to get
> >
> > > > over this hump.
> > > >
> > > > Regardless, I will integrate it into the current
> >
> > Babeldoc (after I get a
> >
> > > > reasonable amount of sleep... :-)).
> > > >
> > > >
> > > > David
> > > >
> > > > On Friday 17 October 2003 10:08 pm, Bruce
> >
> > McDonald wrote:
> > > > > Integrate.  This is what we need to get
> >
> > babeldoc stable.  We can build
> >
> > > > > the future in 1.3.  Dejan, can you check if
> >
> > your application still
> >
> > > > > works with the new code.  Anyone else check
> >
> > please.
> >
> > > > > Ps.  I will be doing a release tonight !prior!
> >
> >  to the
> >
> > > > > On Friday 17 October 2003 07:57 pm, David
> >
> > Glick wrote:
> > > > > > Thanks, Dejan.  I downloaded and tested the
> >
> > latest snapshot directly
> >
> > > > > > using the ftp example, and it worked like a
> >
> > charm.  Since I'm now on
> >
> > > > > > a tight deadline, I need to decide whether
> >
> > it will be easier to
> >
> > > > > > integrate the newest version back into
> >
> > Babeldoc, or just run it
> >
> > > > > > externally for my needs...
> > > > > >
> > > > > > Life is ALWAYS interesting at crunch time!
> > > > > >
> > > > > > David
> > > > > >
> > > > > > On Friday 17 October 2003 3:15 pm, Dejan
> >
> > Krsmanovic wrote:
> > > > > > > Hi David,
> > > > > > > FtpScanner is using Jakarta Commons Net
> >
> > 1.0 package
> >
> > > > > > > (ex ORO Net Components 3.8.1) for ftp
> >
> > scannong. This
> >
> > > > > > > component was mad to work with Unix based
> >
> > servers and
> >
> > > > > > > you were supposed to implement support for
> >
> > other
> >
> > > > > > > servers. Since I needed to use it for MS
> >
> > FTP server I
> >
> > > > > > > have implement support for it.
> > > > > > > AFAIK, Commons Net is improving and they
> >
> > have changed
> >
> > > > > > > the way how server listing is parsed, and
> >
> > also they
> >
> > > > > > > should support other systems (MS for
> >
> > example).
> >
> > > > > > > However, the code for that was not
> >
> > released yet but I
> >
> > > > > > > think it will be released very soon
> >
> > (actualy the
> >
> > > > > > > voting for Commons Net 1.1 relesase has
> >
> > already been
> >
> > > > > > > started on Jakarta's mailing list).
> > > > > > >
> > > > > > > So you have three options:
> > > > > > > - Try to implement AS/400 support by
> >
> > yourself. You
> >
> > > > > > > need to parse your server's output to
> >
> > extract
> >
> > > > > > > filenames, etc  look at the code for
> > > > > > > MsFtpFileListParser.
> > > > > > > - wait for Commons Net 1.1
> > > > > > > - use Commons Net CVS snapshot
> > > > > > >
> > > > > > > Note that  AS/400 might left unsupported
> >
> > by Commons
> >
> > > > > > > Net 1.1. Try to look at their CVS, there
> >
> > are parsers
> >
> > > > > > > for most systems...
> > > > > > >
> > > > > > > Dejan
> > > > > > >
> > > > > > > --- David Glick <dg...@co...> wrote:
> > > > > > > > Gentlemen,
> > > > > > > >
> > > > > > > > I'm trying to set up the FtpScanner, but
> >
> > it is
> >
> > > > > > > > crashing.  The stack trace and
> > > > > > > > config filre are shown below.  The stack
> >
> > trace show
> >
> > > > > > > > that MsFtpFileListParser
> > > > > > > > was called,and the source code indicates
> >
> > that the
> >
> > > > > > > > FtpScanner has been
> > > > > > > > optimized for Microsoft FTP.  Does the
> >
> > FtpScanner
> >
> > > > > > > > also work with
> > > > > > > > non-Microsoft FTP servers?  The one I'm
> >
> > accessing is
> >
> > > > > > > > on an AS/400, but I've
> > > > > > > > used manual FTP clients to it prevously
> >
> > without
> >
> > > > > > > > problems.
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > >
> > > > > > > > David
> > > > > > > >
> > > > > > > >
> > > > > > > > === CONFIG.PROPERTIES ===
> > > > > > > > #scan ftp site every 1 hour for files to
> >
> > place into
> >
> > > > > > > > the outbound pipeline
> > > > > > > > ftpscan.type=ftp
> > > > > > > > #ftpscan.period=3600000
> > > > > > > > ftpscan.period=10000
> > > > > > > > ftpscan.ftpHost=as400
> > > > > > > > ftpscan.ftpUsername=AMUSER
> > > > > > > > ftpscan.ftpPassword=XXXX  <== Sorry, I'd
> >
> > have to
> >
> > > > > > > > shoot you otherwise
> > > > > > > > ftpscan.pipeline=test
> > > > > > > > ftpscan.filter=EBPRDIMP.EBPRDRR
> > > > > > > >
> > > > > > > > === STACK TRACE ===
> > > > > > > > <2003-10-17 12:44:02,550> ERROR
> >
> > [ftpscan] :
> > > > > > > > [ScannerWorker.process] Error
> > > > > > > > scanning...
> > > > > > > > java.lang.NumberFormatException: For
> >
> > input string:
> > > > > > > > "10/07/03"
> > > > > > > >         at
>
> java.lang.NumberFormatException.forInputString(NumberFormatExceptio
>
> > > > > > >n. ja va
> > > > > > >
> > > > > > >:4 8)
> > > > > > >:
> > > > > > > >         at
> >
> > java.lang.Long.parseLong(Long.java:332)
> >
> > > > > > > >         at
> >
> > java.lang.Long.parseLong(Long.java:381)
> >
> > > > > > > >         at
>
> com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseE
>
> > > > > > >nt ry (U nk nown
> > > > > > >
> > > > > > > > Source)
> > > > > > > >         at
>
> com.babeldoc.scanner.worker.FtpScanner$1$MsFtpFileListParser.parseF
>
> > > > > > >il eL is t( Unknown
> > > > > > >
> > > > > > > > Source)
>
> === message truncated ===
>
>
> __________________________________
> Do you Yahoo!?
> The New Yahoo! Shopping - with improved product search
> http://shopping.yahoo.com
>
>
> -------------------------------------------------------
> This SF.net email sponsored by: Enterprise Linux Forum Conference & Expo
> The Event For Linux Datacenter Solutions & Strategies in The Enterprise
> Linux in the Boardroom; in the Front Office; & in the Server Room
> http://www.enterpriselinuxforum.com
> _______________________________________________
> Babeldoc-devel mailing list
> Bab...@li...
> https://lists.sourceforge.net/lists/listinfo/babeldoc-devel

-- 
David Glick
Transmit Consulting, Inc
619-475-4052
dg...@tr...