Directory Scanner

[Godfrey Mthombeni]

I have a problem with the Directory scanner on version 1.1.9-dev. I even tried the latest version, but i still get the same error. i also copied the latest scanner files from cvs.

I have defined a scanner like so :

gdi_directory_documents.type=directory
gdi_directory_documents.period=60000
gdi_directory_documents.inDirectory=C:/e/m
gdi_directory_documents.includeSubfolders=true
gdi_directory_documents.doneDirectory=C:/g/d
gdi_directory_documents.pipeline=temp-xml
gdi_directory_documents.binary=true
gdi_directory_documents.filter=.*

And my pipeline looks something like this
<?xml version="1.0"?>
<pipeline xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://www.babeldoc.com/xsd/pipeline.xsd">
    <documentation>This is a demonstration babel pipeline</documentation>
    <pipeline-name>temp-xml</pipeline-name>
    <dynamic>
        <entry-stage>WriteFile</entry-stage>

        <!-- Entry -->
        <stage-inst>
            <stage-name>WriteFile</stage-name>
            <stage-type>FtpWriter</stage-type>
            <stage-desc>Checks the Document Extension</stage-desc>
            <option>
                <option-name>tracked</option-name>
                <option-value>true</option-value>
            </option>
            <option>
                <option-name>outputFile</option-name>
                <option-value>c:/tmp/invalid/2.xml</option-value>
            </option>
        </stage-inst>
        <connection>
            <source>WriteFile</source>
            <sink>null</sink>
        </connection>
    </dynamic>
</pipeline>

When I start the scanner I get this error :
<2003-10-17 03:50:26,046> INFO  [main] :  Initializing workers:
<2003-10-17 03:50:26,156> INFO  [main] :  gdi_directory_documents (directory) configured...
<2003-10-17 03:50:26,156> INFO  [main] :  Starting workers...
<2003-10-17 03:50:26,171> INFO  [main] :  gdi_directory_documents started...
<2003-10-17 03:51:26,671> INFO  [Thread-1] :  Processing document...
<2003-10-17 03:51:27,296> INFO  [Thread-1] :  PipelineStage name: WriteFile
<2003-10-17 03:51:27,687> ERROR [Thread-1] :  [DefaultPipelineStageErrorHandler.handlePipelineStageError] PipelineStage name: WriteFile Error: com.babeldoc.core.pipeline.PipelineException: [FlatToXmlPipelineStage.process] Exception
<2003-10-17 03:51:27,703> ERROR [Thread-1] :  [AsynchronousFeeder$1.run]
java.lang.NullPointerException
        at java.net.Socket.<init>(Socket.java:283)
        at java.net.Socket.<init>(Socket.java:119)
        at org.apache.commons.net.DefaultSocketFactory.createSocket(DefaultSocketFactory.java:92)
        at org.apache.commons.net.SocketClient.connect(SocketClient.java:201)
        at org.apache.commons.net.SocketClient.connect(SocketClient.java:289)
        at com.babeldoc.core.pipeline.stage.FtpWriterPipelineStage.sendFtpMessage(Unknown Source)
        at com.babeldoc.core.pipeline.stage.FtpWriterPipelineStage.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineStage.processStage(Unknown Source)
        at com.babeldoc.core.pipeline.processor.SyncPipelineStageProcessor.processPipelineStage(Unknown Source)
        at com.babeldoc.core.pipeline.processor.SyncPipelineStageProcessor.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineStageFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineFactoryFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.SynchronousFeeder.process(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.AsynchronousFeeder.actuallyProcess(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.AsynchronousFeeder$1.run(Unknown Source)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:536)
rethrown as
com.babeldoc.core.pipeline.PipelineException: [FlatToXmlPipelineStage.process] Exception
        at com.babeldoc.core.pipeline.stage.FtpWriterPipelineStage.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineStage.processStage(Unknown Source)
        at com.babeldoc.core.pipeline.processor.SyncPipelineStageProcessor.processPipelineStage(Unknown Source)
        at com.babeldoc.core.pipeline.processor.SyncPipelineStageProcessor.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineStageFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.PipelineFactoryFactory.process(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.SynchronousFeeder.process(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.AsynchronousFeeder.actuallyProcess(Unknown Source)
        at com.babeldoc.core.pipeline.feeder.AsynchronousFeeder$1.run(Unknown Source)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:536)
Caused by: java.lang.NullPointerException
        at java.net.Socket.<init>(Socket.java:283)
        at java.net.Socket.<init>(Socket.java:119)
        at org.apache.commons.net.DefaultSocketFactory.createSocket(DefaultSocketFactory.java:92)
        at org.apache.commons.net.SocketClient.connect(SocketClient.java:201)
        at org.apache.commons.net.SocketClient.connect(SocketClient.java:289)
        at com.babeldoc.core.pipeline.stage.FtpWriterPipelineStage.sendFtpMessage(Unknown Source)
        ... 12 more

[Godfrey Mthombeni]

Adding to the above message. The scanner doesn't seem to passing the document to the pipeline.

[Dejan Krsmanovic]

As I could se from your stack trace document is passed to the pipeline.
Your problem is wrong configuration of FtpWriter stage. You don't have parameters like username, password, host...
Are you sure you wanted to use FtpScanner? If you want to write file to c:/tmp/invalid/2.xml you need to use FileWriter stage.