Menu

#17 can't crawl on AD servers, but clients OK

open
nobody
indexer (4)
5
2006-09-29
2006-09-29
Anonymous
No

I use AD account to crawl (tried with specified domain
and w/o one) through LAN (2 AD servers, about 20
client PC and 1 Linux server). I can crawn on ALL
client PC's and Linux server but not on the my AD
server. When I use "smbclient -L servername -U ADuser"
or "smbclient \\\\servername -U ADuser" everything OK:
I can view shares and go through them. But crawl
returns access denied in log(sharehound.log).
This is my config for one of this servers:
<?xml version='1.0'
encoding='utf8'?>^

<quartz>

<job>

<job-
detail>

<name>IndexLocalADserver</
name>

<group>DEFAULT</
group>

<description/
>

<job-
class>org.sourceforge.sharehound.tasks.quartz.LucenedSingleSmbRootCrawlJob</
job-
class>

<job-data-
map>

<entry>

<key>account-properties</
key>

<value>lan.account</
value>

</
entry>

<entry>

<key>crawl-latency</
key>

<value>60</
value>

</
entry>

<entry>

<key>search-root</
key>

<value>smb://ADserver</
value>

</
entry>

<entry>

<key>threads-number</
key>

<value>1</
value>

</
entry>

</job-data-
map>

</job-
detail>

<trigger>

<simple>

<name>IndexLocalADserverTrigger</
name>

<group>DEFAULT</
group>

<job-name>IndexLocalADserver</job-
name>

<job-group>DEFAULT</job-
group>

<repeat-count>-1</repeat-
count>

<repeat-interval>86400000</repeat-
interval>

</
simple>

</
trigger>

</job>

</quartz>

Discussion

  • Nobody/Anonymous

    sharehound.log

     
  • Artem Vasiliev

    Artem Vasiliev - 2006-09-29

    Logged In: YES
    user_id=1367248

    Thanx for this, it's interesting, especially in "smbclient"
    part. Your log file contains the same two times - I hope you
    don't use v1.1.6? If so please upgrade to 1.1.7.
    v1.1.6produces duplicate entries in index files (though it's
    irrelevant here)

     
  • Artem Vasiliev

    Artem Vasiliev - 2006-09-29

    Logged In: YES
    user_id=1367248

    Also I don't recommend specifying hosts by host name for now
    due to [1545526] bug. Use their IPs.

     
  • Nobody/Anonymous

    Logged In: NO

    I tried both hostnames and IP's on the v1.1.7 - result the
    same. I tried with hostname because "smbclient -L
    192.168.1.1" returns error "session request to 192.168.0.1
    failed (Called name not present)
    session request to 192 failed (Called name not
    present)" (this means that I must use -L hostname and -I
    192.168.0.1).

     
  • Nobody/Anonymous

    Logged In: NO

    Sorry for false submit of bug 1569222

     
  • Artem Vasiliev

    Artem Vasiliev - 2006-10-02

    Logged In: YES
    user_id=1367248

    The only idea I have for now is that your smb.conf
    (http://optics.ph.unimelb.edu.au/help/samba/smbclient.1.html#minuss)
    have some important property set which Sharehound's jCIFS
    doesn't. For example it could be situation like in
    http://lists.samba.org/archive/jcifs/2004-March/003116.html
    . If that's your case you should put
    jcifs.netbios.hostname=MYHOSTNAME into
    WEB-INF/classes/jcifs.properties file. For more on setting
    jCIFS properties please see
    http://jcifs.samba.org/src/docs/api/overview-summary.html#scp.
    If this doesn't help please put jcifs.util.loglevel=10 in
    the jcifs.properties file, then send me the jCIFS console
    output.

    You can also take a look at jCIFS FAQ, it's here:
    http://jcifs.samba.org/src/docs/faq.html

     
  • Nobody/Anonymous

    Logged In: NO

    Sorry for false submit of bug 1569222

     
  • Artem Vasiliev

    Artem Vasiliev - 2006-10-03

    Logged In: YES
    user_id=1367248

    Here's the detailed jCIFS log from the author of request:
    ---
    #JCIFS PROPERTIES
    #Tue Oct 03 15:20:32 EEST 2006
    jcifs.smb.client.password=somepassword
    java.runtime.name=Java(TM) 2 Runtime Environment, Standard
    Edition
    sun.boot.library.path=/usr/java/jdk1.5.0_06/jre/lib/i386
    java.vm.version=1.5.0_06-b05
    shared.loader=${catalina.base}/shared/classes,${catalina.base}/shared/lib/*.jar
    jcifs.smb.client.username=skrew_test
    java.vm.vendor=Sun Microsystems Inc.
    java.vendor.url=http\://java.sun.com/
    path.separator=\:
    java.vm.name=Java HotSpot(TM) Client VM
    tomcat.util.buf.StringCache.byte.enabled=true
    file.encoding.pkg=sun.io
    java.util.logging.config.file=/usr/local/apache-tomcat/conf/logging.properties
    user.country=US
    sun.os.patch.level=unknown
    java.vm.specification.name=Java Virtual Machine Specification
    user.dir=/usr/local/apache-tomcat-5.5.12
    java.runtime.version=1.5.0_06-b05
    java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
    java.endorsed.dirs=/usr/local/apache-tomcat/common/endorsed
    os.arch=i386
    java.io.tmpdir=/usr/local/apache-tomcat/temp
    line.separator=\n
    java.vm.specification.vendor=Sun Microsystems Inc.
    java.util.logging.manager=org.apache.juli.ClassLoaderLogManager
    java.naming.factory.url.pkgs=org.apache.naming
    os.name=Linux
    sun.jnu.encoding=UTF-8
    java.library.path=/usr/java/jdk1.5.0_06/jre/lib/i386/client\:/usr/java/jdk1.5.0_06/jre/lib/i386\:/usr/java/jdk1.5.0_06/jre/../lib/i386
    java.specification.name=Java Platform API Specification
    java.class.version=49.0
    sun.management.compiler=HotSpot Client Compiler
    os.version=2.6.9-42.0.2.ELhugemem
    user.home=/usr/local/apache-tomcat
    user.timezone=Europe/Kiev
    catalina.useNaming=true
    java.awt.printerjob=sun.print.PSPrinterJob
    java.specification.version=1.5
    file.encoding=UTF-8
    jcifs.smb.client.soTimeout=25000
    jcifs.util.loglevel=10
    catalina.home=/usr/local/apache-tomcat
    user.name=tomcat
    java.class.path=\:/usr/local/apache-tomcat/bin/bootstrap.jar\:/usr/local/apache-tomcat/bin/commons-logging-api.jar
    java.naming.factory.initial=org.apache.naming.java.javaURLContextFactory
    package.definition=sun.,java.,org.apache.catalina.,org.apache.coyote.,org.apache.tomcat.,org.apache.jasper.
    java.vm.specification.version=1.0
    sun.arch.data.model=32
    java.home=/usr/java/jdk1.5.0_06/jre
    java.specification.vendor=Sun Microsystems Inc.
    user.language=en
    java.vm.info=mixed mode, sharing
    jcifs.netbios.hostname=tetrajuice
    jcifs.netbios.baddr=192.168.0.255
    java.version=1.5.0_06
    java.ext.dirs=/usr/java/jdk1.5.0_06/jre/lib/ext
    sun.boot.class.path=/usr/java/jdk1.5.0_06/jre/lib/rt.jar\:/usr/java/jdk1.5.0_06/jre/lib/i18n.jar\:/usr/java/jdk1.5.0_06/jre/lib/sunrsasign.jar\:/usr/java/jdk1.5.0_06/jre/lib/jsse.jar\:/usr/java/jdk1.5.0_06/jre/lib/jce.jar\:/usr/java/jdk1.5.0_06/jre/lib/charsets.jar\:/usr/java/jdk1.5.0_06/jre/classes
    java.vendor=Sun Microsystems Inc.
    server.loader=${catalina.home}/server/classes,${catalina.home}/server/lib/*.jar
    catalina.base=/usr/local/apache-tomcat
    file.separator=/
    java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi
    jcifs.smb.client.domain=KIEVFIREJUICE
    common.loader=${catalina.home}/common/classes,${catalina.home}/common/i18n/*.jar,${catalina.home}/common/endorsed/*.jar,${catalina.home}/common/lib/*.jar
    sun.cpu.endian=little
    sun.io.unicode.encoding=UnicodeLittle
    jcifs.smb.client.responseTimeout=20000
    package.access=sun.,org.apache.catalina.,org.apache.coyote.,org.apache.tomcat.,org.apache.jasper.,sun.beans.
    sun.cpu.isalist=
    New data read: Transport1[0.0.0.0<00>/192.168.0.10:445]
    00000: FF 53 4D 42 72 00 00 00 00 98 03 C0 00 00 00 00
    |ГїSMBr......ГЂ....|
    00010: 00 00 00 00 00 00 00 00 00 00 DE DB 00 00 01 00
    |..........ГћГ›....|

    byteCount=54 but readBytesWireFormat returned 34
    NodeStatusRequest[nameTrnId=1,isResponse=false,opCode=QUERY,isAuthAnswer=false,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=1,answerCount=0,authorityCount=0,additionalCount=0,questionName=*
    <00>,questionType=0x0021,questionClass=IN,recordName=null,recordType=0x0000,recordClass=0x0000,ttl=0,rDataLength=0]
    00000: 00 01 00 00 00 01 00 00 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 |..
    |

    NetBIOS: new data read from socket
    NodeStatusResponse[nameTrnId=1,isResponse=true,opCode=QUERY,isAuthAnswer=true,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=0,answerCount=1,authorityCount=0,additionalCount=0,questionName=null,questionType=0x0000,questionClass=IN,recordName=*
    <00>,recordType=0x0021,recordClass=IN,ttl=0,rDataLength=137]
    00000: 00 01 84 00 00 00 00 01 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 00 00 00 00 00 89 05 41 42 53 59 4E 54 48
    |.........ABSYNTH|
    00040: 45 20 20 20 20 20 20 20 00 04 00 4B 49 45 56 46 |E
    ...KIEVF|
    00050: 49 52 45 4A 55 49 43 45 20 20 00 84 00 4B 49 45
    |IREJUICE ...KIE|
    00060: 56 46 49 52 45 4A 55 49 43 45 20 20 1C 84 00 41
    |VFIREJUICE ...A|
    00070: 42 53 59 4E 54 48 45 20 20 20 20 20 20 20 20 04
    |BSYNTHE .|
    00080: 00 4B 49 45 56 46 49 52 45 4A 55 49 43 45 20 20
    |.KIEVFIREJUICE |
    00090: 1E 84 00 00 50 04 F7 5D EB 00 00 00 00 00 00 00
    |....P.Г·]Г«.......|
    000A0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000B0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000C0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000D0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000E0: 00 00 00 00 00
    |..... |

    treeConnect: unc=\\ABSYNTHE\IPC$,service=?????
    sessionSetup: accountName=skrew_test,primaryDomain=KIEVFIREJUICE
    LM_COMPATIBILITY=0
    00000: 78 85 A1 5A 8C 98 58 AB 88 69 97 25 54 E0 BF 4C
    |x.ВЎZ..XВ«.i.%TГ ВїL|
    00010: E0 51 7A A4 83 34 40 A5 BD E3 E8 C1 56 3D 3D 5D |Г
    Qz¤.4@¥½ãèÁV==]|
    00020: 55 BF 91 0C C4 DE 97 2A
    |U¿..ÄÞ.* |

    update: 0 0:40
    00000: 78 85 A1 5A 8C 98 58 AB 88 69 97 25 54 E0 BF 4C
    |x.ВЎZ..XВ«.i.%TГ ВїL|
    00010: E0 51 7A A4 83 34 40 A5 BD E3 E8 C1 56 3D 3D 5D |Г
    Qz¤.4@¥½ãèÁV==]|
    00020: 55 BF 91 0C C4 DE 97 2A
    |U¿..ÄÞ.* |

    update: 1 4:234
    00000: FF 53 4D 42 73 00 00 00 00 18 07 C0 00 00 00 00
    |ГїSMBs......ГЂ....|
    00010: 00 00 00 00 00 00 00 00 00 00 DE DB 00 00 02 00
    |..........ГћГ›....|
    00020: 0D 75 00 B8 00 04 41 0A 00 01 00 00 00 00 00 18
    |.u.Вё..A.........|
    00030: 00 18 00 00 00 00 00 54 10 00 00 7B 00 0A D0 72
    |.......T...{..Гђr|
    00040: 55 F2 3C 5F 62 F3 88 B1 92 13 F0 07 C5 FE 41 B1
    |UГІ<_bГі.В±..Г°.Г…ГѕAВ±|
    00050: 71 8F 72 C7 C5 E0 51 7A A4 83 34 40 A5 BD E3 E8
    |q.rÇÅà Qz¤.4@¥½ãè|
    00060: C1 56 3D 3D 5D 55 BF 91 0C C4 DE 97 2A 00 73 00
    |ÁV==]U¿..ÄÞ.*.s.|
    00070: 6B 00 72 00 65 00 77 00 5F 00 74 00 65 00 73 00
    |k.r.e.w._.t.e.s.|
    00080: 74 00 00 00 4B 00 49 00 45 00 56 00 46 00 49 00
    |t...K.I.E.V.F.I.|
    00090: 52 00 45 00 4A 00 55 00 49 00 43 00 45 00 00 00
    |R.E.J.U.I.C.E...|
    000A0: 4C 00 69 00 6E 00 75 00 78 00 00 00 6A 00 43 00
    |L.i.n.u.x...j.C.|
    000B0: 49 00 46 00 53 00 00 00 04 FF 00 00 00 00 00 01
    |I.F.S....Гї......|
    000C0: 00 27 00 00 5C 00 5C 00 41 00 42 00 53 00 59 00
    |.'..\.\.A.B.S.Y.|
    000D0: 4E 00 54 00 48 00 45 00 5C 00 49 00 50 00 43 00
    |N.T.H.E.\.I.P.C.|
    000E0: 24 00 00 00 3F 3F 3F 3F 3F 00
    |$...?????. |

    digest:
    00000: 37 ED D3 54 87 85 50 65 6A 09 13 EF 79 67 7A 7A
    |7Г­Г“T..Pej..ГЇygzz|

    New data read: Transport1[ABSYNTHE<00>/192.168.0.10:445]
    00000: FF 53 4D 42 73 00 00 00 00 98 07 C0 00 00 92 D6
    |ГїSMBs......ГЂ...Г–|
    00010: 56 6F 5C BE 39 39 00 00 07 A8 DE DB 01 50 02 00
    |Vo\Вѕ99...ВЁГћГ›.P..|

    NodeStatusRequest[nameTrnId=2,isResponse=false,opCode=QUERY,isAuthAnswer=false,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=1,answerCount=0,authorityCount=0,additionalCount=0,questionName=*
    <00>,questionType=0x0021,questionClass=IN,recordName=null,recordType=0x0000,recordClass=0x0000,ttl=0,rDataLength=0]
    00000: 00 02 00 00 00 01 00 00 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 |..
    |

    NetBIOS: new data read from socket
    NodeStatusResponse[nameTrnId=2,isResponse=true,opCode=QUERY,isAuthAnswer=true,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=0,answerCount=1,authorityCount=0,additionalCount=0,questionName=null,questionType=0x0000,questionClass=IN,recordName=*
    <00>,recordType=0x0021,recordClass=IN,ttl=0,rDataLength=137]
    00000: 00 02 84 00 00 00 00 01 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 00 00 00 00 00 89 05 41 42 53 59 4E 54 48
    |.........ABSYNTH|
    00040: 45 20 20 20 20 20 20 20 00 04 00 4B 49 45 56 46 |E
    ...KIEVF|
    00050: 49 52 45 4A 55 49 43 45 20 20 00 84 00 4B 49 45
    |IREJUICE ...KIE|
    00060: 56 46 49 52 45 4A 55 49 43 45 20 20 1C 84 00 41
    |VFIREJUICE ...A|
    00070: 42 53 59 4E 54 48 45 20 20 20 20 20 20 20 20 04
    |BSYNTHE .|
    00080: 00 4B 49 45 56 46 49 52 45 4A 55 49 43 45 20 20
    |.KIEVFIREJUICE |
    00090: 1E 84 00 00 50 04 F7 5D EB 00 00 00 00 00 00 00
    |....P.Г·]Г«.......|
    000A0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000B0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000C0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000D0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000E0: 00 00 00 00 00
    |..... |

    NodeStatusRequest[nameTrnId=3,isResponse=false,opCode=QUERY,isAuthAnswer=false,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=1,answerCount=0,authorityCount=0,additionalCount=0,questionName=*
    <00>,questionType=0x0021,questionClass=IN,recordName=null,recordType=0x0000,recordClass=0x0000,ttl=0,rDataLength=0]
    00000: 00 03 00 00 00 01 00 00 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 |..
    |

    NetBIOS: new data read from socket
    NodeStatusResponse[nameTrnId=3,isResponse=true,opCode=QUERY,isAuthAnswer=true,isTruncated=false,isRecurAvailable=false,isRecurDesired=false,isBroadcast=false,resultCode=0,questionCount=0,answerCount=1,authorityCount=0,additionalCount=0,questionName=null,questionType=0x0000,questionClass=IN,recordName=*
    <00>,recordType=0x0021,recordClass=IN,ttl=0,rDataLength=137]
    00000: 00 03 84 00 00 00 00 01 00 00 00 00 20 43 4B 41
    |............ CKA|
    00010: 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41 41
    |AAAAAAAAAAAAAAAA|
    00020: 41 41 41 41 41 41 41 41 41 41 41 41 41 00 00 21
    |AAAAAAAAAAAAA..!|
    00030: 00 01 00 00 00 00 00 89 05 41 42 53 59 4E 54 48
    |.........ABSYNTH|
    00040: 45 20 20 20 20 20 20 20 00 04 00 4B 49 45 56 46 |E
    ...KIEVF|
    00050: 49 52 45 4A 55 49 43 45 20 20 00 84 00 4B 49 45
    |IREJUICE ...KIE|
    00060: 56 46 49 52 45 4A 55 49 43 45 20 20 1C 84 00 41
    |VFIREJUICE ...A|
    00070: 42 53 59 4E 54 48 45 20 20 20 20 20 20 20 20 04
    |BSYNTHE .|
    00080: 00 4B 49 45 56 46 49 52 45 4A 55 49 43 45 20 20
    |.KIEVFIREJUICE |
    00090: 1E 84 00 00 50 04 F7 5D EB 00 00 00 00 00 00 00
    |....P.Г·]Г«.......|
    000A0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000B0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000C0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000D0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
    |................|
    000E0: 00 00 00 00 00
    |..... |

     
  • Nobody/Anonymous

    Logged In: NO

    Sorry for false submit of bug 1569222

     

Log in to post a comment.