New install trying to get sorted, I've only got one device in the devicelist.csv so I can test this out. However, I'm running into a problem when running netdbctl -ud -v, its giving a permission denied error. can you shed some light? Here's the debug:
root@netdb:~# netdbctl -ud -v -debug 3
Tue Feb 25 15:13:36 2014: netdbctl(10173): NetDB Debug Level: 3
Tue Feb 25 15:13:36 2014: netdbctl(10173): Parsing Devices from Big Brother (opt ional)
Tue Feb 25 15:13:36 2014: netdbctl(10173): Running netdbscraper on devices
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent spawni ng 20 processes with 0.5s delay
Tue Feb 25 15:13:36 2014: netdbctl(10173): |DEBUG|: Device: vr-idf1-01, fqdn: vr -idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup :
Tue Feb 25 15:13:36 2014: netdbctl(10173): |DEBUG|: Device: vr-idf1-01, fqdn: vr -idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup :
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10177): Child executi ng: /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com, devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn
Tue Feb 25 15:13:36 2014: netdbctl(10173): Couldn't execute /opt/netdb/netdbscra per/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,d evtype=procurvehp -conf /etc/netdb.conf -pn: Permission denied at /opt/netdb/net dbscraper/netdbscraper.pl line 346.
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent waitin g on 0 processes to finish
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent Comple te
Tue Feb 25 15:13:36 2014: netdbctl(10173): NetDB update complete
root@netdb:~# chmod +x /opt/netdb/netdbscraper/netdbscraper.pl
root@netdb:~# netdbctl -ud -v -debug 3
Tue Feb 25 15:14:20 2014: netdbctl(10185): NetDB Debug Level: 3
Tue Feb 25 15:14:20 2014: netdbctl(10185): Parsing Devices from Big Brother (optional)
Tue Feb 25 15:14:20 2014: netdbctl(10185): Running netdbscraper on devices
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent spawning 20 processes with 0.5s delay
Tue Feb 25 15:14:21 2014: netdbctl(10185): |DEBUG|: Device: vr-idf1-01, fqdn: vr-idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup:
Tue Feb 25 15:14:21 2014: netdbctl(10185): |DEBUG|: Device: vr-idf1-01, fqdn: vr-idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup:
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10189): Child executing: /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn
Tue Feb 25 15:14:21 2014: netdbctl(10185): Couldn't execute /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn: Permission denied at /opt/netdb/netdbscraper/netdbscraper.pl line 346.
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent waiting on 0 processes to finish
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent Complete
Tue Feb 25 15:14:21 2014: netdbctl(10185): NetDB update complete
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
That is odd but it does sound like a permission problem. Do an ls -l on /opt/netdb/netdbscraper/ directory and see what it looks like. You want to make sure the netdb user has access to everything. When you run netdbctl, it changes to the netdb user so you might want to try suing to the netdb user and see how it goes. You can also run the scraper manually with that command above in the debug:
See how that goes. Also on this forum you'll find that another guy has put a lot of work in to an updated scraper for HP devices. If you get the permissions strait, you might want to check out his work if you have trouble scraping your devices.
Jonathan
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
You got it, the procurvehpscraper.pl had a different set of permissions...no execute for any of the rolls. There was indeed an issue scrapping so I'll check out his threads. Appreciate your help, love it when it's a simple fix.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Glad that worked, but as far as your scraper issues, I just added that other scraper to the repository. You can get it from here or run an svn update in /opt/netdb/:
New install trying to get sorted, I've only got one device in the devicelist.csv so I can test this out. However, I'm running into a problem when running netdbctl -ud -v, its giving a permission denied error. can you shed some light? Here's the debug:
root@netdb:~# netdbctl -ud -v -debug 3
Tue Feb 25 15:13:36 2014: netdbctl(10173): NetDB Debug Level: 3
Tue Feb 25 15:13:36 2014: netdbctl(10173): Parsing Devices from Big Brother (opt ional)
Tue Feb 25 15:13:36 2014: netdbctl(10173): Running netdbscraper on devices
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent spawni ng 20 processes with 0.5s delay
Tue Feb 25 15:13:36 2014: netdbctl(10173): |DEBUG|: Device: vr-idf1-01, fqdn: vr -idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup :
Tue Feb 25 15:13:36 2014: netdbctl(10173): |DEBUG|: Device: vr-idf1-01, fqdn: vr -idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup :
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10177): Child executi ng: /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com, devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn
Tue Feb 25 15:13:36 2014: netdbctl(10173): Couldn't execute /opt/netdb/netdbscra per/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,d evtype=procurvehp -conf /etc/netdb.conf -pn: Permission denied at /opt/netdb/net dbscraper/netdbscraper.pl line 346.
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent waitin g on 0 processes to finish
Tue Feb 25 15:13:36 2014: netdbctl(10173): netdbscraper.pl(10176): Parent Comple te
Tue Feb 25 15:13:36 2014: netdbctl(10173): NetDB update complete
root@netdb:~# chmod +x /opt/netdb/netdbscraper/netdbscraper.pl
root@netdb:~# netdbctl -ud -v -debug 3
Tue Feb 25 15:14:20 2014: netdbctl(10185): NetDB Debug Level: 3
Tue Feb 25 15:14:20 2014: netdbctl(10185): Parsing Devices from Big Brother (optional)
Tue Feb 25 15:14:20 2014: netdbctl(10185): Running netdbscraper on devices
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent spawning 20 processes with 0.5s delay
Tue Feb 25 15:14:21 2014: netdbctl(10185): |DEBUG|: Device: vr-idf1-01, fqdn: vr-idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup:
Tue Feb 25 15:14:21 2014: netdbctl(10185): |DEBUG|: Device: vr-idf1-01, fqdn: vr-idf1-01.cbr.com, mac: 1, arp: 1, vrfs: , ipv6: , devtype: procurvehp, authgroup:
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10189): Child executing: /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn
Tue Feb 25 15:14:21 2014: netdbctl(10185): Couldn't execute /opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,devtype=procurvehp -conf /etc/netdb.conf -pn: Permission denied at /opt/netdb/netdbscraper/netdbscraper.pl line 346.
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent waiting on 0 processes to finish
Tue Feb 25 15:14:21 2014: netdbctl(10185): netdbscraper.pl(10188): Parent Complete
Tue Feb 25 15:14:21 2014: netdbctl(10185): NetDB update complete
Hey,
That is odd but it does sound like a permission problem. Do an ls -l on /opt/netdb/netdbscraper/ directory and see what it looks like. You want to make sure the netdb user has access to everything. When you run netdbctl, it changes to the netdb user so you might want to try suing to the netdb user and see how it goes. You can also run the scraper manually with that command above in the debug:
/opt/netdb/netdbscraper/procurvehpscraper.pl -debug 3 -d vr-idf1-01.cbr.com,devtype=procurvehp,arp,devtype=procurvehp
See how that goes. Also on this forum you'll find that another guy has put a lot of work in to an updated scraper for HP devices. If you get the permissions strait, you might want to check out his work if you have trouble scraping your devices.
Jonathan
You got it, the procurvehpscraper.pl had a different set of permissions...no execute for any of the rolls. There was indeed an issue scrapping so I'll check out his threads. Appreciate your help, love it when it's a simple fix.
Hey,
Glad that worked, but as far as your scraper issues, I just added that other scraper to the repository. You can get it from here or run an svn update in /opt/netdb/:
https://sourceforge.net/p/netdbtracking/code/HEAD/tree/branches/netdb-1.12/netdbscraper/procurvehpv2scraper.pl
I also fixed the permission error, I'm not sure how that got introduced.
Jonathan