Hi,
After a considerable amount of time & futzing, I have a working SiLK + FlowViewer install running on Ubuntu Server v14.04.2. Everything's working pretty well, except for one thing - FlowMonitor graphs.
I go and create a new FlowMonitor, that works fine and the graphs are created/rendered and look fine. Except that there's no data in them, all values are 0 and nothing is being graphed.
For the same exact Filter (very simple Filter -- basically just the SiLK sensor name), the FlowViewer & FlowGrapher both work perfectly and show the proper data. Graphs look great, I can see all the flows, and so on.
But for some reason the FlowMonitor graphs are empty. Any ideas??
Thanks!
Tim
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
(Hm, I replied to this but it doesn't seem to have posted, trying again...)
Hi Joe,
Thanks for the reply! Here's the output of DEBUG_MONITOR_C, looks like it's doing something but not sure what this is supposed to look like when working.
Thanks,
Tim
tstevens@tstevens-silk:~/FV/Flow_Working$ cat DEBUG_MONITOR_C
from: end this_filter to: start next_filter elapsed seconds: 299.019954 running: 59100.176836
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/f2e_fp_testbed.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.003708 running: 59100.180544
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-fp1,tstevens-fp2,tstevens-fp5,tstevens-fp6 --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp1tstevens-fp2tstevens-fp5tstevens-fp6
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp1tstevens-fp2tstevens-fp5tstevens-fp6 | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.297120 running: 59100.477664
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000053 running: 59100.477717
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000064 running: 59100.477781
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001381 running: 59100.479162
F2E FP Testbed 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002777 running: 59100.481939
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000035 running: 59100.481974
from: end this_filter to: start next_filter elapsed seconds: 0.000016 running: 59100.481990
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/lab_gateway.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.001779 running: 59100.483769
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-lab-gwy --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-lab-gwy
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-lab-gwy | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.097125 running: 59100.580894
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000053 running: 59100.580947
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000564 running: 59100.581511
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001851 running: 59100.583362
Lab Gateway 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002776 running: 59100.586138
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000036 running: 59100.586174
from: end this_filter to: start next_filter elapsed seconds: 0.000050 running: 59100.586224
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/tstevens-fp1.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.002469 running: 59100.588693
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-fp1 --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp1
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp1 | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.070083 running: 59100.658776
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000052 running: 59100.658828
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000067 running: 59100.658895
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001337 running: 59100.660232
tstevens-fp1 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002800 running: 59100.663032
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000034 running: 59100.663066
from: end this_filter to: start next_filter elapsed seconds: 0.000018 running: 59100.663084
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/tstevens-fp2.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.001892 running: 59100.664976
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-fp2 --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp2
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp2 | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.072245 running: 59100.737221
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000049 running: 59100.737270
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000065 running: 59100.737335
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001324 running: 59100.738659
tstevens-fp2 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002748 running: 59100.741407
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000035 running: 59100.741442
from: end this_filter to: start next_filter elapsed seconds: 0.000018 running: 59100.741460
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/tstevens-fp5.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.001966 running: 59100.743426
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-fp5 --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp5
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp5 | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.069552 running: 59100.812978
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000052 running: 59100.813030
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000063 running: 59100.813093
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001909 running: 59100.815002
tstevens-fp5 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002761 running: 59100.817763
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000035 running: 59100.817798
from: end this_filter to: start next_filter elapsed seconds: 0.000017 running: 59100.817815
/var/www/cgi-bin/FlowMonitor_Files/FlowMonitor_Filters/tstevens-fp6.fil
from: start next_filter to: start SiLK_processing elapsed seconds: 0.002270 running: 59100.820085
rwfilter_command: /usr/local/bin/rwfilter --data-rootdir=/data --type=all --sensors=tstevens-fp6 --start-date=2015/07/10:12 --end-date=2015/07/10:14 --active=2015/07/10:14:30:00-2015/07/10:14:35:00 --pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp6
silk_command: /usr/local/bin/rwfilter --pass=stdout /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-fp6 | /usr/local/bin/rwcount --bin-size=300 --start-time=2015/07/10:14:30:00 --end-time=2015/07/10:14:35:00 --epoch-slots --no-titles > /var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Collector_output
from: start SiLK_processing to: end SiLK_processing elapsed seconds: 0.074436 running: 59100.894521
from: end SiLK_processing to: start SiLK_BINS elapsed seconds: 0.000051 running: 59100.894572
from: start SiLK_BINS to: end SiLK_BINS elapsed seconds: 0.000063 running: 59100.894635
from: end SiLK_BINS to: start RRDtool_update elapsed seconds: 0.001335 running: 59100.895970
tstevens-fp6 1436538900:0
from: start RRDtool_update to: end RRDtool_update elapsed seconds: 0.002787 running: 59100.898757
from: end RRDtool_update to: end this_filter elapsed seconds: 0.000035 running: 59100.898792
tstevens@tstevens-silk:~/FV/Flow_Working$
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I see now that there's something wrong with the "pass" argument in the rwfilter command, eg, one says "--pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-lab-gwy", which does not exist. It looks like a munged version of some static text and the monitor name.
I also see in the working directory that there are some folders there with old monitor names that I created in the process of getting things working and later deleted. Not sure if there's some way to easily 'clean the slate' here. I am fine to delete files/remove monitors, nothing's too difficult to set back up the way I want it.
Let me know your thoughts...
Thanks,
Tim
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I'd be happy to help you. You are getting empty Flow_Monitor output, right? Can you provide the DEBUG_MONITOR_C (captures the data points) and DEBUG_MONITOR_G output (prints the graph)?
Thanks,
Joe
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
thanks for the care!
After some more reading I found that there is kind of bug and I need to make some filter and then monitor will start showig graph.
Best regards,
Ricardas
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi,
After a considerable amount of time & futzing, I have a working SiLK + FlowViewer install running on Ubuntu Server v14.04.2. Everything's working pretty well, except for one thing - FlowMonitor graphs.
I go and create a new FlowMonitor, that works fine and the graphs are created/rendered and look fine. Except that there's no data in them, all values are 0 and nothing is being graphed.
For the same exact Filter (very simple Filter -- basically just the SiLK sensor name), the FlowViewer & FlowGrapher both work perfectly and show the proper data. Graphs look great, I can see all the flows, and so on.
But for some reason the FlowMonitor graphs are empty. Any ideas??
Thanks!
Tim
Hi Tim,
Let's see if FlowMonitor_Collector is getting a value; and then see what the rrdtool commands are doing with it.
Can you see what $work_directory/DEBUG_MONITOR_C is telling you?
Thanks,
Joe
Hi Joe -
Thanks for your reply! Here's the output of DEBUG_MONITOR_C. It seems to be doing "something" but not sure what it 'should' look like...
Thanks,
Tim
(Hm, I replied to this but it doesn't seem to have posted, trying again...)
Hi Joe,
Thanks for the reply! Here's the output of DEBUG_MONITOR_C, looks like it's doing something but not sure what this is supposed to look like when working.
Thanks,
Tim
I see now that there's something wrong with the "pass" argument in the rwfilter command, eg, one says "--pass=/var/www/cgi-bin/FlowViewer/Flow_Working/FlowMonitor_Prefiltered_Site_alltstevens-lab-gwy", which does not exist. It looks like a munged version of some static text and the monitor name.
I also see in the working directory that there are some folders there with old monitor names that I created in the process of getting things working and later deleted. Not sure if there's some way to easily 'clean the slate' here. I am fine to delete files/remove monitors, nothing's too difficult to set back up the way I want it.
Let me know your thoughts...
Thanks,
Tim
Hi Tim,
I have the same situation like you had.
Mabe you have soled it and remember how ?
Thank you in advance!
Ricardas
Hi Ricardas,
I'd be happy to help you. You are getting empty Flow_Monitor output, right? Can you provide the DEBUG_MONITOR_C (captures the data points) and DEBUG_MONITOR_G output (prints the graph)?
Thanks,
Joe
Hi Joe,
thanks for the care!
After some more reading I found that there is kind of bug and I need to make some filter and then monitor will start showig graph.
Best regards,
Ricardas
OK good, Ricardas. If you see something where the software should be improved (e.g., a warning message, fix, etc.) please let me know.
Best,
Joe