Menu
▾
▴
#55 Error in sarra - Type: <class 'AttributeError'>, Value: 'NoneType' object has no attribute 'chdir'
2016-10-18:
The sr_watch is posting the product but the sr_sarra is not able to delete the product.
Dms-op3
-rw-rw-r-- 1 dms dms 1551 Oct 18 13:34 NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
user@dms-op3-host1:~/.cache/sarra/var/log$ grep lflu.orig.auto_dms-op3-host1_20161018133455628 sr_watch_dms_multiple4_0001.log
2016-10-18 13:34:59,578 [INFO] post_hour_tree: rename: /dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
2016-10-18 13:34:59,580 [DEBUG] Published1: xs_MSC-DMS-EDM v02.post.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
2016-10-18 13:34:59,580 [DEBUG] Published2: '20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:' rename=/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: sum=d,bb72134956e3497828c9fc2e26dc879e to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: parts=1,1551,1,0,0 mtime=20161018133455.627 atime=20161018133455.627
Ddi2
user@ddi2:~/.cache/sarra/var/log$ grep lflu.orig.auto_dms-op3-host1_20161018133455628 sr_sarralog
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,039 [DEBUG] notice 20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,040 [DEBUG] urlstr sftp://user@dms-op3-host1-server//apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,041 [DEBUG] Received v02.post.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: '20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:' rename=/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: sum=d,bb72134956e3497828c9fc2e26dc879e to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: parts=1,1551,1,0,0 mtime=20161018133455.627 atime=20161018133455.627
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,042 [INFO] msg_log received: 20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: topic=v02.post.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: lag=0.464574 rename=/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: sum=d,bb72134956e3497828c9fc2e26dc879e to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: parts=1,1551,1,0,0 mtime=20161018133455.627 atime=20161018133455.627
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,043 [DEBUG] downloading/copying into /data/web/dd/public_data/20161018/MSC-DMS-EDM/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,065 [ERROR] Download failed sftp://user@dms-op3-host1-server//apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:. Type: <class 'attributeerror'="">, Value: 'NoneType' object has no attribute 'chdir'
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,070 [DEBUG] 499 sftp download failed : v02.report.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 499 ddi2-server feeder 0.487947 sum=d,bb72134956e3497828c9fc2e26dc879e from_cluster=DDI.EDM to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml source=MSC-DMS-EDM parts=1,1551,1,0,0 mtime=20161018133455.627 message=sftp download failed atime=20161018133455.627
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,070 [DEBUG] downloading/copying into /data/web/dd/public_data/20161018/MSC-DMS-EDM/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
</class>*sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,089 [ERROR] Download failed sftp://user@dms-op3-host1-server//apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:. Type: <class 'attributeerror'="">, Value: 'NoneType' object has no attribute 'chdir'
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,092 [DEBUG] 499 sftp download failed : v02.report.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 499 ddi2-server feeder 0.511471 sum=d,bb72134956e3497828c9fc2e26dc879e from_cluster=DDI.EDM to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml source=MSC-DMS-EDM parts=1,1551,1,0,0 mtime=201610</class>18133455.627 message=sftp download failed atime=20161018133455.627
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,093 [DEBUG] downloading/copying into /data/web/dd/public_data/20161018/MSC-DMS-EDM/dms-pg-generic-ninjo-nswob/13/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,114 [ERROR] Download failed sftp://user@dms-op3-host1-server//apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML:. Type: <class 'attributeerror'="">, Value: 'NoneType' object has no attribute 'chdir'
sr_sarra_get-dms-op3_0002.log:2016-10-18 13:35:00,116 [DEBUG] 499 sftp download failed : v02.report.apps.px.dms_data_links4.dms-pg-generic-ninjo-nswob.NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 20161018133459.578 sftp://user@dms-op3-host1-server/ /apps/px/dms_data_links4/dms-pg-generic-ninjo-nswob/NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml:DMS:CMC_dms-op3-host1:NSWOB:XML: 499 ddi2-server feeder 0.536990 sum=d,bb72134956e3497828c9fc2e26dc879e from_cluster=DDI.EDM to_clusters=DDI.EDM filename=NSWOB_wmo.observation.atmospheric.aviation.metar-1.2-ascii.product-ninjo_nswob_xml-1.0.20161018133000000.lflu.orig.auto_dms-op3-host1_20161018133455628.xml source=MSC-DMS-EDM parts=1,1551,1,0,0 mtime=20161018133455.627 message=sftp download failed atime=20161018133455.627</class>
Chatted with Daluma. He says he likely has a patch that just isn't committed yet.
He is just going to run the flow_test to verify no major breakage before committing.
the patch is in the daily build now... need to re-test.
patch broke sarra, reverted.
this problem is rare and not easily repeatable. sr_watch has been re-worked since, so taking responsibility for this issue, which may be gone, but lowering the priority.
This was found and fixed by Michel... a few months ago.