From: <sasverde> <sas...@gm...> - 2009-07-27 13:03:49
|
I'm trying integrate scribe, with hadoop 0.18.1, and I have install for separated. But, when I configurate and run "scribe", this failed. This reference a "boost", somebody know this problem. Thanks [root@~]# scribed -c /etc/scribe/scribe.conf [Mon Jul 27 08:43:02 2009] "STATUS: STARTING" [Mon Jul 27 08:43:02 2009] "STATUS: configuring" [Mon Jul 27 08:43:02 2009] "got configuration data from file </etc/scribe/scribe.conf>" [Mon Jul 27 08:43:02 2009] "CATEGORY : default" [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type thriftfile successfully." [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type hdfs successfully." scribed: /usr/local/include/boost-1_36/boost/shared_ptr.hpp:419: T* boost::shared_ptr<T>::operator->() const [with T = Store]: Assertion `px != 0' failed. Aborted [root@~]# cat /etc/scribe/scribe.conf port=1463 max_msg_per_second=2000000 max_queue_size=10000000 check_interval=3 <store> category=default type=multi target_write_size=20480 max_write_interval=1 <store0> category=default type=thriftfile file_path=/mnt/scribe/log base_filename=modts rotate_minute=10 max_size=1000000 flush_frequency_ms=2000 </store0> <store1> category=default type=hdfs file_path=/var/log/scribe hdfs_dir=hdfs://localhost:9000/scribe period_length=10 add_newlines=1 target_write_size=20480 max_write_interval=1 buffer_send_rate=2 retry_interval=30 retry_interval_range=10 base_filename=digit_log </store1> </store> [root@~]# |
From: Dhruba B. <dh...@gm...> - 2009-07-28 18:34:17
|
It appears that the scribe server was able to load the hdfs library, especially because I see the log line " Configured store of type hdfs successfully..". Maybe you have a out-of-date boost library? -dhruba On Mon, Jul 27, 2009 at 6:03 AM, <sasverde> <sas...@gm...> wrote: > I'm trying integrate scribe, with hadoop 0.18.1, and I have install for > separated. But, when I configurate and run "scribe", this failed. > This reference a "boost", somebody know this problem. > Thanks > > [root@~]# scribed -c /etc/scribe/scribe.conf > [Mon Jul 27 08:43:02 2009] "STATUS: STARTING" > [Mon Jul 27 08:43:02 2009] "STATUS: configuring" > [Mon Jul 27 08:43:02 2009] "got configuration data from file > </etc/scribe/scribe.conf>" > [Mon Jul 27 08:43:02 2009] "CATEGORY : default" [Mon Jul 27 08:43:02 2009] > "[default] MULTI: Configured store of type thriftfile successfully." > [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type hdfs > successfully." > scribed: /usr/local/include/boost-1_36/boost/shared_ptr.hpp:419: T* > boost::shared_ptr<T>::operator->() const [with T = Store]: Assertion `px != > 0' failed. > Aborted > > [root@~]# cat /etc/scribe/scribe.conf > port=1463 > max_msg_per_second=2000000 > max_queue_size=10000000 > check_interval=3 > <store> > category=default > type=multi > target_write_size=20480 > max_write_interval=1 > > <store0> > category=default > type=thriftfile > file_path=/mnt/scribe/log > base_filename=modts > rotate_minute=10 > max_size=1000000 > flush_frequency_ms=2000 > </store0> > > <store1> > category=default > type=hdfs > file_path=/var/log/scribe > hdfs_dir=hdfs://localhost:9000/scribe > period_length=10 > add_newlines=1 > target_write_size=20480 > max_write_interval=1 > buffer_send_rate=2 > retry_interval=30 > retry_interval_range=10 > base_filename=digit_log > </store1> > </store> > [root@~]# > > > > ------------------------------------------------------------------------------ > > _______________________________________________ > Scribeserver-users mailing list > Scr...@li... > https://lists.sourceforge.net/lists/listinfo/scribeserver-users > > |
From: Anthony G. <agi...@fa...> - 2009-07-29 22:26:55
|
Can you try changing your configuration to not use thrift files when writing to hdfs. It sounds like there may be some problems with this combination of features. type=file fs_type=hdfs Thanks, Anthony On 7/27/09 6:03 AM, "<sasverde>" wrote: I'm trying integrate scribe, with hadoop 0.18.1, and I have install for separated. But, when I configurate and run "scribe", this failed. This reference a "boost", somebody know this problem. Thanks [root@~]# scribed -c /etc/scribe/scribe.conf [Mon Jul 27 08:43:02 2009] "STATUS: STARTING" [Mon Jul 27 08:43:02 2009] "STATUS: configuring" [Mon Jul 27 08:43:02 2009] "got configuration data from file </etc/scribe/scribe.conf>" [Mon Jul 27 08:43:02 2009] "CATEGORY : default" [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type thriftfile successfully." [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type hdfs successfully." scribed: /usr/local/include/boost-1_36/boost/shared_ptr.hpp:419: T* boost::shared_ptr<T>::operator->() const [with T = Store]: Assertion `px != 0' failed. Aborted [root@~]# cat /etc/scribe/scribe.conf port=1463 max_msg_per_second=2000000 max_queue_size=10000000 check_interval=3 <store> category=default type=multi target_write_size=20480 max_write_interval=1 <store0> category=default type=thriftfile file_path=/mnt/scribe/log base_filename=modts rotate_minute=10 max_size=1000000 flush_frequency_ms=2000 </store0> <store1> category=default type=hdfs file_path=/var/log/scribe hdfs_dir=hdfs://localhost:9000/scribe period_length=10 add_newlines=1 target_write_size=20480 max_write_interval=1 buffer_send_rate=2 retry_interval=30 retry_interval_range=10 base_filename=digit_log </store1> </store> [root@~]# |