Re: [Scribeserver-users] Integrate scribe with hadoop

[Anthony G. <agi...@fa...>]

Can you try changing your configuration to not use thrift files when writing to hdfs.  It sounds like there may be some problems with this combination of features.

type=file
fs_type=hdfs

Thanks,
Anthony

On 7/27/09 6:03 AM, "<sasverde>" wrote:

I'm trying integrate scribe, with hadoop 0.18.1, and I have install for separated. But, when I configurate and run "scribe", this failed.
This reference a "boost", somebody know this problem.
Thanks

[root@~]# scribed -c /etc/scribe/scribe.conf
[Mon Jul 27 08:43:02 2009] "STATUS: STARTING"
[Mon Jul 27 08:43:02 2009] "STATUS: configuring"
[Mon Jul 27 08:43:02 2009] "got configuration data from file </etc/scribe/scribe.conf>"
[Mon Jul 27 08:43:02 2009] "CATEGORY : default" [Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type thriftfile successfully."
[Mon Jul 27 08:43:02 2009] "[default] MULTI: Configured store of type hdfs successfully."
scribed: /usr/local/include/boost-1_36/boost/shared_ptr.hpp:419: T* boost::shared_ptr<T>::operator->() const [with T = Store]: Assertion `px != 0' failed.
Aborted

[root@~]# cat /etc/scribe/scribe.conf
port=1463
max_msg_per_second=2000000
max_queue_size=10000000
check_interval=3
<store>
category=default
type=multi
target_write_size=20480
max_write_interval=1

<store0>
category=default
type=thriftfile
file_path=/mnt/scribe/log
base_filename=modts
rotate_minute=10
max_size=1000000
flush_frequency_ms=2000
</store0>

<store1>
category=default
type=hdfs
file_path=/var/log/scribe
hdfs_dir=hdfs://localhost:9000/scribe
period_length=10
add_newlines=1
target_write_size=20480
max_write_interval=1
buffer_send_rate=2
retry_interval=30
retry_interval_range=10
base_filename=digit_log
</store1>
</store>
[root@~]#