Just to help anybody else out that may have this problem. I was getting the following error when using the pydoop HDFS connector.
13/07/03 18:33:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
I was able to fix this by adding the following in $PYTHON_HOME/lib/python2.7/site-packages/pydoop/hdfs/common.py
Add "-Djava.library.path=/usr/lib/hadoop/lib/native" to the DEFAULT_LIBHDFS_OPTS. This fixed this warning message.
Thanks for sharing this solution! I've generalized it to all supported Hadoop versions and pushed the changes to the develop branch:
Log in to post a comment.
Sign up for the SourceForge newsletter:
You seem to have CSS turned off.
Please don't fill out this field.