WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform

Help
Liam
2013-07-04
2013-07-04
  • Liam
    Liam
    2013-07-04

    Just to help anybody else out that may have this problem. I was getting the following error when using the pydoop HDFS connector.

    13/07/03 18:33:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    I was able to fix this by adding the following in $PYTHON_HOME/lib/python2.7/site-packages/pydoop/hdfs/common.py

    Add "-Djava.library.path=/usr/lib/hadoop/lib/native" to the DEFAULT_LIBHDFS_OPTS. This fixed this warning message.

    thanks,
    liam