Error Code [17.10] FileScan initialization failed. Failed to connect to HDFS.

Article ID: UFS0013 Backup of Hadoop data fails

Symptom

The backup of Hadoop data fails. The following error message appears in the FileScan.log file on the master node. The log file is located in the Commvault Log_Files directory  ( by default, /var/log/commvault/Log_Files).

Error Code: [17:10]
Description: Cannot scan [FileScan initialization failed. Failed to connect to HDFS, check if HDFS is up and running, check if CLASSPATH , LD_LIBRARY_PATH for libhdfs.so, libjvm.so is set properly, check documentation for correct config steps ]
Source: doopc, Process: FileScan

Cause

Hadoop backup operation fails because the following Linux environment variables are not set:

  • LD_LIBRARY_PATH 
  • CLASSPATH

Resolution

Set the following Linux environment variables on all data access nodes, including the master node:

  • LD_LIBRARY_PATH=/path_containing_libhdfs.so:/path_containing_libjvm.so:/commvault_install_dir/Base

    Example:

    LD_LIBRARY_PATH="/usr/hadoop-2.6.1/lib/native:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/amd64/server:/opt/commvault/Base"

  • CLASSPATH=$(hadoop classpath --glob)