How To Modify Hadoop Log Level

APPLIES TO:

Oracle WebCenter Sites - Version 2.5 and later
Information in this document applies to any platform.

GOAL

By default, Hadoop's log level is set to INFO. This can be too much for most instances, as it will generate huge log files, even in an environment with low to moderate traffic.

Changing the root logger in log4j.properties file in Hadoop will not change the log level.

Follow the steps below for changing the log level of Hadoop.

FIX

1. Shut down hadoop if it is still running (Note that all Analytics daemons must be restarted if hadoop is restarted. Please refer to KM 1509643.1 for the procedure on how to restart Analytics)
2. Open the [hadoop_home]/bin/hadoop-daemon.sh file
3. Look for the following line:
   
   export HADOOP_ROOT_LOGGER="INFO,DRFA"
    
4. Modify that line to a lower or higher log level (WARN should be sufficient if the goal is to limit the size of the log file rather than debugging an issue)
   
   export HADOOP_ROOT_LOGGER="WARN,DRFA"
    
5. Save the file and start hadoop