Friday, June 21, 2013

WSO2 BAM - Suppress job information in console


Simply add the following property to hive-site.xml in BAM_HOME/repository/conf/advanced

  <property>
      <name>hive.session.silent</name>
      <value>true</value>
   </property> 

This would suppress printing of successful job information to standard out. Also there are a lot of configuration parameters you can find inside org.apache.hadoop.hive.conf.HiveConf class. If a parameter is null, it will be ignored, but if it is set, it will override any values set by hadoop configuration. Here are some other parameters that you can try out (All from HiveConf class).


hadoop.bin.path - Specifies the path to 'bin/hadoop'
hadoop.config.dir - Specifies the path to 'conf' dir

mapred.input.dir - You can specify the input directory to place map-reduce jobs
mapred.input.dir.recursive Search recursively on input dir or not
mapred.job.name Map reduce job name

hive.jobname.length Maximum length for a hive job name
hive.added.files.path You can add additional files into the path specified here
hive.added.jars.path Same as above, but for jars
hive.added.archives.path You get what this is for, right... 

Here are some other interesting looking parameters I found. I have beginner level knowledge on hive and hadoop stuff and have know idea what they do. Please let me know if you know about them or are able to find out more!!

hive.debug.localtask
hive.semantic.analyzer.hook
hive.insert.into.multilevel.dirs

No comments:

Post a Comment