Changes between Version 2 and Version 3 of hbaseconfig


Ignore:
Timestamp:
09/21/2012 11:03:22 AM (14 years ago)
Author:
liaojiaohe
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • hbaseconfig

    v2 v3  
    11HBase重要参数，其他的参数查看文件 
    22 
     3设置hadoop的系统参数时可以使用-D ,这个要放在程序参数的前面 
    34 
    4 注意要点：[[BR]] 
     5 
     6== 使用HBASE作为输入 == 
     7 
     8{{{ 
     9 public static class MapClass extends TableMapper... 
     10}}} 
     11可以使用TableInputFormate的参数 
     12 
     13hbase.mapreduce.inputtable  
     14hbase.mapreduce.scan /** 输入字符串转换为Scan */ 
     15hbase.mapreduce.scan.row.start   /** Scan start row */ 
     16hbase.mapreduce.scan.row.stop  /** Scan stop row */ 
     17hbase.mapreduce.scan.column.family /** Column Family to Scan */ 
     18hbase.mapreduce.scan.columns  /** Space delimited list of columns to scan. */ 
     19hbase.mapreduce.scan.timestamp /** The timestamp used to filter columns with a specific timestamp. */ 
     20hbase.mapreduce.scan.timerange.start 
     21hbase.mapreduce.scan.timerange.end 
     22hbase.mapreduce.scan.maxversions 
     23hbase.mapreduce.scan.cacheblocks  /** Set to false to disable server-side caching of blocks for this scan. */ 
     24hbase.mapreduce.scan.cachedrows  /** The number of rows for caching that will be passed to scanners. */ 
     25 
     26 
     27== 注意要点：[[BR]] == 
     28 
    529 
    630使用HBASE的时候建议关闭 冗余工作 [http://hbase.apache.org/book/mapreduce.specex.html Speculative Execution] 
     31 
     32 mapred.map.tasks.speculative.execution=false 
     33 mapred.reduce.tasks.speculative.execution= false