| Version 3 (modified by liaojiaohe, 14 years ago) (diff) |
|---|
HBase重要参数,其他的参数查看文件
设置hadoop的系统参数时可以使用-D ,这个要放在程序参数的前面
使用HBASE作为输入
public static class MapClass extends TableMapper...
可以使用TableInputFormate的参数
hbase.mapreduce.inputtable hbase.mapreduce.scan / 输入字符串转换为Scan */ hbase.mapreduce.scan.row.start / Scan start row */ hbase.mapreduce.scan.row.stop / Scan stop row */ hbase.mapreduce.scan.column.family / Column Family to Scan */ hbase.mapreduce.scan.columns / Space delimited list of columns to scan. */ hbase.mapreduce.scan.timestamp / The timestamp used to filter columns with a specific timestamp. */ hbase.mapreduce.scan.timerange.start hbase.mapreduce.scan.timerange.end hbase.mapreduce.scan.maxversions hbase.mapreduce.scan.cacheblocks / Set to false to disable server-side caching of blocks for this scan. */ hbase.mapreduce.scan.cachedrows / The number of rows for caching that will be passed to scanners. */
注意要点:
使用HBASE的时候建议关闭 冗余工作 Speculative Execution
mapred.map.tasks.speculative.execution=false mapred.reduce.tasks.speculative.execution= false
Attachments
-
HBase-Config.xls
(47.0 KB) -
added by liaojiaohe 14 years ago.
![(please configure the [header_logo] section in trac.ini)](http://www1.pconline.com.cn/hr/2009/global/images/logo.gif)