public class HiveDataFragmenter extends Fragmenter
Modifier and Type | Field and Description |
---|---|
protected boolean |
filterInFragmenter |
fragments
Constructor and Description |
---|
HiveDataFragmenter(InputData inputData)
Constructs a HiveDataFragmenter object.
|
HiveDataFragmenter(InputData inputData,
java.lang.Class<?> clazz)
Constructs a HiveDataFragmenter object.
|
Modifier and Type | Method and Description |
---|---|
java.util.List<Fragment> |
getFragments()
Gets the fragments of a given path (source name and location of each
fragment).
|
FragmentsStats |
getFragmentsStats()
Returns statistics for Hive table.
|
static org.apache.hadoop.mapred.InputFormat<?,?> |
makeInputFormat(java.lang.String inputFormatName,
org.apache.hadoop.mapred.JobConf jobConf)
Creates the partition InputFormat.
|
isThreadSafe
public HiveDataFragmenter(InputData inputData)
inputData
- all input parameters coming from the clientpublic HiveDataFragmenter(InputData inputData, java.lang.Class<?> clazz)
inputData
- all input parameters coming from the clientclazz
- Class for JobConfpublic java.util.List<Fragment> getFragments() throws java.lang.Exception
Fragmenter
getFragments
in class Fragmenter
java.lang.Exception
- if fragment list could not be retrievedpublic static org.apache.hadoop.mapred.InputFormat<?,?> makeInputFormat(java.lang.String inputFormatName, org.apache.hadoop.mapred.JobConf jobConf) throws java.lang.Exception
inputFormatName
- input format class namejobConf
- configuration data for the Hadoop frameworkInputFormat
derived objectjava.lang.Exception
- if failed to create input formatpublic FragmentsStats getFragmentsStats() throws java.lang.Exception
getFragmentsStats
in class Fragmenter
java.lang.Exception
- if statistics cannot be gathered