org.apache.hawq.pxf.plugins.hdfs.utilities

Class PxfInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat

org.apache.hawq.pxf.plugins.hdfs.utilities.PxfInputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat

public class PxfInputFormat
extends org.apache.hadoop.mapred.FileInputFormat

PxfInputFormat is not intended to read a specific format, hence it implements a dummy getRecordReader Instead, its purpose is to apply FileInputFormat.getSplits from one point in PXF and get the splits which are valid for the actual InputFormats, since all of them we use inherit FileInputFormat but do not override getSplits.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
PxfInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapred.RecordReader	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter)
protected boolean	isSplitable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path filename)

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PxfInputFormat

public PxfInputFormat()

Method Detail

getRecordReader

public org.apache.hadoop.mapred.RecordReader getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                             org.apache.hadoop.mapred.JobConf conf,
                                                             org.apache.hadoop.mapred.Reporter reporter)
                                                      throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat

Throws:

java.io.IOException

isSplitable

protected boolean isSplitable(org.apache.hadoop.fs.FileSystem fs,
                              org.apache.hadoop.fs.Path filename)

Overrides:

isSplitable in class org.apache.hadoop.mapred.FileInputFormat