org.apache.hawq.pxf.plugins.hdfs

Class QuotedLineBreakAccessor

java.lang.Object

org.apache.hawq.pxf.api.utilities.Plugin

org.apache.hawq.pxf.plugins.hdfs.HdfsAtomicDataAccessor

org.apache.hawq.pxf.plugins.hdfs.QuotedLineBreakAccessor

All Implemented Interfaces:

ReadAccessor

public class QuotedLineBreakAccessor
extends HdfsAtomicDataAccessor

A (atomic) PXF Accessor for reading \n delimited files with quoted field delimiter, line delimiter, and quotes. This accessor supports multi-line records, that are read from a single source (non-parallel).

Field Summary

Fields inherited from class org.apache.hawq.pxf.plugins.hdfs.HdfsAtomicDataAccessor

inp

Fields inherited from class org.apache.hawq.pxf.api.utilities.Plugin

inputData

Constructor Summary

Constructors

Constructor and Description
QuotedLineBreakAccessor(InputData input) Constructs a QuotedLineBreakAccessor.

Method Summary

Modifier and Type	Method and Description
boolean	openForRead() Opens the file using the non-splittable API for HADOOP HDFS file access This means that instead of using a FileInputFormat for access, we use a Java stream.
OneRow	readNextObject() Fetches one record (maybe partial) from the file.

Methods inherited from class org.apache.hawq.pxf.plugins.hdfs.HdfsAtomicDataAccessor

closeForRead, isThreadSafe

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QuotedLineBreakAccessor

public QuotedLineBreakAccessor(InputData input)

Constructs a QuotedLineBreakAccessor.

Parameters:

input - all input parameters coming from the client request

Method Detail

openForRead

public boolean openForRead()
                    throws java.lang.Exception

Description copied from class: HdfsAtomicDataAccessor

Opens the file using the non-splittable API for HADOOP HDFS file access This means that instead of using a FileInputFormat for access, we use a Java stream.

Specified by:

openForRead in interface ReadAccessor

Overrides:

openForRead in class HdfsAtomicDataAccessor

Returns:

true for successful file open, false otherwise

Throws:

java.lang.Exception - if opening the resource failed

readNextObject

public OneRow readNextObject()
                      throws java.io.IOException

Fetches one record (maybe partial) from the file. The record is returned as a Java object.

Specified by:

readNextObject in interface ReadAccessor

Overrides:

readNextObject in class HdfsAtomicDataAccessor

Returns:

a OneRow record as a Java object. Returns null if none.

Throws:

java.io.IOException