org.apache.crunch.io
Interface PathTarget
- All Superinterfaces:
- MapReduceTarget, Target
public interface PathTarget
- extends MapReduceTarget
A target whose output goes to a given path on a file system.
Method Summary |
FileNamingScheme |
getFileNamingScheme()
Get the naming scheme to be used for outputs being written to an output
path. |
org.apache.hadoop.fs.Path |
getPath()
|
void |
handleOutputs(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path workingPath,
int index)
Handles moving the output data for this target from a temporary location on the
filesystem to its target path at the end of a MapReduce job. |
getPath
org.apache.hadoop.fs.Path getPath()
getFileNamingScheme
FileNamingScheme getFileNamingScheme()
- Get the naming scheme to be used for outputs being written to an output
path.
- Returns:
- the naming scheme to be used
handleOutputs
void handleOutputs(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.Path workingPath,
int index)
throws IOException
- Handles moving the output data for this target from a temporary location on the
filesystem to its target path at the end of a MapReduce job.
- Parameters:
conf
- The job Configuration
workingPath
- The temp directory that contains the output of the jobindex
- The index of this target for jobs that write multiple output files to a single directory
- Throws:
IOException
Copyright © 2014 The Apache Software Foundation. All Rights Reserved.