I
- Vertex idV
- Vertex valueE
- Edge valuepublic abstract class HCatalogVertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> extends VertexOutputFormat<I,V,E>
HCatalogVertexOutputFormat.HCatalogVertexWriter
by extending
HCatalogVertexOutputFormat.SingleRowHCatalogVertexWriter
or HCatalogVertexOutputFormat.MultiRowHCatalogVertexWriter
depending on how you want to fit your vertices into the output table.
The desired database and table name to store to can be specified via
HCatOutputFormat.setOutput(org.apache.hadoop.mapreduce.Job,
org.apache.hcatalog.mapreduce.OutputJobInfo)
as you setup your vertex output format with
GiraphConfiguration
setVertexOutputFormatClass(Class)}. You must create the output table.
Modifier and Type | Class and Description |
---|---|
protected static class |
HCatalogVertexOutputFormat.HCatalogVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
Abstract class that users should
subclass based on their specific vertex
output.
|
static class |
HCatalogVertexOutputFormat.MultiRowHCatalogVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
HCatalogVertexWriter to write each vertex in multiple rows.
|
protected static class |
HCatalogVertexOutputFormat.SingleRowHCatalogVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
HCatalogVertexWriter to write each vertex in each row.
|
Modifier and Type | Field and Description |
---|---|
protected org.apache.hcatalog.mapreduce.HCatOutputFormat |
hCatOutputFormat
hcat output format
|
Constructor and Description |
---|
HCatalogVertexOutputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) |
protected abstract HCatalogVertexOutputFormat.HCatalogVertexWriter<I,V,E> |
createVertexWriter()
create vertex writer.
|
VertexWriter<I,V,E> |
createVertexWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) |
org.apache.hadoop.mapreduce.OutputCommitter |
getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) |
getConf, setConf
protected org.apache.hcatalog.mapreduce.HCatOutputFormat hCatOutputFormat
public final void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) throws IOException, InterruptedException
checkOutputSpecs
in class VertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
IOException
InterruptedException
public final org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException, InterruptedException
getOutputCommitter
in class VertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
IOException
InterruptedException
protected abstract HCatalogVertexOutputFormat.HCatalogVertexWriter<I,V,E> createVertexWriter()
public final VertexWriter<I,V,E> createVertexWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException, InterruptedException
createVertexWriter
in class VertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
IOException
InterruptedException
Copyright © 2011-2019 The Apache Software Foundation. All Rights Reserved.