org.apache.hadoop.chukwa.datacollection.writer

Class Dedup

java.lang.Object

org.apache.hadoop.chukwa.datacollection.writer.Dedup

All Implemented Interfaces:

ChukwaWriter, PipelineableWriter

public class Dedup
extends Object
implements PipelineableWriter

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.chukwa.datacollection.writer.ChukwaWriter

ChukwaWriter.COMMIT_PENDING, ChukwaWriter.CommitStatus

Field Summary

Fields inherited from interface org.apache.hadoop.chukwa.datacollection.writer.ChukwaWriter

COMMIT_FAIL, COMMIT_OK

Constructor Summary

Constructors

Constructor and Description
Dedup()

Method Summary

Methods

Modifier and Type	Method and Description
ChukwaWriter.CommitStatus	add(List<Chunk> chunks) Called repeatedly with data that should be serialized.
void	close() Called once, indicating that the writer should close files and prepare to exit.
void	init(org.apache.hadoop.conf.Configuration c) Called once to initialize this writer.
void	setNextStage(ChukwaWriter next)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Dedup

public Dedup()

Method Detail

setNextStage

public void setNextStage(ChukwaWriter next)

Specified by:

setNextStage in interface PipelineableWriter

add

public ChukwaWriter.CommitStatus add(List<Chunk> chunks)
                              throws WriterException

Description copied from interface: ChukwaWriter

Called repeatedly with data that should be serialized. Subclasses may assume that init() will be called before any calls to add(), and that add() won't be called after close().

Specified by:

add in interface ChukwaWriter

Returns:

Throws:

WriterException

close

public void close()
           throws WriterException

Description copied from interface: ChukwaWriter

Called once, indicating that the writer should close files and prepare to exit.

Specified by:

close in interface ChukwaWriter

Throws:

WriterException

init

public void init(org.apache.hadoop.conf.Configuration c)
          throws WriterException

Description copied from interface: ChukwaWriter

Called once to initialize this writer.

Specified by:

init in interface ChukwaWriter

Throws:

WriterException