org.apache.crunch.util
Class Protos.TextToProtoFn<M extends com.google.protobuf.Message>
java.lang.Object
org.apache.crunch.DoFn<String,M>
org.apache.crunch.util.Protos.TextToProtoFn<M>
- All Implemented Interfaces:
- Serializable
- Enclosing class:
- Protos
public static class Protos.TextToProtoFn<M extends com.google.protobuf.Message>
- extends DoFn<String,M>
- See Also:
- Serialized Form
Protos.TextToProtoFn
public Protos.TextToProtoFn(String sep,
Class<M> msgClass)
initialize
public void initialize()
- Description copied from class:
DoFn
- Called during the setup of the MapReduce job this
DoFn
is
associated with. Subclasses may override this method to do appropriate
initialization.
- Overrides:
initialize
in class DoFn<String,M extends com.google.protobuf.Message>
process
public void process(String input,
Emitter<M> emitter)
- Description copied from class:
DoFn
- Processes the records from a
PCollection
.
Note: Crunch can reuse a single input record object whose content
changes on each DoFn.process(Object, Emitter)
method call. This
functionality is imposed by Hadoop's Reducer implementation: The framework will reuse the key and value
objects that are passed into the reduce, therefore the application should
clone the objects they want to keep a copy of.
- Specified by:
process
in class DoFn<String,M extends com.google.protobuf.Message>
- Parameters:
input
- The input record.emitter
- The emitter to send the output to
Copyright © 2012 The Apache Software Foundation. All Rights Reserved.