public class ReducersForPieceHandler extends Object implements VertexSenderObserver
Modifier and Type | Class and Description |
---|---|
static class |
ReducersForPieceHandler.BroadcastHandleImpl<T>
Implementation of BroadcastHandle
|
class |
ReducersForPieceHandler.GlobalReduceHandle<S,R extends org.apache.hadoop.io.Writable>
Global Reduce Handle is implementation of ReducerHandle, that will keep
only one value for each worker, and each call to reduce will have
to obtain a global lock, and incur synchronization costs.
|
class |
ReducersForPieceHandler.LocalReduceHandle<S,R extends org.apache.hadoop.io.Writable>
Local Reduce Handle is implementation of ReducerHandle, that will make a
partially reduced value on each worker thread, which are at the end
reduced all together.
|
class |
ReducersForPieceHandler.ReduceHandleImpl<S,R extends org.apache.hadoop.io.Writable>
Parent implementation of ReducerHandle
|
static class |
ReducersForPieceHandler.WrappedReducedValue<R extends org.apache.hadoop.io.Writable>
Wrapper that makes reduced values self-serializable,
and allows them to be broadcasted.
|
Constructor and Description |
---|
ReducersForPieceHandler() |
Modifier and Type | Method and Description |
---|---|
<S,R extends org.apache.hadoop.io.Writable> |
createGlobalReducer(MasterGlobalCommUsage master,
ReduceOperation<S,R> reduceOp,
R globalInitialValue) |
<S,R extends org.apache.hadoop.io.Writable> |
createLocalReducer(MasterGlobalCommUsage master,
ReduceOperation<S,R> reduceOp,
R globalInitialValue) |
void |
vertexSenderWorkerPostprocess(WorkerReduceUsage usage) |
void |
vertexSenderWorkerPreprocess(WorkerReduceUsage usage) |
public void vertexSenderWorkerPreprocess(WorkerReduceUsage usage)
vertexSenderWorkerPreprocess
in interface VertexSenderObserver
public void vertexSenderWorkerPostprocess(WorkerReduceUsage usage)
vertexSenderWorkerPostprocess
in interface VertexSenderObserver
public <S,R extends org.apache.hadoop.io.Writable> ReducerHandle<S,R> createLocalReducer(MasterGlobalCommUsage master, ReduceOperation<S,R> reduceOp, R globalInitialValue)
public <S,R extends org.apache.hadoop.io.Writable> ReducerHandle<S,R> createGlobalReducer(MasterGlobalCommUsage master, ReduceOperation<S,R> reduceOp, R globalInitialValue)
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.