A C F G H I M O P R S T U W 

A

abort() - Method in class org.apache.tez.mapreduce.output.MROutput
MROutput expects that a Processor call abort in case of any error ( including an error during commit ) prior to the Processor's completion
abortOutput(VertexStatus.State) - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 
addSplit(InputSplit) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
addSplit(InputSplit) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 

C

close() - Method in class org.apache.tez.mapreduce.input.MRInput
 
close() - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
close() - Method in class org.apache.tez.mapreduce.output.MROutput
 
combine(TezRawKeyValueIterator, IFile.Writer) - Method in class org.apache.tez.mapreduce.combine.MRCombiner
 
commit() - Method in class org.apache.tez.mapreduce.output.MROutput
MROutput expects that a Processor call commit prior to the Processor's completion
commitOutput() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 
committer - Variable in class org.apache.tez.mapreduce.output.MROutput
 
configureMRApiUsage(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Update the provided configuration to use the new API (mapreduce) or the old API (mapred) based on the configured InputFormat, OutputFormat, Partitioner etc.
configureMRInputWithLegacySplitGeneration(Configuration, Path, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Setup split generation on the client, with splits being distributed via the traditional MapReduce mechanism of distributing splits via the Distributed Cache.
createConfigBuilder(Configuration) - Static method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See TezSplitGrouper.newConfigBuilder(Configuration)
createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.input.MRInput
Create an MRInput.MRInputConfigBuilder
createConfigBuilder(Configuration, Class<?>, String) - Static method in class org.apache.tez.mapreduce.input.MRInput
Create an MRInput.MRInputConfigBuilder for FileInputFormat or FileInputFormat format based InputFormats.
createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.input.MultiMRInput
Create an MultiMRInput.MultiMRInputConfigBuilder to configure a MultiMRInput
createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.output.MROutput
Create an MROutput.MROutputConfigBuilder
createConfigBuilder(Configuration, Class<?>, String) - Static method in class org.apache.tez.mapreduce.output.MROutput
Create an MROutput.MROutputConfigBuilder for a FileOutputFormat or FileOutputFormat based OutputFormats.
createMRInputPayload(Configuration, MRRuntimeProtos.MRSplitsProto) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
 
createMRInputPayloadWithGrouping(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Called to specify that grouping of input splits be performed by Tez The conf should have the input format class configuration set to the TezGroupedSplitsInputFormat.
createNewFormatSplitFromUserPayload(MRRuntimeProtos.MRSplitProto, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Create an instance of InputSplit from the MRInput representation of a split.
createOldFormatSplitFromUserPayload(MRRuntimeProtos.MRSplitProto, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Create an instance of InputSplit from the MRInput representation of a split.
createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
createSplitProto(T, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
 
createSplitProto(InputSplit) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
 

F

flush() - Method in class org.apache.tez.mapreduce.output.MROutput
Call this in the processor before finishing to ensure outputs that outputs have been flushed.

G

generateInputSplitsToMem(Configuration, boolean, int) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Generates Input splits and stores them in a MRRuntimeProtos.MRSplitsProto instance.
getConf() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
getConf() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
getConf() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
getConf() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
getConfigUpdates() - Method in class org.apache.tez.mapreduce.input.MRInput
MRInput sets some additional parameters like split location when using the new API.
getGroupedSplits() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
getGroupedSplits(Configuration, InputSplit[], int, String) - Method in class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper
 
getGroupedSplits(Configuration, InputSplit[], int, String, SplitSizeEstimator) - Method in class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper
 
getGroupedSplits(Configuration, InputSplit[], int, String, SplitSizeEstimator, SplitLocationProvider) - Method in class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper
 
getGroupedSplits() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
getGroupedSplits(Configuration, List<InputSplit>, int, String) - Method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
 
getGroupedSplits(Configuration, List<InputSplit>, int, String, SplitSizeEstimator) - Method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
 
getGroupedSplits(Configuration, List<InputSplit>, int, String, SplitSizeEstimator, SplitLocationProvider) - Method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
 
getJavaOptsForMRAM(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Generate JVM options based on MapReduce AM java options.
getJavaOptsForMRMapper(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Generate JVM options based on MapReduce mapper java options.
getJavaOptsForMRReducer(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Generate JVM options based on MapReduce reducer java options.
getKeyValueReaders() - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
getLength() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
getLength() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
getLocations() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
getLocations() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
getPartition(Object, Object, int) - Method in class org.apache.tez.mapreduce.partition.MRPartitioner
 
getProgress() - Method in class org.apache.tez.mapreduce.input.MRInput
 
getRack() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
getRack() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
getReader() - Method in class org.apache.tez.mapreduce.input.MRInput
Returns a KeyValueReader that can be used to read Map Reduce compatible key value data.
getReader() - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
getResourceForMRMapper(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Extract the container resource requirements from the provided configuration, which would otherwise have been used when running a Hadoop MapReduce mapper.
getResourceForMRReducer(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Extract the container resource requirements from the provided configuration, which would otherwise have been used when running a Hadoop MapReduce reducer.
getSplits(JobConf, int) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
getSplits(JobContext) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
getWriter() - Method in class org.apache.tez.mapreduce.output.MROutput
Get a key value write to write Map Reduce compatible output

H

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.input.MRInput
 
handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.output.MROutput
 
handleInputInitializerEvent(List<InputInitializerEvent>) - Method in class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator
 
handleInputInitializerEvent(List<InputInitializerEvent>) - Method in class org.apache.tez.mapreduce.common.MRInputSplitDistributor
 

I

initCommitter(JobConf, boolean) - Method in class org.apache.tez.mapreduce.output.MROutput
 
initialize() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 
initialize() - Method in class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator
 
initialize() - Method in class org.apache.tez.mapreduce.common.MRInputSplitDistributor
 
initialize() - Method in class org.apache.tez.mapreduce.input.MRInput
 
initialize() - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
initialize() - Method in class org.apache.tez.mapreduce.output.MROutput
 
isCommitRequired() - Method in class org.apache.tez.mapreduce.output.MROutput
 
isTaskRecoverySupported() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 

M

MRCombiner - Class in org.apache.tez.mapreduce.combine
Implements a Map Reduce compatible combiner
MRCombiner(TaskContext) - Constructor for class org.apache.tez.mapreduce.combine.MRCombiner
 
MRHelpers - Class in org.apache.tez.mapreduce.hadoop
This class contains helper methods for frameworks which migrate from MapReduce to Tez, and need to continue to work with existing MapReduce configurations.
MRHelpers() - Constructor for class org.apache.tez.mapreduce.hadoop.MRHelpers
 
MRInput - Class in org.apache.tez.mapreduce.input
MRInput is an Input which provides key/values pairs for the consumer.
MRInput(InputContext, int) - Constructor for class org.apache.tez.mapreduce.input.MRInput
 
MRInputAMSplitGenerator - Class in org.apache.tez.mapreduce.common
Implements an InputInitializer that generates Map Reduce splits in the App Master.
MRInputAMSplitGenerator(InputInitializerContext) - Constructor for class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator
 
MRInputHelpers - Class in org.apache.tez.mapreduce.hadoop
 
MRInputHelpers() - Constructor for class org.apache.tez.mapreduce.hadoop.MRInputHelpers
 
MRInputSplitDistributor - Class in org.apache.tez.mapreduce.common
Implements an InputInitializer that distributes Map Reduce splits created by the client to tasks in the Vertex This can be used when certain reasons (e.g.
MRInputSplitDistributor(InputInitializerContext) - Constructor for class org.apache.tez.mapreduce.common.MRInputSplitDistributor
 
MROutput - Class in org.apache.tez.mapreduce.output
MROutput is an Output which allows key/values pairs to be written by a processor.
MROutput(OutputContext, int) - Constructor for class org.apache.tez.mapreduce.output.MROutput
 
MROutputCommitter - Class in org.apache.tez.mapreduce.committer
Implements the OutputCommitter and provide Map Reduce compatible output commit operations for Map Reduce compatible data sinks.
MROutputCommitter(OutputCommitterContext) - Constructor for class org.apache.tez.mapreduce.committer.MROutputCommitter
 
MRPartitioner - Class in org.apache.tez.mapreduce.partition
Provides an implementation of Partitioner that is compatible with Map Reduce partitioners.
MRPartitioner(Configuration) - Constructor for class org.apache.tez.mapreduce.partition.MRPartitioner
 
mrReader - Variable in class org.apache.tez.mapreduce.input.MRInput
 
MultiMRInput - Class in org.apache.tez.mapreduce.input
 
MultiMRInput(InputContext, int) - Constructor for class org.apache.tez.mapreduce.input.MultiMRInput
 

O

org.apache.hadoop.mapred.split - package org.apache.hadoop.mapred.split
 
org.apache.tez.client - package org.apache.tez.client
 
org.apache.tez.dag.api.client - package org.apache.tez.dag.api.client
 
org.apache.tez.mapreduce.combine - package org.apache.tez.mapreduce.combine
 
org.apache.tez.mapreduce.committer - package org.apache.tez.mapreduce.committer
 
org.apache.tez.mapreduce.common - package org.apache.tez.mapreduce.common
 
org.apache.tez.mapreduce.grouper - package org.apache.tez.mapreduce.grouper
 
org.apache.tez.mapreduce.input - package org.apache.tez.mapreduce.input
 
org.apache.tez.mapreduce.input.base - package org.apache.tez.mapreduce.input.base
 
org.apache.tez.mapreduce.output - package org.apache.tez.mapreduce.output
 
org.apache.tez.mapreduce.partition - package org.apache.tez.mapreduce.partition
 
org.apache.tez.mapreduce.processor - package org.apache.tez.mapreduce.processor
 
org.apache.tez.mapreduce.processor.map - package org.apache.tez.mapreduce.processor.map
 
org.apache.tez.mapreduce.processor.reduce - package org.apache.tez.mapreduce.processor.reduce
 
org.apache.tez.mapreduce.protos - package org.apache.tez.mapreduce.protos
 

P

parseMRInputPayload(UserPayload) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers
Parse the payload used by MRInputPayload
postOp() - Method in class org.apache.tez.mapreduce.processor.SimpleMRProcessor
 

R

readFields(DataInput) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
readFields(DataInput) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
recoverTask(int, int) - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 

S

setConf(Configuration) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
setConf(Configuration) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
setConf(Configuration) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
setConf(Configuration) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
setDesiredNumberOfSplits(int) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
setDesiredNumberOfSplits(int) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
setInputFormat(InputFormat<K, V>) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
setInputFormat(InputFormat<K, V>) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
setSplitLocationProvider(SplitLocationProvider) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
setSplitLocationProvider(SplitLocationProvider) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
setSplitSizeEstimator(SplitSizeEstimator) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
setSplitSizeEstimator(SplitSizeEstimator) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
setupOutput() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter
 
SimpleMRProcessor - Class in org.apache.tez.mapreduce.processor
A SimpleProcessor that provides Map Reduce specific post processing by calling commit (if needed) on all MROutputs connected to this Processor.
SimpleMRProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.processor.SimpleMRProcessor
 
splitMetaInfo - Variable in class org.apache.tez.mapreduce.input.MRInput
 
start() - Method in class org.apache.tez.mapreduce.input.MRInput
 
start() - Method in class org.apache.tez.mapreduce.input.MultiMRInput
 
start() - Method in class org.apache.tez.mapreduce.output.MROutput
 

T

TEZ_GROUPING_RACK_SPLIT_SIZE_REDUCTION - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_RACK_SPLIT_SIZE_REDUCTION_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_REPEATABLE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_REPEATABLE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_BY_COUNT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_BY_COUNT_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_BY_LENGTH - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_BY_LENGTH_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_COUNT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_MAX_SIZE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_MAX_SIZE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_MIN_SIZE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_MIN_SIZE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_WAVES - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TEZ_GROUPING_SPLIT_WAVES_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
Deprecated.
See equivalent in TezSplitGrouper
TezGroupedSplit - Class in org.apache.hadoop.mapred.split
Implements an InputSplit that provides a generic wrapper around a group of real InputSplits
TezGroupedSplit() - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit
 
TezGroupedSplit(List<InputSplit>, String, String[], String, long) - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit
 
TezGroupedSplit(int, String, String[], String) - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit
 
TezGroupedSplit(int, String, String[]) - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit
 
TezGroupedSplit - Class in org.apache.hadoop.mapreduce.split
A Mapreduce InputSplit that provides a generic wrapper around a set of real InputSplits.
TezGroupedSplit() - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
TezGroupedSplit(List<InputSplit>, String, String[], String, long) - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
TezGroupedSplit(int, String, String[], String) - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
TezGroupedSplit(int, String, String[]) - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
TezGroupedSplitsInputFormat<K,V> - Class in org.apache.hadoop.mapred.split
An InputFormat that provides a generic grouping around the splits of a real InputFormat
TezGroupedSplitsInputFormat() - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat
 
TezGroupedSplitsInputFormat<K,V> - Class in org.apache.hadoop.mapreduce.split
An InputFormat that provides a generic grouping around the splits of a real InputFormat
TezGroupedSplitsInputFormat() - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat
 
TezMapredSplitsGrouper - Class in org.apache.hadoop.mapred.split
A Helper that provides grouping logic to group InputSplits using various parameters.
TezMapredSplitsGrouper() - Constructor for class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper
 
TezMapReduceSplitsGrouper - Class in org.apache.hadoop.mapreduce.split
Helper that provides a grouping of input splits based on multiple parameters.
TezMapReduceSplitsGrouper() - Constructor for class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper
 
toString() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
toString() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
translateMRConfToTez(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Translate MapReduce configuration keys to the equivalent Tez keys in the provided configuration.
translateMRConfToTez(Configuration, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Translate MapReduce configuration keys to the equivalent Tez keys in the provided configuration.

U

updateEnvBasedOnMRAMEnv(Configuration, Map<String, String>) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Setup environment variables based on the configured values for the MR AM
updateEnvBasedOnMRTaskEnv(Configuration, Map<String, String>, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers
Setup classpath and other environment variables based on the configured values for MR Mappers or Reducers

W

write(DataOutput) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit
 
write(DataOutput) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit
 
A C F G H I M O P R S T U W 

Copyright © 2016 Apache Software Foundation. All rights reserved.