Package org.apache.nemo.runtime.executor.datatransfer

Class OperatorVertexOutputCollector<O>

java.lang.Object

org.apache.nemo.runtime.executor.datatransfer.OperatorVertexOutputCollector<O>

Type Parameters:

O - output type.

All Implemented Interfaces:

java.io.Serializable, OutputCollector<O>

public final class OperatorVertexOutputCollector<O>
extends java.lang.Object
implements OutputCollector<O>

OutputCollector implementation. This emits four types of outputs 1) internal main outputs: this output becomes the input of internal Transforms 2) internal additional outputs: this additional output becomes the input of internal Transforms 3) external main outputs: this external output is emitted to OutputWriter 4) external additional outputs: this external output is emitted to OutputWriter

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
OperatorVertexOutputCollector(IRVertex irVertex, java.util.List<NextIntraTaskOperatorInfo> internalMainOutputs, java.util.Map<java.lang.String,java.util.List<NextIntraTaskOperatorInfo>> internalAdditionalOutputs, java.util.List<OutputWriter> externalMainOutputs, java.util.Map<java.lang.String,java.util.List<OutputWriter>> externalAdditionalOutputs)	Constructor of the output collector.

Method Summary

Modifier and Type	Method	Description
<T> void	emit(java.lang.String dstVertexId, T output)	Multi-destination emit.
void	emit(O output)	Single-destination emit.
void	emitLatencymark(LatencyMark latencymark)	Emit latencymark to downstream vertices.
void	emitWatermark(Watermark watermark)	Emit watermark to downstream vertices.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OperatorVertexOutputCollector

public OperatorVertexOutputCollector(IRVertex irVertex,
                                     java.util.List<NextIntraTaskOperatorInfo> internalMainOutputs,
                                     java.util.Map<java.lang.String,java.util.List<NextIntraTaskOperatorInfo>> internalAdditionalOutputs,
                                     java.util.List<OutputWriter> externalMainOutputs,
                                     java.util.Map<java.lang.String,java.util.List<OutputWriter>> externalAdditionalOutputs)

Constructor of the output collector.

Parameters:

irVertex - the ir vertex that emits the output

internalMainOutputs - internal main outputs

internalAdditionalOutputs - internal additional outputs

externalMainOutputs - external main outputs

externalAdditionalOutputs - external additional outputs

Method Detail

emit

public void emit(O output)

Description copied from interface: OutputCollector

Single-destination emit.

Specified by:

emit in interface OutputCollector<O>

Parameters:

output - value.

emit

public <T> void emit(java.lang.String dstVertexId,
                     T output)

Description copied from interface: OutputCollector

Multi-destination emit. Currently unused, but might come in handy for operations like multi-output map.

Specified by:

emit in interface OutputCollector<O>

Type Parameters:

T - output type.

Parameters:

dstVertexId - destination vertex id.

output - value.

emitWatermark

public void emitWatermark(Watermark watermark)

Description copied from interface: OutputCollector

Emit watermark to downstream vertices.

Specified by:

emitWatermark in interface OutputCollector<O>

Parameters:

watermark - watermark

emitLatencymark

public void emitLatencymark(LatencyMark latencymark)

Description copied from interface: OutputCollector

Emit latencymark to downstream vertices.

Specified by:

emitLatencymark in interface OutputCollector<O>

Parameters:

latencymark - latencymark