Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W Z 

A

AbsentBlockException - Exception in edu.snu.nemo.runtime.common.exception
An exception which represents the requested block is neither COMMITTED nor SCHEDULED.
AbsentBlockException(String, BlockState.State) - Constructor for exception edu.snu.nemo.runtime.common.exception.AbsentBlockException
 
AbstractBlockStore - Class in edu.snu.nemo.runtime.executor.data.stores
This abstract class represents a default BlockStore, which contains other components used in each implementation of BlockStore.
AbstractBlockStore(SerializerManager) - Constructor for class edu.snu.nemo.runtime.executor.data.stores.AbstractBlockStore
Constructor.
accumulateBarrierMetric(List<Long>, String, String) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
Accumulates the metric data for a barrier vertex.
accumulateMetric(String, List<T>) - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
Method for accumulating metrics in the vertex.
ActiveContextHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.ActiveContextHandler
 
addDAGDirectory(String) - Method in class edu.snu.nemo.common.test.ArgBuilder
 
addDagIncomingEdge(IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Adds the incoming edge of the contained DAG.
addDagOutgoingEdge(IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Adds and outgoing edge of the contained DAG.
addInput(List<Pair<List<Integer>, List<Double>>>, Pair<List<Integer>, List<Double>>) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.TrainingDataCombiner
 
addIterativeIncomingEdge(IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Adds an iterative incoming edge, from the previous iteration, but connection internally.
addJobId(String) - Method in class edu.snu.nemo.common.test.ArgBuilder
 
addNonIterativeIncomingEdge(IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Adds a non-iterative incoming edge, from outside the previous iteration.
addOptimizationPolicy(String) - Method in class edu.snu.nemo.common.test.ArgBuilder
 
addState(Enum, String) - Method in class edu.snu.nemo.common.StateMachine.Builder
Adds a state with name and description.
addTransition(Enum, Enum, String) - Method in class edu.snu.nemo.common.StateMachine.Builder
Adds a transition with description.
addUserArgs(String...) - Method in class edu.snu.nemo.common.test.ArgBuilder
 
addUserMain(String) - Method in class edu.snu.nemo.common.test.ArgBuilder
 
addVertex(V) - Method in class edu.snu.nemo.common.dag.DAGBuilder
Add vertex to the builder.
addVertex(V, Stack<LoopVertex>) - Method in class edu.snu.nemo.common.dag.DAGBuilder
Add vertex to the builder, using the LoopVertex stack.
addVertex(V, DAG<V, E>) - Method in class edu.snu.nemo.common.dag.DAGBuilder
Add vertex to the builder, using the information from the given DAG.
addVertex(IRVertex) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageBuilder
Adds a IRVertex to this stage.
agg(Column, Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
agg(Column, Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
agg(Map<String, String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
agg(Map<String, String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
agg(Tuple2<String, String>, Seq<Tuple2<String, String>>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
aggregate(U, Function2<U, T, U>, Function2<U, U, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
alias(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
alias(Symbol) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
all() - Static method in class edu.snu.nemo.runtime.common.data.HashRange
 
AllocatedEvaluatorHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.AllocatedEvaluatorHandler
 
AlternatingLeastSquare - Class in edu.snu.nemo.examples.beam
Sample Alternating Least Square application.
AlternatingLeastSquare.CalculateNextMatrix - Class in edu.snu.nemo.examples.beam
DoFn for calculating next matrix at each iteration.
AlternatingLeastSquare.ParseLine - Class in edu.snu.nemo.examples.beam
Method for parsing the input line.
AlternatingLeastSquare.TrainingDataCombiner - Class in edu.snu.nemo.examples.beam
Combiner for the training data.
AlternatingLeastSquare.UngroupSingleVectorList - Class in edu.snu.nemo.examples.beam
A DoFn that relays a single vector list.
AlternatingLeastSquare.UpdateUserAndItemMatrix - Class in edu.snu.nemo.examples.beam
Composite transform that wraps the transforms inside the loop.
AlternatingLeastSquareInefficient - Class in edu.snu.nemo.examples.beam
Sample Alternating Least Square application.
AlternatingLeastSquareInefficient.UpdateUserAndItemMatrix - Class in edu.snu.nemo.examples.beam
Composite transform that wraps the transforms inside the loop.
AnnotatingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A compile-time pass that annotates the IR DAG with execution properties.
AnnotatingPass(ExecutionProperty.Key, Set<ExecutionProperty.Key>) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.AnnotatingPass
Constructor.
AnnotatingPass(ExecutionProperty.Key) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.AnnotatingPass
Constructor.
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.CompressionPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgeDataStorePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgeMetricCollectionPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgePartitionerPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewVertexPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultEdgeUsedDataHandlingPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultParallelismPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultStagePartitioningPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DisaggregationEdgeDataStorePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DuplicateEdgeGroupSizePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoEdgeDataFlowModelPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoEdgeDataStorePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoVertexExecutorPlacementPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ReviseInterStageEdgeDataStorePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeDataFlowModelPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeDataStorePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeUsedDataHandlingPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ScheduleGroupPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ShuffleEdgePushPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.CompositePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.CommonSubexpressionEliminationPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.DataSkewReshapingPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopExtractionPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations.LoopFusionPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations.LoopInvariantCodeMotionPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopUnrollingPass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.SailfishRelayReshapingPass
 
apply(List<Double>, List<Double>) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CombineFunction
 
apply(Iterable<List<Double>>) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CombineFunctionForIterable
 
apply(PhysicalPlan, Map<String, List<Long>>) - Method in class edu.snu.nemo.runtime.common.optimizer.pass.runtime.DataSkewRuntimePass
 
apply(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlanGenerator
Generates the PhysicalPlan to be executed.
appName(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
ArgBuilder - Class in edu.snu.nemo.common.test
Argument builder.
ArgBuilder() - Constructor for class edu.snu.nemo.common.test.ArgBuilder
 
as(Encoder<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
as(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
as(Symbol) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
asFileAreas(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Retrieves the list of FileAreas for the specified KeyRange.
asyncConnect(String, String) - Method in class edu.snu.nemo.runtime.common.message.grpc.GrpcMessageEnvironment
 
asyncConnect(String, String) - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
asyncConnect(String, String) - Method in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
Asynchronously connect to the node called receiverId and return a future of MessageSender that sends messages to the listener with listenerId.
asyncConnect(String, String) - Method in class edu.snu.nemo.runtime.common.message.ncs.NcsMessageEnvironment
 
Average() - Constructor for class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Default constructor.
Average(long, long) - Constructor for class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Public constructor.

B

Backend<Plan> - Interface in edu.snu.nemo.compiler.backend
Interface for backend components.
baseRelationToDataFrame(BaseRelation) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
BatchSingleJobScheduler - Class in edu.snu.nemo.runtime.master.scheduler
BatchSingleJobScheduler receives a single PhysicalPlan to execute and schedules the TaskGroups.
BatchSingleJobScheduler(SchedulingPolicy, SchedulerRunner, PendingTaskGroupQueue, BlockManagerMaster, PubSubEventHandlerWrapper, UpdatePhysicalPlanEventHandler) - Constructor for class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
 
BeamBoundedSourceVertex<O> - Class in edu.snu.nemo.compiler.frontend.beam.source
SourceVertex implementation for BoundedSource.
BeamBoundedSourceVertex(BoundedSource<O>) - Constructor for class edu.snu.nemo.compiler.frontend.beam.source.BeamBoundedSourceVertex
Constructor of BeamBoundedSourceVertex.
BeamCoder<T> - Class in edu.snu.nemo.compiler.frontend.beam.coder
Coder from Coder.
BeamCoder(Coder<T>) - Constructor for class edu.snu.nemo.compiler.frontend.beam.coder.BeamCoder
Constructor of BeamCoder.
BeamStateTranslator - Class in edu.snu.nemo.compiler.frontend.beam
A StateTranslator for Beam.
BeamStateTranslator() - Constructor for class edu.snu.nemo.compiler.frontend.beam.BeamStateTranslator
 
beforeRequest(long) - Method in class edu.snu.nemo.runtime.common.ReplyFutureMap
Called by message sender, just before a new request is sent.
beginMeasurement(Map<String, Object>) - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
Begin the measurement of metric data.
beginMeasurement(String, Map<String, Object>) - Method in class edu.snu.nemo.runtime.executor.MetricCollector
Begins recording the start time of this metric measurement, in addition to the metric given.
Block<K extends Serializable> - Interface in edu.snu.nemo.runtime.executor.data.block
This interface represents a block, which is the output of a specific task.
BLOCK_MANAGER_MASTER_MESSAGE_LISTENER_ID - Static variable in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
 
BlockFetchException - Exception in edu.snu.nemo.common.exception
BlockFetchException.
BlockFetchException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.BlockFetchException
BlockFetchException.
blockIdToFilePath(String, String) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Converts a block id to the corresponding file path.
blockIdToMetaFilePath(String, String) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Converts a block id to the corresponding metadata file path.
BlockManagerMaster - Class in edu.snu.nemo.runtime.master
Master-side block manager.
BlockManagerMaster.BlockLocationRequestHandler - Class in edu.snu.nemo.runtime.master
The handler of block location requests.
BlockManagerMaster.PartitionManagerMasterControlMessageReceiver - Class in edu.snu.nemo.runtime.master
Handler for control messages received.
BlockManagerWorker - Class in edu.snu.nemo.runtime.executor.data
Executor-side block manager.
BlockState - Class in edu.snu.nemo.runtime.common.state
Represents the states of a whole data(a task output).
BlockState() - Constructor for class edu.snu.nemo.runtime.common.state.BlockState
 
BlockState.State - Enum in edu.snu.nemo.runtime.common.state
BlockState.
BlockStore - Interface in edu.snu.nemo.runtime.executor.data.stores
Interface for Block placement.
BlockWriteException - Exception in edu.snu.nemo.common.exception
BlockWriteException.
BlockWriteException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.BlockWriteException
BlockWriteException.
BoundedSourceTask<O> - Class in edu.snu.nemo.runtime.common.plan.physical
BoundedSourceTask.
BoundedSourceTask(String, String) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.BoundedSourceTask
Constructor.
Broadcast - Class in edu.snu.nemo.examples.beam
Sample Broadcast application.
bufferEncoder() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
Specifies the Encoder for the intermediate value type.
bufferSchema() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Data types of values in the aggregation buffer.
build() - Method in class edu.snu.nemo.common.dag.DAGBuilder
Build the DAG.
build() - Method in class edu.snu.nemo.common.StateMachine.Builder
Builds and returns the StateMachine.
build() - Method in class edu.snu.nemo.common.test.ArgBuilder
 
build() - Method in class edu.snu.nemo.compiler.optimizer.policy.PolicyBuilder
Build a policy using compileTimePasses and runtimePasses in this object.
build() - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
Builds immutable MetricData.
build() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageBuilder
Builds and returns the Stage.
build() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
 
build() - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification.Builder
 
builder() - Static method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
Get a builder for the session.
Builder() - Constructor for class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
buildInputStream(InputStream, List<StreamChainer>) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
buildOutputStream(OutputStream, List<StreamChainer>) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
buildWithoutSourceSinkCheck() - Method in class edu.snu.nemo.common.dag.DAGBuilder
Build the DAG for LoopVertex.
ByteInputContext - Class in edu.snu.nemo.runtime.executor.bytetransfer
Container for multiple input streams.
ByteOutputContext - Class in edu.snu.nemo.runtime.executor.bytetransfer
Container for multiple output streams.
ByteOutputContext.ByteOutputStream - Class in edu.snu.nemo.runtime.executor.bytetransfer
An OutputStream implementation which buffers data to ByteBufs.
ByteOutputStream() - Constructor for class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream
 
BytesCoder - Class in edu.snu.nemo.common.coder
A Coder which is used for an array of bytes.
BytesCoder() - Constructor for class edu.snu.nemo.common.coder.BytesCoder
Constructor.
ByteTransfer - Class in edu.snu.nemo.runtime.executor.bytetransfer
Manages channels and exposes interface for BlockManagerWorker.
ByteTransferContext - Class in edu.snu.nemo.runtime.executor.bytetransfer

C

cache() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
cache() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
calculateHashRanges(Map<String, List<Long>>, Integer) - Method in class edu.snu.nemo.runtime.common.optimizer.pass.runtime.DataSkewRuntimePass
Method for calculating key ranges to evenly distribute the skewed metric data.
cancel() - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
 
chainInput(InputStream) - Method in class edu.snu.nemo.runtime.executor.data.streamchainer.CompressionStreamChainer
 
chainInput(InputStream) - Method in interface edu.snu.nemo.runtime.executor.data.streamchainer.StreamChainer
Chain InputStream and returns chained InputStream.
chainOutput(OutputStream) - Method in class edu.snu.nemo.runtime.executor.data.streamchainer.CompressionStreamChainer
 
chainOutput(OutputStream) - Method in interface edu.snu.nemo.runtime.executor.data.streamchainer.StreamChainer
Chain OutputStream and returns chained OutputStream.
checkJobTermination() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
checkpoint() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
checkpoint() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
checkpoint(boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
checkStageCompletion(String) - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
checkState(Enum) - Method in class edu.snu.nemo.common.StateMachine
Checks whether the current state is same as the expectedCurrentState.
ClientEndpoint - Class in edu.snu.nemo.client
A request endpoint in client side of a job.
ClientEndpoint(StateTranslator) - Constructor for class edu.snu.nemo.client.ClientEndpoint
Constructor.
ClosableBlockingQueue<T> - Class in edu.snu.nemo.runtime.executor.bytetransfer
A blocking queue implementation which is capable of closing.
ClosableBlockingQueue() - Constructor for class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Creates a closable blocking queue.
ClosableBlockingQueue(int) - Constructor for class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Creates a closable blocking queue.
close() - Method in class edu.snu.nemo.common.ir.vertex.transform.RelayTransform
 
close() - Method in interface edu.snu.nemo.common.ir.vertex.transform.Transform
Close the transform.
close() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.DoTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.FlattenTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.GroupByKeyTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.WindowTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.CollectTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.FlatMapTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.GroupByKeyTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapToPairTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceByKeyTransform
 
close() - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceTransform
 
close() - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptyTransform
 
close() - Method in class edu.snu.nemo.driver.RemoteClientMessageLoggingHandler
 
close() - Method in class edu.snu.nemo.runtime.common.message.grpc.GrpcMessageEnvironment
 
close() - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
close() - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageSender
 
close() - Method in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
Close this message environment.
close() - Method in interface edu.snu.nemo.runtime.common.message.MessageSender
Closes the connection.
close() - Method in class edu.snu.nemo.runtime.common.message.ncs.NcsMessageEnvironment
 
close() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream
 
close() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext
Closes this stream.
close() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Mark the input end of this queue as closed.
close() - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputWriter
Notifies that all writes for a block is end.
close() - Method in class edu.snu.nemo.runtime.executor.MetricManagerWorker
 
close() - Method in interface edu.snu.nemo.runtime.executor.MetricMessageSender
 
close() - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Closes and cleans up this queue.
close() - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
 
coalesce(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
coalesce(int, boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
coalesce(int) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
Coder<T> - Interface in edu.snu.nemo.common.coder
A Coder<T> object encodes or decodes values of type T into byte streams.
Coder.DummyCoder - Class in edu.snu.nemo.common.coder
Dummy coder implementation which is not supposed to be used.
collect() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaPairRDD
 
collect() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
collect(DAG<IRVertex, IREdge>, Stack<LoopVertex>, IRVertex, Serializer) - Static method in class edu.snu.nemo.compiler.frontend.spark.core.java.SparkFrontendUtils
Collect data by running the DAG.
collectAsync() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
collectOutputList() - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputCollectorImpl
Collects the accumulated output and replace the output list.
collectPartitions(int[]) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
CollectTransform<T> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Collect transform.
CollectTransform(String) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.CollectTransform
Constructor.
CombineFunction() - Constructor for class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CombineFunction
 
CombineFunctionForIterable() - Constructor for class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CombineFunctionForIterable
 
combineFutures(List<CompletableFuture<DataUtil.IteratorWithNumBytes>>) - Static method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
Combine the given list of futures.
commit() - Method in interface edu.snu.nemo.runtime.executor.data.block.Block
Commits this block to prevent further write.
commit() - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Commits this block to prevent further write.
commit() - Method in class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Commits this block to prevent further write.
commit() - Method in class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Commits this block to prevent further write.
commitBlock(String, DataStoreProperty.Value, List<Long>, String, int, UsedDataHandlingProperty.Value) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Notifies that all writes for a block is end.
commitBlock() - Method in class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Notifies that all writes are finished for the block corresponding to this metadata.
commitBlock() - Method in class edu.snu.nemo.runtime.executor.data.metadata.LocalFileMetadata
Notifies that all writes are finished for the block corresponding to this metadata.
commitBlock() - Method in class edu.snu.nemo.runtime.executor.data.metadata.RemoteFileMetadata
Write the collected PartitionMetadatas to the metadata file.
commitBlock(String) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Notifies that all writes for a block is end.
commitBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
Notifies that all writes for a block is end.
commitBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 
CommonEventHandler<T> - Interface in edu.snu.nemo.common.eventhandler
Class for handling common events.
CommonSubexpressionEliminationPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass for Common Subexpression Elimination optimization.
CommonSubexpressionEliminationPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.CommonSubexpressionEliminationPass
Default constructor.
compareAndSetState(Enum, Enum) - Method in class edu.snu.nemo.common.StateMachine
Atomically sets the state to the given updated state if the current state equals to the expected state.
compile(DAG<IRVertex, IREdge>) - Method in interface edu.snu.nemo.compiler.backend.Backend
Compiles a DAG to a physical execution plan.
compile(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.compiler.backend.nemo.NemoBackend
Compiles an IR DAG into a PhysicalPlan to be submitted to Runtime.
compile(DAG<IRVertex, IREdge>, PhysicalPlanGenerator) - Method in class edu.snu.nemo.compiler.backend.nemo.NemoBackend
Compiles an IR DAG into a PhysicalPlan to be submitted to Runtime.
CompilerEvent - Interface in edu.snu.nemo.common.eventhandler
An empty interface to indicate events that are sent from Compiler.
CompilerEventHandler<T extends CompilerEvent> - Interface in edu.snu.nemo.common.eventhandler
Class for handling events sent from Compiler.
CompileTimeOptimizationException - Exception in edu.snu.nemo.common.exception
DynamicOptimizationException.
CompileTimeOptimizationException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.CompileTimeOptimizationException
Constructor of DynamicOptimizationException.
CompileTimeOptimizationException(String) - Constructor for exception edu.snu.nemo.common.exception.CompileTimeOptimizationException
Constructor of DynamicOptimizationException.
CompiletimeOptimizer - Class in edu.snu.nemo.compiler.optimizer
Compile time optimizer class.
CompileTimePass - Interface in edu.snu.nemo.compiler.optimizer.pass.compiletime
Interface for compile-time optimization passes that processes the DAG.
CompositePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
A compile-time pass composed of multiple compile-time passes, which each modifies an IR DAG.
CompositePass(List<CompileTimePass>) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.CompositePass
Constructor.
CompressionPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass for applying compression algorithm for data flowing between vertices.
CompressionPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.CompressionPass
Default constructor.
CompressionPass(CompressionProperty.Compression) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.CompressionPass
Constructor.
CompressionProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
Compression ExecutionProperty.
CompressionProperty.Compression - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of Compression ExecutionProperty.
CompressionStreamChainer - Class in edu.snu.nemo.runtime.executor.data.streamchainer
StreamChainer for applying compression.
CompressionStreamChainer(CompressionProperty.Compression) - Constructor for class edu.snu.nemo.runtime.executor.data.streamchainer.CompressionStreamChainer
Constructor.
COMPUTE - Static variable in class edu.snu.nemo.common.ir.vertex.executionproperty.ExecutorPlacementProperty
 
compute(Partition, TaskContext) - Method in class edu.snu.nemo.compiler.frontend.spark.core.RDD
 
concatNonSerPartitions(Iterable<NonSerializedPartition>) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Concatenates an iterable of non-serialized Partitions into a single iterable of elements.
config(SparkConf) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
config(Map<String, String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
Apply config in the form of Java Map.
config(String, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
connectInternalVertices(IREdge) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageBuilder
Connects two IRVertex in this stage.
connectVertices(E) - Method in class edu.snu.nemo.common.dag.DAGBuilder
Connect vertices at the edge.
consistentWithEquals() - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 
ContainerException - Exception in edu.snu.nemo.common.exception
ContainerException.
ContainerException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.ContainerException
ContainerException.
ContainerManager - Class in edu.snu.nemo.runtime.master.resource
Encapsulates REEF's evaluator management for executors.
ContainerManager(int, EvaluatorRequestor, MessageEnvironment) - Constructor for class edu.snu.nemo.runtime.master.resource.ContainerManager
 
contains(V) - Method in class edu.snu.nemo.common.dag.DAGBuilder
check if the DAGBuilder contains the vertex.
contains(Predicate<V>) - Method in class edu.snu.nemo.common.dag.DAGBuilder
check if the DAGBuilder contains any vertex that satisfies the predicate.
containsKey(ExecutionProperty.Key) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
 
ContextImpl - Class in edu.snu.nemo.common
Transform Context Implementation.
ContextImpl(Map<Transform, Object>) - Constructor for class edu.snu.nemo.common.ContextImpl
Constructor of Context Implementation.
ContextStartHandler() - Constructor for class edu.snu.nemo.driver.NemoContext.ContextStartHandler
 
ContextStopHandler() - Constructor for class edu.snu.nemo.driver.NemoContext.ContextStopHandler
 
convert(Function<DAG<V, E>, DAG<V2, E2>>) - Method in class edu.snu.nemo.common.dag.DAG
Converts a DAG into another DAG according to a function.
convertBlockState(ControlMessage.BlockStateFromExecutor) - Static method in class edu.snu.nemo.runtime.master.RuntimeMaster
 
convertBlockState(BlockState.State) - Static method in class edu.snu.nemo.runtime.master.RuntimeMaster
 
convertToNonSerPartitions(Serializer, Iterable<SerializedPartition<K>>) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Converts the serialized Partitions in an iterable to non-serialized Partitions.
convertToSerPartitions(Serializer, Iterable<NonSerializedPartition<K>>) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Converts the non-serialized Partitions in an iterable to serialized Partitions.
copyExecutionPropertiesTo(IREdge) - Method in class edu.snu.nemo.common.ir.edge.IREdge
Static function to copy executionProperties from an edge to the other.
copyExecutionPropertiesTo(IRVertex) - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
Static function to copy executionProperties from a vertex to the other.
count() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countApprox(long) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countApprox(long, double) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countApproxDistinct(double) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countAsync() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countByValue() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countByValueApprox(long) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
countByValueApprox(long, double) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
create(String) - Static method in class edu.snu.nemo.runtime.executor.data.metadata.RemoteFileMetadata
Creates a new block metadata.
createAccumulator() - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.TrainingDataCombiner
 
createBlock(String, DataStoreProperty.Value) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Creates a new block.
createBlock(String) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Creates a new block.
createBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
Creates a new block.
createBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalFileStore
Creates a new block.
createBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.MemoryStore
 
createBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.SerializedMemoryStore
 
createDataFrame(JavaRDD<?>, Class<?>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataFrame(JavaRDD<Row>, StructType) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataFrame(List<?>, Class<?>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataFrame(List<Row>, StructType) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataFrame(RDD<?>, Class<?>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataFrame(RDD<Row>, StructType) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataset(List<T>, Encoder<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataset(RDD<T>, Encoder<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createDataset(Seq<T>, Encoder<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
createLocalReader(int, RuntimeEdge) - Method in class edu.snu.nemo.runtime.executor.datatransfer.DataTransferFactory
Creates a local InputReader between two task in a single task group.
createLocalWriter(Task, int, RuntimeEdge<?>) - Method in class edu.snu.nemo.runtime.executor.datatransfer.DataTransferFactory
Creates an local OutputWriter between two task in a single task group.
createReader(int, IRVertex, RuntimeEdge) - Method in class edu.snu.nemo.runtime.executor.datatransfer.DataTransferFactory
Creates an InputReader between two stages.
CreateViewTransform<I,O> - Class in edu.snu.nemo.compiler.frontend.beam.transform
CreateView transform implementation.
CreateViewTransform(PCollectionView<O>) - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
Constructor of CreateViewTransform.
createWriter(Task, int, IRVertex, RuntimeEdge<?>) - Method in class edu.snu.nemo.runtime.executor.datatransfer.DataTransferFactory
Creates an OutputWriter between two stages.
crossJoin(Dataset<?>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
csv(Dataset<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
csv(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
csv(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
csv(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 

D

DAG<V extends Vertex,E extends Edge<V>> - Class in edu.snu.nemo.common.dag
DAG implementation.
DAG(Set<V>, Map<V, Set<E>>, Map<V, Set<E>>, Map<V, LoopVertex>, Map<V, Integer>) - Constructor for class edu.snu.nemo.common.dag.DAG
Constructor of DAG, called by the DAGBuilder.
DAG.TraversalOrder - Enum in edu.snu.nemo.common.dag
Indicates the traversal order of this DAG.
DAGBuilder<V extends Vertex,E extends Edge<V>> - Class in edu.snu.nemo.common.dag
DAG Builder.
DAGBuilder() - Constructor for class edu.snu.nemo.common.dag.DAGBuilder
Constructor of DAGBuilder: it initializes everything.
DAGBuilder(DAG<V, E>) - Constructor for class edu.snu.nemo.common.dag.DAGBuilder
Constructor of DAGBuilder with a DAG to start from.
DAGDirectory() - Constructor for class edu.snu.nemo.conf.JobConf.DAGDirectory
 
DataCommunicationPatternProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
DataCommunicationPattern ExecutionProperty.
DataCommunicationPatternProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of DataCommunicationPattern ExecutionProperty.
DataFlowModelProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
DataFlowModel ExecutionProperty.
DataFlowModelProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of DataFlowModel ExecutionProperty.
DataFrameReader - Class in edu.snu.nemo.compiler.frontend.spark.sql
A data frame reader to create the initial dataset.
Dataset<T> - Class in edu.snu.nemo.compiler.frontend.spark.sql
A dataset component: it represents relational data.
DataSkewCompositePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
Pass to modify the DAG for a job to perform data skew.
DataSkewCompositePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.DataSkewCompositePass
Default constructor.
DataSkewEdgeDataStorePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pass to annotate the DAG for a job to perform data skew.
DataSkewEdgeDataStorePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgeDataStorePass
Default constructor.
DataSkewEdgeMetricCollectionPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pass to annotate the DAG for a job to perform data skew.
DataSkewEdgeMetricCollectionPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgeMetricCollectionPass
Default constructor.
DataSkewEdgePartitionerPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pado pass for tagging edges with PartitionerProperty.
DataSkewEdgePartitionerPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewEdgePartitionerPass
Default constructor.
DataSkewHashPartitioner - Class in edu.snu.nemo.runtime.executor.data.partitioner
An implementation of Partitioner which hashes output data from a source task appropriate to detect data skew.
DataSkewHashPartitioner(int) - Constructor for class edu.snu.nemo.runtime.executor.data.partitioner.DataSkewHashPartitioner
 
DataSkewPolicy - Class in edu.snu.nemo.compiler.optimizer.policy
A policy to perform data skew dynamic optimization.
DataSkewPolicy() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.DataSkewPolicy
Default constructor.
DataSkewReshapingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass to modify the DAG for a job to perform data skew.
DataSkewReshapingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.DataSkewReshapingPass
Default constructor.
DataSkewRuntimePass - Class in edu.snu.nemo.runtime.common.optimizer.pass.runtime
Dynamic optimization pass for handling data skew.
DataSkewRuntimePass() - Constructor for class edu.snu.nemo.runtime.common.optimizer.pass.runtime.DataSkewRuntimePass
Constructor.
DataSkewVertexPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pass to annotate the DAG for a job to perform data skew.
DataSkewVertexPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DataSkewVertexPass
Default constructor.
DataStoreProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
DataStore ExecutionProperty.
DataStoreProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of DataStore ExecutionProperty.
DataTransfer - Class in edu.snu.nemo.runtime.executor.datatransfer
Contains common parts involved in InputReader and OutputWriter.
DataTransfer(String) - Constructor for class edu.snu.nemo.runtime.executor.datatransfer.DataTransfer
 
DataTransferFactory - Class in edu.snu.nemo.runtime.executor.datatransfer
A factory that produces InputReader and OutputWriter.
DataTransferFactory(int, BlockManagerWorker) - Constructor for class edu.snu.nemo.runtime.executor.datatransfer.DataTransferFactory
 
dataType() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
The data type of the returned value.
DataUtil - Class in edu.snu.nemo.runtime.executor.data
Utility methods for data handling (e.g., (de)serialization).
DataUtil.InputStreamIterator<T> - Class in edu.snu.nemo.runtime.executor.data
An iterator that emits objects from InputStream using the corresponding Coder.
DataUtil.IteratorWithNumBytes<T> - Interface in edu.snu.nemo.runtime.executor.data
Iterator with interface to access to the number of bytes.
DataUtil.IteratorWithNumBytes.NumBytesNotSupportedException - Exception in edu.snu.nemo.runtime.executor.data
decode(InputStream) - Method in class edu.snu.nemo.common.coder.BytesCoder
 
decode(InputStream) - Method in interface edu.snu.nemo.common.coder.Coder
Decodes the a value from the given input stream.
decode(InputStream) - Method in class edu.snu.nemo.common.coder.Coder.DummyCoder
 
decode(InputStream) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.BeamCoder
 
decode(InputStream) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 
decode(InputStream) - Method in class edu.snu.nemo.compiler.frontend.spark.coder.SparkCoder
 
DefaultEdgeUsedDataHandlingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pass for initiating IREdge UsedDataHandling ExecutionProperty with default values.
DefaultEdgeUsedDataHandlingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultEdgeUsedDataHandlingPass
Default constructor.
DefaultParallelismPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Optimization pass for tagging parallelism execution property.
DefaultParallelismPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultParallelismPass
Default constructor with desired number of source parallelism 1, shuffle decreasing factor 2.
DefaultParallelismPass(int, int) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultParallelismPass
Default constructor.
DefaultPolicy - Class in edu.snu.nemo.compiler.optimizer.policy
A basic default policy, that performs the minimum amount of optimization to be done to a specific DAG.
DefaultPolicy() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy
Default constructor.
DefaultPolicyWithSeparatePass - Class in edu.snu.nemo.compiler.optimizer.policy
A simple example policy to demonstrate a policy with a separate, refactored pass.
DefaultPolicyWithSeparatePass() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicyWithSeparatePass
Default constructor.
DefaultPolicyWithSeparatePass.RefactoredPass - Class in edu.snu.nemo.compiler.optimizer.policy
A simple custom pass consisted of the two passes at the end of the default pass.
DefaultStagePartitioningPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Default method of partitioning an IR DAG into stages.
DefaultStagePartitioningPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultStagePartitioningPass
Default constructor.
deleteFile() - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Deletes the file that contains this block data.
deleteMetadata() - Method in class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Deletes the metadata.
deleteMetadata() - Method in class edu.snu.nemo.runtime.executor.data.metadata.LocalFileMetadata
 
deleteMetadata() - Method in class edu.snu.nemo.runtime.executor.data.metadata.RemoteFileMetadata
 
deleteOutputFile(String, String) - Static method in class edu.snu.nemo.common.test.ExampleTestUtil
Delete output files.
DeployMode() - Constructor for class edu.snu.nemo.conf.JobConf.DeployMode
 
dequeue() - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Dequeues the next TaskGroup to be scheduled.
dequeue() - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
Dequeues the next TaskGroup to be scheduled according to job dependency priority.
deregister() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
De-registers this context from ContextManager.
deriveSerializerFrom(SparkContext) - Static method in class edu.snu.nemo.compiler.frontend.spark.core.java.SparkFrontendUtils
Derive Spark serializer from a spark context.
describe(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
describe(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
deserializePartition(long, Serializer, K, InputStream) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Reads the data of a partition from an input stream and deserializes it.
deterministic() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Whether this function always returns the same output on the identical input.
DirectByteArrayOutputStream - Class in edu.snu.nemo.common
This class represents a custom implementation of ByteArrayOutputStream, which enables to get bytes buffer directly (without memory copy).
DirectByteArrayOutputStream() - Constructor for class edu.snu.nemo.common.DirectByteArrayOutputStream
Default constructor.
DirectByteArrayOutputStream(int) - Constructor for class edu.snu.nemo.common.DirectByteArrayOutputStream
Constructor specifying the size.
DisaggregationEdgeDataStorePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass to support Disaggregated Resources by tagging edges.
DisaggregationEdgeDataStorePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DisaggregationEdgeDataStorePass
Default constructor.
DisaggregationPolicy - Class in edu.snu.nemo.compiler.optimizer.policy
A policy to demonstrate the disaggregation optimization, that uses GlusterFS as file storage.
DisaggregationPolicy() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.DisaggregationPolicy
Default constructor.
distinct() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
distinct(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
distinct() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
DoTransform<I,O> - Class in edu.snu.nemo.compiler.frontend.beam.transform
DoFn transform implementation.
DoTransform(DoFn, PipelineOptions) - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.DoTransform
DoTransform Constructor.
DriverEndpoint - Class in edu.snu.nemo.client
A request endpoint in driver side of a job.
DriverEndpoint(JobStateManager, ClientEndpoint) - Constructor for class edu.snu.nemo.client.DriverEndpoint
Construct an endpoint in driver side.
DriverMemMb() - Constructor for class edu.snu.nemo.conf.JobConf.DriverMemMb
 
DriverStopHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.DriverStopHandler
 
drop(Column) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
drop(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
drop(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
drop(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
dropDuplicates() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
dropDuplicates(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
dropDuplicates(String[]) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
dropDuplicates(String, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
dropDuplicates(String, String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
DUMMY_CODER - Static variable in interface edu.snu.nemo.common.coder.Coder
Dummy coder.
DummyCoder() - Constructor for class edu.snu.nemo.common.coder.Coder.DummyCoder
 
DuplicateEdgeGroupProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
Invariant data ExecutionProperty.
DuplicateEdgeGroupPropertyValue - Class in edu.snu.nemo.common.ir.edge.executionproperty
Value of DuplicateEdgeGroupProperty.
DuplicateEdgeGroupPropertyValue(String) - Constructor for class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Constructor.
DuplicateEdgeGroupSizePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass for annotate duplicate data for each edge.
DuplicateEdgeGroupSizePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DuplicateEdgeGroupSizePass
Default constructor.
dynamicOptimization(PhysicalPlan, MetricCollectionBarrierVertex) - Static method in class edu.snu.nemo.runtime.common.optimizer.RuntimeOptimizer
Dynamic optimization method to process the dag with an appropriate pass, decided by the stats.
DynamicOptimizationEvent - Class in edu.snu.nemo.runtime.common.eventhandler
An event for triggering dynamic optimization.
DynamicOptimizationEvent(PhysicalPlan, MetricCollectionBarrierVertex, Pair<String, String>) - Constructor for class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEvent
Default constructor.
DynamicOptimizationEventHandler - Class in edu.snu.nemo.runtime.common.eventhandler
Class for handling event to perform dynamic optimization.
DynamicOptimizationException - Exception in edu.snu.nemo.common.exception
DynamicOptimizationException.
DynamicOptimizationException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.DynamicOptimizationException
Constructor of DynamicOptimizationException.
DynamicOptimizationException(String) - Constructor for exception edu.snu.nemo.common.exception.DynamicOptimizationException
Constructor of DynamicOptimizationException.
DynamicOptimizationProperty - Class in edu.snu.nemo.common.ir.vertex.executionproperty
DynamicOptimizationType ExecutionProperty.
DynamicOptimizationProperty.Value - Enum in edu.snu.nemo.common.ir.vertex.executionproperty
Possible values of DynamicOptimization ExecutionProperty.

E

Edge<V extends Vertex> - Class in edu.snu.nemo.common.dag
Connects two vertices of a DAG.
Edge(String, V, V) - Constructor for class edu.snu.nemo.common.dag.Edge
Constructor for Edge.
edu.snu.nemo.client - package edu.snu.nemo.client
 
edu.snu.nemo.common - package edu.snu.nemo.common
 
edu.snu.nemo.common.coder - package edu.snu.nemo.common.coder
 
edu.snu.nemo.common.dag - package edu.snu.nemo.common.dag
 
edu.snu.nemo.common.eventhandler - package edu.snu.nemo.common.eventhandler
 
edu.snu.nemo.common.exception - package edu.snu.nemo.common.exception
 
edu.snu.nemo.common.ir - package edu.snu.nemo.common.ir
 
edu.snu.nemo.common.ir.edge - package edu.snu.nemo.common.ir.edge
 
edu.snu.nemo.common.ir.edge.executionproperty - package edu.snu.nemo.common.ir.edge.executionproperty
 
edu.snu.nemo.common.ir.executionproperty - package edu.snu.nemo.common.ir.executionproperty
 
edu.snu.nemo.common.ir.vertex - package edu.snu.nemo.common.ir.vertex
 
edu.snu.nemo.common.ir.vertex.executionproperty - package edu.snu.nemo.common.ir.vertex.executionproperty
 
edu.snu.nemo.common.ir.vertex.transform - package edu.snu.nemo.common.ir.vertex.transform
 
edu.snu.nemo.common.test - package edu.snu.nemo.common.test
 
edu.snu.nemo.compiler.backend - package edu.snu.nemo.compiler.backend
 
edu.snu.nemo.compiler.backend.nemo - package edu.snu.nemo.compiler.backend.nemo
 
edu.snu.nemo.compiler.frontend.beam - package edu.snu.nemo.compiler.frontend.beam
 
edu.snu.nemo.compiler.frontend.beam.coder - package edu.snu.nemo.compiler.frontend.beam.coder
 
edu.snu.nemo.compiler.frontend.beam.source - package edu.snu.nemo.compiler.frontend.beam.source
 
edu.snu.nemo.compiler.frontend.beam.transform - package edu.snu.nemo.compiler.frontend.beam.transform
 
edu.snu.nemo.compiler.frontend.spark - package edu.snu.nemo.compiler.frontend.spark
 
edu.snu.nemo.compiler.frontend.spark.coder - package edu.snu.nemo.compiler.frontend.spark.coder
 
edu.snu.nemo.compiler.frontend.spark.core - package edu.snu.nemo.compiler.frontend.spark.core
 
edu.snu.nemo.compiler.frontend.spark.core.java - package edu.snu.nemo.compiler.frontend.spark.core.java
 
edu.snu.nemo.compiler.frontend.spark.source - package edu.snu.nemo.compiler.frontend.spark.source
 
edu.snu.nemo.compiler.frontend.spark.sql - package edu.snu.nemo.compiler.frontend.spark.sql
 
edu.snu.nemo.compiler.frontend.spark.transform - package edu.snu.nemo.compiler.frontend.spark.transform
 
edu.snu.nemo.compiler.optimizer - package edu.snu.nemo.compiler.optimizer
 
edu.snu.nemo.compiler.optimizer.examples - package edu.snu.nemo.compiler.optimizer.examples
 
edu.snu.nemo.compiler.optimizer.pass.compiletime - package edu.snu.nemo.compiler.optimizer.pass.compiletime
 
edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating - package edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
 
edu.snu.nemo.compiler.optimizer.pass.compiletime.composite - package edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
 
edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping - package edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
 
edu.snu.nemo.compiler.optimizer.policy - package edu.snu.nemo.compiler.optimizer.policy
 
edu.snu.nemo.conf - package edu.snu.nemo.conf
 
edu.snu.nemo.driver - package edu.snu.nemo.driver
 
edu.snu.nemo.examples.beam - package edu.snu.nemo.examples.beam
 
edu.snu.nemo.examples.spark - package edu.snu.nemo.examples.spark
 
edu.snu.nemo.examples.spark.sql - package edu.snu.nemo.examples.spark.sql
 
edu.snu.nemo.runtime.common - package edu.snu.nemo.runtime.common
 
edu.snu.nemo.runtime.common.data - package edu.snu.nemo.runtime.common.data
 
edu.snu.nemo.runtime.common.eventhandler - package edu.snu.nemo.runtime.common.eventhandler
 
edu.snu.nemo.runtime.common.exception - package edu.snu.nemo.runtime.common.exception
 
edu.snu.nemo.runtime.common.message - package edu.snu.nemo.runtime.common.message
 
edu.snu.nemo.runtime.common.message.grpc - package edu.snu.nemo.runtime.common.message.grpc
 
edu.snu.nemo.runtime.common.message.local - package edu.snu.nemo.runtime.common.message.local
 
edu.snu.nemo.runtime.common.message.ncs - package edu.snu.nemo.runtime.common.message.ncs
 
edu.snu.nemo.runtime.common.metric - package edu.snu.nemo.runtime.common.metric
 
edu.snu.nemo.runtime.common.metric.parameter - package edu.snu.nemo.runtime.common.metric.parameter
 
edu.snu.nemo.runtime.common.optimizer - package edu.snu.nemo.runtime.common.optimizer
 
edu.snu.nemo.runtime.common.optimizer.pass.runtime - package edu.snu.nemo.runtime.common.optimizer.pass.runtime
 
edu.snu.nemo.runtime.common.plan - package edu.snu.nemo.runtime.common.plan
 
edu.snu.nemo.runtime.common.plan.physical - package edu.snu.nemo.runtime.common.plan.physical
 
edu.snu.nemo.runtime.common.plan.stage - package edu.snu.nemo.runtime.common.plan.stage
 
edu.snu.nemo.runtime.common.state - package edu.snu.nemo.runtime.common.state
 
edu.snu.nemo.runtime.executor - package edu.snu.nemo.runtime.executor
 
edu.snu.nemo.runtime.executor.bytetransfer - package edu.snu.nemo.runtime.executor.bytetransfer
Responsible for transferring block content from one executor to another.
edu.snu.nemo.runtime.executor.data - package edu.snu.nemo.runtime.executor.data
 
edu.snu.nemo.runtime.executor.data.block - package edu.snu.nemo.runtime.executor.data.block
 
edu.snu.nemo.runtime.executor.data.metadata - package edu.snu.nemo.runtime.executor.data.metadata
 
edu.snu.nemo.runtime.executor.data.partitioner - package edu.snu.nemo.runtime.executor.data.partitioner
 
edu.snu.nemo.runtime.executor.data.stores - package edu.snu.nemo.runtime.executor.data.stores
 
edu.snu.nemo.runtime.executor.data.streamchainer - package edu.snu.nemo.runtime.executor.data.streamchainer
 
edu.snu.nemo.runtime.executor.datatransfer - package edu.snu.nemo.runtime.executor.datatransfer
 
edu.snu.nemo.runtime.master - package edu.snu.nemo.runtime.master
 
edu.snu.nemo.runtime.master.eventhandler - package edu.snu.nemo.runtime.master.eventhandler
 
edu.snu.nemo.runtime.master.resource - package edu.snu.nemo.runtime.master.resource
 
edu.snu.nemo.runtime.master.scheduler - package edu.snu.nemo.runtime.master.scheduler
 
emit(O) - Method in interface edu.snu.nemo.common.ir.OutputCollector
Single-destination emit.
emit(String, Object) - Method in interface edu.snu.nemo.common.ir.OutputCollector
Multi-destination emit.
emit(O) - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputCollectorImpl
 
emit(String, Object) - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputCollectorImpl
 
Employee() - Constructor for class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Employee
 
EMPTY_DAG_DIRECTORY - Static variable in class edu.snu.nemo.common.dag.DAG
 
EmptyComponents - Class in edu.snu.nemo.compiler.optimizer.examples
Empty components to mock transform and source, for tests and examples.
EmptyComponents() - Constructor for class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents
 
EmptyComponents.EmptySourceVertex<T> - Class in edu.snu.nemo.compiler.optimizer.examples
An empty Source Vertex.
EmptyComponents.EmptyTransform<I,O> - Class in edu.snu.nemo.compiler.optimizer.examples
An empty transform.
emptyDataFrame() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
EmptySourceVertex(String) - Constructor for class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptySourceVertex
Constructor.
EmptyTransform(String) - Constructor for class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptyTransform
Default constructor.
encode(byte[], OutputStream) - Method in class edu.snu.nemo.common.coder.BytesCoder
 
encode(Object, OutputStream) - Method in class edu.snu.nemo.common.coder.Coder.DummyCoder
 
encode(T, OutputStream) - Method in interface edu.snu.nemo.common.coder.Coder
Encodes the given value onto the specified output stream.
encode(T, OutputStream) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.BeamCoder
 
encode(Pair<A, B>, OutputStream) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 
encode(T, OutputStream) - Method in class edu.snu.nemo.compiler.frontend.spark.coder.SparkCoder
 
endMeasurement(Map<String, Object>) - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
End the measurement of metric data.
endMeasurement(String, Map<String, Object>) - Method in class edu.snu.nemo.runtime.executor.MetricCollector
Ends this metric measurement, recording the end time in addition to the metric given.
enqueue(ScheduledTaskGroup) - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Enqueues a TaskGroup to this PQ.
enqueue(ScheduledTaskGroup) - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
 
ensureALSOutputValidity(String, String, String) - Static method in class edu.snu.nemo.common.test.ExampleTestUtil
This method test the output validity of AlternatingLeastSquareITCase.
ensureOutputValidity(String, String, String) - Static method in class edu.snu.nemo.common.test.ExampleTestUtil
Ensures output correctness with the given test resource file.
enterCompositeTransform(TransformHierarchy.Node) - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineVisitor
 
equals(Object) - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
equals(Object) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
 
equals(Object) - Method in class edu.snu.nemo.common.Pair
 
equals(Object) - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultParallelismPass
 
equals(Object) - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
equals(Object) - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
This method should be overridden for KeyRange comparisons.
equals(Object) - Method in class edu.snu.nemo.runtime.executor.data.FileArea
 
evaluate(Row) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Calculates the final result.
ExampleTestUtil - Class in edu.snu.nemo.common.test
Test Utils for Examples.
except(Dataset<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
execute() - Method in class edu.snu.nemo.runtime.executor.TaskGroupExecutor
Executes the task group.
execute(PhysicalPlan, int) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
Submits the PhysicalPlan to Runtime.
ExecutionProperty<T> - Class in edu.snu.nemo.common.ir.executionproperty
An abstract class for each execution factors.
ExecutionProperty(ExecutionProperty.Key, T) - Constructor for class edu.snu.nemo.common.ir.executionproperty.ExecutionProperty
Default constructor.
ExecutionProperty.Key - Enum in edu.snu.nemo.common.ir.executionproperty
Key for different types of execution property.
ExecutionPropertyMap - Class in edu.snu.nemo.common.ir.executionproperty
ExecutionPropertyMap Class, which uses HashMap for keeping track of ExecutionProperties for vertices and edges.
ExecutionPropertyMap(String) - Constructor for class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Constructor for ExecutionPropertyMap class.
Executor - Class in edu.snu.nemo.runtime.executor
Executor.
Executor(String, int, PersistentConnectionToMasterMap, MessageEnvironment, SerializerManager, DataTransferFactory, MetricManagerWorker) - Constructor for class edu.snu.nemo.runtime.executor.Executor
 
EXECUTOR_CAPACITY - Static variable in class edu.snu.nemo.conf.JobConf
 
EXECUTOR_CONF - Static variable in class edu.snu.nemo.conf.JobConf
 
EXECUTOR_ID - Static variable in class edu.snu.nemo.conf.JobConf
 
EXECUTOR_MESSAGE_LISTENER_ID - Static variable in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
 
ExecutorCapacity() - Constructor for class edu.snu.nemo.conf.JobConf.ExecutorCapacity
 
ExecutorId() - Constructor for class edu.snu.nemo.conf.JobConf.ExecutorId
 
ExecutorJsonContents() - Constructor for class edu.snu.nemo.conf.JobConf.ExecutorJsonContents
 
ExecutorJsonPath() - Constructor for class edu.snu.nemo.conf.JobConf.ExecutorJsonPath
 
ExecutorPlacementProperty - Class in edu.snu.nemo.common.ir.vertex.executionproperty
ExecutionPlacement ExecutionProperty.
ExecutorRepresenter - Class in edu.snu.nemo.runtime.master.resource
Contains information/state regarding an executor.
ExecutorRepresenter(String, ResourceSpecification, MessageSender<ControlMessage.Message>, ActiveContext, ExecutorService) - Constructor for class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
expand(PCollection<KV<Integer, List<Double>>>) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.UpdateUserAndItemMatrix
 
expand(PCollection<KV<Integer, List<Double>>>) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquareInefficient.UpdateUserAndItemMatrix
 
expand(PCollection<KV<Integer, List<Double>>>) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.UpdateModel
 
extractKey(Object) - Method in interface edu.snu.nemo.common.KeyExtractor
Extracts key.
extractKey(Object) - Method in class edu.snu.nemo.compiler.frontend.spark.SparkKeyExtractor
 
extractOutput(List<Pair<List<Integer>, List<Double>>>) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.TrainingDataCombiner
 

F

FailedContextHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.FailedContextHandler
 
FailedEvaluatorHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.FailedEvaluatorHandler
 
FileArea - Class in edu.snu.nemo.runtime.executor.data
A file area descriptor.
FileArea(String, long, long) - Constructor for class edu.snu.nemo.runtime.executor.data.FileArea
Creates a file area.
FileBlock<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.block
This class represents a block which is stored in (local or remote) file.
FileBlock(Serializer, String, FileMetadata<K>) - Constructor for class edu.snu.nemo.runtime.executor.data.block.FileBlock
Constructor.
FileDirectory() - Constructor for class edu.snu.nemo.conf.JobConf.FileDirectory
 
FileMetadata<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.metadata
This class represents a metadata for a Block.
FileMetadata() - Constructor for class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Construct a new file metadata.
FileMetadata(List<PartitionMetadata<K>>) - Constructor for class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Construct a file metadata with existing partition metadata.
FileStore - Interface in edu.snu.nemo.runtime.executor.data.stores
Stores blocks in (local or remote) files.
filter(Function<T, Boolean>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
filter(Column) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
filter(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
filterVertices(Predicate<V>) - Method in class edu.snu.nemo.common.dag.DAG
Filters the vertices according to the given condition.
finish(JavaUserDefinedTypedAggregation.Average) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
Transform the output of the reduction.
finishBundle(DoFn<KV<Integer, Pair<List<Integer>, List<Double>>>, KV<Integer, List<Double>>>.FinishBundleContext) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.CalculateNextMatrix
FinishBundle method for BEAM.
finishBundle() - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.ApplyGradient
FinishBundle method for BEAM.
finishBundle(DoFn<String, KV<Integer, List<Double>>>.FinishBundleContext) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CalculateGradient
FinishBundle method for BEAM.
first() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
flatMap(FlatMapFunction<T, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
flatMapToPair(PairFlatMapFunction<T, K2, V2>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
FlatMapTransform<T,U> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Flatmap Transform that flattens each output element after mapping each elements to an iterator.
FlatMapTransform(FlatMapFunction<T, U>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.FlatMapTransform
Constructor.
FlattenTransform<T> - Class in edu.snu.nemo.compiler.frontend.beam.transform
Flatten transform implementation.
FlattenTransform() - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.FlattenTransform
FlattenTransform Constructor.
flush() - Method in class edu.snu.nemo.driver.RemoteClientMessageLoggingHandler
 
fold(T, Function2<T, T, T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
foreach(VoidFunction<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
foreachAsync(VoidFunction<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
foreachPartition(VoidFunction<Iterator<T>>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
foreachPartitionAsync(VoidFunction<Iterator<T>>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
forEachProperties(Consumer<? super ExecutionProperty>) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Same as forEach function in Java 8, but for execution properties.
format(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
from(Dataset<U>) - Static method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
Using the immutable property of datasets, we can downcast spark datasets to our class using this function.
from(SparkSession, Map<String, String>) - Static method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
Method to downcast Spark's spark session to our spark session class.
fromOptions(PipelineOptions) - Static method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineRunner
Static initializer for creating PipelineRunner with the given options.

G

generateBlockId(String, int) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for a block, whose data is the output of a task.
generateExecutorId() - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for executor.
generateLogicalTaskId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for Task.
generateMessageId() - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for a control message.
generatePhysicalPlanId() - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for PhysicalPlan.
generatePhysicalTaskId(int, String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for Task.
generateResourceSpecId() - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for a resource specification.
generateRuntimeEdgeId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for RuntimeEdge.
generateStageEdgeId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for StageEdge.
generateStageId(Integer) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for Stage.
generateTaskGroupId(int, String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Generates the ID for ScheduledTaskGroup.
get(ExecutionProperty.Key) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Get the value of the given execution property type.
getAge() - Method in class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample.Person
Getter.
getAncestors(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the ancestors of a vertex.
getAssignedLoopVertexOf(V) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the wrapping LoopVertex of the vertex.
getAttemptCountForStage(String) - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getAttemptIdx() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getBlockId() - Method in exception edu.snu.nemo.runtime.common.exception.AbsentBlockException
 
getBlockLocationHandler(String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
Returns a handler of block location requests.
getBlockMap() - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 
getBufDirectly() - Method in class edu.snu.nemo.common.DirectByteArrayOutputStream
 
getBuilder() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getCapacity() - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
getChannelClass() - Method in class edu.snu.nemo.runtime.common.NativeChannelImplementationSelector
 
getChannelClass() - Method in interface edu.snu.nemo.runtime.common.NettyChannelImplementationSelector
 
getChannelClass() - Method in class edu.snu.nemo.runtime.common.NioChannelImplementationSelector
 
getCheckpointFile() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
getChildren(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the children vertices of the given vertex.
getClone() - Method in class edu.snu.nemo.common.ir.vertex.InitializedSourceVertex
 
getClone() - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
 
getClone() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getClone() - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
 
getClone() - Method in class edu.snu.nemo.common.ir.vertex.OperatorVertex
 
getClone() - Method in class edu.snu.nemo.compiler.frontend.beam.source.BeamBoundedSourceVertex
 
getClone() - Method in class edu.snu.nemo.compiler.frontend.spark.source.SparkBoundedSourceVertex
 
getClone() - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptySourceVertex
 
getCoder() - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
getCoder() - Method in class edu.snu.nemo.runtime.common.plan.RuntimeEdge
 
getCoder() - Method in class edu.snu.nemo.runtime.executor.data.streamchainer.Serializer
method that returns Coder.
getCoderArguments() - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DataSkewPolicy
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicyWithSeparatePass
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DisaggregationPolicy
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.PadoPolicy
 
getCompileTimePasses() - Method in interface edu.snu.nemo.compiler.optimizer.policy.Policy
 
getCompileTimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.SailfishPolicy
 
getCompletedFuture() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteInputContext
Returns a future, which is completed when the corresponding transfer for this context gets done.
getCompleteTaskGroups() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
getComputationUnitId() - Method in class edu.snu.nemo.runtime.common.metric.MetricData
 
getComputationUnitId() - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
 
getContainerType() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getContainerType() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getContainerType() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
getContainerType() - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
getContextDescriptor() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
getContextId() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
getCount() - Method in class edu.snu.nemo.common.DirectByteArrayOutputStream
 
getCount() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Getter.
getCount() - Method in class edu.snu.nemo.runtime.executor.data.FileArea
 
getCurrentState() - Method in class edu.snu.nemo.common.StateMachine
 
getCurrentTaskGroupExecutionState() - Method in class edu.snu.nemo.runtime.executor.TaskGroupStateManager
 
getDAG() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getDagIncomingEdges() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getDagOutgoingEdges() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getDAGSnapshot() - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
Access the DAG snapshot when triggering dynamic optimization.
getData() - Method in class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
 
getData() - Method in interface edu.snu.nemo.runtime.executor.data.Partition
 
getData() - Method in class edu.snu.nemo.runtime.executor.data.SerializedPartition
 
getDatasetCommandsList() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
getDeployModeConf(Configuration) - Static method in class edu.snu.nemo.client.JobLauncher
Get deploy mode configuration.
getDescendants(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the descendants of a vertex.
getDst() - Method in class edu.snu.nemo.common.dag.Edge
 
getDstVertex() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
 
getDstVertex() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdge
 
getEdgeBetween(String, String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the edge between two vertices.
getEdgeWithLoop(IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getElementsTotal() - Method in class edu.snu.nemo.runtime.executor.data.metadata.PartitionMetadata
 
getElementsTotal() - Method in class edu.snu.nemo.runtime.executor.data.SerializedPartition
 
getEndTime() - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
 
getEventClass() - Method in interface edu.snu.nemo.common.eventhandler.CommonEventHandler
fetches the class of the event.
getEventClass() - Method in class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEventHandler
 
getEventClass() - Method in class edu.snu.nemo.runtime.master.eventhandler.UpdatePhysicalPlanEventHandler
 
getEventHandlerClasses() - Method in class edu.snu.nemo.runtime.common.optimizer.pass.runtime.DataSkewRuntimePass
 
getEventHandlerClasses() - Method in interface edu.snu.nemo.runtime.common.optimizer.pass.runtime.RuntimePass
 
getException() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
getExecutionProperties() - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
getExecutionProperties() - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
 
getExecutionProperties() - Method in class edu.snu.nemo.runtime.common.plan.RuntimeEdge
 
getExecutionPropertyToModify() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.AnnotatingPass
Getter for key of execution property to modify.
getExecutorCapacity() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
getExecutorId() - Method in class edu.snu.nemo.runtime.executor.Executor
 
getExecutorId() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
getExecutorRepresenterMap() - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
 
getExecutorResourceConf(Configuration) - Static method in class edu.snu.nemo.client.JobLauncher
Get executor resource configuration.
getFailedExecutorRepresenterMap() - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
 
getFileAreas(String, KeyRange) - Method in interface edu.snu.nemo.runtime.executor.data.stores.FileStore
Gets the list of FileAreas for the specified block.
getFileAreas(String, KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
 
getFileAreas(String, KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalFileStore
 
getGroupId() - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Get the data id.
getGroupSize() - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Get the group size.
getId() - Method in class edu.snu.nemo.common.dag.Edge
 
getId() - Method in class edu.snu.nemo.common.dag.Vertex
 
getId() - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
ID of the item this ExecutionPropertyMap class is keeping track of.
getId() - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
getId() - Method in class edu.snu.nemo.runtime.common.message.ncs.NcsMessageEnvironment
 
getId() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
 
getId() - Method in class edu.snu.nemo.runtime.executor.datatransfer.DataTransfer
 
getIdToStageStates() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getIdToTaskGroupStates() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getIncomingEdgesOf(V) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the incoming edges of the given vertex.
getIncomingEdgesOf(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the incoming edges of the given vertex.
getIndexFromTaskGroupId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Extracts task group index from a task group ID.
getInitialConf() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
getInputStreams() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteInputContext
Returns Iterator of InputStreams.
getIrVertexId() - Method in class edu.snu.nemo.runtime.common.plan.physical.Task
 
getIRVertexOf(Task) - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
Get an IR vertex of the given task.
getIsUserTriggered() - Method in interface edu.snu.nemo.compiler.frontend.spark.sql.NemoSparkUserFacingClass
 
getIsUserTriggered() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
getIterativeIncomingEdges() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getJobConf(String[]) - Static method in class edu.snu.nemo.client.JobLauncher
Get job configuration.
getJobId() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getJobId() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getJobState() - Method in class edu.snu.nemo.client.ClientEndpoint
Get the current state of the running job.
getJobState() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getKey() - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionProperty
 
getKey() - Method in class edu.snu.nemo.runtime.executor.data.metadata.PartitionMetadata
 
getKey() - Method in class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
 
getKey() - Method in interface edu.snu.nemo.runtime.executor.data.Partition
 
getKey() - Method in class edu.snu.nemo.runtime.executor.data.SerializedPartition
 
getLength() - Method in class edu.snu.nemo.runtime.executor.data.SerializedPartition
 
getLocationFuture() - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster.BlockLocationRequestHandler
 
getLogicalTaskIdIdFromPhysicalTaskId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Extracts logical task ID from a physical task ID.
getLogicalTaskIdToReadable() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getLogicalTaskIdToReadables() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getLoopFusionPass() - Static method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations
 
getLoopInvariantCodeMotionPass() - Static method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations
 
getLoopStackDepthOf(V) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the stack depth of the given vertex.
getMaxNumberOfIterations() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getMemory() - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
getMessageSender(String) - Method in class edu.snu.nemo.runtime.common.message.PersistentConnectionToMasterMap
Get the message sender corresponding to the given listener ID.
getMetricByKey(String) - Method in class edu.snu.nemo.runtime.master.MetricManagerMaster
 
getMetricByKey(String) - Method in interface edu.snu.nemo.runtime.master.MetricMessageHandler
Retrieves the string form of metric given the metric key.
getMetricCollectionBarrierVertex() - Method in class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEvent
 
getMetricData() - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
Method for retrieving metrics from the vertex.
getMetrics() - Method in class edu.snu.nemo.runtime.common.metric.MetricData
 
getMetrics() - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
 
getName() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getName() - Method in class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample.Person
Getter.
getName() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Employee
Getter.
getNewPhysicalPlan() - Method in class edu.snu.nemo.runtime.common.eventhandler.UpdatePhysicalPlanEvent
 
getNonIterativeIncomingEdges() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getNumEncodedBytes() - Method in class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
 
getNumEncodedBytes() - Method in interface edu.snu.nemo.runtime.executor.data.DataUtil.IteratorWithNumBytes
 
getNumEncodedBytes() - Method in class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
 
getNumericId() - Method in class edu.snu.nemo.common.dag.Edge
 
getNumericId() - Method in class edu.snu.nemo.common.dag.Vertex
 
getNumPartitions() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
getNumSerializedBytes() - Method in class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
 
getNumSerializedBytes() - Method in interface edu.snu.nemo.runtime.executor.data.DataUtil.IteratorWithNumBytes
 
getNumSerializedBytes() - Method in class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
 
getOffset() - Method in class edu.snu.nemo.runtime.executor.data.metadata.PartitionMetadata
 
getOrCreate() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
getOutgoingEdgesOf(V) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the outgoing edges of the given vertex.
getOutgoingEdgesOf(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the outgoing edges of the given vertex.
getParents(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the parent vertices of the given vertex.
getPartitionMetadataIterable() - Method in class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Gets a iterable containing the partition metadata of corresponding block.
getPartitions() - Method in class edu.snu.nemo.compiler.frontend.spark.core.RDD
 
getPartitions(KeyRange<K>) - Method in interface edu.snu.nemo.runtime.executor.data.block.Block
Retrieves the NonSerializedPartitions in a specific key range from this block.
getPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Retrieves the partitions of this block from the file in a specific key range and deserializes it.
getPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Retrieves the NonSerializedPartitions in a specific hash range from this block.
getPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Retrieves the NonSerializedPartitions in a specific hash range from this block.
getPartitions(String, KeyRange<K>) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
getPartitions(String, KeyRange<K>) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
Retrieves NonSerializedPartitions in a specific KeyRange from a block.
getPartitions(String, KeyRange<K>) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 
getPartitionSize() - Method in class edu.snu.nemo.runtime.executor.data.metadata.PartitionMetadata
 
getPassList() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.CompositePass
Getter for list of compile time passes.
getPath() - Method in class edu.snu.nemo.runtime.executor.data.FileArea
 
getPhysicalPlan() - Method in class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEvent
 
getPosition() - Method in class edu.snu.nemo.runtime.executor.data.FileArea
 
getPrerequisiteExecutionProperties() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.AnnotatingPass
 
getPrerequisiteExecutionProperties() - Method in interface edu.snu.nemo.compiler.optimizer.pass.compiletime.CompileTimePass
Getter for prerequisite execution properties.
getPrerequisiteExecutionProperties() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.CompositePass
 
getPrerequisiteExecutionProperties() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.ReshapingPass
 
getProducerTaskGroupIds(String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
Gets the ids of the task groups which already produced or will produce data for a specific block.
getProperty(ExecutionProperty.Key) - Method in class edu.snu.nemo.common.ir.edge.IREdge
Get the executionProperty of the IREdge.
getProperty(ExecutionProperty.Key) - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
Get the executionProperty of the IRVertex.
getProperty(ExecutionProperty.Key) - Method in class edu.snu.nemo.runtime.common.plan.RuntimeEdge
Get the execution property of the Runtime Edge.
getPubSubEventHandler() - Method in class edu.snu.nemo.common.eventhandler.PubSubEventHandlerWrapper
 
getReadable() - Method in class edu.snu.nemo.runtime.common.plan.physical.BoundedSourceTask
 
getReadables(int) - Method in class edu.snu.nemo.common.ir.vertex.InitializedSourceVertex
 
getReadables(int) - Method in class edu.snu.nemo.common.ir.vertex.SourceVertex
Gets parallel readables.
getReadables(int) - Method in class edu.snu.nemo.compiler.frontend.beam.source.BeamBoundedSourceVertex
 
getReadables(int) - Method in class edu.snu.nemo.compiler.frontend.spark.source.SparkBoundedSourceVertex
 
getReadables(int) - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptySourceVertex
 
getRemoteExecutorId() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
getRepresentativeEdgeId() - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Get the physical edge id of the representative edge.
getResourceSpecId() - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
getResultId() - Static method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
This method is to be removed after a result handler is implemented.
getRootVertices() - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the root vertices of this DAG.
getRunningTaskGroups() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
getRuntimeEdge() - Method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
 
getRuntimeEdgeIdFromBlockId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Extracts runtime edge ID from a block ID.
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DataSkewPolicy
 
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy
 
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DefaultPolicyWithSeparatePass
 
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.DisaggregationPolicy
 
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.PadoPolicy
 
getRuntimePasses() - Method in interface edu.snu.nemo.compiler.optimizer.policy.Policy
 
getRuntimePasses() - Method in class edu.snu.nemo.compiler.optimizer.policy.SailfishPolicy
 
getSalary() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Employee
Getter.
getScheduleGroupIndex() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getScheduleGroupIndex() - Method in class edu.snu.nemo.runtime.common.plan.stage.Stage
 
getScheduleTimeoutMs() - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
getScheduleTimeoutMs() - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Returns this scheduling policy's timeout before an executor assignment.
getSerializedPartitions(KeyRange<K>) - Method in interface edu.snu.nemo.runtime.executor.data.block.Block
Retrieves the SerializedPartitions in a specific key range.
getSerializedPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Retrieves the SerializedPartitions in a specific key range.
getSerializedPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Retrieves the SerializedPartitions in a specific hash range.
getSerializedPartitions(KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Retrieves the SerializedPartitions in a specific hash range.
getSerializedPartitions(String, KeyRange<K>) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Retrieves SerializedPartitions in a specific KeyRange from a block.
getSerializedPartitions(String, KeyRange<K>) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
 
getSerializedPartitions(String, KeyRange<K>) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 
getSerializedTaskGroupDag() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getSerializedTaskGroupDag() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getSerializer(String) - Method in class edu.snu.nemo.runtime.executor.data.SerializerManager
Return the serializer for the specified runtime edge.
getSerializerFromWorker(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.AbstractBlockStore
Gets data coder for a block from the SerializerManager.
getServerChannelClass() - Method in class edu.snu.nemo.runtime.common.NativeChannelImplementationSelector
 
getServerChannelClass() - Method in interface edu.snu.nemo.runtime.common.NettyChannelImplementationSelector
 
getServerChannelClass() - Method in class edu.snu.nemo.runtime.common.NioChannelImplementationSelector
 
getSideInputs() - Method in class edu.snu.nemo.common.ContextImpl
 
getSideInputs() - Method in interface edu.snu.nemo.common.ir.vertex.transform.Transform.Context
 
getSourceParallelism() - Method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
Get the parallelism of the source task.
getSparkContext() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaPairRDD
 
getSparkContext() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
getSrc() - Method in class edu.snu.nemo.common.dag.Edge
 
getSrcIrVertexId() - Method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
 
getSrcVertex() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
 
getSrcVertex() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdge
 
getStageDAG() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
 
getStageIdFromTaskGroupId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Extracts stage ID from a task group ID.
getStageInternalDAG() - Method in class edu.snu.nemo.runtime.common.plan.stage.Stage
 
getStageState(String) - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getStartTime() - Method in class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
 
getState() - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
 
getState() - Method in exception edu.snu.nemo.runtime.common.exception.AbsentBlockException
 
getStateMachine() - Method in class edu.snu.nemo.runtime.common.state.BlockState
 
getStateMachine() - Method in class edu.snu.nemo.runtime.common.state.JobState
 
getStateMachine() - Method in class edu.snu.nemo.runtime.common.state.StageState
 
getStateMachine() - Method in class edu.snu.nemo.runtime.common.state.TaskGroupState
 
getStateMachine() - Method in class edu.snu.nemo.runtime.common.state.TaskState
 
getStorageLevel() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
getStreamChainers() - Method in class edu.snu.nemo.runtime.executor.data.streamchainer.Serializer
method that returns list of StreamChainer.
getSum() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Getter.
getTag() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
get the Tag of the Transform.
getTaskGroupDag() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getTaskGroupId() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getTaskGroupIds() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
getTaskGroupIdx() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getTaskGroupIdxToKeyRange() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
 
getTaskGroupIncomingEdges() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getTaskGroupOutgoingEdges() - Method in class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
 
getTaskGroupState(String) - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
getTaskIndexFromBlockId(String) - Static method in class edu.snu.nemo.runtime.common.RuntimeIdGenerator
Extracts task index from a block ID.
getTaskInfo() - Method in class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEvent
 
getTaskInfo() - Method in class edu.snu.nemo.runtime.common.eventhandler.UpdatePhysicalPlanEvent
 
getTaskIRVertexMap() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
 
getTaskIRVertexMap() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlanGenerator
Getter for taskIRVertexMap.
getTerminationCondition() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
getTopologicalSort() - Method in class edu.snu.nemo.common.dag.DAG
Gets the DAG's vertices in topologically sorted order.
getTransform() - Method in class edu.snu.nemo.common.ir.vertex.OperatorVertex
 
getTransform() - Method in class edu.snu.nemo.runtime.common.plan.physical.OperatorTask
 
getValue() - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionProperty
 
getVertexById(String) - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the vertex given its ID.
getVertices() - Method in class edu.snu.nemo.common.dag.DAG
Retrieves the vertices of this DAG.
getWrittenBytes() - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputWriter
 
glom() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
GLUSTER_DISK_DIRECTORY - Static variable in class edu.snu.nemo.conf.JobConf
 
GlusterFileStore - Class in edu.snu.nemo.runtime.executor.data.stores
Stores blocks in a mounted GlusterFS volume.
GlusterVolumeDirectory() - Constructor for class edu.snu.nemo.conf.JobConf.GlusterVolumeDirectory
 
groupBy(Function<T, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
groupBy(Function<T, U>, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
GroupByKeyTransform<I> - Class in edu.snu.nemo.compiler.frontend.beam.transform
Group Beam KVs.
GroupByKeyTransform() - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.GroupByKeyTransform
GroupByKey constructor.
GroupByKeyTransform<K,V> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Transform for group by key transformation.
GroupByKeyTransform() - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.GroupByKeyTransform
Constructor.
GrpcMessageEnvironment - Class in edu.snu.nemo.runtime.common.message.grpc
This class is installed when every node, containing both driver and evaluator, has been started, and setup grpc environment to implement RPC semantics defined in edu.snu.nemo.runtime.common.message package.

H

hasException() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
hashCode() - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
hashCode() - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
 
hashCode() - Method in class edu.snu.nemo.common.Pair
 
hashCode() - Method in class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.DefaultParallelismPass
 
hashCode() - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
hashCode() - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
This method should be overridden for KeyRange comparisons.
hashCode() - Method in class edu.snu.nemo.runtime.executor.data.FileArea
 
HashPartitioner - Class in edu.snu.nemo.runtime.executor.data.partitioner
An implementation of Partitioner which hashes output data from a source task according to the key of elements.
HashPartitioner() - Constructor for class edu.snu.nemo.runtime.executor.data.partitioner.HashPartitioner
 
HashRange - Class in edu.snu.nemo.runtime.common.data
Descriptor for hash range.
HashRangeMultiplier() - Constructor for class edu.snu.nemo.conf.JobConf.HashRangeMultiplier
 
hasNext() - Method in class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
 
hasSameItineraryAs(IREdge) - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
hint(String, Object...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
hint(String, Seq<Object>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 

I

id() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
IdManager - Class in edu.snu.nemo.common.ir
ID manager.
IllegalEdgeOperationException - Exception in edu.snu.nemo.common.exception
IllegalEdgeOperationException.
IllegalEdgeOperationException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.IllegalEdgeOperationException
IllegalEdgeOperationException.
IllegalMessageException - Exception in edu.snu.nemo.common.exception
IllegalMessageException.
IllegalMessageException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.IllegalMessageException
IllegalMessageException.
IllegalStateTransitionException - Exception in edu.snu.nemo.common.exception
IllegalStateTransitionException.
IllegalStateTransitionException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.IllegalStateTransitionException
IllegalStateTransitionException.
IllegalVertexOperationException - Exception in edu.snu.nemo.common.exception
IllegalVertexOperationException.
IllegalVertexOperationException(String) - Constructor for exception edu.snu.nemo.common.exception.IllegalVertexOperationException
IllegalVertexOperationException.
includes(Integer) - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
includes(K) - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
 
increaseMaxNumberOfIterations() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
increase the value of maximum number of iterations by 1.
initialize(MutableAggregationBuffer) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Initializes the given aggregation buffer.
initializeDataset(SparkSession, LinkedHashMap<String, Object[]>) - Static method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
Method to reproduce the initial Dataset on separate evaluators when reading from sources.
InitializedSourceVertex<T> - Class in edu.snu.nemo.common.ir.vertex
Source vertex with initial data as object.
InitializedSourceVertex(Iterable<T>) - Constructor for class edu.snu.nemo.common.ir.vertex.InitializedSourceVertex
Constructor.
initializeFunction(Object...) - Method in interface edu.snu.nemo.compiler.frontend.spark.sql.NemoSparkUserFacingClass
A method to distinguish user-called functions from internal calls.
initializeState(String, String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
Initializes the states of a block which will be produced by producer task(s).
InputReader - Class in edu.snu.nemo.runtime.executor.datatransfer
Represents the input data transfer to a task.
InputReader(int, IRVertex, RuntimeEdge, BlockManagerWorker) - Constructor for class edu.snu.nemo.runtime.executor.datatransfer.InputReader
 
inputSchema() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Data types of input arguments of this aggregate function.
InputStreamIterator(Iterator<InputStream>, Serializer<T>) - Constructor for class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
Construct Iterator from InputStream and Coder.
InputStreamIterator(Iterator<InputStream>, Serializer<T>, long) - Constructor for class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
Construct Iterator from InputStream and Coder.
IntactPartitioner - Class in edu.snu.nemo.runtime.executor.data.partitioner
An implementation of Partitioner which makes an output data from a source task to a single Partition.
IntactPartitioner() - Constructor for class edu.snu.nemo.runtime.executor.data.partitioner.IntactPartitioner
 
intersect(Dataset<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
InvalidParameterException - Exception in edu.snu.nemo.common.exception
InvalidParameterException.
InvalidParameterException(String) - Constructor for exception edu.snu.nemo.common.exception.InvalidParameterException
InvalidParameterException.
IORequestHandleThreadsTotal() - Constructor for class edu.snu.nemo.conf.JobConf.IORequestHandleThreadsTotal
 
IREdge - Class in edu.snu.nemo.common.ir.edge
Physical execution plan of intermediate data movement.
IREdge(DataCommunicationPatternProperty.Value, IRVertex, IRVertex, Coder) - Constructor for class edu.snu.nemo.common.ir.edge.IREdge
Constructor of IREdge.
IREdge(DataCommunicationPatternProperty.Value, IRVertex, IRVertex, Coder, Boolean) - Constructor for class edu.snu.nemo.common.ir.edge.IREdge
Constructor of IREdge.
IRVertex - Class in edu.snu.nemo.common.ir.vertex
The top-most wrapper for a user operation in the IR.
IRVertex() - Constructor for class edu.snu.nemo.common.ir.vertex.IRVertex
Constructor of IRVertex.
irVertexPropertiesToString() - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
 
isAll() - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
isAll() - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
 
isCheckpointed() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
isCompositeVertex(V) - Method in class edu.snu.nemo.common.dag.DAG
Checks whether the given vertex is assigned with a wrapping LoopVertex.
isEmpty() - Method in class edu.snu.nemo.common.dag.DAGBuilder
Checks whether the DAGBuilder is empty.
isEmpty() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
isEmpty() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageBuilder
 
isEmpty() - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Checks whether there are schedulable TaskGroups in the queue or not.
isEmpty() - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
 
isRegisterByteSizeObserverCheap(Pair<A, B>) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
Returns whether both leftCoder and rightCoder are considered not expensive.
isSerialized() - Method in class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
 
isSerialized() - Method in interface edu.snu.nemo.runtime.executor.data.Partition
 
isSerialized() - Method in class edu.snu.nemo.runtime.executor.data.SerializedPartition
 
isSideInput() - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
isSideInput() - Method in class edu.snu.nemo.runtime.common.plan.RuntimeEdge
 
isSideInputReader() - Method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
 
iterator(Partition, TaskContext) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 

J

JavaPairRDD<K,V> - Class in edu.snu.nemo.compiler.frontend.spark.core.java
Java RDD for pairs.
JavaRDD<T> - Class in edu.snu.nemo.compiler.frontend.spark.core.java
Java RDD.
javaRDD() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
Create a javaRDD component from this data set.
JavaSparkContext - Class in edu.snu.nemo.compiler.frontend.spark.core.java
Spark context wrapper for Java.
JavaSparkContext(SparkContext) - Constructor for class edu.snu.nemo.compiler.frontend.spark.core.java.JavaSparkContext
Constructor.
JavaSparkPi - Class in edu.snu.nemo.examples.spark
Computes an approximation to pi.
JavaSparkSQLExample - Class in edu.snu.nemo.examples.spark.sql
Java Spark SQL Example program.
JavaSparkSQLExample.Person - Class in edu.snu.nemo.examples.spark.sql
Simple person class.
JavaUserDefinedTypedAggregation - Class in edu.snu.nemo.examples.spark.sql
Java SparkSQL example: User-defined Typed Aggregation.
JavaUserDefinedTypedAggregation.Average - Class in edu.snu.nemo.examples.spark.sql
Average class.
JavaUserDefinedTypedAggregation.Employee - Class in edu.snu.nemo.examples.spark.sql
Employee class.
JavaUserDefinedTypedAggregation.MyAverage - Class in edu.snu.nemo.examples.spark.sql
MyAverage class.
JavaUserDefinedUntypedAggregation - Class in edu.snu.nemo.examples.spark.sql
Java SparkSQL example: User-defined Untyped Aggregation.
JavaUserDefinedUntypedAggregation.MyAverage - Class in edu.snu.nemo.examples.spark.sql
MyAverage class.
JavaWordCount - Class in edu.snu.nemo.examples.spark
Java Wordcount example.
jdbc(String, String, Properties) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
jdbc(String, String, String[], Properties) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
jdbc(String, String, String, long, long, int, Properties) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
JOB_ID - Static variable in class edu.snu.nemo.conf.JobConf
 
JobConf - Class in edu.snu.nemo.conf
Job Configurations.
JobConf() - Constructor for class edu.snu.nemo.conf.JobConf
 
JobConf.DAGDirectory - Class in edu.snu.nemo.conf
Directory to store JSON representation of intermediate DAGs.
JobConf.DeployMode - Class in edu.snu.nemo.conf
Deploy mode.
JobConf.DriverMemMb - Class in edu.snu.nemo.conf
Nemo driver memory.
JobConf.ExecutorCapacity - Class in edu.snu.nemo.conf
Executor capacity.
JobConf.ExecutorId - Class in edu.snu.nemo.conf
Executor id.
JobConf.ExecutorJsonContents - Class in edu.snu.nemo.conf
Contents of the JSON file that specifies resource layout.
JobConf.ExecutorJsonPath - Class in edu.snu.nemo.conf
Path to the JSON file that specifies resource layout.
JobConf.FileDirectory - Class in edu.snu.nemo.conf
Directory to store files for storing blocks.
JobConf.GlusterVolumeDirectory - Class in edu.snu.nemo.conf
Directory points the mounted GlusterFS volume to store files in remote fashion.
JobConf.HashRangeMultiplier - Class in edu.snu.nemo.conf
Hash range multiplier.
JobConf.IORequestHandleThreadsTotal - Class in edu.snu.nemo.conf
Number of I/O threads for block fetch requests from other executor.
JobConf.JobId - Class in edu.snu.nemo.conf
Job id.
JobConf.JVMHeapSlack - Class in edu.snu.nemo.conf
The fraction of container memory not to use fo the JVM heap.
JobConf.MaxScheduleAttempt - Class in edu.snu.nemo.conf
Max number of attempts for task group scheduling.
JobConf.OptimizationPolicy - Class in edu.snu.nemo.conf
The name of the optimization policy.
JobConf.PartitionTransportClientNumThreads - Class in edu.snu.nemo.conf
The number of threads of block transfer client.
JobConf.PartitionTransportServerBacklog - Class in edu.snu.nemo.conf
The maximum length which the pending connection queue of block transfer may grow to.
JobConf.PartitionTransportServerNumListeningThreads - Class in edu.snu.nemo.conf
The number of listening threads of block transfer server.
JobConf.PartitionTransportServerNumWorkingThreads - Class in edu.snu.nemo.conf
The number of block transfer server threads which work on accepted connections.
JobConf.PartitionTransportServerPort - Class in edu.snu.nemo.conf
The TCP port to which local block transfer binds.
JobConf.SchedulerTimeoutMs - Class in edu.snu.nemo.conf
Scheduler timeout in ms.
JobConf.ScheduleSerThread - Class in edu.snu.nemo.conf
The number of serialization threads for scheduling.
JobConf.SerializedDAG - Class in edu.snu.nemo.conf
Serialized {edu.snu.nemo.common.dag.DAG} from user main method.
JobConf.UserMainArguments - Class in edu.snu.nemo.conf
User Main Arguments.
JobConf.UserMainClass - Class in edu.snu.nemo.conf
User Main Class Name.
JobId() - Constructor for class edu.snu.nemo.conf.JobConf.JobId
 
JobLauncher - Class in edu.snu.nemo.client
Job launcher.
JobMessageHandler() - Constructor for class edu.snu.nemo.client.NemoClient.JobMessageHandler
 
JobState - Class in edu.snu.nemo.runtime.common.state
Represents the states and their transitions of a PhysicalPlan.
JobState() - Constructor for class edu.snu.nemo.runtime.common.state.JobState
 
JobState.State - Enum in edu.snu.nemo.runtime.common.state
JobState.
JobStateManager - Class in edu.snu.nemo.runtime.master
Manages the states related to a job.
JobStateManager(PhysicalPlan, BlockManagerMaster, MetricMessageHandler, int) - Constructor for class edu.snu.nemo.runtime.master.JobStateManager
 
join(Dataset<?>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
join(Dataset<?>, Column) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
join(Dataset<?>, Column, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
join(Dataset<?>, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
join(Dataset<?>, Seq<String>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
join(Dataset<?>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
json(Dataset<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
json(JavaRDD<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
json(RDD<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
json(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
json(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
json(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
JsonParseException - Exception in edu.snu.nemo.common.exception
JsonParseException.
JsonParseException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.JsonParseException
JsonParseException.
JVMHeapSlack() - Constructor for class edu.snu.nemo.conf.JobConf.JVMHeapSlack
 

K

keyBy(Function<T, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
KeyExtractor - Interface in edu.snu.nemo.common
Extracts a key from an element.
KeyExtractorProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
KeyExtractor ExecutionProperty.
KeyRange<K extends Serializable> - Interface in edu.snu.nemo.runtime.common.data
Represents the key range of data partitions within a block.

L

launchDAG(DAG) - Static method in class edu.snu.nemo.client.JobLauncher
Launch application using the application DAG.
leaveCompositeTransform(TransformHierarchy.Node) - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineVisitor
 
left() - Method in class edu.snu.nemo.common.Pair
 
limit(int) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
LimitedInputStream - Class in edu.snu.nemo.runtime.executor.data
This class provide functionality to limit bytes read from InputStream.
LimitedInputStream(InputStream, long) - Constructor for class edu.snu.nemo.runtime.executor.data.LimitedInputStream
Constructor.
load() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
load(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
load(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
load(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
LOCAL_DISK_DIRECTORY - Static variable in class edu.snu.nemo.conf.JobConf
 
LocalBlockStore - Class in edu.snu.nemo.runtime.executor.data.stores
This abstract class represents BlockStore which contains the (meta)data of the Blocks in local.
LocalBlockStore(SerializerManager) - Constructor for class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
Constructor.
LocalFileMetadata<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.metadata
This class represents a metadata for a local file Block.
LocalFileMetadata() - Constructor for class edu.snu.nemo.runtime.executor.data.metadata.LocalFileMetadata
Constructor.
LocalFileStore - Class in edu.snu.nemo.runtime.executor.data.stores
Stores blocks in local files.
LocalMessageDispatcher - Class in edu.snu.nemo.runtime.common.message.local
Dispatch messages on a single machine.
LocalMessageDispatcher() - Constructor for class edu.snu.nemo.runtime.common.message.local.LocalMessageDispatcher
 
LocalMessageEnvironment - Class in edu.snu.nemo.runtime.common.message.local
A simple MessageEnvironment implementation that works on a single node.
LocalMessageEnvironment(String, LocalMessageDispatcher) - Constructor for class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
LocalMessageSender<T> - Class in edu.snu.nemo.runtime.common.message.local
A simple MessageSender implementation that works on a single node.
LocalMessageSender(String, String, String, LocalMessageDispatcher) - Constructor for class edu.snu.nemo.runtime.common.message.local.LocalMessageSender
 
LoopCompositeTransform<inputT extends org.apache.beam.sdk.values.PInput,outputT extends org.apache.beam.sdk.values.POutput> - Class in edu.snu.nemo.compiler.frontend.beam.transform
A composite transform for wrapping transforms inside a loop to create loop operators in the IR.
LoopCompositeTransform() - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.LoopCompositeTransform
 
LoopExtractionPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass for extracting and grouping each loops together using the LoopVertex.
LoopExtractionPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopExtractionPass
Default constructor.
LoopFusionPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations.LoopFusionPass
Default constructor.
LoopInvariantCodeMotionPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopOptimizations.LoopInvariantCodeMotionPass
Default constructor.
LoopOptimizationCompositePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
A series of passes to perform LoopOptimization.
LoopOptimizationCompositePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.LoopOptimizationCompositePass
Default constructor.
LoopOptimizations - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Loop Optimization.
LoopOptimizations.LoopFusionPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass for Loop Fusion optimization.
LoopOptimizations.LoopInvariantCodeMotionPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass for Loop Invariant Code Motion optimization.
loopTerminationConditionMet() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
loopTerminationConditionMet(Integer) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
LoopUnrollingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass for unrolling the loops grouped by the LoopExtractionPass.
LoopUnrollingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.LoopUnrollingPass
 
LoopVertex - Class in edu.snu.nemo.common.ir.vertex
IRVertex that contains a partial DAG that is iterative.
LoopVertex(String) - Constructor for class edu.snu.nemo.common.ir.vertex.LoopVertex
The LoopVertex constructor.

M

main(String[]) - Static method in class edu.snu.nemo.client.JobLauncher
Main JobLauncher method.
main(String[]) - Static method in class edu.snu.nemo.compiler.optimizer.examples.MapReduceDisaggregationOptimization
Main function of the example MR program.
main(String[]) - Static method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare
Main function for the ALS BEAM program.
main(String[]) - Static method in class edu.snu.nemo.examples.beam.AlternatingLeastSquareInefficient
Main function for the ALS BEAM program.
main(String[]) - Static method in class edu.snu.nemo.examples.beam.Broadcast
Main function for the BEAM program.
main(String[]) - Static method in class edu.snu.nemo.examples.beam.MapReduce
Main function for the MR BEAM program.
main(String[]) - Static method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression
Main function for the MLR BEAM program.
main(String[]) - Static method in class edu.snu.nemo.examples.spark.JavaSparkPi
Main method.
main(String[]) - Static method in class edu.snu.nemo.examples.spark.JavaWordCount
Main method.
main(String[]) - Static method in class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample
Main function.
main(String[]) - Static method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation
Main function.
main(String[]) - Static method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation
Main function.
map(Function<T, O>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
Map transform.
map(Function1<T, U>, Encoder<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
map(MapFunction<T, U>, Encoder<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
mapEdgeWithLoop(IREdge, IREdge) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Maps an edge from/to loop with the corresponding edge from/to internal vertex.
mapPartitions(FlatMapFunction<Iterator<T>, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
mapPartitions(FlatMapFunction<Iterator<T>, U>, boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
mapPartitions(Function1<Iterator<T>, Iterator<U>>, Encoder<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
mapPartitions(MapPartitionsFunction<T, U>, Encoder<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
mapPartitionsToPair(PairFlatMapFunction<Iterator<T>, K2, V2>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
mapPartitionsToPair(PairFlatMapFunction<Iterator<T>, K2, V2>, boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
mapPartitionsWithIndex(Function2<Integer, Iterator<T>, Iterator<R>>, boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
MapReduce - Class in edu.snu.nemo.examples.beam
Sample MapReduce application.
MapReduceDisaggregationOptimization - Class in edu.snu.nemo.compiler.optimizer.examples
A sample MapReduceDisaggregationOptimization application.
mapToPair(PairFunction<T, K2, V2>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
MapToPairTransform<T,K,V> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Map elements to Pair elements.
MapToPairTransform(PairFunction<T, K, V>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.MapToPairTransform
Constructor.
MapTransform<I,O> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Map Transform for Spark.
MapTransform(Function<I, O>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.MapTransform
Constructor.
markDuplicateEdges() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Marks duplicate edges with DuplicateEdgeGroupProperty.
master(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession.Builder
 
MASTER_COMMUNICATION_ID - Static variable in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
 
MasterControlMessageReceiver() - Constructor for class edu.snu.nemo.runtime.master.RuntimeMaster.MasterControlMessageReceiver
 
max(Comparator<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
MaxScheduleAttempt() - Constructor for class edu.snu.nemo.conf.JobConf.MaxScheduleAttempt
 
MemoryStore - Class in edu.snu.nemo.runtime.executor.data.stores
Store data in local memory.
merge(JavaUserDefinedTypedAggregation.Average, JavaUserDefinedTypedAggregation.Average) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
Merge two intermediate values.
merge(MutableAggregationBuffer, Row) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Merges two aggregation buffers and stores the updated buffer values back to `buffer1`.
mergeAccumulators(Iterable<List<Pair<List<Integer>, List<Double>>>>) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.TrainingDataCombiner
 
MessageContext - Interface in edu.snu.nemo.runtime.common.message
This class sends a reply message from MessageListener.
MessageEnvironment - Interface in edu.snu.nemo.runtime.common.message
Set up MessageListeners to handle incoming messages on this node, and connect to remote nodes and return MessageSenders to send message to them.
MessageListener<T> - Interface in edu.snu.nemo.runtime.common.message
Handles messages from MessageSender.
MessageParameters - Class in edu.snu.nemo.runtime.common.message
Parameters for message components.
MessageParameters() - Constructor for class edu.snu.nemo.runtime.common.message.MessageParameters
 
MessageParameters.SenderId - Class in edu.snu.nemo.runtime.common.message
Id of the sender.
MessageSender<T> - Interface in edu.snu.nemo.runtime.common.message
This class sends messages to MessageListener with some defined semantics.
MetricCollectionBarrierTask - Class in edu.snu.nemo.runtime.common.plan.physical
MetricCollectionBarrierTask.
MetricCollectionBarrierVertex<T> - Class in edu.snu.nemo.common.ir.vertex
IRVertex that collects statistics to send them to the optimizer for dynamic optimization.
MetricCollectionBarrierVertex() - Constructor for class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
Constructor for dynamic optimization vertex.
MetricCollectionProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
MetricCollection ExecutionProperty.
MetricCollectionProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of MetricCollection ExecutionProperty.
MetricCollector - Class in edu.snu.nemo.runtime.executor
This metric collector collects metrics and send through MetricMessageSender.
MetricCollector(MetricMessageSender) - Constructor for class edu.snu.nemo.runtime.executor.MetricCollector
Constructor.
MetricData - Class in edu.snu.nemo.runtime.common.metric
MetricData that holds executor side metrics.
MetricDataBuilder - Class in edu.snu.nemo.runtime.common.metric
MetricData Builder.
MetricDataBuilder(String) - Constructor for class edu.snu.nemo.runtime.common.metric.MetricDataBuilder
Constructor.
MetricFlushPeriod - Class in edu.snu.nemo.runtime.common.metric.parameter
Metric flushing period.
MetricFlushPeriod() - Constructor for class edu.snu.nemo.runtime.common.metric.parameter.MetricFlushPeriod
 
MetricManagerMaster - Class in edu.snu.nemo.runtime.master
A default metric message handler.
MetricManagerWorker - Class in edu.snu.nemo.runtime.executor
Metric sender that periodically flushes the collected metrics to Driver.
MetricMessageHandler - Interface in edu.snu.nemo.runtime.master
Metric message handler.
MetricMessageSender - Interface in edu.snu.nemo.runtime.executor
Interface for metric sender.
metrics() - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
 
min(Comparator<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
MultinomialLogisticRegression - Class in edu.snu.nemo.examples.beam
Sample Multinomial Logistic Regression application.
MultinomialLogisticRegression.ApplyGradient - Class in edu.snu.nemo.examples.beam
DoFn class that applies the gradient to the model.
MultinomialLogisticRegression.CalculateGradient - Class in edu.snu.nemo.examples.beam
Calculate Gradient.
MultinomialLogisticRegression.CombineFunction - Class in edu.snu.nemo.examples.beam
Combine Function for two Double arrays.
MultinomialLogisticRegression.CombineFunctionForIterable - Class in edu.snu.nemo.examples.beam
Combine Function for Iterable of gradients.
MultinomialLogisticRegression.UpdateModel - Class in edu.snu.nemo.examples.beam
+ Composite transform that wraps the transforms inside the loop.
MyAverage() - Constructor for class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
 
MyAverage() - Constructor for class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Public constructor.

N

name() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
NativeChannelImplementationSelector - Class in edu.snu.nemo.runtime.common
A NettyChannelImplementationSelector implementation that prefers native transport if possible.
NcsMessageEnvironment - Class in edu.snu.nemo.runtime.common.message.ncs
Message environment for NCS.
NemoBackend - Class in edu.snu.nemo.compiler.backend.nemo
Backend component for Nemo Runtime.
NemoBackend() - Constructor for class edu.snu.nemo.compiler.backend.nemo.NemoBackend
Constructor.
NemoClient - Class in edu.snu.nemo.client
A wrapper class that contains client handlers.
NemoClient.JobMessageHandler - Class in edu.snu.nemo.client
Message handler.
NemoContext - Class in edu.snu.nemo.driver
REEF Context for the Executor.
NemoContext.ContextStartHandler - Class in edu.snu.nemo.driver
Called when the context starts.
NemoContext.ContextStopHandler - Class in edu.snu.nemo.driver
Called when the context is stopped.
NemoDriver - Class in edu.snu.nemo.driver
REEF Driver for Nemo.
NemoDriver.ActiveContextHandler - Class in edu.snu.nemo.driver
Context active.
NemoDriver.AllocatedEvaluatorHandler - Class in edu.snu.nemo.driver
Container allocated.
NemoDriver.DriverStopHandler - Class in edu.snu.nemo.driver
Driver stopped.
NemoDriver.FailedContextHandler - Class in edu.snu.nemo.driver
Context failed.
NemoDriver.FailedEvaluatorHandler - Class in edu.snu.nemo.driver
Evaluator failed.
NemoDriver.StartHandler - Class in edu.snu.nemo.driver
Driver started.
NemoPipelineOptions - Interface in edu.snu.nemo.compiler.frontend.beam
NemoPipelineOptions.
NemoPipelineResult - Class in edu.snu.nemo.compiler.frontend.beam
Beam result.
NemoPipelineResult() - Constructor for class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
Default constructor.
NemoPipelineRunner - Class in edu.snu.nemo.compiler.frontend.beam
Runner class for BEAM programs.
NemoPipelineVisitor - Class in edu.snu.nemo.compiler.frontend.beam
Visits every node in the beam dag to translate the BEAM program to the IR.
NemoPipelineVisitor(DAGBuilder<IRVertex, IREdge>, PipelineOptions) - Constructor for class edu.snu.nemo.compiler.frontend.beam.NemoPipelineVisitor
Constructor of the BEAM Visitor.
NemoSparkUserFacingClass - Interface in edu.snu.nemo.compiler.frontend.spark.sql
Common interface for SparkSQL supporting Nemo classes containing the methods that are exposed to users.
NettyChannelImplementationSelector - Interface in edu.snu.nemo.runtime.common
Selects appropriate Channel implementation.
newBuilder() - Static method in class edu.snu.nemo.common.StateMachine
 
newBuilder() - Static method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
newEdgeId() - Static method in class edu.snu.nemo.common.ir.IdManager
 
newEventLoopGroup(int, ThreadFactory) - Method in class edu.snu.nemo.runtime.common.NativeChannelImplementationSelector
 
newEventLoopGroup(int, ThreadFactory) - Method in interface edu.snu.nemo.runtime.common.NettyChannelImplementationSelector
Creates a new EventLoopGroup.
newEventLoopGroup(int, ThreadFactory) - Method in class edu.snu.nemo.runtime.common.NioChannelImplementationSelector
 
newInputContext(String, byte[]) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransfer
Initiate a transfer context to receive data.
newOutputContext(String, byte[]) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransfer
Initiate a transfer context to send data.
newOutputStream() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext
Closes existing sub-stream (if any) and create a new sub-stream.
newVertexId() - Static method in class edu.snu.nemo.common.ir.IdManager
 
next() - Method in class edu.snu.nemo.runtime.executor.data.DataUtil.InputStreamIterator
 
NioChannelImplementationSelector - Class in edu.snu.nemo.runtime.common
A NettyChannelImplementationSelector implementation that prefers nio-based channel implementation.
NodeConnectionException - Exception in edu.snu.nemo.common.exception
NodeConnectionException.
NodeConnectionException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.NodeConnectionException
NodeConnectionException.
NONE - Static variable in class edu.snu.nemo.common.ir.vertex.executionproperty.ExecutorPlacementProperty
 
NonSerializedMemoryBlock<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.block
This class represents a block which is stored in local memory and not serialized.
NonSerializedMemoryBlock(Serializer) - Constructor for class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Constructor.
NonSerializedPartition<K> - Class in edu.snu.nemo.runtime.executor.data
A collection of data elements.
NonSerializedPartition(K, Iterable) - Constructor for class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
Creates a non-serialized Partition having a specific key value.
NonSerializedPartition(K, Iterable, long, long) - Constructor for class edu.snu.nemo.runtime.executor.data.NonSerializedPartition
Creates a non-serialized Partition having a specific key value.
NumBytesNotSupportedException() - Constructor for exception edu.snu.nemo.runtime.executor.data.DataUtil.IteratorWithNumBytes.NumBytesNotSupportedException

O

of(CompressionProperty.Compression) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.CompressionProperty
Static method exposing the constructor.
of(DataCommunicationPatternProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.DataCommunicationPatternProperty
Static method exposing the constructor.
of(DataFlowModelProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.DataFlowModelProperty
Static method exposing the constructor.
of(DataStoreProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.DataStoreProperty
Static method exposing the constructor.
of(DuplicateEdgeGroupPropertyValue) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupProperty
Static method exposing the constructor.
of(KeyExtractor) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.KeyExtractorProperty
Static method exposing the constructor.
of(MetricCollectionProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.MetricCollectionProperty
Static method exposing the constructor.
of(PartitionerProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.PartitionerProperty
Static method exposing the constructor.
of(UsedDataHandlingProperty.Value) - Static method in class edu.snu.nemo.common.ir.edge.executionproperty.UsedDataHandlingProperty
Static method exposing the constructor.
of(IREdge, DataCommunicationPatternProperty.Value) - Static method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Static initializer for irEdges.
of(IRVertex) - Static method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Static initializer for irVertex.
of(DynamicOptimizationProperty.Value) - Static method in class edu.snu.nemo.common.ir.vertex.executionproperty.DynamicOptimizationProperty
Static method exposing the constructor.
of(String) - Static method in class edu.snu.nemo.common.ir.vertex.executionproperty.ExecutorPlacementProperty
Static method exposing the constructor.
of(Integer) - Static method in class edu.snu.nemo.common.ir.vertex.executionproperty.ParallelismProperty
Static method exposing the constructor.
of(Integer) - Static method in class edu.snu.nemo.common.ir.vertex.executionproperty.ScheduleGroupIndexProperty
Static method exposing the constructor.
of(Integer) - Static method in class edu.snu.nemo.common.ir.vertex.executionproperty.StageIdProperty
Static method exposing the constructor.
of(A, B) - Static method in class edu.snu.nemo.common.Pair
Static initializer of the Pair class.
of(Coder<A>, Coder<B>) - Static method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
static initializer of the class.
of(SparkContext, Iterable<T>, Integer) - Static method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
Static method to create a JavaRDD object from an iterable object.
of(SparkSession, Dataset<T>) - Static method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
Static method to create a JavaRDD object from a Dataset.
of(SparkContext) - Static method in class edu.snu.nemo.compiler.frontend.spark.core.RDD
Static method to create a RDD object.
of(int, int) - Static method in class edu.snu.nemo.runtime.common.data.HashRange
 
of(Iterator<E>) - Static method in interface edu.snu.nemo.runtime.executor.data.DataUtil.IteratorWithNumBytes
Create an DataUtil.IteratorWithNumBytes, with no information about the number of bytes.
of(Iterator<E>, long, long) - Static method in interface edu.snu.nemo.runtime.executor.data.DataUtil.IteratorWithNumBytes
Create an DataUtil.IteratorWithNumBytes, with the number of bytes in decoded and serialized form.
ofRows(SparkSession, LogicalPlan) - Static method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
Overrides super.ofRows.
onBlockStateChanged(String, BlockState.State, String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
Deals with state change of a block.
onChannelError(Throwable) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteInputContext
 
onChannelError(Throwable) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext
 
onChannelError(Throwable) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
Handles exception.
onContainerAllocated(String, AllocatedEvaluator, Configuration) - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
Take the necessary actions in container manager once a container a is allocated.
onContainerAllocated(String, AllocatedEvaluator, Configuration) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
Called when a container is allocated for this runtime.
onData(Iterator<T>, String) - Method in class edu.snu.nemo.common.ir.vertex.transform.RelayTransform
 
onData(Iterator<I>, String) - Method in interface edu.snu.nemo.common.ir.vertex.transform.Transform
On data received.
onData(Iterator<I>, String) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
 
onData(Iterator<I>, String) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.DoTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.FlattenTransform
 
onData(Iterator<I>, String) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.GroupByKeyTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.WindowTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.CollectTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.FlatMapTransform
 
onData(Iterator<Tuple2<K, V>>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.GroupByKeyTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapToPairTransform
 
onData(Iterator<I>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapTransform
 
onData(Iterator<Tuple2<K, V>>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceByKeyTransform
 
onData(Iterator<T>, String) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceTransform
 
onData(Iterator<I>, String) - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptyTransform
 
onExecutorAdded(String) - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
 
onExecutorAdded(String) - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
onExecutorAdded(String) - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
Called when an executor is added to Runtime, so that the extra resource can be used to execute the job.
onExecutorAdded(String) - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Adds the executorId to the pool of available executors.
onExecutorFailed() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
onExecutorFailed(String) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
Called when an executor fails due to container failure on this runtime.
onExecutorLaunched(ActiveContext) - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
Initializes master's connection to the executor once launched.
onExecutorLaunched(ActiveContext) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
Called when an executor is launched on a container for this runtime.
onExecutorRemoved(String) - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
 
onExecutorRemoved(String) - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
 
onExecutorRemoved(String) - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
onExecutorRemoved(String) - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
Called when an executor is removed from Runtime, so that faults related to the removal can be handled.
onExecutorRemoved(String) - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Deletes the executorId from the pool of available executors.
onFailure(long, Throwable) - Method in class edu.snu.nemo.runtime.common.ReplyFutureMap
Called for a failure in request-reply communication.
onInputContext(ByteInputContext) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Respond to a block notification by another executor.
onJobScheduled(PhysicalPlan) - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Registers a job to this queue in case the queue needs to understand the topology of the job DAG.
onJobScheduled(PhysicalPlan) - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
 
onJobStateChanged(JobState.State) - Method in class edu.snu.nemo.runtime.master.JobStateManager
Updates the state of the job.
onMessage(T) - Method in interface edu.snu.nemo.runtime.common.message.MessageListener
Called back when a message is received.
onMessage(ControlMessage.Message) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster.PartitionManagerMasterControlMessageReceiver
 
onMessage(ControlMessage.Message) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster.MasterControlMessageReceiver
 
onMessageWithContext(T, MessageContext) - Method in interface edu.snu.nemo.runtime.common.message.MessageListener
Called back when a message is received, and return a response using MessageContext.
onMessageWithContext(ControlMessage.Message, MessageContext) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster.PartitionManagerMasterControlMessageReceiver
 
onMessageWithContext(ControlMessage.Message, MessageContext) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster.MasterControlMessageReceiver
 
onMetricMessageReceived(String, String) - Method in class edu.snu.nemo.runtime.master.MetricManagerMaster
 
onMetricMessageReceived(String, String) - Method in interface edu.snu.nemo.runtime.master.MetricMessageHandler
Handle the received metric message.
onNext(JobMessage) - Method in class edu.snu.nemo.client.NemoClient.JobMessageHandler
 
onNext(ContextStart) - Method in class edu.snu.nemo.driver.NemoContext.ContextStartHandler
 
onNext(ContextStop) - Method in class edu.snu.nemo.driver.NemoContext.ContextStopHandler
 
onNext(ActiveContext) - Method in class edu.snu.nemo.driver.NemoDriver.ActiveContextHandler
 
onNext(AllocatedEvaluator) - Method in class edu.snu.nemo.driver.NemoDriver.AllocatedEvaluatorHandler
 
onNext(StopTime) - Method in class edu.snu.nemo.driver.NemoDriver.DriverStopHandler
 
onNext(FailedContext) - Method in class edu.snu.nemo.driver.NemoDriver.FailedContextHandler
 
onNext(FailedEvaluator) - Method in class edu.snu.nemo.driver.NemoDriver.FailedEvaluatorHandler
 
onNext(StartTime) - Method in class edu.snu.nemo.driver.NemoDriver.StartHandler
 
onNext(DynamicOptimizationEvent) - Method in class edu.snu.nemo.runtime.common.eventhandler.DynamicOptimizationEventHandler
 
onNext(UpdatePhysicalPlanEvent) - Method in class edu.snu.nemo.runtime.master.eventhandler.UpdatePhysicalPlanEventHandler
 
onOutputContext(ByteOutputContext) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Respond to a block request by another executor.
onProducerTaskGroupFailed(String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
To be called when a potential producer task group fails.
onProducerTaskGroupScheduled(String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
To be called when a potential producer task group is scheduled.
onStageStateChanged(String, StageState.State) - Method in class edu.snu.nemo.runtime.master.JobStateManager
Updates the state of a stage.
onSuccessMessage(long, T) - Method in class edu.snu.nemo.runtime.common.ReplyFutureMap
Called by message receiver, for a successful reply message.
onTaskGroupExecutionComplete(String) - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
onTaskGroupExecutionComplete(String, String) - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
onTaskGroupExecutionComplete(String, String) - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Marks the taskGroup's completion in the executor.
onTaskGroupExecutionFailed(String) - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
onTaskGroupExecutionFailed(String, String) - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
onTaskGroupExecutionFailed(String, String) - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Marks the taskGroup's failure in the executor.
onTaskGroupScheduled(ScheduledTaskGroup) - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
onTaskGroupStateChanged(TaskGroupState.State, Optional<String>, Optional<TaskGroupState.RecoverableFailureCause>) - Method in class edu.snu.nemo.runtime.executor.TaskGroupStateManager
Updates the state of the task group.
onTaskGroupStateChanged(String, TaskGroupState.State) - Method in class edu.snu.nemo.runtime.master.JobStateManager
Updates the state of a task group.
onTaskGroupStateChanged(String, String, TaskGroupState.State, int, String, TaskGroupState.RecoverableFailureCause) - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
Receives a ControlMessage.TaskGroupStateChangedMsg from an executor.
onTaskGroupStateChanged(String, String, TaskGroupState.State, int, String, TaskGroupState.RecoverableFailureCause) - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
Called when a TaskGroup's execution state changes.
onTaskStateChanged(String, TaskState.State, Optional<TaskGroupState.RecoverableFailureCause>) - Method in class edu.snu.nemo.runtime.executor.TaskGroupStateManager
Updates the state of a task.
open(String) - Static method in class edu.snu.nemo.runtime.executor.data.metadata.RemoteFileMetadata
Opens a existing block metadata in file.
OperatorTask - Class in edu.snu.nemo.runtime.common.plan.physical
OperatorTask.
OperatorTask(String, String, Transform) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.OperatorTask
Constructor.
OperatorVertex - Class in edu.snu.nemo.common.ir.vertex
IRVertex that transforms input data.
OperatorVertex(Transform) - Constructor for class edu.snu.nemo.common.ir.vertex.OperatorVertex
Constructor of OperatorVertex.
OptimizationPolicy() - Constructor for class edu.snu.nemo.conf.JobConf.OptimizationPolicy
 
optimize(DAG<IRVertex, IREdge>, Policy, String) - Static method in class edu.snu.nemo.compiler.optimizer.CompiletimeOptimizer
Optimize function.
option(String, boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
option(String, double) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
option(String, long) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
option(String, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
options(Map<String, String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
options(Map<String, String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
orc(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
orc(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
orc(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
orderBy(Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
orderBy(Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
orderBy(String, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
orderBy(String, String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
OutputCollector<O> - Interface in edu.snu.nemo.common.ir
Interface through which Transform emits outputs.
OutputCollectorImpl<O> - Class in edu.snu.nemo.runtime.executor.datatransfer
Output Collector Implementation.
OutputCollectorImpl() - Constructor for class edu.snu.nemo.runtime.executor.datatransfer.OutputCollectorImpl
Constructor of a new OutputCollector.
outputEncoder() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
Specifies the Encoder for the final output value type.
OutputWriter - Class in edu.snu.nemo.runtime.executor.datatransfer
Represents the output data transfer from a task.
OutputWriter(int, int, String, IRVertex, RuntimeEdge<?>, BlockManagerWorker) - Constructor for class edu.snu.nemo.runtime.executor.datatransfer.OutputWriter
 

P

PadoCompositePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
A series of passes to support Pado optimization.
PadoCompositePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.PadoCompositePass
Default constructor.
PadoEdgeDataFlowModelPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pado pass for tagging edges with DataFlowModel ExecutionProperty.
PadoEdgeDataFlowModelPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoEdgeDataFlowModelPass
Default constructor.
PadoEdgeDataStorePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pado pass for tagging edges with DataStore ExecutionProperty.
PadoEdgeDataStorePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoEdgeDataStorePass
Default constructor.
PadoPolicy - Class in edu.snu.nemo.compiler.optimizer.policy
A policy to perform Pado optimization that uses transient resources on data centers.
PadoPolicy() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.PadoPolicy
Default constructor.
PadoVertexExecutorPlacementPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Pado pass for tagging vertices.
PadoVertexExecutorPlacementPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.PadoVertexExecutorPlacementPass
Default constructor.
Pair<A,B> - Class in edu.snu.nemo.common
Pair class.
PairCoder<A,B> - Class in edu.snu.nemo.compiler.frontend.beam.coder
BEAM Coder for Pair.
ParallelismProperty - Class in edu.snu.nemo.common.ir.vertex.executionproperty
Parallelism ExecutionProperty.
parallelize(List<T>, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaSparkContext
Initiate a JavaRDD with the number of parallelism.
parquet(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
parquet(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
parquet(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
ParseLine(Boolean) - Constructor for class edu.snu.nemo.examples.beam.AlternatingLeastSquare.ParseLine
Constructor for Parseline DoFn class.
Partition<T,K> - Interface in edu.snu.nemo.runtime.executor.data
A collection of data elements.
partition(Iterable, int, KeyExtractor) - Method in class edu.snu.nemo.runtime.executor.data.partitioner.DataSkewHashPartitioner
 
partition(Iterable, int, KeyExtractor) - Method in class edu.snu.nemo.runtime.executor.data.partitioner.HashPartitioner
 
partition(Iterable, int, KeyExtractor) - Method in class edu.snu.nemo.runtime.executor.data.partitioner.IntactPartitioner
 
partition(Iterable, int, KeyExtractor) - Method in interface edu.snu.nemo.runtime.executor.data.partitioner.Partitioner
Divides the output data from a task into multiple blocks.
partitioner() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
Partitioner - Interface in edu.snu.nemo.runtime.executor.data.partitioner
This interface represents the way of partitioning output data from a source task.
PartitionerProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
Partitioner ExecutionProperty.
PartitionerProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of Partitioner ExecutionProperty.
PartitionManagerMasterControlMessageReceiver() - Constructor for class edu.snu.nemo.runtime.master.BlockManagerMaster.PartitionManagerMasterControlMessageReceiver
 
PartitionMetadata<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.metadata
This class represents a metadata for a partition.
PartitionMetadata(K, int, long, long) - Constructor for class edu.snu.nemo.runtime.executor.data.metadata.PartitionMetadata
Constructor.
partitions() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
PartitionTransportClientNumThreads() - Constructor for class edu.snu.nemo.conf.JobConf.PartitionTransportClientNumThreads
 
PartitionTransportServerBacklog() - Constructor for class edu.snu.nemo.conf.JobConf.PartitionTransportServerBacklog
 
PartitionTransportServerNumListeningThreads() - Constructor for class edu.snu.nemo.conf.JobConf.PartitionTransportServerNumListeningThreads
 
PartitionTransportServerNumWorkingThreads() - Constructor for class edu.snu.nemo.conf.JobConf.PartitionTransportServerNumWorkingThreads
 
PartitionTransportServerPort() - Constructor for class edu.snu.nemo.conf.JobConf.PartitionTransportServerPort
 
pathExistsBetween(V, V) - Method in class edu.snu.nemo.common.dag.DAG
Function checks whether there is a path between two vertices.
peek() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Retrieves, but does not removes, the head of this queue, waiting if necessary.
PendingTaskGroupQueue - Interface in edu.snu.nemo.runtime.master.scheduler
Keep tracks of all pending task groups.
persist(StorageLevel) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
persist() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
persist(StorageLevel) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
PersistentConnectionToMasterMap - Class in edu.snu.nemo.runtime.common.message
Persistent connection for sending messages to master.
PersistentConnectionToMasterMap(MessageEnvironment) - Constructor for class edu.snu.nemo.runtime.common.message.PersistentConnectionToMasterMap
 
Person() - Constructor for class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample.Person
 
PhysicalPlan - Class in edu.snu.nemo.runtime.common.plan.physical
A job's physical plan, to be executed by the Runtime.
PhysicalPlan(String, DAG<PhysicalStage, PhysicalStageEdge>, Map<Task, IRVertex>) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
Constructor.
PhysicalPlanGenerationException - Exception in edu.snu.nemo.common.exception
PhysicalPlanGenerationException.
PhysicalPlanGenerationException(String) - Constructor for exception edu.snu.nemo.common.exception.PhysicalPlanGenerationException
PhysicalPlanGenerationException.
PhysicalPlanGenerationException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.PhysicalPlanGenerationException
PhysicalPlanGenerationException.
PhysicalPlanGenerator - Class in edu.snu.nemo.runtime.common.plan.physical
A function that converts an IR DAG to physical DAG.
PhysicalStage - Class in edu.snu.nemo.runtime.common.plan.physical
PhysicalStage.
PhysicalStage(String, DAG<Task, RuntimeEdge<Task>>, int, int, String, List<Map<String, Readable>>) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
Constructor.
PhysicalStageEdge - Class in edu.snu.nemo.runtime.common.plan.physical
Contains information stage boundary StageEdge.
PhysicalStageEdge(String, ExecutionPropertyMap, IRVertex, IRVertex, PhysicalStage, PhysicalStage, Coder, Boolean) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
Constructor.
Policy - Interface in edu.snu.nemo.compiler.optimizer.policy
An interface for policies, each of which is composed of a list of static optimization passes.
PolicyBuilder - Class in edu.snu.nemo.compiler.optimizer.policy
A builder for policies.
PolicyBuilder() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.PolicyBuilder
Default constructor.
PolicyBuilder(Boolean) - Constructor for class edu.snu.nemo.compiler.optimizer.policy.PolicyBuilder
Constructor.
prepare(Transform.Context, OutputCollector<T>) - Method in class edu.snu.nemo.common.ir.vertex.transform.RelayTransform
 
prepare(Transform.Context, OutputCollector<O>) - Method in interface edu.snu.nemo.common.ir.vertex.transform.Transform
Prepare the transform.
prepare(Transform.Context, OutputCollector<O>) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
 
prepare(Transform.Context, OutputCollector<O>) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.DoTransform
 
prepare(Transform.Context, OutputCollector<T>) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.FlattenTransform
 
prepare(Transform.Context, OutputCollector<KV<Object, List>>) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.GroupByKeyTransform
 
prepare(Transform.Context, OutputCollector<T>) - Method in class edu.snu.nemo.compiler.frontend.beam.transform.WindowTransform
 
prepare(Transform.Context, OutputCollector<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.CollectTransform
 
prepare(Transform.Context, OutputCollector<U>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.FlatMapTransform
 
prepare(Transform.Context, OutputCollector<Tuple2<K, Iterable<V>>>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.GroupByKeyTransform
 
prepare(Transform.Context, OutputCollector<Tuple2<K, V>>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapToPairTransform
 
prepare(Transform.Context, OutputCollector<O>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.MapTransform
 
prepare(Transform.Context, OutputCollector<Tuple2<K, V>>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceByKeyTransform
 
prepare(Transform.Context, OutputCollector<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceTransform
 
prepare(Transform.Context, OutputCollector<O>) - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptyTransform
 
PrimitiveCompositePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
A series of primitive passes that is applied commonly to all policies.
PrimitiveCompositePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.PrimitiveCompositePass
Default constructor.
processElement(DoFn<KV<Integer, Pair<List<Integer>, List<Double>>>, KV<Integer, List<Double>>>.ProcessContext) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.CalculateNextMatrix
ProcessElement method for BEAM.
processElement(DoFn<String, KV<Integer, Pair<List<Integer>, List<Double>>>>.ProcessContext) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.ParseLine
ProcessElement method for BEAM.
processElement(DoFn<KV<Integer, Iterable<List<Double>>>, KV<Integer, List<Double>>>.ProcessContext) - Method in class edu.snu.nemo.examples.beam.AlternatingLeastSquare.UngroupSingleVectorList
 
processElement(DoFn<KV<Integer, CoGbkResult>, KV<Integer, List<Double>>>.ProcessContext) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.ApplyGradient
ProcessElement method for BEAM.
processElement(DoFn<String, KV<Integer, List<Double>>>.ProcessContext) - Method in class edu.snu.nemo.examples.beam.MultinomialLogisticRegression.CalculateGradient
ProcessElement method for BEAM.
propertiesToJSON() - Method in class edu.snu.nemo.common.dag.Edge
 
propertiesToJSON() - Method in class edu.snu.nemo.common.dag.Vertex
 
propertiesToJSON() - Method in class edu.snu.nemo.common.ir.edge.IREdge
 
propertiesToJSON() - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
 
propertiesToJSON() - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
 
propertiesToJSON() - Method in class edu.snu.nemo.common.ir.vertex.OperatorVertex
 
propertiesToJSON() - Method in class edu.snu.nemo.compiler.frontend.beam.source.BeamBoundedSourceVertex
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStage
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.physical.Task
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.RuntimeEdge
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.stage.Stage
 
propertiesToJSON() - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdge
 
publish(LogRecord) - Method in class edu.snu.nemo.driver.RemoteClientMessageLoggingHandler
TODO #XXX: buffer the log messages for performance.
PubSubEventHandlerWrapper - Class in edu.snu.nemo.common.eventhandler
Wrapper class with a pub/sub event handler.
put(ExecutionProperty<?>) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
Put the given execution property in the ExecutionPropertyMap.
put(T) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Adds an element.
putPartitions(Iterable<NonSerializedPartition<K>>) - Method in interface edu.snu.nemo.runtime.executor.data.block.Block
Stores NonSerializedPartitions to this block.
putPartitions(Iterable<NonSerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Writes NonSerializedPartitions to this block.
putPartitions(Iterable<NonSerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Stores NonSerializedPartitions to this block.
putPartitions(Iterable<NonSerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Serialized and stores NonSerializedPartitions to this block.
putPartitions(String, Iterable<Partition>, DataStoreProperty.Value) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Store an iterable of data partitions to a block in the target BlockStore.
putPartitions(String, Iterable<NonSerializedPartition<K>>) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Saves an iterable of NonSerializedPartitions to a block.
putPartitions(String, Iterable<NonSerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
 
putPartitions(String, Iterable<NonSerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 
putSerializedPartitions(Iterable<SerializedPartition<K>>) - Method in interface edu.snu.nemo.runtime.executor.data.block.Block
Stores SerializedPartitions to this block.
putSerializedPartitions(Iterable<SerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.FileBlock
Writes SerializedPartitions to this block.
putSerializedPartitions(Iterable<SerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.NonSerializedMemoryBlock
Stores SerializedPartitions to this block.
putSerializedPartitions(Iterable<SerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Stores SerializedPartitions to this block.
putSerializedPartitions(String, Iterable<SerializedPartition<K>>) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Saves an iterable of SerializedPartitions to a block.
putSerializedPartitions(String, Iterable<SerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
 
putSerializedPartitions(String, Iterable<SerializedPartition<K>>) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalBlockStore
 

Q

queryBlock(String, String, DataStoreProperty.Value, KeyRange) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Inquiries the location of the specific block and routes the request to the local block manager worker or to the lower data plane.

R

randomSplit(double[]) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
randomSplit(double[], long) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
randomSplit(double[]) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
randomSplit(double[], long) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
rangeBeginInclusive() - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
rangeBeginInclusive() - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
 
rangeEndExclusive() - Method in class edu.snu.nemo.runtime.common.data.HashRange
 
rangeEndExclusive() - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
 
RDD<T> - Class in edu.snu.nemo.compiler.frontend.spark.core
RDD for Nemo.
read() - Method in interface edu.snu.nemo.common.ir.Readable
Method to read data from the source.
read() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
read() - Method in class edu.snu.nemo.runtime.executor.data.LimitedInputStream
 
read() - Method in class edu.snu.nemo.runtime.executor.datatransfer.InputReader
Reads input data depending on the communication pattern of the srcVertex.
Readable<O> - Interface in edu.snu.nemo.common.ir
Interface for readable.
reduce(Function2<T, T, T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
Reduce action.
reduce(JavaUserDefinedTypedAggregation.Average, JavaUserDefinedTypedAggregation.Employee) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
Combine two values to produce a new value.
reduceByKey(Function2<V, V, V>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaPairRDD
 
ReduceByKeyTransform<K,V> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Transform for reduce by key transformation.
ReduceByKeyTransform(Function2<V, V, V>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.ReduceByKeyTransform
Constructor.
reduceIterator(Iterator<T>, Function2<T, T, T>) - Static method in class edu.snu.nemo.compiler.frontend.spark.transform.ReduceTransform
Reduce the iterator elements into a single object.
ReduceTransform<T> - Class in edu.snu.nemo.compiler.frontend.spark.transform
Reduce Transform for Spark.
ReduceTransform(Function2<T, T, T>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.transform.ReduceTransform
Constructor.
register(String, Coder, ExecutionPropertyMap) - Method in class edu.snu.nemo.runtime.executor.data.SerializerManager
Register a coder for runtime edge.
registerByteSizeObserver(Pair<A, B>, ElementByteSizeObserver) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
Notifies ElementByteSizeObserver about the byte size of the encoded value using this coder.
registerCompileTimePass(CompileTimePass) - Method in class edu.snu.nemo.compiler.optimizer.policy.PolicyBuilder
Register compile time pass.
registerRuntimePass(RuntimePass<?>, CompileTimePass) - Method in class edu.snu.nemo.compiler.optimizer.policy.PolicyBuilder
Register run time passes.
RelayTransform<T> - Class in edu.snu.nemo.common.ir.vertex.transform
A Transform relays input data from upstream vertex to downstream vertex promptly.
RelayTransform() - Constructor for class edu.snu.nemo.common.ir.vertex.transform.RelayTransform
Default constructor.
RemoteClientMessageLoggingHandler - Class in edu.snu.nemo.driver
A simple logging handler that forwards messages to REEF client.
RemoteClientMessageLoggingHandler(JobMessageObserver) - Constructor for class edu.snu.nemo.driver.RemoteClientMessageLoggingHandler
 
RemoteFileMetadata<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.metadata
This class represents a metadata for a remote file block.
RemoteFileStore - Interface in edu.snu.nemo.runtime.executor.data.stores
Interface for remote block stores (e.g., GlusterFS, ...).
remove(ExecutionProperty.Key) - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
remove the execution property.
removeBlock(String, DataStoreProperty.Value) - Method in class edu.snu.nemo.runtime.executor.data.BlockManagerWorker
Remove the block from store.
removeBlock(String) - Method in interface edu.snu.nemo.runtime.executor.data.stores.BlockStore
Removes a block of data.
removeBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.GlusterFileStore
Removes the file that the target block is stored.
removeBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.LocalFileStore
Removes the file that the target block is stored.
removeBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.MemoryStore
 
removeBlock(String) - Method in class edu.snu.nemo.runtime.executor.data.stores.SerializedMemoryStore
 
removeListener(String) - Method in class edu.snu.nemo.runtime.common.message.grpc.GrpcMessageEnvironment
 
removeListener(String) - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
removeListener(String) - Method in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
Remove the MessageListener bound to a specific listener ID.
removeListener(String) - Method in class edu.snu.nemo.runtime.common.message.ncs.NcsMessageEnvironment
 
removeTaskGroupsAndDescendants(String) - Method in interface edu.snu.nemo.runtime.master.scheduler.PendingTaskGroupQueue
Removes a stage and its descendant stages from this queue.
removeTaskGroupsAndDescendants(String) - Method in class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
Removes a stage and its descendant stages from this PQ.
removeVertex(V) - Method in class edu.snu.nemo.common.dag.DAGBuilder
Remove the vertex from the list.
removeWorker(String) - Method in class edu.snu.nemo.runtime.master.BlockManagerMaster
Manages the block information when a executor is removed.
repartition(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
repartition(Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
repartition(int) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
repartition(int, Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
repartition(int, Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
repartition(Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
reply(U) - Method in interface edu.snu.nemo.runtime.common.message.MessageContext
Send back a reply message.
ReplyFutureMap<T> - Class in edu.snu.nemo.runtime.common
Orchestrate message sender and receiver using CompletableFuture for asynchronous request-reply communication.
ReplyFutureMap() - Constructor for class edu.snu.nemo.runtime.common.ReplyFutureMap
 
request(T) - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageSender
 
request(T) - Method in interface edu.snu.nemo.runtime.common.message.MessageSender
requestContainer(int, ResourceSpecification) - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
Requests containers/evaluators with the given specifications.
requestContainer(String) - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
 
RESERVED - Static variable in class edu.snu.nemo.common.ir.vertex.executionproperty.ExecutorPlacementProperty
 
ReshapingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
A compile-time pass that reshapes the structure of the IR DAG.
ReshapingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.ReshapingPass
Default constructor.
ReshapingPass(Set<ExecutionProperty.Key>) - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.ReshapingPass
Constructor.
ResourceSpecification - Class in edu.snu.nemo.runtime.master.resource
Represents the specifications of a resource.
ResourceSpecification(String, int, int) - Constructor for class edu.snu.nemo.runtime.master.resource.ResourceSpecification
 
ResourceSpecification.Builder - Class in edu.snu.nemo.runtime.master.resource
A Builder class for ResourceSpecification.
ReviseInterStageEdgeDataStorePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
Edge data store pass to process inter-stage memory store edges.
ReviseInterStageEdgeDataStorePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ReviseInterStageEdgeDataStorePass
Default constructor.
right() - Method in class edu.snu.nemo.common.Pair
 
RoundRobinSchedulingPolicy - Class in edu.snu.nemo.runtime.master.scheduler
A Round-Robin implementation used by BatchSingleJobScheduler.
RoundRobinSchedulingPolicy(ContainerManager, int) - Constructor for class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
run(Pipeline) - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineRunner
Method to run the Pipeline.
run() - Method in class edu.snu.nemo.driver.UserApplicationRunner
 
RUNTIME_MASTER_MESSAGE_LISTENER_ID - Static variable in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
 
RuntimeEdge<V extends Vertex> - Class in edu.snu.nemo.runtime.common.plan
Represents the edge between vertices in a logical/physical plan in runtime.
RuntimeEdge(String, ExecutionPropertyMap, V, V, Coder) - Constructor for class edu.snu.nemo.runtime.common.plan.RuntimeEdge
Constructs the edge given the below parameters.
RuntimeEdge(String, ExecutionPropertyMap, V, V, Coder, Boolean) - Constructor for class edu.snu.nemo.runtime.common.plan.RuntimeEdge
Constructs the edge given the below parameters.
RuntimeEvent - Interface in edu.snu.nemo.common.eventhandler
An empty interface to indicate events that are sent from Runtime.
RuntimeEventHandler<T extends RuntimeEvent> - Interface in edu.snu.nemo.common.eventhandler
Class for handling events sent from Runtime.
RuntimeIdGenerator - Class in edu.snu.nemo.runtime.common
ID Generator.
RuntimeMaster - Class in edu.snu.nemo.runtime.master
Runtime Master is the central controller of Runtime.
RuntimeMaster(Scheduler, SchedulerRunner, PendingTaskGroupQueue, ContainerManager, BlockManagerMaster, MetricMessageHandler, MessageEnvironment, String) - Constructor for class edu.snu.nemo.runtime.master.RuntimeMaster
 
RuntimeMaster.MasterControlMessageReceiver - Class in edu.snu.nemo.runtime.master
Handler for control messages received by Master.
RuntimeOptimizer - Class in edu.snu.nemo.runtime.common.optimizer
Runtime optimizer class.
RuntimePass<T> - Interface in edu.snu.nemo.runtime.common.optimizer.pass.runtime
Interface for dynamic optimization passes, for dynamically optimizing a physical plan.

S

SailfishEdgeDataFlowModelPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass to support Sailfish-like shuffle by tagging edges.
SailfishEdgeDataFlowModelPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeDataFlowModelPass
Default constructor.
SailfishEdgeDataStorePass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass to support Sailfish-like shuffle by tagging edges.
SailfishEdgeDataStorePass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeDataStorePass
Default constructor.
SailfishEdgeUsedDataHandlingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass to support Sailfish-like shuffle by tagging edges.
SailfishEdgeUsedDataHandlingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.SailfishEdgeUsedDataHandlingPass
Default constructor.
SailfishPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.composite
A series of passes to support Sailfish-like disk seek batching during shuffle.
SailfishPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.composite.SailfishPass
Default constructor.
SailfishPolicy - Class in edu.snu.nemo.compiler.optimizer.policy
A policy to demonstrate the Sailfish optimization, that batches disk seek during data shuffle.
SailfishPolicy() - Constructor for class edu.snu.nemo.compiler.optimizer.policy.SailfishPolicy
Default constructor.
SailfishRelayReshapingPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping
Pass to modify the DAG for a job to batch the disk seek.
SailfishRelayReshapingPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.reshaping.SailfishRelayReshapingPass
Default constructor.
sample(boolean, double) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
sample(boolean, double, long) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
sample(boolean, double) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sample(boolean, double, long) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
saveAsObjectFile(String) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
saveAsTextFile(String) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
saveAsTextFile(String, Class<? extends CompressionCodec>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
ScheduledTaskGroup - Class in edu.snu.nemo.runtime.common.plan.physical
A ScheduledTaskGroup is a grouping of Task that belong to a stage.
ScheduledTaskGroup(String, byte[], String, List<PhysicalStageEdge>, List<PhysicalStageEdge>, int, String, Map<String, Readable>) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.ScheduledTaskGroup
Constructor.
ScheduleGroupIndexProperty - Class in edu.snu.nemo.common.ir.vertex.executionproperty
ScheduleGroupIndex ExecutionProperty.
ScheduleGroupPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass for assigning each stages in schedule groups.
ScheduleGroupPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ScheduleGroupPass
Default constructor.
scheduleJob(PhysicalPlan, JobStateManager) - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
Receives a job to schedule.
scheduleJob(PhysicalPlan, JobStateManager) - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
Schedules the given job.
scheduleJob(JobStateManager) - Method in class edu.snu.nemo.runtime.master.scheduler.SchedulerRunner
 
Scheduler - Interface in edu.snu.nemo.runtime.master.scheduler
Receives jobs to execute and schedules ScheduledTaskGroup to executors.
SchedulerRunner - Class in edu.snu.nemo.runtime.master.scheduler
Takes a TaskGroup from the pending queue and schedules it to an executor.
SchedulerRunner(SchedulingPolicy, PendingTaskGroupQueue) - Constructor for class edu.snu.nemo.runtime.master.scheduler.SchedulerRunner
 
SchedulerTimeoutMs() - Constructor for class edu.snu.nemo.conf.JobConf.SchedulerTimeoutMs
 
ScheduleSerThread() - Constructor for class edu.snu.nemo.conf.JobConf.ScheduleSerThread
 
scheduleTaskGroup(ScheduledTaskGroup, JobStateManager) - Method in class edu.snu.nemo.runtime.master.scheduler.RoundRobinSchedulingPolicy
 
scheduleTaskGroup(ScheduledTaskGroup, JobStateManager) - Method in interface edu.snu.nemo.runtime.master.scheduler.SchedulingPolicy
Attempts to schedule the given taskGroup to an executor according to this policy.
SchedulingException - Exception in edu.snu.nemo.common.exception
SchedulingException.
SchedulingException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.SchedulingException
SchedulingException.
SchedulingPolicy - Interface in edu.snu.nemo.runtime.master.scheduler
Defines the policy by which BatchSingleJobScheduler assigns task groups to executors.
schema(StructType) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
select(Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
select(Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
select(String, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
select(String, String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
select(TypedColumn<T, U1>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
selectExpr(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
selectExpr(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
send(T) - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageSender
 
send(T) - Method in interface edu.snu.nemo.runtime.common.message.MessageSender
Send a message to corresponding MessageListener.onMessage(T).
send(String, String) - Method in class edu.snu.nemo.runtime.executor.MetricManagerWorker
 
send(String, String) - Method in interface edu.snu.nemo.runtime.executor.MetricMessageSender
 
sendControlMessage(ControlMessage.Message) - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
SenderId() - Constructor for class edu.snu.nemo.runtime.common.message.MessageParameters.SenderId
 
SerializedDAG() - Constructor for class edu.snu.nemo.conf.JobConf.SerializedDAG
 
SerializedMemoryBlock<K extends Serializable> - Class in edu.snu.nemo.runtime.executor.data.block
This class represents a block which is serialized and stored in local memory.
SerializedMemoryBlock(Serializer) - Constructor for class edu.snu.nemo.runtime.executor.data.block.SerializedMemoryBlock
Constructor.
SerializedMemoryStore - Class in edu.snu.nemo.runtime.executor.data.stores
Serialize and store data in local memory.
SerializedPartition<K> - Class in edu.snu.nemo.runtime.executor.data
A collection of data elements.
SerializedPartition(K, long, byte[], int) - Constructor for class edu.snu.nemo.runtime.executor.data.SerializedPartition
Creates a serialized Partition having a specific key value.
serializePartition(Coder, NonSerializedPartition, OutputStream) - Static method in class edu.snu.nemo.runtime.executor.data.DataUtil
Serializes the elements in a non-serialized partition into an output stream.
Serializer<T> - Class in edu.snu.nemo.runtime.executor.data.streamchainer
class that contains Coder and List of StreamChainer.
Serializer(Coder<T>, List<StreamChainer>) - Constructor for class edu.snu.nemo.runtime.executor.data.streamchainer.Serializer
Constructor.
SerializerManager - Class in edu.snu.nemo.runtime.executor.data
Mapping from RuntimeEdgeId to Coder.
SerializerManager() - Constructor for class edu.snu.nemo.runtime.executor.data.SerializerManager
Constructor.
setAge(int) - Method in class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample.Person
Setter.
setCapacity(int) - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification.Builder
 
setChannelError(Throwable) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
Sets exception.
setCoder(Coder) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for coder.
setCommitted(boolean) - Method in class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Set the commit value.
setContainerType(String) - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification.Builder
 
setCount(long) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Setter.
setDAGSnapshot(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.common.ir.vertex.MetricCollectionBarrierVertex
This is to set the DAG snapshot at the end of the DataSkewCompositePass.
setDstStage(Stage) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for the destination stage.
setDstVertex(IRVertex) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for the destination vertex.
setEdgeProperties(ExecutionPropertyMap) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for edge properties.
setGroupSize(int) - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Set the group size.
setInDriver() - Static method in class edu.snu.nemo.common.ir.IdManager
Set the realm of the loaded class as REEF driver.
setInitialState(Enum) - Method in class edu.snu.nemo.common.StateMachine.Builder
 
setIsUserTriggered(boolean) - Method in interface edu.snu.nemo.compiler.frontend.spark.sql.NemoSparkUserFacingClass
Set the userTriggered flag.
setIsUserTriggered(boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
setMaxNumberOfIterations(Integer) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Set the maximum number of iterations.
setMemory(int) - Method in class edu.snu.nemo.runtime.master.resource.ResourceSpecification.Builder
 
setName(String) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
setName(String) - Method in class edu.snu.nemo.examples.spark.sql.JavaSparkSQLExample.Person
Setter.
setName(String) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Employee
Setter.
setProperty(ExecutionProperty<?>) - Method in class edu.snu.nemo.common.ir.edge.IREdge
Set an executionProperty of the IREdge.
setProperty(ExecutionProperty<?>) - Method in class edu.snu.nemo.common.ir.vertex.IRVertex
Set an executionProperty of the IRVertex.
setReadable(Readable<O>) - Method in class edu.snu.nemo.runtime.common.plan.physical.BoundedSourceTask
Sets the readable for this task.
setRepresentativeEdgeId(String) - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
Set physical edge id.
setSalary(long) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Employee
Setter.
setScheduler(Scheduler) - Method in class edu.snu.nemo.runtime.master.eventhandler.UpdatePhysicalPlanEventHandler
 
setSideInputFlag(Boolean) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for side input flag.
setSrcStage(Stage) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for the source stage.
setSrcVertex(IRVertex) - Method in class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Setter for the source vertex.
setState(Enum) - Method in class edu.snu.nemo.common.StateMachine
Sets the current state as a certain state.
setStreamChainers(List<StreamChainer>) - Method in class edu.snu.nemo.runtime.executor.data.streamchainer.Serializer
method that sets list of StreamChainer.
setSum(long) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.Average
Setter.
setTaskGroupIdxToKeyRange(List<KeyRange>) - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalStageEdge
Sets the task group idx to key range list.
setTerminationCondition(IntPredicate) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Set the intPredicate termination condition for the LoopVertex.
setupListener(String, MessageListener<T>) - Method in class edu.snu.nemo.runtime.common.message.grpc.GrpcMessageEnvironment
 
setupListener(String, MessageListener<T>) - Method in class edu.snu.nemo.runtime.common.message.local.LocalMessageEnvironment
 
setupListener(String, MessageListener<T>) - Method in interface edu.snu.nemo.runtime.common.message.MessageEnvironment
Set up a MessageListener with a listener id.
setupListener(String, MessageListener<T>) - Method in class edu.snu.nemo.runtime.common.message.ncs.NcsMessageEnvironment
 
ShuffleEdgePushPass - Class in edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating
A pass for tagging shuffle edges different from the default ones.
ShuffleEdgePushPass() - Constructor for class edu.snu.nemo.compiler.optimizer.pass.compiletime.annotating.ShuffleEdgePushPass
Default constructor.
shutDown() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
SingleJobTaskGroupQueue - Class in edu.snu.nemo.runtime.master.scheduler
Keep tracks of all pending task groups.
SingleJobTaskGroupQueue() - Constructor for class edu.snu.nemo.runtime.master.scheduler.SingleJobTaskGroupQueue
 
sort(Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sort(Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sort(String, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sort(String, String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sortBy(Function<T, S>, boolean, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
sortWithinPartitions(Column...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sortWithinPartitions(Seq<Column>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sortWithinPartitions(String, Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sortWithinPartitions(String, String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
SourceVertex<O> - Class in edu.snu.nemo.common.ir.vertex
IRVertex that reads data from an external source.
SourceVertex() - Constructor for class edu.snu.nemo.common.ir.vertex.SourceVertex
 
SparkBoundedSourceVertex<T> - Class in edu.snu.nemo.compiler.frontend.spark.source
Bounded source vertex for Spark.
SparkBoundedSourceVertex(SparkSession, Dataset<T>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.source.SparkBoundedSourceVertex
Constructor.
SparkBoundedSourceVertex(List<Readable<T>>) - Constructor for class edu.snu.nemo.compiler.frontend.spark.source.SparkBoundedSourceVertex
Constructor.
SparkCoder<T> - Class in edu.snu.nemo.compiler.frontend.spark.coder
Kryo Spark Coder for serialization.
SparkCoder(Serializer) - Constructor for class edu.snu.nemo.compiler.frontend.spark.coder.SparkCoder
Default constructor.
SparkFrontendUtils - Class in edu.snu.nemo.compiler.frontend.spark.core.java
Utility class for RDDs.
SparkKeyExtractor - Class in edu.snu.nemo.compiler.frontend.spark
Extracts the key from a KV element.
SparkKeyExtractor() - Constructor for class edu.snu.nemo.compiler.frontend.spark.SparkKeyExtractor
 
sparkSession() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
sparkSession() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
sparkSession() - Method in interface edu.snu.nemo.compiler.frontend.spark.sql.NemoSparkUserFacingClass
 
SparkSession - Class in edu.snu.nemo.compiler.frontend.spark.sql
A simple version of the Spark session, containing SparkContext that contains SparkConf.
sparkSession() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
SparkSession.Builder - Class in edu.snu.nemo.compiler.frontend.spark.sql
Spark Session Builder.
sql(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
Stage - Class in edu.snu.nemo.runtime.common.plan.stage
Represents a stage in Runtime's execution of a job.
Stage(String, DAG<IRVertex, IREdge>, int) - Constructor for class edu.snu.nemo.runtime.common.plan.stage.Stage
Constructor.
StageBuilder - Class in edu.snu.nemo.runtime.common.plan.stage
Stage Builder.
StageBuilder(Integer, int) - Constructor for class edu.snu.nemo.runtime.common.plan.stage.StageBuilder
Builds a Stage.
StageEdge - Class in edu.snu.nemo.runtime.common.plan.stage
Stage Edge.
StageEdge(String, ExecutionPropertyMap, Stage, Stage, Coder, Boolean, IRVertex, IRVertex) - Constructor for class edu.snu.nemo.runtime.common.plan.stage.StageEdge
Represents the edge between stages.
StageEdgeBuilder - Class in edu.snu.nemo.runtime.common.plan.stage
Stage Edge Builder.
StageEdgeBuilder(String) - Constructor for class edu.snu.nemo.runtime.common.plan.stage.StageEdgeBuilder
Represents the edge between vertices in a logical plan.
StageIdProperty - Class in edu.snu.nemo.common.ir.vertex.executionproperty
StageId ExecutionProperty.
stagePartitionIrDAG(DAG<IRVertex, IREdge>) - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlanGenerator
We take the stage-partitioned DAG and create actual stage and stage edge objects to create a DAG of stages.
StageState - Class in edu.snu.nemo.runtime.common.state
Represents the states and their transitions of a PhysicalStage.
StageState() - Constructor for class edu.snu.nemo.runtime.common.state.StageState
 
StageState.State - Enum in edu.snu.nemo.runtime.common.state
StageState.
StartHandler() - Constructor for class edu.snu.nemo.driver.NemoDriver.StartHandler
 
StateMachine - Class in edu.snu.nemo.common
A finite state machine that can be created with user defined states and transitions.
StateMachine.Builder - Class in edu.snu.nemo.common
Builder that builds a StateMachine.
StateTranslator - Interface in edu.snu.nemo.client
A class provides the translation between the state of job and corresponding ClientEndpoint.
storeJSON(String, String, String) - Method in class edu.snu.nemo.common.dag.DAG
Stores JSON representation of this DAG into a file.
storeJSON(String, String) - Method in class edu.snu.nemo.runtime.master.JobStateManager
Stores JSON representation of job state into a file.
StreamChainer - Interface in edu.snu.nemo.runtime.executor.data.streamchainer
A StreamChainer object indicates each stream manipulation strategy.
structuralValue(Pair<A, B>) - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 

T

table(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
table(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.SparkSession
 
take(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
take() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ClosableBlockingQueue
Retrieves and removes the head of this queue, waiting if necessary.
takeAsync(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
takeOrdered(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
takeOrdered(int, Comparator<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
takeSample(boolean, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
takeSample(boolean, int, long) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
Task - Class in edu.snu.nemo.runtime.common.plan.physical
Task.
Task(String, String) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.Task
Constructor.
TaskGroupExecutor - Class in edu.snu.nemo.runtime.executor
Executes a task group.
TaskGroupExecutor(ScheduledTaskGroup, DAG<Task, RuntimeEdge<Task>>, TaskGroupStateManager, DataTransferFactory, MetricMessageSender) - Constructor for class edu.snu.nemo.runtime.executor.TaskGroupExecutor
 
TaskGroupState - Class in edu.snu.nemo.runtime.common.state
Represents the states and their transitions of a ScheduledTaskGroup.
TaskGroupState() - Constructor for class edu.snu.nemo.runtime.common.state.TaskGroupState
 
TaskGroupState.RecoverableFailureCause - Enum in edu.snu.nemo.runtime.common.state
Causes of a recoverable failure.
TaskGroupState.State - Enum in edu.snu.nemo.runtime.common.state
TaskGroupState.
TaskGroupStateManager - Class in edu.snu.nemo.runtime.executor
Manages the states related to a task group.
TaskGroupStateManager(ScheduledTaskGroup, DAG<Task, RuntimeEdge<Task>>, String, PersistentConnectionToMasterMap, MetricMessageSender) - Constructor for class edu.snu.nemo.runtime.executor.TaskGroupStateManager
 
TaskState - Class in edu.snu.nemo.runtime.common.state
Represents the states and their transitions of a Task.
TaskState() - Constructor for class edu.snu.nemo.runtime.common.state.TaskState
 
TaskState.State - Enum in edu.snu.nemo.runtime.common.state
TaskState.
terminate() - Method in class edu.snu.nemo.runtime.executor.Executor
 
terminate() - Method in class edu.snu.nemo.runtime.master.MetricManagerMaster
 
terminate() - Method in interface edu.snu.nemo.runtime.master.MetricMessageHandler
Cleans up and terminates this handler.
terminate() - Method in class edu.snu.nemo.runtime.master.resource.ContainerManager
Terminates ContainerManager.
terminate() - Method in class edu.snu.nemo.runtime.master.RuntimeMaster
 
terminate() - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
 
terminate() - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
To be called when a job should be terminated.
terminate() - Method in class edu.snu.nemo.runtime.master.scheduler.SchedulerRunner
 
text(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
text(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
text(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
textFile(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
textFile(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
textFile(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.DataFrameReader
 
toDebugString() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
toDF() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
toDF(Seq<String>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
toDF(String...) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
toJavaRDD() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
toJSON() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
toJson() - Method in class edu.snu.nemo.runtime.common.metric.MetricData
 
toLocalIterator() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
top(int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
top(int, Comparator<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
topologicalDo(Consumer<V>) - Method in class edu.snu.nemo.common.dag.DAG
Applies the function to each node in the DAG in a topological order.
toString() - Method in class edu.snu.nemo.common.coder.Coder.DummyCoder
 
toString() - Method in class edu.snu.nemo.common.dag.DAG
 
toString() - Method in class edu.snu.nemo.common.ir.edge.executionproperty.DuplicateEdgeGroupPropertyValue
 
toString() - Method in class edu.snu.nemo.common.ir.executionproperty.ExecutionPropertyMap
 
toString() - Method in class edu.snu.nemo.common.ir.vertex.transform.RelayTransform
 
toString() - Method in class edu.snu.nemo.common.Pair
 
toString() - Method in class edu.snu.nemo.common.StateMachine
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.coder.BeamCoder
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.CreateViewTransform
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.DoTransform
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.FlattenTransform
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.GroupByKeyTransform
 
toString() - Method in class edu.snu.nemo.compiler.frontend.beam.transform.WindowTransform
 
toString() - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptySourceVertex
 
toString() - Method in class edu.snu.nemo.compiler.optimizer.examples.EmptyComponents.EmptyTransform
 
toString() - Method in class edu.snu.nemo.runtime.common.data.HashRange
This method should be overridden for a readable representation of KeyRange.
toString() - Method in interface edu.snu.nemo.runtime.common.data.KeyRange
This method should be overridden for a readable representation of KeyRange.
toString() - Method in class edu.snu.nemo.runtime.common.plan.physical.PhysicalPlan
 
toString() - Method in class edu.snu.nemo.runtime.common.state.BlockState
 
toString() - Method in class edu.snu.nemo.runtime.common.state.JobState
 
toString() - Method in class edu.snu.nemo.runtime.common.state.StageState
 
toString() - Method in class edu.snu.nemo.runtime.common.state.TaskGroupState
 
toString() - Method in class edu.snu.nemo.runtime.common.state.TaskState
 
toString() - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteTransferContext
 
toString() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
toString() - Method in class edu.snu.nemo.runtime.master.resource.ExecutorRepresenter
 
toStringWithPhysicalPlan() - Method in class edu.snu.nemo.runtime.master.JobStateManager
 
TrainingDataCombiner() - Constructor for class edu.snu.nemo.examples.beam.AlternatingLeastSquare.TrainingDataCombiner
 
Transform<I,O> - Interface in edu.snu.nemo.common.ir.vertex.transform
Interface for specifying 'What' to do with data.
transform(Function1<Dataset<T>, Dataset<U>>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
Transform.Context - Interface in edu.snu.nemo.common.ir.vertex.transform
Context of the transform.
TRANSIENT - Static variable in class edu.snu.nemo.common.ir.vertex.executionproperty.ExecutorPlacementProperty
 
translateState(JobState.State) - Method in interface edu.snu.nemo.client.StateTranslator
Translate a job state of nemo to a corresponding client endpoint state.
translateState(JobState.State) - Method in class edu.snu.nemo.compiler.frontend.beam.BeamStateTranslator
Translate a job state of nemo to a corresponding Beam state.
treeAggregate(U, Function2<U, T, U>, Function2<U, U, U>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
treeAggregate(U, Function2<U, T, U>, Function2<U, U, U>, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
treeReduce(Function2<T, T, T>) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
treeReduce(Function2<T, T, T>, int) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 

U

UnboundedSourceTask - Class in edu.snu.nemo.runtime.common.plan.physical
UnboundedSourceTask.
UnboundedSourceTask(String, String) - Constructor for class edu.snu.nemo.runtime.common.plan.physical.UnboundedSourceTask
Constructor.
UngroupSingleVectorList() - Constructor for class edu.snu.nemo.examples.beam.AlternatingLeastSquare.UngroupSingleVectorList
 
union(Dataset<T>) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
UnknownExecutionStateException - Exception in edu.snu.nemo.common.exception
UnknownExecutionStateException.
UnknownExecutionStateException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnknownExecutionStateException
UnknownExecutionStateException.
UnknownFailureCauseException - Exception in edu.snu.nemo.common.exception
UnknownFailureCauseException.
UnknownFailureCauseException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnknownFailureCauseException
UnknownFailureCauseException.
unpersist() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
unpersist(boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
unpersist() - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
unpersist(boolean) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
UnrecoverableFailureException - Exception in edu.snu.nemo.common.exception
UnrecoverableFailureException.
UnrecoverableFailureException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnrecoverableFailureException
UnrecoverableFailureException.
unRollIteration(DAGBuilder<IRVertex, IREdge>) - Method in class edu.snu.nemo.common.ir.vertex.LoopVertex
Method for unrolling an iteration of the LoopVertex.
UnsupportedBlockStoreException - Exception in edu.snu.nemo.common.exception
UnsupportedBlockStoreException.
UnsupportedBlockStoreException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedBlockStoreException
UnsupportedBlockStoreException.
UnsupportedCommPatternException - Exception in edu.snu.nemo.common.exception
UnsupportedCommPatternException.
UnsupportedCommPatternException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedCommPatternException
UnsupportedCommPatternException.
UnsupportedCompressionException - Exception in edu.snu.nemo.common.exception
UnsupportedCompressionException Thrown when the compression method is not supported.
UnsupportedCompressionException(String) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedCompressionException
Constructor.
UnsupportedExecutionPropertyException - Exception in edu.snu.nemo.common.exception
UnsupportedExecutionPropertyException.
UnsupportedExecutionPropertyException(String) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedExecutionPropertyException
UnsupportedExecutionPropertyException.
UnsupportedMethodException - Exception in edu.snu.nemo.common.exception
UnsupportedMethodException.
UnsupportedMethodException(String) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedMethodException
UnsupportedMethodException.
UnsupportedPartitionerException - Exception in edu.snu.nemo.common.exception
UnsupportedPartitionerException.
UnsupportedPartitionerException(Throwable) - Constructor for exception edu.snu.nemo.common.exception.UnsupportedPartitionerException
UnsupportedPartitionerException.
update(MutableAggregationBuffer, Row) - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedUntypedAggregation.MyAverage
Updates the given aggregation buffer `buffer` with new input data from `input`.
updateJob(String, PhysicalPlan, Pair<String, String>) - Method in class edu.snu.nemo.runtime.master.scheduler.BatchSingleJobScheduler
 
updateJob(String, PhysicalPlan, Pair<String, String>) - Method in interface edu.snu.nemo.runtime.master.scheduler.Scheduler
Receives and updates the scheduler with a new physical plan for a job.
UpdatePhysicalPlanEvent - Class in edu.snu.nemo.runtime.common.eventhandler
An event for updating the physical plan in the scheduler.
UpdatePhysicalPlanEventHandler - Class in edu.snu.nemo.runtime.master.eventhandler
Class for handling event to update physical plan to the scheduler.
UsedDataHandlingProperty - Class in edu.snu.nemo.common.ir.edge.executionproperty
UsedDataHandling ExecutionProperty.
UsedDataHandlingProperty.Value - Enum in edu.snu.nemo.common.ir.edge.executionproperty
Possible values of UsedDataHandling ExecutionProperty.
UserApplicationRunner - Class in edu.snu.nemo.driver
Compiles and runs User application.
UserMainArguments() - Constructor for class edu.snu.nemo.conf.JobConf.UserMainArguments
 
UserMainClass() - Constructor for class edu.snu.nemo.conf.JobConf.UserMainClass
 

V

valueOf(String) - Static method in enum edu.snu.nemo.common.dag.DAG.TraversalOrder
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.CompressionProperty.Compression
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataCommunicationPatternProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataFlowModelProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataStoreProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.MetricCollectionProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.PartitionerProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.UsedDataHandlingProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.executionproperty.ExecutionProperty.Key
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.common.ir.vertex.executionproperty.DynamicOptimizationProperty.Value
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.BlockState.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.JobState.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.StageState.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.TaskGroupState.RecoverableFailureCause
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.TaskGroupState.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum edu.snu.nemo.runtime.common.state.TaskState.State
Returns the enum constant of this type with the specified name.
values() - Static method in enum edu.snu.nemo.common.dag.DAG.TraversalOrder
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.CompressionProperty.Compression
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataCommunicationPatternProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataFlowModelProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.DataStoreProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.MetricCollectionProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.PartitionerProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.edge.executionproperty.UsedDataHandlingProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.executionproperty.ExecutionProperty.Key
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.common.ir.vertex.executionproperty.DynamicOptimizationProperty.Value
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.BlockState.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.JobState.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.StageState.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.TaskGroupState.RecoverableFailureCause
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.TaskGroupState.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum edu.snu.nemo.runtime.common.state.TaskState.State
Returns an array containing the constants of this enum type, in the order they are declared.
verifyDeterministic() - Method in class edu.snu.nemo.compiler.frontend.beam.coder.PairCoder
 
Vertex - Class in edu.snu.nemo.common.dag
A vertex in DAG.
Vertex(String) - Constructor for class edu.snu.nemo.common.dag.Vertex
 
visitPrimitiveTransform(TransformHierarchy.Node) - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineVisitor
 

W

waitUntilFinish(Duration) - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
 
waitUntilFinish() - Method in class edu.snu.nemo.compiler.frontend.beam.NemoPipelineResult
 
waitUntilFinish() - Method in class edu.snu.nemo.runtime.master.JobStateManager
Wait for this job to be finished and return the final state.
waitUntilFinish(long, TimeUnit) - Method in class edu.snu.nemo.runtime.master.JobStateManager
Wait for this job to be finished and return the final state.
waitUntilJobFinish(long, TimeUnit) - Method in class edu.snu.nemo.client.ClientEndpoint
Wait for this job to be finished (complete or failed) and return the final state.
waitUntilJobFinish() - Method in class edu.snu.nemo.client.ClientEndpoint
Wait for this job to be finished and return the final state.
where(Column) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
where(String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
WindowTransform<T> - Class in edu.snu.nemo.compiler.frontend.beam.transform
Windowing transform implementation.
WindowTransform(WindowFn) - Constructor for class edu.snu.nemo.compiler.frontend.beam.transform.WindowTransform
Default Constructor.
withColumn(String, Column) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
withColumnRenamed(String, String) - Method in class edu.snu.nemo.compiler.frontend.spark.sql.Dataset
 
write(int) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream
 
write(byte[], int, int) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream
 
write(Iterable) - Method in class edu.snu.nemo.runtime.executor.datatransfer.OutputWriter
Writes output data depending on the communication pattern of the edge.
writeFileArea(FileArea) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream
Writes a data frame from FileArea.
writePartitionMetadata(K, int, long) - Method in class edu.snu.nemo.runtime.executor.data.metadata.FileMetadata
Writes the metadata for a partition.
writeSerializedPartition(SerializedPartition) - Method in class edu.snu.nemo.runtime.executor.bytetransfer.ByteOutputContext.ByteOutputStream

Z

zero() - Method in class edu.snu.nemo.examples.spark.sql.JavaUserDefinedTypedAggregation.MyAverage
A zero value for this aggregation.
zipWithIndex() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
zipWithUniqueId() - Method in class edu.snu.nemo.compiler.frontend.spark.core.java.JavaRDD
 
A B C D E F G H I J K L M N O P Q R S T U V W Z 
Skip navigation links

Copyright © 2018. All rights reserved.