Package org.apache.nemo.conf

Class JobConf

java.lang.Object

org.apache.reef.tang.formats.ConfigurationModuleBuilder

org.apache.nemo.conf.JobConf

public final class JobConf
extends org.apache.reef.tang.formats.ConfigurationModuleBuilder

Job Configurations.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	JobConf.BandwidthJSONContents	Contents of the JSON file that specifies bandwidth between locations.
class	JobConf.BandwidthJSONPath	Path to the JSON file that specifies bandwidth between locations.
class	JobConf.ChunkSizeKb	MemoryChunk size in the memory pool.
class	JobConf.ClientSideRPCServerHost	Host of the client-side RPC server.
class	JobConf.ClientSideRPCServerPort	Port of the client-side RPC server.
class	JobConf.DAGDirectory	Directory to store JSON representation of intermediate DAGs.
class	JobConf.DBAddress	Address pointing to the DB for saving metrics.
class	JobConf.DBEnabled	Specified whether or not to enable writing metrics to DB or not.
class	JobConf.DBId	ID for the pointed DB address for saving metrics.
class	JobConf.DBPasswd	Password for the pointed DB address for saving metrics.
class	JobConf.DeployMode	Deploy mode.
class	JobConf.DriverMemMb	Nemo driver memory.
class	JobConf.EnvironmentType	Specifies the type of the environment the workload runs on.
class	JobConf.ExecutorId	Executor id.
class	JobConf.ExecutorJSONContents	Contents of the JSON file that specifies resource layout.
class	JobConf.ExecutorJSONPath	Path to the JSON file that specifies resource layout.
class	JobConf.ExecutorMemoryMb	The size of total memory in the executor.
class	JobConf.ExecutorPoisonSec	Used for fault-injected tests.
class	JobConf.ExecutorType	Executor type: lambda: Nemo will use lambda executor.
class	JobConf.FileDirectory	Directory to store files for storing blocks.
class	JobConf.GlusterVolumeDirectory	Directory points the mounted GlusterFS volume to store files in remote fashion.
class	JobConf.IORequestHandleThreadsTotal	Number of I/O threads for block fetch requests from other executor.
class	JobConf.JobId	Job id.
class	JobConf.JVMHeapSlack	The fraction of container memory not to use fo the JVM heap.
class	JobConf.LatencyMarkPeriod	Period how often latencymarks are sent from source vertex.
class	JobConf.MaxNumDownloadsForARuntimeEdge	Maximum number of parallel downloads for a runtime edge.
class	JobConf.MaxOffheapRatio	Maximum off-heap memory ratio to the total memory in the executor.
class	JobConf.MaxTaskAttempt	Max number of attempts for task scheduling.
class	JobConf.OptimizationPolicy	The name of the optimization policy.
class	JobConf.PartitionTransportClientNumThreads	The number of threads of block transfer client.
class	JobConf.PartitionTransportServerBacklog	The maximum length which the pending connection queue of block transfer may grow to.
class	JobConf.PartitionTransportServerNumListeningThreads	The number of listening threads of block transfer server.
class	JobConf.PartitionTransportServerNumWorkingThreads	The number of block transfer server threads which work on accepted connections.
class	JobConf.PartitionTransportServerPort	The TCP port to which local block transfer binds.
class	JobConf.SchedulerImplClassName	Scheduler impl.
class	JobConf.ScheduleSerThread	The number of serialization threads for scheduling.
class	JobConf.StreamMetricPeriod	Period how often stream metrics are recorded.
class	JobConf.UserMainArguments	User Main Arguments.
class	JobConf.UserMainClass	User Main Class Name.

Field Summary

Fields

Modifier and Type	Field	Description
static org.apache.reef.tang.formats.ConfigurationModule	EXECUTOR_CONF
static org.apache.reef.tang.formats.RequiredParameter<java.lang.String>	EXECUTOR_ID
static org.apache.reef.tang.formats.OptionalParameter<java.lang.String>	GLUSTER_DISK_DIRECTORY
static org.apache.reef.tang.formats.RequiredParameter<java.lang.String>	JOB_ID
static org.apache.reef.tang.formats.OptionalParameter<java.lang.Integer>	LATENCYMARK_PERIOD
static org.apache.reef.tang.formats.OptionalParameter<java.lang.String>	LOCAL_DISK_DIRECTORY
static org.apache.reef.tang.formats.OptionalParameter<java.lang.Integer>	STREAM_METRIC_PERIOD

Fields inherited from class org.apache.reef.tang.formats.ConfigurationModuleBuilder

b, freeImpls, freeParams, map, reqDecl, setOpts

Constructor Summary

Constructors

Constructor	Description
JobConf()

Method Summary

Methods inherited from class org.apache.reef.tang.formats.ConfigurationModuleBuilder

bind, bindConstructor, bindConstructor, bindImplementation, bindImplementation, bindImplementation, bindList, bindList, bindList, bindNamedParameter, bindNamedParameter, bindNamedParameter, bindNamedParameter, bindSetEntry, bindSetEntry, bindSetEntry, bindSetEntry, build, merge

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EXECUTOR_ID

public static final org.apache.reef.tang.formats.RequiredParameter<java.lang.String> EXECUTOR_ID

JOB_ID

public static final org.apache.reef.tang.formats.RequiredParameter<java.lang.String> JOB_ID

STREAM_METRIC_PERIOD

public static final org.apache.reef.tang.formats.OptionalParameter<java.lang.Integer> STREAM_METRIC_PERIOD

LATENCYMARK_PERIOD

public static final org.apache.reef.tang.formats.OptionalParameter<java.lang.Integer> LATENCYMARK_PERIOD

LOCAL_DISK_DIRECTORY

public static final org.apache.reef.tang.formats.OptionalParameter<java.lang.String> LOCAL_DISK_DIRECTORY

GLUSTER_DISK_DIRECTORY

public static final org.apache.reef.tang.formats.OptionalParameter<java.lang.String> GLUSTER_DISK_DIRECTORY

EXECUTOR_CONF

public static final org.apache.reef.tang.formats.ConfigurationModule EXECUTOR_CONF

Constructor Detail

JobConf

public JobConf()