Package org.apache.nemo.compiler.frontend.beam

Class PipelineVisitor

  • All Implemented Interfaces:
    org.apache.beam.sdk.Pipeline.PipelineVisitor
    public final class PipelineVisitor
extends org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults
    Uses the translator and the context to build a Nemo IR DAG. - Translator: Translates each PTransform, and lets us know whether or not to enter into a composite PTransform. - Context: The translator builds a DAG in the context.

    • Nested Class Summary

      • Nested classes/interfaces inherited from interface org.apache.beam.sdk.Pipeline.PipelineVisitor

        org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior, org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)  
      IRDAG getConvertedPipeline()  
      void leaveCompositeTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)  
      void visitPrimitiveTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)  

      • Methods inherited from class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

        enterPipeline, getPipeline, leavePipeline, visitValue

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • PipelineVisitor

        public PipelineVisitor​(org.apache.beam.sdk.Pipeline pipeline,
                       NemoPipelineOptions pipelineOptions)
        Parameters:
        pipeline - to visit.
        pipelineOptions - pipeline options.

    • Method Detail

      • visitPrimitiveTransform

        public void visitPrimitiveTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
        Specified by:
        visitPrimitiveTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor
        Overrides:
        visitPrimitiveTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

      • enterCompositeTransform

        public org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
        Specified by:
        enterCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor
        Overrides:
        enterCompositeTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

      • leaveCompositeTransform

        public void leaveCompositeTransform​(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
        Specified by:
        leaveCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor
        Overrides:
        leaveCompositeTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

      • getConvertedPipeline

        public IRDAG getConvertedPipeline()
        Returns:
        the converted pipeline.