Package org.apache.nemo.examples.beam

Class WriteOneFilePerWindow.PerWindowFiles

  • All Implemented Interfaces:
    java.io.Serializable
    Enclosing class:
    WriteOneFilePerWindow
    public static final class WriteOneFilePerWindow.PerWindowFiles
extends org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy
    A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written. This always includes the shard number and the total number of shards. For windowed writes, it also includes the window and pane index (a sequence number assigned to each trigger firing).
    See Also:
    Serialized Form

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.io.fs.ResourceId unwindowedFilename​(int shardNumber, int numShards, org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)  
      org.apache.beam.sdk.io.fs.ResourceId windowedFilename​(int shardNumber, int numShards, org.apache.beam.sdk.transforms.windowing.BoundedWindow window, org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo, org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)  

      • Methods inherited from class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

        populateDisplayData

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Method Detail

      • windowedFilename

        public org.apache.beam.sdk.io.fs.ResourceId windowedFilename​(int shardNumber,
                                                             int numShards,
                                                             org.apache.beam.sdk.transforms.windowing.BoundedWindow window,
                                                             org.apache.beam.sdk.transforms.windowing.PaneInfo paneInfo,
                                                             org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)
        Specified by:
        windowedFilename in class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy

      • unwindowedFilename

        public org.apache.beam.sdk.io.fs.ResourceId unwindowedFilename​(int shardNumber,
                                                               int numShards,
                                                               org.apache.beam.sdk.io.FileBasedSink.OutputFileHints outputFileHints)
        Specified by:
        unwindowedFilename in class org.apache.beam.sdk.io.FileBasedSink.FilenamePolicy