Package org.apache.nemo.runtime.executor.data

Class DataUtil.InputStreamIterator<T>

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      long getCurrNumEncodedBytes()
      This method can be called before the every actual data completely taken from iterator, When the every actual data completely taken from iterator, its return value must be same with a return value of getNumSerializedBytes().
      long getCurrNumSerializedBytes()
      This method can be called before the every actual data completely taken from iterator, When the every actual data completely taken from iterator, its return value must be same with a return value of getNumSerializedBytes().
      long getNumEncodedBytes()
      This method should be called after the actual data is taken out of iterator, since the existence of an iterator does not guarantee that data inside it is ready.
      long getNumSerializedBytes()
      This method should be called after the actual data is taken out of iterator, since the existence of an iterator does not guarantee that data inside it is ready.
      boolean hasNext()  
      boolean isReadNotSerializedData()  
      T next()  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface java.util.Iterator

        forEachRemaining, remove

    • Method Detail

      • hasNext

        public boolean hasNext()
        Specified by:
        hasNext in interface java.util.Iterator<T>

      • next

        public T next()
        Specified by:
        next in interface java.util.Iterator<T>

      • getNumSerializedBytes

        public long getNumSerializedBytes()
        Description copied from interface: DataUtil.IteratorWithNumBytes
        This method should be called after the actual data is taken out of iterator, since the existence of an iterator does not guarantee that data inside it is ready.
        Specified by:
        getNumSerializedBytes in interface DataUtil.IteratorWithNumBytes<T>
        Returns:
        the number of bytes in serialized form (which is, for example, encoded and compressed)

      • getNumEncodedBytes

        public long getNumEncodedBytes()
        Description copied from interface: DataUtil.IteratorWithNumBytes
        This method should be called after the actual data is taken out of iterator, since the existence of an iterator does not guarantee that data inside it is ready.
        Specified by:
        getNumEncodedBytes in interface DataUtil.IteratorWithNumBytes<T>
        Returns:
        the number of bytes in encoded form (which is ready to be decoded)

      • getCurrNumSerializedBytes

        public long getCurrNumSerializedBytes()
        Description copied from interface: DataUtil.IteratorWithNumBytes
        This method can be called before the every actual data completely taken from iterator, When the every actual data completely taken from iterator, its return value must be same with a return value of getNumSerializedBytes().
        Specified by:
        getCurrNumSerializedBytes in interface DataUtil.IteratorWithNumBytes<T>
        Returns:
        the number of currently read bytes in serialized form (which is, for example, encoded and compressed)

      • getCurrNumEncodedBytes

        public long getCurrNumEncodedBytes()
        Description copied from interface: DataUtil.IteratorWithNumBytes
        This method can be called before the every actual data completely taken from iterator, When the every actual data completely taken from iterator, its return value must be same with a return value of getNumSerializedBytes().
        Specified by:
        getCurrNumEncodedBytes in interface DataUtil.IteratorWithNumBytes<T>
        Returns:
        the number of bytes in encoded form (which is ready to be decoded)