Class SkewRunTimePass

  • All Implemented Interfaces:
    BiFunction<IRDAG,​Message<Map<Object,​Long>>,​IRDAG>

    public final class SkewRunTimePass
    extends RunTimePass<Map<Object,​Long>>
    Dynamic optimization pass for handling data skew. Using a map of key to partition size as a metric used for dynamic optimization, this RunTimePass identifies a number of keys with big partition sizes(skewed key) and evenly redistributes data via overwriting incoming edges of destination tasks.
    • Constructor Detail

      • SkewRunTimePass

        public SkewRunTimePass()
      • SkewRunTimePass

        public SkewRunTimePass​(int numOfSkewedKeys)