Release 0.4 (2018-10-29)
MR3
- Support auto parallelism for reducers with
ONE_TO_ONE
edges. - Auto parallelism can use input statistics when reassigning partitions to reducers.
- Support ByteBuffer sharing among RuntimeTasks.
Hive on MR3
- Support Hive 3.1.0.
- Hive 1 uses Tez 0.9.1.
- Metastore checks the inclusion of
__HIVE_DEFAULT_PARTITION__
when retrieving column statistics. - MR3JobMonitor returns immediately from MR3 DAGAppMaster when the DAG completes.