This repository has been archived by the owner on Dec 4, 2024. It is now read-only.
Spark and Spark History 2.7.0-2.4.0
New features
- Upgraded Spark and Spark History Server to 2.4.0
Updates
- Spark Mesos Dispatcher uses the same user for running Spark jobs as itself and defaults to
nobody
- Switched to dcos-commons bootstrap script for IP address detection
Breaking changes
- Removed configuration option
use_bootstrap_for_IP_detect
since we now use bootstrap by default for Spark container IP detection which works across all containerizers:DOCKER
&MESOS
(UCR) and networking modes:HOST
& CNI Virtual Networks.