Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

Spark and Spark History 2.7.0-2.4.0

Compare
Choose a tag to compare
@akirillov akirillov released this 14 Mar 18:23
· 70 commits to master since this release

New features

  • Upgraded Spark and Spark History Server to 2.4.0

Updates

  • Spark Mesos Dispatcher uses the same user for running Spark jobs as itself and defaults to nobody
  • Switched to dcos-commons bootstrap script for IP address detection

Breaking changes

  • Removed configuration option use_bootstrap_for_IP_detect since we now use bootstrap by default for Spark container IP detection which works across all containerizers: DOCKER & MESOS (UCR) and networking modes: HOST & CNI Virtual Networks.