Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

Spark and Spark History 2.4.0-2.2.1-3

Compare
Choose a tag to compare
@samvantran samvantran released this 03 Oct 18:10
· 241 commits to master since this release
5998d09

New Features

  • Added service name to dispatcher’s VIP endpoints (#412)
  • Added shell-escape fix to spark-cli (SPARK-21014) (#401)
  • Added spark.mesos.executor.gpus (SPARK-21033) (#23)
  • Added dispatcher and driver metrics (#24 && #25)
  • Added statsd sink for spark metrics (#402)
    • Note: metrics is a beta feature and requires enabling UCR. Production use is not advised.

Updates

  • Updated tests, build tools, CLI and vendor packages (#383)
  • Updated bootstrap version to 0.50.0 (#372)
  • Updated JRE version to 8u172 (#371)

Bug fixes

  • Fixed duplicate docker image URLs; use resource.json as default (#385)

Breaking Changes

  • VIP endpoints for the dispatcher are no longer spark-dispatcher:<port> and are now dispatcher.{{service.name}}:<port>