Changelog

Upcoming Release

Version 0.5.0 (January 7, 2019)

  • Support login via keytab, allowing for long-running services (PR #115, Issue #103)
  • Rename daemon to driver everywhere, deprecating old methods/classes (PR #116)
  • Allow forwarding java options to the Skein driver (PR #117)
  • Fix bugs preventing the Skein driver from running inside a YARN container (PR #119)
  • Add support for running a single user process on the same node as the Application Master, allowing for faster application startup for single-container services (PR #120, Issue #118)
  • Ensure application directory is cleaned up, even during application master failure or if killed by other tools (PR #122)
  • Fix support for application retries (PR #122)
  • Deprecate commands field in favor of script (PR #125, Issue #121)
  • Add --force option to skein driver stop (PR #126, Issue #124)
  • Update Web UI to display new features (progress reports, application master/driver logs, etc…) (PR #127, PR #95, Issue #123)
  • Obtain a resource manager delegation token for all applications. Allows for applications to submit additional applications as needed (PR #127)

Version 0.4.1 (December 7, 2018)

  • Reduce size of Skein’s JAR by selectively culling unnecessary resources (PR #109)
  • Use Protobuf Lite to further reduce JAR size (PR #111)
  • Normalize application specification consistently between Client.submit and Client.submit_and_connect (PR #114, Issue #110).

Version 0.4.0 (December 5, 2018)

  • Add support for proxying user credentials, allowing submitted applications to run as a different user than the submitter (PR #101)
  • Support running on MapR provided clusters (PR #105)
  • Allow TLS credentials to be configured per-application (PR #107)
  • Silence extraneous gRPC logged warning (“Fork support only compatible with epoll1 and poll polling strategies”).This warning doesn’t apply to our use case, and will not be raised in a future release of gRPC. (PR #107)
  • Upgrade gRPC version to 1.16 (PR #107)
  • Silence deprecation warnings in Python 3.7 (PR #108)

Version 0.3.1 (October 29, 2018)

  • Use NM_HOST to determine hostname, fixes connection issues on systems with alternate network interfaces (e.g. infiniband) (PR #97)
  • Fix accidental reliance on JAVA_HOME being defined (PR #100)

Version 0.3.0 (October 26, 2018)

  • Add support for YARN node label expressions (PR #44)
  • Allow memory requirements to be specified with human-readable units (PR #87, Issue #86)
  • Add support for YARN node and rack requirements/suggestions (PR #90, Issue #89)
  • Allow setting diagnostics message on user-requested shutdown (PR #92)
  • Add ability to set application progress (PR #93, Issue #88)
  • Error nicely if user forgets to kinit (PR #94)
  • Improve logging messages in client daemon (PR #95)
  • Support configurable logging for client daemon (PR #96)

Version 0.2.0 (October 11, 2018)

  • Add support for specifying additional filesystems, needed for ViewFs (PR #58)
  • Add a Web UI for viewing application status and logs (PR #68, PR #42, Issue #34)
  • Cleanup staging directory for killed applications (PR #71, Issue #69)
  • Support application-level Access Control Lists (ACLs) (PR #78, Issue #74)
  • Add support for user-defined pages in the Web UI (PR #72)
  • Remove unneeded resources to reduce JAR size (PR #83)
  • Support custom logging configurations (PR #84, Issue #79)
  • Improve logging messages and granularity (PR #84, Issue #79)
  • Add exit_message field for completed containers to aid in debugging (PR #84, PR #66)

Version 0.1.1 (August 6, 2018)

  • Fix bug in key ownership model (PR #53)
  • Cleanup and document skein.recipes (PR #50)

Version 0.1.0 (August 1, 2018)

  • Initial Public Release
  • Clean rewrite of Key-Value Store to support more powerful operations (PR #40, Issue #33, Issue #35)
  • Expose container node addresses in Python API (PR #39, Issue #38)
  • Expose application and container ids, as well as resource limits in running containers via environment variables (PR #37, Issue #32).
  • Cleanup internals and rework public API (PR #36)
  • Correctly handle multiple values in LOCAL_DIRS (PR #31)

Version 0.0.4 (July 3, 2018)

  • Initial Alpha Release