Releases: Hydrospheredata/mist
Releases · Hydrospheredata/mist
v1.1.3
v1.1.2
v1.1.1
v1.1.0
No changes were made, except adding Spark 2.4.0 and Scala 2.12 support.
2.12 artifacts were published too:
- spark-2.4.0-bin-hadoop2.7-scala-2.12.tgz
- mist-1.1.0-scala-2.12.tar.gz
- docker image:
hydrosphere/mist:1.1.0-2.4.0-scala-2.12
v1.0.0
v1.0.0-RC17
- Upgrade mist-ui to 2.0.1 (pagination for job list 🔥)
- Provide full error message from job invocation #501, #508
- Change default worker settings #513 : workerMode ->
exclusive
,maxJobs
-> 1 - Mqtt async interface - enable auto reconnect option #510
- Fix problems with collecting logs from workers #496
- Http api
- add
DELETE
methods forv2/api/functions
,v2/api/artifacts
,v2/api/contexts
#507 - add
startTImeout
,performTimeout
options forPOST
v2/api/functions/{id}/jobs
- add
- Mist-lib
v1.0.0-RC16
This release contains a lot of fixes and improvements around user libraries for functions. New mistlib
version for scala/java isn't compatible with previous versions, so to upgrade a mist to v1.0.0-RC16
it's required to migrate and redeploy functions (migration example)
Python library was completely rewritten and now is called mistpy
. Also, now it's available in pipy.
Documentation
Example
- Python library improvements: #485, #441,
- Mistlib:
- Explicit result type declaration in
MistFn
andHandle
was removed. Handle declaration was divided into two parts: first buildRawHandle[A]
whereA
is resulting type, then buildHandle
from it usingasHandle
/toHandle
methods andJsEncoder
- fix #440 - #362 - default
main
method implementation, now it's possible to run mist functions directly fromspark-submit
- scala:
- #473 - use default values in case classes for building argument extraction -
mist.api.encoding.generic.extractorWithDefaults
- #473 - use default values in case classes for building argument extraction -
- java:
- Explicit result type declaration in
- #491 - fix worker termination
- #484 - support contexts that were created before
v1.0.0-RC15
v1.0.0-RC15
- Manual worker mode fixes:
- Fix
workers.manual.onStop
behavior. PreviouslyonStop
command was used to invoke user action after stopping worker, now it used directly to stop it (worker expects to handlesigkill
and notify master node that it was correctly stopped) - Return
WORKER_NAME
env foronStop
- #480
- Fix
- Fail not started jobs if a context was marked as broken - #479 , #445
- Fix
spark-submit
command building - #472
v1.0.0-RC14
- Logs collection improved - now job logs contain logs from spark #435 #462
- Added support for contexts on kubernetes backed cluster #430 #460
- Added support for python binary configuration #461 (
spark.pyspark.python
,spark.pyspark.python.driver
) - Docker image contains mesos library by default #444 #465
- Fixed job cancellation #469