-
Notifications
You must be signed in to change notification settings - Fork 665
Towards Modin 1.0
Devin Petersohn edited this page Nov 11, 2021
·
13 revisions
This page contains the details of the criteria by which we will decide and declare that Modin is stable enough for a 1.0 release.
- Backend agnostic Execution API
- Supported on the backends: Ray, Dask, Python Multiprocessing
- Data-manipulation front-end API for DSLs
- Supported on the DSLs: pandas, SQL
- Dataframe algebra translation layer
- Query execution both in eager and lazy modes
- Data partitioning and placement API
- Fault tolerance and error handling
- Logging
- Fault tolerance for a node or worker failures
- Reasonable performance on common operators
- Not slower than pandas on medium dataset sizes (500MB)
- Microbenchmarks, end-to-end benchmarks, and dashboard
- Full documentation both for programmers and users
- Code complying to the adopted style-guide and docstring format