|
1 | 1 | |Banner|
|
2 | 2 |
|
3 |
| -`Website <https://tatradev.com>`_ |
4 |
| -• `Docs <https://tatradev.com>`_ |
5 |
| -• `Blog <https://tatradev.com>`_ |
6 |
| -• `Twitter <https://tatradev.com>`_ |
7 |
| -• `Chat (Community & Support) <https://tatradev.com>`_ |
8 |
| -• `Tutorial <https://tatradev.com>`_ |
| 3 | +`Website <http://pipertool.org/>`_ |
| 4 | +• `Docs <http://pipertool.org>`_ |
| 5 | +• `Chat (Community & Support) <https://t.me/pipertool>`_ |
| 6 | +• `Tutorials <http://pipertool.org>`_ |
9 | 7 |
|
10 | 8 | # TODO: add useful installation links, code coverage and test from CICD
|
11 | 9 |
|
@@ -39,40 +37,26 @@ Quick start
|
39 | 37 | Installation
|
40 | 38 | ============
|
41 | 39 |
|
42 |
| - |
43 |
| -Snap (Snapcraft/Linux) |
44 |
| ----------------------- |
45 |
| - |
46 |
| - |
47 |
| -Choco (Chocolatey/Windows) |
48 |
| --------------------------- |
49 |
| - |
50 |
| -Brew (Homebrew/Mac OS) |
51 |
| ----------------------- |
52 |
| - |
53 |
| -Conda (Anaconda) |
54 |
| ----------------- |
55 |
| - |
56 | 40 | pip (PyPI)
|
57 | 41 | ----------
|
58 | 42 |
|
| 43 | +.. code-block:: bash |
| 44 | + :caption: pip installation |
| 45 | + pip install pipertool |
| 46 | +
|
59 | 47 | Comparison to related technologies
|
60 | 48 | ==================================
|
61 | 49 |
|
62 |
| -#. Data Engineering tools such as `AirFlow <https://airflow.apache.org/>`_, |
63 |
| - `Luigi <https://github.com/spotify/luigi>`_, and others - We use Airflow and Luigi as possible context for executors |
64 |
| - |
65 |
| -#. Opyrator - |
| 50 | +#. Jupyter - is the de facto experimental environment for most data scientists. However, it is desirable to write experimental code. |
66 | 51 |
|
67 |
| -#. Ansible - |
68 |
| - |
69 |
| -#. Kubernetes - |
| 52 | +#. Data Engineering tools such as `AirFlow <https://airflow.apache.org/>`_, |
| 53 | + `Luigi <https://github.com/spotify/luigi>`_ -These are very popular ML pipeline build tools. Airflow can be connected to a kubernetes cluster or collect tasks through a simple PythonOperator. The downside is that their functionality is generally limited on this, that is, they do not provide ML modules out of the box. Moreover, all developments will still have to be wrapped in a scheduler and this is not always a trivial task. However, we like them and we use Airflow and Luigi as possible context for executors. |
70 | 54 |
|
71 |
| -#. Dagster - |
| 55 | +#. Azure ML / Amazon SageMaker / Google Cloud - Cloud platforms really allow you to assemble an entire system from ready-made modules and put it into operation relatively quickly. Of the minuses: high cost, binding to a specific cloud, as well as small customization for specific business needs. For a large business, this is the most logical option - to build an ML infrastructure in the cloud. We also maintain cloud options as posible ways for the deployment step. |
72 | 56 |
|
73 |
| -#. DVC, MLFlow, and others - |
| 57 | +#. DataRobot/Baseten - They offer an interesting, but small set of ready-made modules. However, in Baseten, all integration is implied in the kubernetes cluster. This is not always convenient and necessary for Proof-of-Concept. Piper also provides an open-source framework in which you can build a truly customized pipeline from many modules. Basically, such companies either do not provide an open-source framework, or provide a very truncated set of modules for experiments, which limits the freedom, functionality, and applicability of these platforms. This is partly similar to the hub of models and datasets in huggingface. |
74 | 58 |
|
75 |
| -#. |
| 59 | +#. Mlflow / DVC, etc. - There are also many excellent projects on the market for tracking experiments, serving and storing machine learning models. But they are increasingly utilitarian and do not directly help in the task of accelerating the construction of a machine learning MVP project. We plan to add integrations to Piper with the most popular frameworks for the needs of DS and ML specialists. |
76 | 60 |
|
77 | 61 |
|
78 | 62 | Contributing
|
@@ -100,11 +84,11 @@ By submitting a pull request to this project, you agree to license your contribu
|
100 | 84 |
|
101 | 85 |
|
102 | 86 |
|
103 |
| -.. |Banner| image:: https://tatradev.com |
104 |
| - :target: https://tatradev.com |
| 87 | +.. |Banner| image:: https://static.tildacdn.com/tild3434-6665-4638-a432-626636353134/illistration.svg |
| 88 | + :target: http://pipertool.org/ |
105 | 89 | :alt: Piper logo
|
106 | 90 |
|
107 | 91 |
|
108 | 92 | .. |Contribs| image:: https://tatradev.com
|
109 | 93 | :target: https://github.com/TatraDev/piper/graphs/contributors
|
110 |
| - :alt: Contributors |
| 94 | + :alt: Contributors |
0 commit comments