Skip to content
This repository was archived by the owner on Oct 11, 2023. It is now read-only.

add training MNIST using Kubeflow, S3, and Argo link #36

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

add training MNIST using Kubeflow, S3, and Argo link #36

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
41359ed
add training MNIST using Kubeflow, S3, and Argo link
julienstroheker May 14, 2018
368e0af
Merge branch 'master' into feat/10gf
julienstroheker May 25, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 13 additions & 2 deletions 10-going-further/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,8 +26,9 @@ Such a file system can be deployed inside your Kubernetes cluster, and can use t
Here are some tools and frameworks that can make it easy to deploy such a distributed file system on Kubernetes:

* [GlusterFS](http://www.gluster.org/)
* [Rook](https://rook.io/)
* [Portworx](https://portworx.com/)
* [Rook.io](https://rook.io/)
* [Minio](https://www.minio.io)
* [Portwork](https://portworx.com/)
* [Pachyderm](http://pachyderm.io/)

## Autoscaling a Kubernetes Cluster
Expand All @@ -41,3 +42,13 @@ As of this writing, autoscaling is only supported on Kubernetes cluster created
See the following resources to get started:

* [Kubernetes Azure cluster-autoscaler](https://github.com/kubernetes/autoscaler/tree/master/cluster-autoscaler/cloudprovider/azure)

## More resources

### Training MNIST using Kubeflow, S3, and Argo.

[https://github.com/kubeflow/examples/tree/master/mnist](https://github.com/kubeflow/examples/tree/master/mnist)

If you want to experiment running a distributed MNIST on a distributed storage using Minio with Kubeflow, you can [check this example](https://github.com/kubeflow/examples/tree/master/mnist) from the official Kubeflow/Examples repository.

This example will also introduce you to a workflow tool named : [argo](https://github.com/argoproj/argo). It is very useful when you want to automatically prepare data, train, serve and monitor using only one command.