Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/analytics.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/aws_eks_deep_mnist_11_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/aws_eks_deep_mnist_48_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/azure.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/azure_aks_deep_mnist_11_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/azure_aks_deep_mnist_42_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/azuredashboard.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/car.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/cat.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/cat_explanation.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/cicd-seldon copy.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/cifar10-od_34_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/cifar10-od_34_2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/completed-pipeline-deploy.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/dashboard.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/dashboard_image.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/demo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/deploy-graph.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/digit.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/dog.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/git-user.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs-gb/images/gpt2-graph.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/graf.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs-gb/images/grafana-mlflow copy.jpg
Binary file added docs-gb/images/grafana-mlflow.jpg
Binary file added docs-gb/images/jaeger-ui-grpc-example copy.png
Binary file added docs-gb/images/jaeger-ui-rest-example copy.png
Binary file added docs-gb/images/jenkins-x-full-diagram.jpg
Binary file added docs-gb/images/k-pipeline-dashboard.jpg
Binary file added docs-gb/images/k8s-dashboard-1.jpg
Binary file added docs-gb/images/k8s-dashboard-2.jpg
Binary file added docs-gb/images/k8s-dashboard.jpg
Binary file added docs-gb/images/kubeflow-pipeline.jpg
Binary file added docs-gb/images/kubeflow-seldon-nlp-full.jpg
Binary file added docs-gb/images/mlflow-dashboard copy 2.png
Binary file added docs-gb/images/mlflow-dashboard copy.png
Binary file added docs-gb/images/mlflow-dashboard.png
Binary file added docs-gb/images/new-item.png
Binary file added docs-gb/images/notebook_12_2.png
Binary file added docs-gb/images/notebook_22_1.png
Binary file added docs-gb/images/outliers-combiner-1.jpg
Binary file added docs-gb/images/outliers-combiner-2.jpg
Binary file added docs-gb/images/outliers-combiner-3.jpg
Binary file added docs-gb/images/pelican.jpeg
Binary file added docs-gb/images/pipeline-architecture.jpg
Binary file added docs-gb/images/pipeline-config.png
Binary file added docs-gb/images/pipeline-only-run.jpg
Binary file added docs-gb/images/pipeline-stages.png
Binary file added docs-gb/images/pipeline-view.jpg
Binary file added docs-gb/images/pipeline1.png
Binary file added docs-gb/images/running-pipeline.jpg
Binary file added docs-gb/images/sagemaker-scikit-iris-train.png
Binary file added docs-gb/images/scm-config.png
Binary file added docs-gb/images/seldon-analytics.jpg
Binary file added docs-gb/images/seldon-kubeflow-batch.gif
Binary file added docs-gb/images/tensorflow-grpc-kafka.png
Binary file added docs-gb/images/tensorflow-rest-kafka.png
32 changes: 32 additions & 0 deletions docs-gb/images/tfserving-mnist_20_0.svg
Binary file added docs-gb/images/tfserving-mnist_23_0.png
Binary file added docs-gb/images/triton_examples_11_1.png
Binary file added docs-gb/images/triton_examples_17_1.png
Binary file added docs-gb/images/triton_examples_24_1.png
Binary file added docs-gb/images/triton_examples_30_1.png
Binary file added docs-gb/images/upload-pipeline.jpg
4 changes: 2 additions & 2 deletions docs-gb/integrations/distributed-tracing.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,11 +80,11 @@ spec:

## REST Example

![jaeger-ui-rest](./jaeger-ui-rest-example.png)
![jaeger-ui-rest](../images/jaeger-ui-rest-example.png)

## gRPC Example

![jaeger-ui-rest](./jaeger-ui-grpc-example.png)
![jaeger-ui-rest](../images/jaeger-ui-grpc-example.png)


## Worked Example
Expand Down
2 changes: 1 addition & 1 deletion docs-gb/integrations/drift_detection.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,4 +7,4 @@ Machine learning models do not extrapolate well outside of the training data dis

The general framework shown in this example is to use the Seldon Core payload logger to pass requests to components that process them asynchronously. The results can be passed onwards to alterting systems.

![Example architecture](analytics.png)
![Example architecture](../images/analytics.png)
4 changes: 2 additions & 2 deletions docs-gb/integrations/explainers.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Model Explainers

![cat](cat.png)
![explanation](cat_explanation.png)
![cat](../images/cat.png)
![explanation](../images/cat_explanation.png)

Seldon provides model explanations using its [Alibi](https://github.com/SeldonIO/alibi) library.

Expand Down
2 changes: 1 addition & 1 deletion docs-gb/integrations/outlier_detection.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ A [worked example with using the CIFAR10 task](../examples/outlier_cifar10.html)

The general framework shown in this example is to use the Seldon Core payload logger to pass requests to components that process them asynchronously. The results can be passed onwards to alterting systems.

![Example architecture](analytics.png)
![Example architecture](../images/analytics.png)



Expand Down
10 changes: 5 additions & 5 deletions docs-gb/notebooks/alibaba_ack_deep_mnist.md
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](alibaba_cloud_ack_deep_mnist_files/alibaba_cloud_ack_deep_mnist_16_0.png)
![png](../images/alibaba_cloud_ack_deep_mnist_16_0.png)



Expand Down Expand Up @@ -289,7 +289,7 @@ We need to first create a cluster in Alibaba Cloud - you should follow the follo

You should follow up the instructions but the finished cluster should look as follows:

![k8s-dashboard-2](images/k8s-dashboard-2.jpg)
![k8s-dashboard-2](../images/k8s-dashboard-2.jpg)

### 4.2 Copy the kubectl configuration to access the cluster

Expand Down Expand Up @@ -319,7 +319,7 @@ Use the setup notebook to [Setup Cluster](https://docs.seldon.io/projects/seldon
### 4.5 Push docker image
We'll now make sure the image is accessible within the Kubernetes cluster by pushing it to the repo that we created in step 4.3. This should look as follows in your dashboard:

![k8s-dashboard-1](images/k8s-dashboard-1.jpg)
![k8s-dashboard-1](../images/k8s-dashboard-1.jpg)

#### To push the image we first tag it

Expand Down Expand Up @@ -436,7 +436,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](alibaba_cloud_ack_deep_mnist_files/alibaba_cloud_ack_deep_mnist_40_0.png)
![png](../images/alibaba_cloud_ack_deep_mnist_40_0.png)



Expand Down Expand Up @@ -581,4 +581,4 @@ For this we can access the URL with the command below, it will request an admin

The metrics include requests per second, as well as latency. You are able to add your own custom metrics, and try out other more complex deployments by following furher guides at https://docs.seldon.io/projects/seldon-core/en/latest/examples/notebooks.html

![graf](images/graf.jpg)
![graf](../images/graf.jpg)
4 changes: 2 additions & 2 deletions docs-gb/notebooks/alibaba_cloud_ack_deep_mnist.md
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](alibaba_cloud_ack_deep_mnist_files/alibaba_cloud_ack_deep_mnist_16_0.png)
![png](../images/alibaba_cloud_ack_deep_mnist_16_0.png)



Expand Down Expand Up @@ -436,7 +436,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](alibaba_cloud_ack_deep_mnist_files/alibaba_cloud_ack_deep_mnist_40_0.png)
![png](../images/alibaba_cloud_ack_deep_mnist_40_0.png)



Expand Down
4 changes: 2 additions & 2 deletions docs-gb/notebooks/aws_eks_deep_mnist.md
Original file line number Diff line number Diff line change
Expand Up @@ -161,7 +161,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](aws_eks_deep_mnist_files/aws_eks_deep_mnist_11_0.png)
![png](../images/aws_eks_deep_mnist_11_0.png)



Expand Down Expand Up @@ -629,7 +629,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](aws_eks_deep_mnist_files/aws_eks_deep_mnist_48_0.png)
![png](../images/aws_eks_deep_mnist_48_0.png)



Expand Down
4 changes: 2 additions & 2 deletions docs-gb/notebooks/azure_aks_deep_mnist.md
Original file line number Diff line number Diff line change
Expand Up @@ -195,7 +195,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](azure_aks_deep_mnist_files/azure_aks_deep_mnist_11_0.png)
![png](../images/azure_aks_deep_mnist_11_0.png)



Expand Down Expand Up @@ -520,7 +520,7 @@ print("Expected label: ", np.sum(range(0, 10) * y), ". One hot encoding: ", y)



![png](azure_aks_deep_mnist_files/azure_aks_deep_mnist_42_0.png)
![png](../images/azure_aks_deep_mnist_42_0.png)



Expand Down
48 changes: 24 additions & 24 deletions docs-gb/notebooks/cifar10_kafka.md
Original file line number Diff line number Diff line change
Expand Up @@ -70,26 +70,26 @@ Install Strimzi on cluster
!helm repo add strimzi https://strimzi.io/charts/
```

"strimzi" already exists with the same configuration, skipping
"strimzi" already exists with the same configuration, skipping



```python
!helm install my-release strimzi/strimzi-kafka-operator
```

NAME: my-release
LAST DEPLOYED: Thu May 19 09:40:16 2022
NAMESPACE: seldon
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Thank you for installing strimzi-kafka-operator-0.28.0
To create a Kafka cluster refer to the following documentation.
https://strimzi.io/docs/operators/latest/deploying.html#deploying-cluster-operator-helm-chart-str
NAME: my-release
LAST DEPLOYED: Thu May 19 09:40:16 2022
NAMESPACE: seldon
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Thank you for installing strimzi-kafka-operator-0.28.0

To create a Kafka cluster refer to the following documentation.

https://strimzi.io/docs/operators/latest/deploying.html#deploying-cluster-operator-helm-chart-str


Set the following to whether you are running a local Kind cluster or a cloud based cluster.
Expand All @@ -108,7 +108,7 @@ else:
!kubectl apply -f cluster-cloud.yaml
```

kafka.kafka.strimzi.io/my-cluster created
kafka.kafka.strimzi.io/my-cluster created


Get broker endpoint.
Expand Down Expand Up @@ -185,10 +185,10 @@ spec:
!kubectl apply -f topics.yaml
```

kafkatopic.kafka.strimzi.io/cifar10-rest-input unchanged
kafkatopic.kafka.strimzi.io/cifar10-rest-output unchanged
kafkatopic.kafka.strimzi.io/cifar10-grpc-input unchanged
kafkatopic.kafka.strimzi.io/cifar10-grpc-output unchanged
kafkatopic.kafka.strimzi.io/cifar10-rest-input unchanged
kafkatopic.kafka.strimzi.io/cifar10-rest-output unchanged
kafkatopic.kafka.strimzi.io/cifar10-grpc-input unchanged
kafkatopic.kafka.strimzi.io/cifar10-grpc-output unchanged


## Install Seldon
Expand Down Expand Up @@ -809,19 +809,19 @@ spec:
!cat cifar10_rest.yaml | sed s/BROKER_IP/$BROKER_CIP:9092/ | kubectl apply -f -
```

seldondeployment.machinelearning.seldon.io/tfserving-cifar10 created
seldondeployment.machinelearning.seldon.io/tfserving-cifar10 created


Looking at the metrics dashboard for Seldon you should see throughput we are getting. For a single replica on GKE with n1-standard-4 nodes we can see roughly 150 requests per second being processed.

![rest](tensorflow-rest-kafka.png)
![rest](../images/tensorflow-rest-kafka.png)


```python
!kubectl delete -f cifar10_rest.yaml
```

seldondeployment.machinelearning.seldon.io "tfserving-cifar10" deleted
seldondeployment.machinelearning.seldon.io "tfserving-cifar10" deleted


## Test CIFAR10 gRPC Model
Expand Down Expand Up @@ -1406,19 +1406,19 @@ spec:
!cat cifar10_grpc.yaml | sed s/BROKER_IP/$BROKER_CIP:9092/ | kubectl apply -f -
```

seldondeployment.machinelearning.seldon.io/tfserving-cifar10 created
seldondeployment.machinelearning.seldon.io/tfserving-cifar10 created


Looking at the metrics dashboard for Seldon you should see throughput we are getting. For a single replica on GKE with n1-standard-4 nodes we can see around 220 requests per second being processed.

![grpc](tensorflow-grpc-kafka.png)
![grpc](../images/tensorflow-grpc-kafka.png)


```python
!kubectl delete -f cifar10_grpc.yaml
```

seldondeployment.machinelearning.seldon.io "tfserving-cifar10" deleted
seldondeployment.machinelearning.seldon.io "tfserving-cifar10" deleted



Expand Down
4 changes: 2 additions & 2 deletions docs-gb/notebooks/cifar10_od_poetry.md
Original file line number Diff line number Diff line change
Expand Up @@ -771,7 +771,7 @@ plt.show();



![png](cifar10-od_files/cifar10-od_34_0.png)
![png](../images/cifar10-od_34_0.png)



Expand All @@ -780,7 +780,7 @@ plt.show();



![png](cifar10-od_files/cifar10-od_34_2.png)
![png](../images/cifar10-od_34_2.png)



Expand Down
Loading
Loading