Skip to content

Commit ebe3aad

Browse files
committed
feat: minio and pyspark docs added
1 parent 362c59a commit ebe3aad

File tree

5 files changed

+48
-48
lines changed

5 files changed

+48
-48
lines changed
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
title: 📦 Storage
Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
# 🪣 Minio
2+
3+
## Docker compose
4+
5+
`docker_compose.yaml`:
6+
7+
```yaml
8+
services:
9+
storage_s3:
10+
restart: always
11+
image: quay.io/minio/minio:RELEASE.2024-10-29T16-01-48Z
12+
ports:
13+
- 5560:5560
14+
- 5561:5561
15+
hostname: storage-s3
16+
environment:
17+
MINIO_ROOT_USER: admin
18+
MINIO_ROOT_PASSWORD: password
19+
command: server /data --console-address ":5560" --address=":5561"
20+
healthcheck:
21+
test: ["CMD", "curl", "-f", "http://localhost:5560/minio/health/live"]
22+
interval: 5s
23+
timeout: 5s
24+
retries: 5
25+
26+
storage_s3_initial_setup:
27+
image: minio/mc:RELEASE.2024-10-29T15-34-59Z
28+
depends_on:
29+
storage_s3:
30+
condition: service_healthy
31+
volumes:
32+
- ./docker_entrypoint.sh:/docker_entrypoint.sh:z
33+
entrypoint:
34+
- /docker_entrypoint.sh
35+
```
36+
37+
`docker_entrypoint.sh`:
38+
39+
```sh
40+
#!/bin/bash
41+
42+
# Set up alias for MinIO
43+
mc alias set minio http://storage-s3:5561 admin password;
44+
45+
# Create buckets
46+
mc mb minio/data-lakehouse;
47+
```

docs/dev_ops/.pages

Lines changed: 0 additions & 1 deletion
This file was deleted.

docs/dev_ops/services/.pages

Lines changed: 0 additions & 1 deletion
This file was deleted.

docs/dev_ops/services/minio.md

Lines changed: 0 additions & 46 deletions
This file was deleted.

0 commit comments

Comments
 (0)