Skip to content

Commit a9c8ae6

Browse files
Merge pull request #1057 from oracle-devrel/nacho
fix: directory structures, markdown formatting (no QA)
2 parents 43b1bd3 + 8540023 commit a9c8ae6

File tree

144 files changed

+711
-343
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

144 files changed

+711
-343
lines changed

cloud-infrastructure/ai-infra-gpu/AI Infrastructure/triton-mixtral/README.md

Lines changed: 0 additions & 258 deletions
This file was deleted.

cloud-infrastructure/ai-infra-gpu/Benchmarks/gds-benchmarks/README.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,10 @@
11
# DISCLAIMER
2-
This code is provided as a starting point for your own benchmarks or for adaptation to your specific needs. It is not production-ready, and may lack a testing strategy, requiring modifications to function properly.
32

3+
This code is provided as a starting point for your own benchmarks or for adaptation to your specific needs. It is not production-ready, and may lack a testing strategy, requiring modifications to function properly.
44

55
# gds-benchmakrs
6-
```
6+
7+
```bash
78
[root@machine gds_benchmarks]# tree -L 2
89
.
910
├── backups
@@ -34,12 +35,12 @@ The **'scripts'** directory contains all the bash scripts used for initializing
3435

3536
During operation, **'launch.sh'** will conduct multiple tests using a variety of block and file sizes, which are predefined (Block sizes include: 4k, 8k, 16k, 32k, 64k, 128k, 256k, 512k, 1M, 2M, 4M, 8M, 16M). Each test iteration is performed four times. The file size varies depending on the number of threads, and to maintain efficiency, file sizes are kept relatively small. The GDSIO benchmark scales the file size with the number of threads, which can lead to extensive data processing. For example, running eight threads with a 128G file size would result in a total of 1024 TB of data being written, reflecting the scale of operations handled by this setup.
3637

37-
3838
Each test will be logged under the corresponding directory. The naming of the log files has the following format: ``gdsio_s<block size>_m<mode number>_w<threads / workers>_r<repetition number>_d<timestamp>.log``
3939
gdsio_s1M_m2_w1_r1_d1671836744.log
4040
For example, this log refers to a test that used 1M as block size, Mode 2 (CPU_GPU), 1 thread, and its timestamp.
4141
Each log also contains the full command that was issued to run:
42-
```
42+
43+
```bash
4344
/usr/local/cuda/gds/tools/gdsio -D /mnt/nvme0/ -d 0 -w 1 -s 8G -x 2 -i 1M -I 1 -V >> /home/ubuntu/gds_benchmarks/scripts/../logs/CPU_GPU//gdsio_s1M_m2_w1_r1_d1671836744.log
4445
IoType: WRITE XferType: CPU_GPU Threads: 1 DataSetSize: 8388608/8388608(KiB) IOSize: 1024(KiB) Throughput: 4.179353 GiB/sec, Avg_Latency: 233.618286 usecs ops: 8192 total_time 1.914172 secs
4546
Verifying data

cloud-infrastructure/ai-infra-gpu/README.md

Lines changed: 17 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,28 +1,31 @@
11
# AI infrastructure and GPU
22

3-
We are a team of technical specialists for AI infrastructure, graphics, and HPC on NVIDIA GPUs at OCI for
4-
- AI infrastructure for large-scale AI (Generative AI Large language model training, NLP) and small-scale AI (predictive AI, recommender systems, speech recognition, computer vision)
5-
- Computational Fluid Dynamics, Finite Element Analysis, Molecular Dynamics, Monte Carlo Simulations
6-
- Parallel File Systems (Weka, GlusterFS, BeeGFS, Lustre, IBM Spectrum Scale/GPFS)
7-
- Graphics (streaming, gaming, VDI)
8-
who support customers across various industries and geographies in EMEA (local support in 10 languages incl. German, French, Dutch, Italian & Spanish) with
9-
- Presentations
10-
- Demonstrations
11-
- PoCs/benchmarks
12-
- Architecture designs & sizing
13-
14-
# Useful Links
3+
We are a team of technical specialists for AI infrastructure, graphics, and HPC on NVIDIA GPUs at OCI for:
4+
5+
- AI infrastructure for large-scale AI (Generative AI Large language model training, NLP) and small-scale AI (predictive AI, recommender systems, speech recognition, computer vision)
6+
- Computational Fluid Dynamics, Finite Element Analysis, Molecular Dynamics, Monte Carlo Simulations
7+
- Parallel File Systems (Weka, GlusterFS, BeeGFS, Lustre, IBM Spectrum Scale/GPFS)
8+
- Graphics (streaming, gaming, VDI)
9+
10+
Who support customers across various industries and geographies in EMEA (local support in 10 languages incl. German, French, Dutch, Italian & Spanish) with:
11+
12+
- Presentations
13+
- Demonstrations
14+
- PoCs/benchmarks
15+
- Architecture designs & sizing
16+
17+
## Useful Links
1518

1619
- [Oracle Cloud GPU Instances](https://www.oracle.com/uk/cloud/compute/gpu/)
1720
- High-level description of Oracle Cloud GPU offering
1821
- [Oracle Cloud AI Infrastructure](https://www.oracle.com/uk/ai-infrastructure/)
19-
- High-level description of Oracle Cloud Artificial Intelligence infrastructure offering
22+
- High-level description of Oracle Cloud Artificial Intelligence infrastructure offering
2023
- [GPU instances details](https://docs.oracle.com/en-us/iaas/Content/Compute/References/computeshapes.htm#bm-gpu)
2124
- Oracle Cloud Bare-Metal GPU specifications
2225
- [AI infrastructure - Best practices on OCI](https://www.oracle.com/cloud/oci-best-practices-guide/#ai-infra-on-oci)
2326
- Guides, architectures, videos, and automation scripts to plan, design, and deploy AI workloads on our GPU compute and OCI services.
2427

25-
# License
28+
## License
2629

2730
Copyright (c) 2024 Oracle and/or its affiliates.
2831

0 commit comments

Comments
 (0)