Skip to content

Commit 5ea1f15

Browse files
openshift-merge-bot[bot]openshift-merge-bot[bot]
authored
Merge pull request #56 from opendatahub-io/main
Sync release and main branches
2 parents 0acf4da + a7d53e9 commit 5ea1f15

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

53 files changed

+1701
-856
lines changed

‎.github/ISSUE_TEMPLATE/bug_report.md

Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
---
2+
name: Bug report
3+
about: Create a report to help us improve
4+
title: ""
5+
labels: "bug"
6+
assignees: ""
7+
---
8+
9+
**Describe the bug**
10+
11+
<!-- A clear and concise description of what the bug is. -->
12+
13+
**To Reproduce**
14+
15+
Script that can be used to send a request that reproduced the behavior (preferably using `grpcurl`):
16+
```
17+
grpcurl -plaintext -proto proto/generation.proto -d \
18+
'{
19+
"model_id": "",
20+
"requests": [
21+
{
22+
"text": "<Text that causes the bad behavior>"
23+
}
24+
],
25+
"params":{
26+
}
27+
}' \
28+
localhost:8033 fmaas.GenerationService/Generate
29+
```
30+
31+
**Expected behavior**
32+
33+
<!-- A clear and concise description of what you expected to happen. -->
34+
35+
**Screenshots**
36+
37+
<!-- If applicable, add screenshots to help explain your problem. -->
38+
39+
**Environment (please complete the following information):**
40+
41+
- OS/Architecture [e.g. linux amd64]
42+
- Version [e.g. git commit short-hash 5f67482]
43+
- Model [e.g. bigscience/bloom]
44+
45+
**Additional context**
46+
47+
<!-- Add any other context about the problem here. -->

‎.github/ISSUE_TEMPLATE/feature_request.md

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
---
2+
name: Feature request
3+
about: Suggest an idea for this project
4+
title: ""
5+
labels: ""
6+
assignees: ""
7+
---
8+
9+
<!-- Complete this request to suggest an idea or improvement to a project. -->
10+
11+
**Is your feature request related to a problem? If so, please describe.**
12+
13+
<!-- Please provide a clear and concise description of what the problem is. Ex. "I am always frustrated when [...]" -->
14+
15+
**Describe your proposed solution**
16+
17+
<!-- Please provide a clear and concise description of the solution you would like to propose. -->
18+
19+
**Describe alternatives you have considered**
20+
21+
<!-- Please provide a clear and concise description of any alternative solutions or features you've considered. -->
22+
23+
**Additional context**
24+
25+
<!-- Add additional context or screenshots pertaining to the feature request here. -->

‎.github/ISSUE_TEMPLATE/user_story.md

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
---
2+
name: User story
3+
about: Create a user story for this project
4+
title: ""
5+
assignees: ""
6+
---
7+
8+
## Overview
9+
10+
<!--
11+
Describe the goal or feature or two, usually in the form of a user story.
12+
As a [USER], I want to [TASK], so that [REASON]
13+
-->
14+
15+
### Acceptance Criteria
16+
17+
<!-- Ask yourself, are these criteria testable?
18+
19+
- [ ] List of what needs to be true
20+
- [ ] to consider this done
21+
- [ ] done done
22+
-->
23+
24+
### Questions
25+
26+
<!--
27+
- List any questions?
28+
- That you are unsure of the answer?
29+
-->
30+
31+
### Assumptions
32+
33+
<!--
34+
- List any assumptions that
35+
- You are making in terms of time-frame,
36+
- Output, or general context setting
37+
-->
38+
39+
### Reference
40+
41+
<!--
42+
- [Reference](links)
43+
- [To issues](or-any-inspiration)
44+
- [That might be](helpful)
45+
-->

‎.github/actions/free-up-disk-space/action.yml

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
name: "Free up disk space"
2+
description: "Removes non-essential tools, libraries and cached files from GitHub action runner node"
3+
4+
runs:
5+
using: "composite"
6+
steps:
7+
- name: "Remove non-essential tools and libraries"
8+
shell: bash
9+
run: |
10+
# https://github.com/actions/runner-images/issues/2840#issuecomment-790492173
11+
echo "Disk usage before cleanup:"
12+
df -h
13+
echo "Removing non-essential tools and libraries ..."
14+
sudo rm -rf /opt/ghc
15+
sudo rm -rf /usr/share/dotnet
16+
# sudo rm -rf /usr/local/share/boost
17+
echo "Deleting libraries for Android (12G), CodeQL (5.3G), PowerShell (1.3G), Swift (1.7G) ..."
18+
sudo rm -rf /usr/local/lib/android
19+
sudo rm -rf "${AGENT_TOOLSDIRECTORY}/CodeQL"
20+
sudo rm -rf /usr/local/share/powershell
21+
sudo rm -rf /usr/share/swift
22+
echo "Disk usage after cleanup:"
23+
df -h
24+
25+
- name: "Prune docker images"
26+
shell: bash
27+
run: |
28+
echo "Pruning docker images ..."
29+
docker image prune -a -f
30+
docker system df
31+
echo "Disk usage after pruning docker images:"
32+
df -h

‎.github/pull_request_template.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
#### Motivation
2+
3+
[Describe why this change is needed]
4+
5+
#### Modifications
6+
7+
[Describe the code changes]
8+
9+
#### Result
10+
11+
[Describe how the changes affects existing behavior and how to test it]
12+
13+
#### Related Issues
14+
15+
[Resolves #123]

‎.github/workflows/build.yml

Lines changed: 122 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,122 @@
1+
name: "Build"
2+
3+
on:
4+
workflow_dispatch:
5+
push:
6+
branches:
7+
- "main"
8+
paths-ignore:
9+
- "**.md"
10+
- "proto/**"
11+
pull_request:
12+
branches:
13+
- "main"
14+
paths-ignore:
15+
- "**.md"
16+
- "proto/**"
17+
18+
defaults:
19+
run:
20+
shell: bash
21+
22+
env:
23+
CI: true
24+
DOCKER_BUILDKIT: 1
25+
SERVER_IMAGE_NAME: "text-gen-server:0"
26+
27+
jobs:
28+
build:
29+
runs-on: ubuntu-latest
30+
env:
31+
BUILDKIT_INLINE_CACHE: 1
32+
33+
steps:
34+
- name: "Checkout"
35+
uses: actions/checkout@v4
36+
37+
- name: "Free up disk space"
38+
uses: ./.github/actions/free-up-disk-space
39+
40+
- name: "Set up QEMU"
41+
uses: docker/setup-qemu-action@v3
42+
43+
- name: "Set up Docker Buildx"
44+
uses: docker/setup-buildx-action@v3
45+
46+
- name: "Generate job steps to build stages sequentially"
47+
run: |
48+
build_targets=$(grep -iE "^FROM .+ as .*$" Dockerfile | grep -E -o "[^ ]+$")
49+
for t in $build_targets; do
50+
echo
51+
echo " - name: \"Docker build ${t}\""
52+
echo " run: docker build --target=$t -t $t ."
53+
done
54+
55+
- name: "Docker build base"
56+
run: docker build --target=base -t base .
57+
58+
- name: "Docker build cuda-base"
59+
run: docker build --target=cuda-base -t cuda-base .
60+
61+
- name: "Docker build cuda-devel"
62+
run: docker build --target=cuda-devel -t cuda-devel .
63+
64+
- name: "Docker build python-builder"
65+
run: docker build --target=python-builder -t python-builder .
66+
67+
- name: "Docker build flash-att-v2-builder"
68+
run: docker build --target=flash-att-v2-builder -t flash-att-v2-builder .
69+
70+
- name: "Docker build flash-att-builder"
71+
run: docker build --target=flash-att-builder -t flash-att-builder .
72+
73+
- name: "Docker build flash-att-cache"
74+
run: docker build --target=flash-att-cache -t flash-att-cache .
75+
76+
- name: "Docker build flash-att-v2-cache"
77+
run: docker build --target=flash-att-v2-cache -t flash-att-v2-cache .
78+
79+
- name: "Docker build auto-gptq-installer"
80+
run: docker build --target=auto-gptq-installer -t auto-gptq-installer .
81+
82+
- name: "Docker build auto-gptq-cache"
83+
run: docker build --target=auto-gptq-cache -t auto-gptq-cache .
84+
85+
- name: "Docker build cuda-runtime"
86+
run: docker build --target=cuda-runtime -t cuda-runtime .
87+
88+
- name: "Docker build rust-builder"
89+
run: docker build --target=rust-builder -t rust-builder .
90+
91+
- name: "Docker build router-builder"
92+
run: docker build --target=router-builder -t router-builder .
93+
94+
- name: "Docker build launcher-builder"
95+
run: docker build --target=launcher-builder -t launcher-builder .
96+
97+
- name: "Docker build test-base"
98+
run: docker build --target=test-base -t test-base .
99+
100+
- name: "Docker build cpu-tests"
101+
run: docker build --target=cpu-tests -t cpu-tests .
102+
103+
- name: "Docker build build"
104+
run: docker build --target=build -t build .
105+
106+
- name: "Docker build exllama-kernels-builder"
107+
run: docker build --target=exllama-kernels-builder -t exllama-kernels-builder .
108+
109+
- name: "Docker build exllamav2-kernels-builder"
110+
run: docker build --target=exllamav2-kernels-builder -t exllamav2-kernels-builder .
111+
112+
- name: "Docker build server-release"
113+
run: docker build --target=server-release -t server-release .
114+
115+
- name: "List docker images"
116+
run: docker images
117+
118+
- name: "Check disk usage"
119+
shell: bash
120+
run: |
121+
docker system df
122+
df -h

0 commit comments

Comments
 (0)