Skip to content

Commit 0c352d8

Browse files
PanaetiusPanaetius
authored
Merge pull request #3580 from SwissDataScienceCenter/release/v2.7.0
chore: release v2.7.0
2 parents 4288ada + ac01826 commit 0c352d8

File tree

79 files changed

+1169
-1616
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

79 files changed

+1169
-1616
lines changed

‎CHANGES.rst

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,36 @@
1818
Changes
1919
=======
2020

21+
`2.7.0 <https://github.com/SwissDataScienceCenter/renku-python/compare/v2.6.1...v2.7.0>`__ (2023-08-09)
22+
-------------------------------------------------------------------------------------------------------
23+
24+
Bug Fixes
25+
~~~~~~~~~
26+
27+
- **cli:** adapt to changes in KG api for importing datasets
28+
(`#3549 <https://github.com/SwissDataScienceCenter/renku-python/issues/3549>`__)
29+
(`020434a <https://github.com/SwissDataScienceCenter/renku-python/commit/020434a7dd6449755644a2e9ca849b8821900f72>`__)
30+
- **cli:** fix overwriting dataset tags
31+
(`#3497 <https://github.com/SwissDataScienceCenter/renku-python/issues/3497>`__)
32+
(`17a49ae <https://github.com/SwissDataScienceCenter/renku-python/commit/17a49aebc7207901986c38fd30afc58baf40be1f>`__)
33+
- **service:** add branch to service cache path
34+
(`#3562 <https://github.com/SwissDataScienceCenter/renku-python/issues/3562>`__)
35+
(`3800a38 <https://github.com/SwissDataScienceCenter/renku-python/commit/3800a3823515763c207b1b15f348df3b0cdd9831>`__)
36+
- **service:** add support for using default values in template
37+
parameters
38+
(`#3550 <https://github.com/SwissDataScienceCenter/renku-python/issues/3550>`__)
39+
(`d162392 <https://github.com/SwissDataScienceCenter/renku-python/commit/d162392b3dc20dd3433be78b08f101e7f268ed7d>`__)
40+
41+
Features
42+
~~~~~~~~
43+
44+
- **cli:** allow disabling automated parameter detection in renku run
45+
(`#3548 <https://github.com/SwissDataScienceCenter/renku-python/issues/3548>`__)
46+
(`bcdeba1 <https://github.com/SwissDataScienceCenter/renku-python/commit/bcdeba1f286ad786edb4e19e21236c4408fa3ed7>`__)
47+
- **service:** replace/refactor internal repository cache
48+
(`#3534 <https://github.com/SwissDataScienceCenter/renku-python/issues/3534>`__)
49+
(`a9994a8 <https://github.com/SwissDataScienceCenter/renku-python/commit/a9994a8cb2541527ca9be731037cc60b03d62cea>`__)
50+
2151
`2.6.0 <https://github.com/SwissDataScienceCenter/renku-python/compare/v2.5.0...v2.6.0>`__ (2023-06-20)
2252
-------------------------------------------------------------------------------------------------------
2353

‎cache-cleanup-job/Dockerfile

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
# Docker image for core-svc cronjob
2+
FROM alpine:3.18.2
3+
RUN apk add --no-cache ca-certificates=20230506-r0 curl=8.1.2-r0 bash=5.2.15-r5 && rm -rf /var/cache/apk/*
4+
RUN curl -LO "https://storage.googleapis.com/kubernetes-release/release/$(curl -s https://storage.googleapis.com/kubernetes-release/release/stable.txt)/bin/linux/amd64/kubectl" &&\
5+
chmod +x ./kubectl &&\
6+
mv ./kubectl /usr/bin/kubectl
7+
8+
RUN mkdir /code
9+
WORKDIR /code
10+
COPY cleanup.sh /code/
11+
12+
ENTRYPOINT ["/bin/bash", "/code/cleanup.sh"]

‎cache-cleanup-job/README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
# Core Service cache cleanup image
2+
Small image to be used for the cache cleanup CronJob for the core service.
3+
4+
Loops through endpoint slices and call the cleanup endpoint on each core-svc instance.
5+
6+
Push as `renku/renku-core-cleanup:<version>` to use

‎cache-cleanup-job/cleanup.sh

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
#!/bin/bash
2+
3+
set -e
4+
5+
core_version=$1
6+
namespace=$2
7+
8+
mapfile -t -d " " pod_ips < <(kubectl -n "$namespace" get pods --selector="app.kubernetes.io/name=core" --selector="app.kubernetes.io/deploymentVersion=$core_version" -o=jsonpath="{.items[*].status.podIP}" )
9+
10+
success=true
11+
12+
for pod_ip in "${pod_ips[@]}"
13+
do
14+
echo "Calling http://$pod_ip:8080/renku/cache.cleanup"
15+
if curl "http://$pod_ip:8080/renku/cache.cleanup" ; then
16+
:
17+
else
18+
echo "Cleanup failed for pod $pod_ip with status $?">&2
19+
success=false
20+
fi
21+
done
22+
23+
if ! $success; then
24+
exit 1;
25+
fi

‎conftest.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,6 @@
5858
"tests.service.fixtures.service_integration",
5959
"tests.service.fixtures.service_jobs",
6060
"tests.service.fixtures.service_projects",
61-
"tests.service.fixtures.service_scheduler",
6261
]
6362

6463
INCLUDE_FIXTURES = GLOBAL_FIXTURE_LOCATIONS + CORE_FIXTURE_LOCATIONS + CLI_FIXTURE_LOCATIONS + SERVICE_FIXTURE_LOCATIONS

‎docker-compose.yml

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -87,19 +87,6 @@ services:
8787
- traefik.http.routers.swagger.rule=PathPrefix(`/api/docs`)
8888
- traefik.http.services.my-service.loadbalancer.server.port=8080
8989

90-
renku-scheduler:
91-
build:
92-
context: .
93-
dockerfile: Dockerfile
94-
args:
95-
BUILD_CORE_SERVICE: 1
96-
command: ["service", "scheduler"]
97-
depends_on:
98-
- redis
99-
networks:
100-
- net
101-
env_file: .env
102-
10390
renku-worker:
10491
build:
10592
context: .

‎docs/reference/commands/index.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@
1414
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
1515
See the License for the specific language governing permissions and
1616
limitations under the License.
17+
.. _cli-command:
1718

1819
Renku Command Line
1920
==================

‎helm-chart/renku-core/Chart.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,4 +3,4 @@ appVersion: "1.0"
33
description: A Helm chart for Kubernetes
44
name: renku-core
55
icon: https://avatars0.githubusercontent.com/u/53332360?s=400&u=a4311d22842343604ef61a8c8a1e5793209a67e9&v=4
6-
version: 2.6.0
6+
version: 2.7.0

‎helm-chart/renku-core/templates/cache-cleanup-job.yaml

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
{{- range $version := .Values.versions }}
2+
{{ if ne $version.name "v9"}}
3+
---
4+
apiVersion: batch/v1
5+
kind: CronJob
6+
metadata:
7+
name: {{ include "renku-core.fullname" $ }}-cleanup-{{ $version.name }}
8+
labels:
9+
app.kubernetes.io/deploymentVersion: {{ $version.name }}
10+
spec:
11+
schedule: "*/5 * * * *"
12+
concurrencyPolicy: Forbid
13+
jobTemplate:
14+
spec:
15+
template:
16+
spec:
17+
containers:
18+
- name: {{ include "renku-core.fullname" $ }}-cache-cleanup-{{ $version.name }}
19+
image: renku/renku-core-cleanup:v1
20+
imagePullPolicy: IfNotPresent
21+
args:
22+
- {{ $version.name | quote}}
23+
- {{ $.Release.Namespace }}
24+
restartPolicy: OnFailure
25+
serviceAccountName: {{ include "renku-core.fullname" $ }}-cleanup
26+
{{ end }}
27+
{{ end }}

‎helm-chart/renku-core/templates/cronjob-serviceaccount.yaml

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
apiVersion: v1
2+
kind: ServiceAccount
3+
metadata:
4+
name: {{ include "renku-core.fullname" $ }}-cleanup
5+
labels:
6+
{{ include "renku-core.labels" $ | indent 4 }}
7+
---
8+
apiVersion: rbac.authorization.k8s.io/v1
9+
kind: Role
10+
metadata:
11+
name: {{ include "renku-core.fullname" $ }}-cleanup
12+
labels:
13+
{{ include "renku-core.labels" $ | indent 4 }}
14+
rules:
15+
- apiGroups:
16+
- ""
17+
resources:
18+
- pods
19+
verbs:
20+
- get
21+
- list
22+
---
23+
apiVersion: rbac.authorization.k8s.io/v1
24+
kind: RoleBinding
25+
metadata:
26+
name: {{ include "renku-core.fullname" $ }}-cleanup
27+
labels:
28+
{{ include "renku-core.labels" $ | indent 4 }}
29+
roleRef:
30+
apiGroup: rbac.authorization.k8s.io
31+
kind: Role
32+
name: {{ include "renku-core.fullname" $ }}-cleanup
33+
subjects:
34+
- kind: ServiceAccount
35+
name: {{ include "renku-core.fullname" $ }}-cleanup
36+
namespace: {{ $.Release.Namespace }}

0 commit comments

Comments
 (0)