Skip to content

Commit c12e145

Browse files
BaunsgaardBaunsgaard
committed
[MINOR] Python Testing Cleanup
This commit cleanup the cloud based testing for the Python api. Specifically we clean up the logging and verbose printing of many tests to reduce the logging sizes of tests in every commit. Furthermore, we separate the testing of Scuro to a separte action, to make the Python tests more consistant. Follow up tasks include separation of installed packages for Scuro, and the SystemDS basic packages.
1 parent de2461e commit c12e145

File tree

314 files changed

+4382
-171
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

314 files changed

+4382
-171
lines changed

‎.github/workflows/python.yml‎

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,7 @@ jobs:
5353
os: [ubuntu-24.04]
5454
java: ['17']
5555
javadist: ['adopt']
56-
test_mode: [env, noenv, federated]
56+
test_mode: [env, noenv, federated, scuro]
5757

5858
name: ${{ matrix.os }} Java ${{ matrix.java }} ${{ matrix.javadist }} Python ${{ matrix.python-version }}/ ${{ matrix.test_mode}}
5959
steps:
@@ -150,4 +150,10 @@ jobs:
150150
cd src/main/python
151151
./tests/federated/runFedTest.sh
152152
153+
- name: Run Scuro Python Tests
154+
if: ${{ matrix.test_mode == 'scuro' }}
155+
run: |
156+
cd src/main/python
157+
python -m unittest discover -s tests/scuro -p 'test_*.py'
158+
153159

‎.github/workflows/pythonFormatting.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,5 +52,5 @@ jobs:
5252
5353
- name: Run Black Check
5454
run: |
55-
black --check --exclude operator/algorithm \
55+
black --check --exclude '(operator/algorithm/|auto_tests/)' \
5656
src/main/python/systemds src/main/python/tests

‎src/main/python/docs/source/api/operator/algorithms/WoE.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
WoE
223
===
324

‎src/main/python/docs/source/api/operator/algorithms/WoEApply.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
WoEApply
223
========
324

‎src/main/python/docs/source/api/operator/algorithms/abstain.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
abstain
223
=======
324

‎src/main/python/docs/source/api/operator/algorithms/adasyn.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
adasyn
223
======
324

‎src/main/python/docs/source/api/operator/algorithms/als.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
als
223
===
324

‎src/main/python/docs/source/api/operator/algorithms/alsCG.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
alsCG
223
=====
324

‎src/main/python/docs/source/api/operator/algorithms/alsDS.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
alsDS
223
=====
324

‎src/main/python/docs/source/api/operator/algorithms/alsPredict.rst‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
.. -------------------------------------------------------------
2+
..
3+
.. Licensed to the Apache Software Foundation (ASF) under one
4+
.. or more contributor license agreements. See the NOTICE file
5+
.. distributed with this work for additional information
6+
.. regarding copyright ownership. The ASF licenses this file
7+
.. to you under the Apache License, Version 2.0 (the
8+
.. "License"); you may not use this file except in compliance
9+
.. with the License. You may obtain a copy of the License at
10+
..
11+
.. http://www.apache.org/licenses/LICENSE-2.0
12+
..
13+
.. Unless required by applicable law or agreed to in writing,
14+
.. software distributed under the License is distributed on an
15+
.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
16+
.. KIND, either express or implied. See the License for the
17+
.. specific language governing permissions and limitations
18+
.. under the License.
19+
..
20+
.. ------------------------------------------------------------
21+
122
alsPredict
223
==========
324

0 commit comments

Comments
 (0)