Skip to content

Commit ee6a295

Browse files
authored
experiments: fiqa baseline model (#37)
* fix name * baseline examples * added baseline index * modified CI * fix linting * check types only for src * k=1 experiment * finied experiments
1 parent 896626a commit ee6a295

File tree

11 files changed

+2399
-125
lines changed

11 files changed

+2399
-125
lines changed

.github/workflows/ci.yaml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ jobs:
2020
runs-on: ubuntu-latest
2121
outputs:
2222
related: ${{ steps.filter.outputs.related }}
23-
belar: ${{ steps.filter.outputs.belar }}
23+
ragas: ${{ steps.filter.outputs.ragas }}
2424
docs: ${{ steps.filter.outputs.docs }}
2525
steps:
2626
- uses: actions/checkout@v3
@@ -35,8 +35,8 @@ jobs:
3535
- codecov.yml
3636
- pyproject.toml
3737
- requirements/test.txt
38-
belar:
39-
- "belar/**"
38+
ragas:
39+
- "src/ragas/**"
4040
- "tests/**"
4141
- "examples/**"
4242
docs:
@@ -54,7 +54,7 @@ jobs:
5454
os: [ubuntu-latest, macos-latest, windows-latest]
5555
python-version: ["3.7", "3.8", "3.9", "3.10"]
5656

57-
if: ${{ (github.event_name == 'pull_request' && needs.diff.outputs.belar == 'true') || github.event_name == 'push' }}
57+
if: ${{ (github.event_name == 'pull_request' && needs.diff.outputs.ragas == 'true') || github.event_name == 'push' }}
5858
name: python${{ matrix.python-version }}_unit_tests (${{ matrix.os }})
5959
runs-on: ${{ matrix.os }}
6060

@@ -101,7 +101,7 @@ jobs:
101101
needs:
102102
- diff
103103

104-
if: ${{ (github.event_name == 'pull_request' && needs.diff.outputs.belar == 'true') || github.event_name == 'push' }}
104+
if: ${{ (github.event_name == 'pull_request' && needs.diff.outputs.ragas == 'true') || github.event_name == 'push' }}
105105

106106
steps:
107107
- uses: actions/checkout@v3
@@ -144,4 +144,4 @@ jobs:
144144
run: make lint
145145
- name: Type check
146146
if: ${{ github.event_name == 'pull_request' }}
147-
run: git diff --name-only --diff-filter=AM "origin/$GITHUB_BASE_REF" -z -- '**/*.py' '**/*.pyi' | xargs -0 --no-run-if-empty pyright
147+
run: git diff --name-only --diff-filter=AM "origin/$GITHUB_BASE_REF" -z -- 'src/**/*.py' 'src/**/*.pyi' | xargs -0 --no-run-if-empty pyright

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -164,4 +164,5 @@ ragas/_version.py
164164
experiments/**/data
165165
experiments/**/storage
166166
**/fil-result/
167+
experiments/baselines/fiqa/datasets
167168
src/ragas/_version.py

0 commit comments

Comments
 (0)