Skip to content

Commit d89793b

Browse files
committed
Update prompts and fix typo in evaluation script
Added clarification about zero-based indexing for OutputDataFrame tests in SYSTEM_PROMPT_testing.md. Fixed a typo in the evaluation script ('create_app_ficture' to 'create_app_fixture') for app_04_custom_app_name instructions.
1 parent 8fd6e28 commit d89793b

File tree

2 files changed

+5
-1
lines changed

2 files changed

+5
-1
lines changed

shiny/pytest/_generate/_data/_prompts/SYSTEM_PROMPT_testing.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,10 @@ For non-Shiny Python code, respond: "This framework is for Shiny for Python only
5050

5151
10. **Newline at End**: Always end files with a newline.
5252

53+
**11. DataFrames:** OutputDataFrame tests use **zero-based indexing**, so
54+
`data_grid.expect_cell(value="Action Button", row=0, col=0)`
55+
verifies the cell in the first row and first column, not the headers.
56+
5357
## Examples
5458

5559
### Checkbox Group

tests/inspect-ai/scripts/evaluation.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ def get_app_specific_instructions(app_name: str) -> str:
8989
""",
9090
"app_04_custom_app_name": """
9191
For this app, focus on:
92-
- Ensure that the create_app_ficture is called with the correct app file. In this case, it should be "app_input_checkbox_group.py"
92+
- Ensure that the create_app_fixture is called with the correct app file. In this case, it should be "app_input_checkbox_group.py"
9393
- Ensure that the test creates an instance of the InputCheckboxGroup controller with id "colors"
9494
- Ensure that the checkbox group component is verified for its label, choices, selected values, inline state, and width.
9595
- Ensure that the test checks the checkbox group state changes and verifies the output text accordingly.

0 commit comments

Comments
 (0)