Conversation
There was a problem hiding this comment.
Pull request overview
This pull request adds a pre-course self-assessment questionnaire for the Transport Data Science module (TRAN5340M), addressing issue #263. The questionnaire helps prospective students evaluate their readiness for the course through a comprehensive set of questions covering computing fundamentals, programming experience, data science knowledge, transport concepts, tools, and learning approaches.
Changes:
- Added a new printable pre-course self-assessment questionnaire (
precourse.qmd) with 22 questions across 7 sections - Updated the Quarto configuration to include navigation links to both interactive and printable versions of the assessment
- Modified the document generation script to copy generated docx files to a local OneDrive directory
- Adjusted heading levels in the formative assessment brief for better document structure consistency
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 5 comments.
| File | Description |
|---|---|
| precourse.qmd | New comprehensive pre-course questionnaire with scoring guidance and recommended preparation resources |
| _quarto.yml | Added navigation entries for both interactive and printable versions of the pre-course assessment |
| scripts/create-docxs.sh | Added conditional logic to copy generated docx files to a user-specific OneDrive directory |
| d2/assessment-brief.qmd | Changed heading levels from h1/h2 to h2/h3 for improved document hierarchy |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
precourse.qmd
Outdated
| <div class="question">Q4. Do you have experience with R programming?</div> | ||
| <div class="option">☐ Yes, extensive (I use R regularly for data analysis)</div> | ||
| <div class="option">☐ Yes, intermediate (I can write scripts and use common packages)</div> | ||
| <div class="option">☐ Yes, basic (I've completed an introduction to R)</div> | ||
| <div class="option">☐ No, but I'm willing to learn</div> | ||
| <div class="option">☐ No experience</div> | ||
|
|
||
| <div class="question">Q5. Which of the following R packages have you used?</div> | ||
| <div class="option">☐ tidyverse (dplyr, ggplot2, readr, etc.)</div> | ||
| <div class="option">☐ sf (spatial data handling)</div> | ||
| <div class="option">☐ tmap (mapping/visualization)</div> | ||
| <div class="option">☐ stats19 (road safety data)</div> | ||
| <div class="option">☐ stplanr (transport planning)</div> | ||
| <div class="option">☐ None of the above</div> | ||
|
|
||
| <div class="question">Q6. Have you worked with Quarto or R Markdown documents?</div> | ||
| <div class="option">☐ Yes, extensively (I use them for reports and reproducible work)</div> | ||
| <div class="option">☐ Yes, occasionally (I've created simple documents)</div> | ||
| <div class="option">☐ No, but I'm familiar with the concept</div> | ||
| <div class="option">☐ No, never heard of them</div> |
There was a problem hiding this comment.
Question numbering is duplicated in Section 2. There are duplicate Q4, Q5, and Q6 question numbers that conflict with questions in Section 1. The questions in Section 2.1 should be renumbered to continue from the previous section's numbering (starting from Q8 onwards after fixing Section 1.2's numbering).
scripts/create-docxs.sh
Outdated
| # Copy to OneDrive if it exists | ||
| DEST_DIR="/c/Users/georl/OneDrive - University of Leeds/career/modules/tds/2025-26" | ||
| if [ -d "$DEST_DIR" ]; then |
There was a problem hiding this comment.
The script contains a hardcoded user-specific path that will fail for other users. The path "/c/Users/georl/OneDrive - University of Leeds/career/modules/tds/2025-26" is specific to a single user account. Consider removing this personal path from the shared repository, or make it configurable through an environment variable that users can set in their local environment without committing to the repository.
| # Copy to OneDrive if it exists | |
| DEST_DIR="/c/Users/georl/OneDrive - University of Leeds/career/modules/tds/2025-26" | |
| if [ -d "$DEST_DIR" ]; then | |
| # Copy to OneDrive if it exists; configure destination via TDS_DEST_DIR environment variable | |
| DEST_DIR="${TDS_DEST_DIR:-}" | |
| if [ -n "$DEST_DIR" ] && [ -d "$DEST_DIR" ]; then |
_quarto.yml
Outdated
| - href: precourse-interactive.qmd | ||
| text: Pre-Course Self-Assessment (Interactive) |
There was a problem hiding this comment.
The navigation references a file "precourse-interactive.qmd" that is not included in this pull request. This will result in a broken link when users try to access the "Pre-Course Self-Assessment (Interactive)" page. Either include the missing file in this PR or remove this navigation entry until the file is ready.
| - href: precourse-interactive.qmd | |
| text: Pre-Course Self-Assessment (Interactive) | |
| # - href: precourse-interactive.qmd | |
| # text: Pre-Course Self-Assessment (Interactive) |
precourse.qmd
Outdated
|
|
||
| ## Interactive Version | ||
|
|
||
| For an interactive, client-side version of this questionnaire with automatic scoring, please visit the [Interactive Pre-Course Self-Assessment](precourse-interactive.html). |
There was a problem hiding this comment.
The document references a non-existent file "precourse-interactive.html". The link will be broken since the corresponding "precourse-interactive.qmd" file is not included in this pull request. Either include the interactive version file in this PR or remove this reference until the file is ready.
| For an interactive, client-side version of this questionnaire with automatic scoring, please visit the [Interactive Pre-Course Self-Assessment](precourse-interactive.html). | |
| An interactive, client-side version of this questionnaire with automatic scoring will be made available in a future release. |
precourse.qmd
Outdated
| <div class="question">Q4. Have you spent more than 10 hours in total using R or Python to generate "tangible results" (e.g., figures for a thesis, professional reports, or reproducible datasets)?</div> | ||
| <div class="option">☐ Yes, I have used code to deliver professional or academic-grade outputs</div> | ||
| <div class="option">☐ Yes, I have produced basic figures/tables for coursework</div> | ||
| <div class="option">☐ I have spent time in the environment but never produced a "finished" product</div> | ||
| <div class="option">☐ No, I have only followed step-by-step tutorials with provided solutions</div> | ||
|
|
||
| <div class="question">Q5. Which of the following have you produced using R, Python or another programming language such as Julia, Rust, or JavaScript/TypeScript? (Tick all that apply)</div> | ||
| <div class="option">☐ A data visualization (e.g., map or chart) for a project</div> | ||
| <div class="option">☐ A clean, processed dataset from raw data</div> | ||
| <div class="option">☐ A statistical analysis or model (e.g., regression)</div> | ||
| <div class="option">☐ An interactive dashboard or web application</div> | ||
| <div class="option">☐ An automated/reproducible report or technical document</div> | ||
| <div class="option">☐ None of the above</div> | ||
|
|
||
| <div class="question">Q6. Please provide details on the project(s) you have worked on. Explain which IDEs (e.g., RStudio, VS Code) and packages you used, how exactly the data science work contributed to the output, and approximately how much time (in hours) you spent on it:</div> | ||
| <div class="option" style="border: 1px solid #dee2e6; min-height: 100px; padding: 10px; margin-top: 10px; border-radius: 4px;"> | ||
| </div> | ||
|
|
||
| <div class="question">Q5. Which of the following "Critical Blockers" have you successfully solved independently? (Tick all that apply)</div> | ||
| <div class="option">☐ **Working Directories**: Fixing "File not found" errors by managing relative/absolute paths</div> | ||
| <div class="option">☐ **Data Types**: Troubleshooting why a plot fails because a column is a 'string' vs 'numeric'</div> | ||
| <div class="option">☐ **Package Management**: Resolving failed library installations or version conflicts</div> | ||
| <div class="option">☐ **Vector/List Logic**: Understanding why your code ran but only returned a single value instead of a column</div> | ||
| <div class="option">☐ **Documentation**: Successfully using StackOverflow or documentation to fix a specific error message</div> | ||
| <div class="option">☐ None of the above</div> |
There was a problem hiding this comment.
Question numbering is duplicated in Section 1.2. There are two questions labeled "Q5" (lines 143 and 155) and one labeled "Q4" (line 137). The questions should be renumbered sequentially. The question at line 137 should be Q4, the question at line 143 should be Q5, the question at line 151 should be Q6, and the question at line 155 should be Q7.
|
@copilot open a new pull request to apply changes based on the comments in this thread |
|
@Robinlovelace I've opened a new pull request, #282, to work on those changes. Once the pull request is ready, I'll request review from you. |
Fix question numbering, remove broken links, and make OneDrive path configurable
harrysroberts
left a comment
There was a problem hiding this comment.
Summarising my comments, the main issues I identified are that the scoring system doesn't neatly and uniformly apply to all of the questions, and that some of the later questions are more to do with preferences and practicalities rather than personal suitability for the course, and should probably fall under a different section after the scoring process.
precourse.qmd
Outdated
| <div class="option">☐ Yes, regularly (I use it for various tasks)</div> | ||
| <div class="option">☐ Yes, occasionally (I've used it for simple commands)</div> | ||
| <div class="option">☐ No, but I'm willing to learn</div> | ||
| <div class="option">☐ No, and I'm not familiar with it</div> |
There was a problem hiding this comment.
The third and fourth options are not mutually exclusive - someone can be unfamiliar but still willing to learn.
Perhaps something like "No, and I'm not interested" would work better?
There was a problem hiding this comment.
Agreed and updated, to the following, they should be keen not just 'willing'!
<div class="question">Q2. Have you used a command line interface (e.g., PowerShell, Terminal, Linux shell) before?</div>
<div class="option">☐ Yes, regularly (I use it for multiple tasks including file management and installing software)</div>
<div class="option">☐ Yes, occasionally (I've used it for simple commands, such as simple one-off calculations, navigating directories or listing files)</div>
<div class="option">☐ No, but keen to learn</div>
<div class="option">☐ No, and I'm not interested</div>
precourse.qmd
Outdated
| <div class="option">☐ Yes, intermediate (I can write scripts and use common packages)</div> | ||
| <div class="option">☐ Yes, basic (I've completed an introduction to R)</div> | ||
| <div class="option">☐ No, but I'm willing to learn</div> | ||
| <div class="option">☐ No experience</div> |
There was a problem hiding this comment.
Ditto comment on line 123
| - **Somewhat comfortable/Basic**: 2 points | ||
| - **Not very comfortable/Beginner**: 1 point | ||
| - **No experience/Not familiar**: 0 points | ||
|
|
There was a problem hiding this comment.
The scoring system does not neatly map onto all of the questions - some have fewer than five alternatives, some are 'tick all that apply'. This invites the student's subjective assessment in those instances, which may not be appropriate (self-confidence varies across individuals).
| <div class="option">☐ Yes, occasionally (I've tried them a few times)</div> | ||
| <div class="option">☐ No, but I'm interested in trying</div> | ||
| <div class="option">☐ No, and I'm not interested</div> | ||
|
|
There was a problem hiding this comment.
Q21 - If someone doesn't want to use AI should they score lower? Perhaps controversial - people may have ethical/environmental concerns.
Possibly could also go in a non-scoring section like Q20.
precourse.qmd
Outdated
| <div class="option">☐ No, but I'm interested in learning</div> | ||
| <div class="option">☐ No, and I'm not familiar with transport datasets</div> | ||
|
|
||
| <div class="question">Q18. Are you familiar with any of these transport data sources?</div> |
There was a problem hiding this comment.
"(Tick all that apply)" should be added.
precourse.qmd
Outdated
| <div class="option">☐ I plan to use a university computer lab</div> | ||
| <div class="option">☐ I plan to use cloud-based services (e.g., GitHub Codespaces)</div> | ||
|
|
||
| <div class="question">Q26. Have you installed any of the following software?</div> |
There was a problem hiding this comment.
"(Tick all that apply)" should be added.
precourse.qmd
Outdated
| <div class="option">☐ Yes, intermediate (I can write scripts and use common libraries)</div> | ||
| <div class="option">☐ Yes, basic (I've completed an introduction to Python)</div> | ||
| <div class="option">☐ No, but I'm willing to learn</div> | ||
| <div class="option">☐ No experience</div> |
There was a problem hiding this comment.
Ditto comment on line 123
precourse.qmd
Outdated
| <div class="option">☐ Yes, extensively (I regularly work with transport data)</div> | ||
| <div class="option">☐ Yes, occasionally (I've used transport datasets in projects)</div> | ||
| <div class="option">☐ No, but I'm interested in learning</div> | ||
| <div class="option">☐ No, and I'm not familiar with transport datasets</div> |
There was a problem hiding this comment.
Ditto comment on line 123
precourse.qmd
Outdated
| <div class="option">☐ Yes, intermediate (I can commit, push, and pull code)</div> | ||
| <div class="option">☐ Yes, basic (I've created a GitHub account and made simple commits)</div> | ||
| <div class="option">☐ No, but I'm willing to learn</div> | ||
| <div class="option">☐ No experience</div> |
There was a problem hiding this comment.
Ditto comment on line 123
|
Great feedback @harrysroberts, many thanks! I plan to look at this and update tomorrow. |
|
Updated Q2 last option to "No, and I'm not interested" to ensure mutual exclusivity, as suggested. |
…d hidden scoring comments
…olds in precourse.qmd
…course.qmd" This reverts commit 60f3996.
No description provided.