Merge pull request #153 from afeld/gradescope

use GradeScope for NYU

Author: afeld

.github/ISSUE_TEMPLATE/new-term-nyu.md

@@ -31,7 +31,6 @@ assignees: afeld
   - [ ] Confirm it works
     - [ ] Run [initial demo](https://python-public-policy.afeld.me/en/nyu/lecture_0.html#id2)
     - [ ] Run [Lecture 3](https://python-public-policy.afeld.me/en/nyu/lecture_3.html)
-      - [ ] [Export to PDF](https://python-public-policy.afeld.me/en/nyu/assignments.html#submission)
 - [ ] New Brightspace site
   - [ ] Update bookmark
   - [ ] [Request Ed Discussions](https://support.nyu.edu/esc?id=kb_article&table=kb_knowledge&sys_id=695ab043c3cfd694d0e1b2fc05013193&recordUrl=%2Fkb_view.do%3Fsys_kb_id%3D695ab043c3cfd694d0e1b2fc05013193)
@@ -42,6 +41,9 @@ assignees: afeld
   - [ ] Import
   - [ ] Simplify name
   - [ ] Create recurring Zoom
+  - [ ] Set up Gradescope
+    - [NYU docs](https://support.nyu.edu/esc?id=kb_article&sysparm_article=KB0012077)
+    - [Official docs](https://guides.gradescope.com/hc/en-us/articles/23587619649805-Using-Gradescope-LTI-1-3-with-Brightspace-D2L-as-an-Instructor)
   - [ ] Change Assignment dates and publish them
   - [ ] Update participation dates, from [Lecture 0-5](https://python-public-policy.afeld.me/en/nyu/syllabus.html#schedule)
   - [ ] [Set up PeerMark for Final Project](https://nyu.service-now.com/sp?id=kb_article&sysparm_article=KB0018477&sys_kb_id=f89fbe521b6f9c10a575997fbd4bcb80&spa=1)

assignments.md

@@ -68,24 +68,33 @@ That is now your own copy; make edits in there directly.
 
 Engaging with comments left in {{coding_env_name}} is more than welcome.
 {% else -%}
-1. Export the notebook as a PDF. From the Jupyter interface, go to:
-   1. `File`
-   1. `Save and Export Notebook As…`
-   1. `PDF`
-   1. You may need to [allow popups](https://support.google.com/chrome/answer/95472)
-1. Glance through the PDF to ensure everything is showing up as you intend.
-   - In particular, check your visualizations.
-   - What you see is what the instructors will see.
-   - [Troubleshooting tips](#pdf-export)
-1. **If one of the Homeworks:** Upload the PDF to the {{lms_name}} Assignment.
-1. **If the Final Project:**
-   1. In [{{lms_name}}]({{lms_url}}), go to `Content`, then `Final Project`. You should see the TurnItIn/PeerMark dashboard.
-   1. Follow [these instructions](https://help.turnitin.com/feedback-studio/d2l/LTI13/student/submitting-a-paper/submitting-a-paper.htm) to upload the PDF.
-
-When you're ready to have it formally re-graded, please resubmit through the same Assignment in {{lms_name}}.
+1. Export the files.
+   - `.ipynb`:
+     1. `File`
+     1. `Download`
+   - `.py`:
+     1. `File`
+     1. `Save and Export Notebook As`
+     1. `Executable Script`
+        - You may need to [allow popups](https://support.google.com/chrome/answer/95472).
+1. Submit.
+   1. In [{{lms_name}}]({{lms_url}}), go to `Content`.
+      - Note that this is _not_ the `Assignments` tab of {{lms_name}}.
+   1. **If one of the Homeworks:**
+      1. Click `Gradescope`.
+      1. [Upload the files to the Assignment in Gradescope.](https://guides.gradescope.com/hc/en-us/articles/21865616724749-Submitting-a-Code-assignment)
+   1. **If the Final Project:**
+      1. Click `Final Project`. You should see the TurnItIn/PeerMark dashboard.
+      1. Follow [these instructions](https://help.turnitin.com/feedback-studio/d2l/LTI13/student/submitting-a-paper/submitting-a-paper.htm) to upload the files.
 {%- endif %}
 
-Note: In-class exercises will not be graded.
+### Notes
+
+{% if id == "nyu" -%}
+- You can ignore Gradescope saying "Large file hidden". The {{assistant_name}} can download the notebook to view.
+- [Resubmissions](syllabus.md#resubmission) are done the same way.
+{%- endif %}
+- In-class exercises will not be submitted/graded.
 
 ## Common issues
 
@@ -160,33 +169,3 @@ The {{coding_env_kernel_name}} is [the place where Python is installed and the c
   - Make sure you aren't loading data sets you don't need.
   - If loading a new dataset, [make it smaller](assignments/open_ended.md#reducing-data-size)
   {% if id == "nyu" %}- Close {{coding_env_kernel_name}}s you aren't using from the [Running]({{coding_env_origin}}/user-redirect/tree#running) page.{% endif %}
-
-{% if id == "nyu" -%}
-### PDF export
-
-[Jupyter notebook export to PDF is _fragile_, especially with interactive charts through Plotly.](meta/instructor_guide.md#jupyterhub-troubleshooting)
-
-If you get a **500 error**, it could be happening for a handful of reasons. Scroll to the bottom and read the message.
-
-- If it mentions `Undefined control sequence` and `\pandocbounded`, it's [an issue with the exporter](https://github.com/jupyter/nbconvert/issues/2173). Jump to the [Alternatives](#alternatives).
-- If it mentions a package being missing, ask on [Ed]({{discussions_url}}).
-- Otherwise, it may be crashing due to not being handle the complexity of the render. Try reducing your output (in the Jupyter sense) to smaller subsets. This can include:
-   - Not displaying so many rows/values
-   - Reducing the number of points that are plotted
-
-#### Alternatives
-
-If you are unable to get the direct-to-PDF export working, try:
-
-- Going through HTML:
-   1. [Export the notebook as HTML.](https://jupyterlab.readthedocs.io/en/stable/user/export.html)
-   1. Open the HTML file in your browser.
-   1. `File`->`Print…`
-   1. `Save as PDF`
-   1. If any of the visualizations are cut off:
-      1. Cancel the Print to PDF.
-      1. Viewing the HTML file, make the browser window narrower.
-         - This forces the visualizations to re-draw.
-      1. Try from `File`->`Print…` again.
-- An online converter, such as [Ploomer](https://www.convert.ploomber.io/)
-{%- endif %}

extras/lib/school.py

@@ -19,8 +19,8 @@ class SchoolText:
     name_tool_url: str
     lms_profile_pic_url: str
     lms_notification_settings_url: str
-    lms_grading_docs: str
-    lms_reorder_docs: str
+    grading_docs: str
+    grading_extension_docs: str
     coding_env_name: str
     coding_env_origin: str
     coding_env_kernel_name: str
@@ -56,8 +56,8 @@ class SchoolText:
         name_tool_url="https://courseworks2.columbia.edu/courses/210776/external_tools/62951",
         lms_profile_pic_url="https://courseworks2.columbia.edu/profile",
         lms_notification_settings_url="https://edstem.org/us/settings/notifications",
-        lms_grading_docs="https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-use-SpeedGrader/ta-p/757",
-        lms_reorder_docs="https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-move-or-reorder-an-assignment/ta-p/1289",
+        grading_docs="https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-use-SpeedGrader/ta-p/757",
+        grading_extension_docs="https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-assign-an-assignment-to-an-individual-student/ta-p/717#assign_to_student_only",
         coding_env_name="Google Colab",
         coding_env_origin="https://colab.research.google.com",
         coding_env_kernel_name="runtime",
@@ -101,8 +101,8 @@ class SchoolText:
         name_tool_url="https://www.nyu.edu/students/student-information-and-resources/registration-records-and-graduation/forms-policies-procedures/pronouns-and-name-pronunciation.html#S1",
         lms_profile_pic_url="https://community.d2l.com/brightspace/kb/articles/18108-change-personal-settings-in-brightspace",
         lms_notification_settings_url="https://brightspace.nyu.edu/d2l/Notifications/Settings?ou=432695",
-        lms_grading_docs="https://community.d2l.com/brightspace/kb/articles/3529-evaluate-assignments-using-the-assignments-tool",
-        lms_reorder_docs="https://community.d2l.com/brightspace/kb/articles/3405-reorder-edit-and-delete-assignments-and-categories",
+        grading_docs="https://guides.gradescope.com/hc/en-us/articles/22066635961357-Grading-a-Programming-Assignment#h_01HH372CKNNR01EAMQ1VS6BB7M",
+        grading_extension_docs="https://guides.gradescope.com/hc/en-us/articles/22251762857997-Extending-assignment-release-dates-due-dates-and-time-limits",
         coding_env_name="JupyterHub",
         coding_env_origin="https://padmgp-4506-spring.rcnyu.org",
         coding_env_kernel_name="kernel",
@@ -113,7 +113,7 @@ class SchoolText:
         cross_registration="https://wagner.nyu.edu/portal/students/academics/courses/across-nyu/instructions/form",
         auditing="https://wagner.nyu.edu/portal/students/academics/registration/auditing",
         r_credit="https://www.nyu.edu/students/student-information-and-resources/registration-records-and-graduation/transcripts-certifications-grades/grades.html",
-        assignment_cutoff_name="`End Date`",
+        assignment_cutoff_name="`Late Due Date`",
         python_for_mbas="https://bobcat.library.nyu.edu/permalink/f/ci13eu/nyu_aleph008975996",
         statista_url="https://search.library.nyu.edu/permalink/01NYU_INST/1697t4d/alma990062490650107871",
         final_project_proposal="https://edstem.org/us/courses/68651/discussion/5711987",
@@ -126,6 +126,7 @@ class SchoolText:
             "conda",
             # "conversation",  # Brightspace term, TODO
             "grader",
+            "gradescope",
             "jupyterhub",
             "nyu",
             "padm",

meta/adrs/submission.md

@@ -40,7 +40,7 @@ If sticking with PDFs, they can be exported from {{coding_env_name}}:
 
 ## Decision
 
-TODO
+Notebook + Python files through Gradescope
 
 ## Consequences
 

meta/assistant_guide.md

@@ -107,47 +107,47 @@ The following should be true for each Assignment:
 - [ ] Points
     - [ ] 100 points per Assignment, except for Homework 3 and the Final Project Proposal which are 50 each
     - [ ] Percentage of the overall grade matches [the breakdown in the syllabus](../syllabus.md#assignments-and-evaluation)
-- [ ] Grouped and [ordered]({{lms_reorder_docs}}) in a logical way
+{% if id == "columbia" -%}
+- [ ] Grouped and [ordered](https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-move-or-reorder-an-assignment/ta-p/1289) in a logical way
 - [ ] Display Grade as: Percentage
 - [ ] Submission Type: Online, Website URL
     - Final Project Proposal is a Discussion
 - [ ] Dates match [the schedule](../syllabus.md#schedule):
   - [ ] Due date
   - [ ] {{assignment_cutoff_name}}
-{% if id == "columbia" -%}
 - [ ] [Published](https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-publish-or-unpublish-an-assignment-as-an-instructor/ta-p/585)
 - [ ] Grading Policy Settings (under Grades tab)
   - [ ] **Late Policies:** Check "Automatically apply deduction to late assignments"
   - [ ] **Grade Posting Policies:** Automatic
 {% else -%}
-- [ ] Associated with the `Homework` gradebook category
-- [ ] [Enable TurnItIn similarity reports](https://support.nyu.edu/esc?id=kb_article&sysparm_article=KB0011354)
-- [ ] `Visible`
+- [ ] `Allow late submissions`
+- [ ] Dates match [the schedule](../syllabus.md#schedule):
+  - [ ] `Release Date` is the start of the course
+  - [ ] `Due Date`
+    - Use the start of the second section, if applicable.
+  - [ ] {{assignment_cutoff_name}}
+    - Ditto.
+- [ ] `Enable manual grading`
+- [ ] `Submission Methods Enabled`: `Upload` only
 {%- endif %}
 
 ### Grading
 
-[How to grade in {{lms_name}}]({{lms_grading_docs}})
+[Official docs]({{grading_docs}})
 
 {% if id == "columbia" -%}
 - Grading is done through [SpeedGrader](https://community.canvaslms.com/t5/Canvas-Basics-Guide/What-is-SpeedGrader/ta-p/13).
   - Filter the students to your particular section in the top right.
   - You can leave comments on particular cells through the Colab interface.
   - If points are deducted, explicitly state what the deductions are for.
 - If you're having trouble accessing the notebook in {{coding_env_name}}, make sure the URL doesn't include an `authuser` [parameter](https://developer.mozilla.org/en-US/docs/Learn_web_development/Howto/Web_mechanics/What_is_a_URL#parameters).
-{% else -%}
-- Use [annotations](https://brightspaceresources.ccc.edu/kb/how-do-i-use-the-annotation-tool-to-provide-feedback-on-an-assignment-submitted-to-an-assignment-folder/) to leave comments within the PDFs.
 {% endif -%}
 - [Scoring {% if id == "nyu" %}and regrade {% endif %}rules](../syllabus.md#assignment-scoring)
 - You are checking student submissions against the solutions. That said, student code/output doesn't need to look _exactly_ like what's in the solution, as long as they're doing what's asked for in each Step.
 When grading, points should only be deducted based on [these criteria](../syllabus.md#assignment-scoring). Please leave comments for:
   - Point deductions, explaining what it's being deducted for
   - Feedback like "this could be done better/differently," even if there isn't a corresponding point deduction
-{% if id == "columbia" -%}
-- [How to give extensions](https://community.canvaslms.com/t5/Instructor-Guide/How-do-I-assign-an-assignment-to-an-individual-student/ta-p/717#assign_to_student_only)
-{% else -%}
-- [How to give extensions](https://documentation.brightspace.com/EN/le/assignments/instructor/set_release_conditions.htm?tocpath=Instructors%7CAssess%20and%20grade%20learners%7CCreate%20assignments%20and%20assess%20submissions%7C_____7) — see "Add special access to an assignment"
-{%- endif %}
+- [How to give extensions]({{grading_extension_docs}})
   - Grant any request for 1-2 days made before the deadline; escalate others to the instructor.
   - Set the {{assignment_cutoff_name}} to the original [late submission deadline](../syllabus.md#schedule) or the new due date, whichever is later.
   {%- if id == "nyu" %}

meta/instructor_guide.md

@@ -114,17 +114,16 @@ This only shows students coming off the wait list.
 {% else -%}
 ## JupyterHub troubleshooting
 
-Most of the issues are around Plotly rendering / PDF export. Things that have been hit repeatedly:
+Most of the issues are around Plotly rendering. Things that have been hit repeatedly:
 
-- [Embedded image error in nbconvert](https://github.com/jupyter/nbconvert/issues/2173)
-  - As of 11/30/24, JupyterHub is using too new a version of pandoc in the `base` environment.
 - [Plotly JupyterLab support](https://plotly.com/python/getting-started/#JupyterLab-Support)
   - [Needs to be installed on `base` environment as well](https://blog.afeld.me/getting-plotly-to-work-in-hosted-jupyterhub-26692f5ef2be)
-- [PDF export fidelity](https://github.com/jupyterlab/jupyterlab/issues/12113)
 - [orjson attribute error through Plotly](https://github.com/plotly/plotly.py/issues/3567)
-- [PDF exporting crashes when there's a lot of data being output / in plots](../assignments.md#pdf-export)
 
-See also: comments in [`environment.yml`](https://github.com/afeld/python-public-policy/blob/main/extras/environment.yml). Attempted to distill into the [student troubleshooting guide](../assignments.md#pdf-export).
+### See also
+
+- Comments in [`environment.yml`](https://github.com/afeld/python-public-policy/blob/main/extras/environment.yml)
+- [Student troubleshooting guide](../assignments.md#common-issues)
 {%- endif %}
 
 ## Contacts