-
Notifications
You must be signed in to change notification settings - Fork 43
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
Our web scraper works for all past and current semesters, however it has begun to crash when scraping upcoming semesters like Fall 2025.
To Reproduce
Steps to reproduce the behavior:
- Go to 'cron-job' branch (if not merged yet)
- run 'python3 cron/no_login.py'
- wait and see if it crashes while scraping a course
- if this works, we proceed to checking the docker container instead of the script
- run 'docker compose -f docker-compose.yml -f docker-compose.development.yml up'
- view the 'yacs_cron' container by method of your choosing
- go to your 'command line' of choice in however you are viewing the docker container (this would be the 'exec' tab docker desktop
- see steps 2 and 3
Expected behavior
- The python file should run for a few minutes
- it will produce output about which types of courses it is currently scraping e.g. CSCI
- It should produce a csv file named after the semester after running
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working