Skip to content

Early python kill after enabling CAPES support in production #73

@snowme34

Description

@snowme34

The key line: ./docker-run.sh: line 6: 6 Killed

Below is the abridged log.

/usr/local/lib/python3.7/site-packages/requests/__init__.py:80: RequestsDependencyWarning: urllib3 (1.24.1) or chardet (3.0.4) doesn't match a supported version!
  RequestsDependencyWarning)
Beginning department scraping.
Finished department scraping.
Beginning course scraping.
Initializing 1 threads ...
Thread 0 is starting.
...
[T0] Saving WES to /cache/capes_pages/WES.html ...
Thread 0 has finished the work assigned to it.
Finished CAPES scraping.
Beginning course parsing.
...
[Courses] Parsing department CSE.
Finished course parsing.
Begin cleaning database.
Finished cleaning database.
Beginning CAPES parsing.
[CAPES] Parsing department LTSP.
[CAPES] Parsing department TDDE.
[CAPES] Parsing department LIHL.
[CAPES] Skipping department MCWP. No reviews found.
[CAPES] Parsing department REV.
[CAPES] Skipping department BGGN. No reviews found.
[CAPES] Parsing department MAE.
[CAPES] Parsing department HUM.
[CAPES] Skipping department GPPS. No reviews found.
[CAPES] Skipping department CLRE. No reviews found.
[CAPES] Skipping department HLAW. No reviews found.
[CAPES] Parsing department BIEB.
[CAPES] Parsing department LTEN.
[CAPES] Parsing department PSYC.
[CAPES] Skipping department BGSE. No reviews found.
[CAPES] Parsing department LTKO.
[CAPES] Parsing department BENG.
[CAPES] Parsing department ANTH.
[CAPES] Parsing department MUS.
[CAPES] Parsing department TMC.
[CAPES] Skipping department LTCO. No reviews found.
[CAPES] Parsing department LTTH.
[CAPES] Skipping department EMED. No reviews found.
[CAPES] Parsing department ANSC.
[CAPES] Parsing department BIMM.
[CAPES] Skipping department PEDS. No reviews found.
[CAPES] Parsing department HILA.
[CAPES] Parsing department HDP.
[CAPES] Parsing department JAPN.
[CAPES] Skipping department WES. No reviews found.
[CAPES] Parsing department LTGM.
[CAPES] Skipping department BNFO. No reviews found.
[CAPES] Skipping department SURG. No reviews found.
[CAPES] Skipping department LIFR. No reviews found.
[CAPES] Skipping department AESE. No reviews found.
[CAPES] Parsing department HISC.
[CAPES] Skipping department DSE. No reviews found.
[CAPES] Parsing department SE.
[CAPES] Skipping department GPIM. No reviews found.
[CAPES] Parsing department ENVR.
[CAPES] Parsing department HIEU.
[CAPES] Parsing department LIGN.
[CAPES] Parsing department COGS.
[CAPES] Parsing department ECE.
[CAPES] Parsing department LIGM.
[CAPES] Parsing department NANO.
[CAPES] Skipping department LHCO. No reviews found.
[CAPES] Skipping department NEU. No reviews found.
[CAPES] Parsing department DOC.
[CAPES] Parsing department PHYS.
[CAPES] Parsing department LTLA.
[CAPES] Parsing department COMM.
[CAPES] Skipping department GPCO. No reviews found.
[CAPES] Parsing department HITO.
[CAPES] Skipping department GPLA. No reviews found.
[CAPES] Skipping department GPPA. No reviews found.
[CAPES] Skipping department SIOC. No reviews found.
[CAPES] Parsing department DSGN.
[CAPES] Skipping department MATS. No reviews found.
[CAPES] Parsing department CENG.
[CAPES] Skipping department PHAR. No reviews found.
[CAPES] Parsing department LTEA.
[CAPES] Skipping department ANES. No reviews found.
[CAPES] Parsing department HINE.
[CAPES] Parsing department LTCS.
[CAPES] Parsing department VIS.
[CAPES] Parsing department DSC.
[CAPES] Skipping department GPGN. No reviews found.
[CAPES] Skipping department UROL. No reviews found.
[CAPES] Skipping department PATH. No reviews found.
[CAPES] Parsing department LISP.
[CAPES] Parsing department TDPR.
[CAPES] Parsing department LTWL.
[CAPES] Parsing department LTEU.
[CAPES] Skipping department SOCG. No reviews found.
[CAPES] Parsing department ANAR.
[CAPES] Parsing department JUDA.
[CAPES] Skipping department MSED. No reviews found.
[CAPES] Parsing department USP.
[CAPES] Parsing department MGT.
[CAPES] Skipping department RMED. No reviews found.
[CAPES] Parsing department TDHT.
[CAPES] Parsing department FILM.
[CAPES] Parsing department AIP.
[CAPES] Skipping department SOMI. No reviews found.
[CAPES] Skipping department BIOM. No reviews found.
[CAPES] Skipping department GPEC. No reviews found.
[CAPES] Parsing department ESYS.
[CAPES] Parsing department TDDM.
[CAPES] Parsing department BIPN.
[CAPES] Parsing department LIPO.
[CAPES] Skipping department RAD. No reviews found.
[CAPES] Parsing department LAWS.
[CAPES] Skipping department SIOB. No reviews found.
[CAPES] Parsing department LTGK.
[CAPES] Skipping department SPPS. No reviews found.
[CAPES] Parsing department MMW.
[CAPES] Skipping department CLIN. No reviews found.
[CAPES] Parsing department LTAM.
[CAPES] Parsing department TWS.
[CAPES] Parsing department WARR.
[CAPES] Skipping department SOMC. No reviews found.
[CAPES] Parsing department INTL.
[CAPES] Parsing department TDDR.
[CAPES] Skipping department DERM. No reviews found.
[CAPES] Parsing department TDMV.
[CAPES] Parsing department CAT.
[CAPES] Parsing department MATH.
[CAPES] Parsing department LTFR.
./docker-run.sh: line 6:     6 Killed                  python3 -u datautil/webreg_scrape_upload.py
[uWSGI] getting INI configuration from application.ini
...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions