This service is designed to process and manage uploaded lecture material (video recordings, documents, slides) to facilitate some advanced features in the MEITREX platform.
- Splitting of lecture videos into sections based on detected slide changes via computer vision
- OCR of lecture video on screen text
- Transcript & Closed Captions generation for lecture videos
- Generating of text embeddings on a per-section-basis for videos and per-page-basis for documents
- Semantic search/fetching of semantically similar sections of lecture material
- Automatic generation of section titles for the video sections generated
For a deeper dive into the features and considerations made during development, check out our paper on DocProcAI.
The service uses the config.yaml file located in the root directory for configuration.
For further information about configuration check out this file, all configuration properties are explained using in-file comments.
For additional information on the design and implementation of this service, check out the accompanying paper.
Scripts used for training live in the training repository.