Skip to content

AsawareeBhide/CS6476-VisRel

 
 

Repository files navigation

CS6476-TermProject

Project Website

https://akrishna77.github.io/visual-relationships/

Running the Notebook

Create a virtual environment, to avoid dependency mismatches.

conda create -n cvproj python=3.7.4
conda activate cvproj

Install dependencies from requirements.txt.

pip install -r requirements.txt

Implemented so far

Faster-RCNN - Satya Mallick's Blog

Spacy for S-P-O extraction - Peter's Github - Sticking with this!

NLTK approach - Poor performance!

Stanford Parser approach - Poor Performance!

Triplet Mining from Dataset

Few-shot learning based approach for Visual Relationship detection - triplet loss function. (Ongoing)

Things to explore

Object pair filtering.

Misc

If you're having trouble viewing the notebook, copy the link to the .ipynb file into Jupyter Notebook Viewer!

About

Visual relationship detection using few shot learning.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 99.5%
  • Python 0.5%