DLT-Hallucination-Measurement

To Run the Code

Install required libs:

pip3 install accelerate==0.21.0 peft==0.4.0 bitsandbytes==0.40.2 transformers==4.31.0 trl==0.4.7

First train the model using the following command.

python3 trainModel.py

Then run the model.

python3 runModel.py

Name		Name	Last commit message	Last commit date
Latest commit History 21 Commits
.gitignore		.gitignore
Question Similarity v2.ipynb		Question Similarity v2.ipynb
Question Similarity.ipynb		Question Similarity.ipynb
README.md		README.md
Updated Comparison Data.csv		Updated Comparison Data.csv
context.pkl		context.pkl
final.csv		final.csv
final_gpt_gen_qa.csv		final_gpt_gen_qa.csv
gpt_gen_qa.csv		gpt_gen_qa.csv
important_words.csv		important_words.csv
nerExtraction.py		nerExtraction.py
ners_tags.csv		ners_tags.csv
ners_tags_domain.csv		ners_tags_domain.csv
relationExtraction.py		relationExtraction.py
runBaseModel.py		runBaseModel.py
runModel.py		runModel.py
sentenceSimilarity.py		sentenceSimilarity.py
similar_entities.pkl		similar_entities.pkl
summary.csv		summary.csv
summary.pkl		summary.pkl
testModel.py		testModel.py
tfidfNER.ipynb		tfidfNER.ipynb
trainModel.py		trainModel.py
train_ners.csv		train_ners.csv
trained_relations.csv		trained_relations.csv
uploadModel.ipynb		uploadModel.ipynb