DEV To STAGING (#311)

* Remove unused library and commented code

* Issue fixed

* 224 color mismatch in graph viz model (#225)

* count changes

* added legend count

* bloom url changes

* lint changes

* removal of console

---------

Co-authored-by: kartikpersistent <[email protected]>

* Modified retrieval query (#226)

* Manage file status (#227)

* manage status of processing file

* Remove progress bar from Generate Graph Document button

* 224 color mismatch in graph viz model (#225)

* count changes

* added legend count

* bloom url changes

* lint changes

* removal of console

---------

Co-authored-by: kartikpersistent <[email protected]>

* Modified retrieval query (#226)

* Convert KNN score value string to Float

---------

Co-authored-by: Prakriti Solankey <[email protected]>
Co-authored-by: kartikpersistent <[email protected]>
Co-authored-by: vasanthasaikalluri <[email protected]>

* Chatbot optimization (#230)

* Optimised and cleaned Chatbot Integration

* modified chat integration functions

* bug changes (#231)

* batch queries and relationship count correction (#232)

* batch queries and relationship count correction

* status should not be processing

* 'url_changes' (#235)

* Color mismatch in graph viz model (#233)

* count changes

* added legend count

* bloom url changes

* lint changes

* removal of console

* 'colour'

* 'color'

---------

Co-authored-by: kartikpersistent <[email protected]>

* lint fixes

* Create schema endpoint to get labels and relationtypes

* source link fixes

* Handle exception when youtube Api unable to fetch transcript
youtube_transcript_api._errors.TranscriptsDisabled

* configured backend status based the ENV Variable (#246)

* configured backend status based the ENV Variable

* removed the connection status check in PROD enviournment

* Requirement split gcs and s3 icons on the page (#247)

* separated S3 and GCS

* resolved the conflicts

* Update error message in response

* dev env

* Chatbot optimization (#250)

* Optimised and cleaned Chatbot Integration

* modified chat integration functions

* Modified max_tokens and min_score

* Modified prompt and added error message

* Modified Prompt and error message

* 245 bug chatbot UI (#252)

* fixed chatbot aspect ratio/width issue

* fixed chat bot ui issue

* 'hoverchanges' (#254)

* added settings panel for relationship type and node label selection (#234)

* added settings panel for relationship type and node label selection

* added checkbox for fetching existing scehma

* integrated /schema api

* added dependency in the useCallback

* usercredentials payload fix

* Accept param in Extract API to filter graph to allowedNode and allowedRealationship

* CHange param type in extract

* Issue fixed

* integrated extract api

* updated string as list for allowednodes and allowedrelations

* removed button on settings

* format fixes

* Added baseEntityLabel as True

---------

Co-authored-by: Pravesh Kumar <[email protected]>
Co-authored-by: aashipandya <[email protected]>

* Handle File status for long time (#256)

* format fixes

* fixed failed status bug

* Fixed list.split issue in allowed nodes

* Issue fixed

* Updated check of empty allowed nodes and allowed relations list (#258)

* added settings panel for relationship type and node label selection

* added checkbox for fetching existing scehma

* integrated /schema api

* added dependency in the useCallback

* usercredentials payload fix

* Accept param in Extract API to filter graph to allowedNode and allowedRealationship

* CHange param type in extract

* Issue fixed

* integrated extract api

* updated string as list for allowednodes and allowedrelations

* check for empty list of nodes and relations

---------

Co-authored-by: kartikpersistent <[email protected]>
Co-authored-by: Pravesh Kumar <[email protected]>

* Removed wrong commit

* Updated condition for allowed nodes relations (#265)

* added settings panel for relationship type and node label selection

* added checkbox for fetching existing scehma

* integrated /schema api

* added dependency in the useCallback

* usercredentials payload fix

* Accept param in Extract API to filter graph to allowedNode and allowedRealationship

* CHange param type in extract

* Issue fixed

* integrated extract api

* updated string as list for allowednodes and allowedrelations

* check for empty list of nodes and relations

* condition updated

* removed frontend changes

---------

Co-authored-by: kartikpersistent <[email protected]>
Co-authored-by: Pravesh Kumar <[email protected]>

* changed the checkbox to button (#266)

* Adding link to Aura on the connection modal (#263)

* Remove node id title changes (#264)

* Remove the id and type changes from the nodes as that makes them incompatible with the relationships

* common function for saving nodes and relations to graph

---------

Co-authored-by: aashipandya <[email protected]>

* fixed the legend container height issue (#267)

* added supported files description (#268)

* fixed legends gap issue

* format fixes

* parameter should be none not str (#269)

* Chatbot latency optimization (#270)

* Added graph Object and Modified Retrieval query

* Added Database parameter to API

* Modified Database parameter

* added connect in place of submit ,added connect to neo4j aura in place of connect to neo4j  (#271)

* added connect in place of submit added connect to neo4j aura inplace of connect to neo4j

* added open graph with bloom

* removed the Aura as it can connect with any neo4j db

* label colour fix (#273)

* removed default Person and Works AT for allowed nodes and relationship types

* changed the Wikipedia input label

* removed unused constants

* wikipedia whitespaces fix

* wikipedia url and youtube white spaces error (#280)

* urgent fix (#281)

* Info in the chat response (#282)

* Added graph Object and Modified Retrieval query

* Added Database parameter to API

* Modified Database parameter

* Added info parameter to output

* reestablished the sse on page refresh to sync the processing status (#285)

* UI bugs/features (#284)

* disabled the use existing schema on no node labels

* added docs Icon

* decreased the alert window in the success scenario

* added trim for inputs for white space handling in the youtube wikipedia gcs

* Time estimation alert for large files (#287)

* reestablished the sse on page refresh to sync the processing status

* added the time estimation message for large files

* showing alert only once

* delete api for removing documents (#290)

* Show connection uri (#291)

* added Connection URI

* UI updated

* removed duplicate useEffect

* Backend queries (#257)

* created backend queries for graph

* Modified username parameter

* Added GET request

* Modified exceptions

* 'frontendHandling'

* removed session id parameter

* doc_limit

* 'type_changes'

* 'nameChanges'

* graph viz ui

* legend renamed

* renamed

* removed import

* removed duplicate useEffect

---------

Co-authored-by: kartikpersistent <[email protected]>
Co-authored-by: Prakriti Solankey <[email protected]>
Co-authored-by: Prakriti Solankey <[email protected]>

* Delete list of documents from db (#293)

* delete api for removing documents

* Added list of documents for deletion

* Update exception to track Json_payload

* Delete api (#296)

* delete api for removing documents

* Added list of documents for deletion

* added delete functionality

---------

Co-authored-by: aashipandya <[email protected]>

* Delete api (#298)

* delete api for removing documents

* Added list of documents for deletion

* added delete functionality

* changed the message and disabled the delete files if there is no selected files

* format fixes

---------

Co-authored-by: aashipandya <[email protected]>

* removed duplicate variables

* css change

* upgraded the nvl package

* removed duplicate delete button

* closing the event source on failed condition

* nvl issue 261 - private package (#299)

* Fix issue #261 #261

* Fix issue #261 #261

---------

Co-authored-by: kartikpersistent <[email protected]>

* Delete with entities switch (#300)

* added delete entities switch

* added the hover message on checkboxes

* changed query for deletion of files

* changed the font size the confimation message

---------

Co-authored-by: aashipandya <[email protected]>

* docker changes

* disabled the checkbox when File status is uploading or processing

* Added Cloud logging library for strucred logs

* replaced switch with checkbox

* removed unused imports

* spell mistake

* removed the cancel button on delete popup modal

* bug_fix_labels_mismatch_count

* deletion scenarios

* fixed / trailing bug in s3 bucket url

* Switch frontend port in docker-compose to 8080 to match with the frontend Dockerfile (#305)

* Add in Each api google log struct

* Implemented polling for status update (#309)

* Implemented polling for status update

* status updation for large files

* added example env in the frontend

* updated the readme with frontend env info

* readme changes

* readme updates

* setting up failed status

---------

Co-authored-by: Prakriti Solankey <[email protected]>
Co-authored-by: kartikpersistent <[email protected]>
Co-authored-by: vasanthasaikalluri <[email protected]>
Co-authored-by: aashipandya <[email protected]>
Co-authored-by: Morgan Senechal <[email protected]>
Co-authored-by: Michael Hunger <[email protected]>
Co-authored-by: Prakriti Solankey <[email protected]>

Author: 7 people

README.md

@@ -61,8 +61,18 @@ NEO4J_PASSWORD = ""\
 AWS_ACCESS_KEY_ID =  ""\
 AWS_SECRET_ACCESS_KEY = ""\
 EMBEDDING_MODEL = ""\
-IS_EMBEDDING = "TRUE"
-KNN_MIN_SCORE = ""\
+IS_EMBEDDING = "TRUE"\
+KNN_MIN_SCORE = ""
+
+## Setting up Enviournment Variables For Frontend Configuration
+
+Create .env file in the frontend root folder and update the following env variables.\
+BACKEND_API_URL=""\
+BLOOM_URL=""\
+REACT_APP_SOURCES=""\
+LLM_MODELS=""\
+ENV=""\
+TIME_PER_CHUNK=
 
 ## Functions/Modules
 

backend/example.env

@@ -13,4 +13,5 @@ LANGCHAIN_API_KEY = ""
 LANGCHAIN_PROJECT = ""
 LANGCHAIN_TRACING_V2 = ""
 LANGCHAIN_ENDPOINT = ""
-NUMBER_OF_CHUNKS_TO_COMBINE = ""
+NUMBER_OF_CHUNKS_TO_COMBINE = ""
+# NUMBER_OF_CHUNKS_ALLOWED = ""

backend/requirements.txt

@@ -164,4 +164,5 @@ wrapt==1.16.0
 yarl==1.9.4
 youtube-transcript-api==0.6.2
 zipp==3.17.0
-sentence-transformers
+sentence-transformers
+google-cloud-logging==3.10.0