Skip to content

Commit 84f9572

Browse files
committed
Update readme and model
1 parent 27e5251 commit 84f9572

File tree

17 files changed

+18
-64
lines changed

17 files changed

+18
-64
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ It is intended that the plugins and skills provided in this repository, are adap
1212

1313
- `./text_2_sql` contains an three Multi-Shot implementations for Text2SQL generation and querying which can be used to answer questions backed by a database as a knowledge base. A **prompt based** and **vector based** approach are shown, both of which exhibit great performance in answering sql queries. Additionally, a further iteration on the vector based approach is shown which uses a **query cache** to further speed up generation. With these plugins, your RAG application can now access and pull data from any SQL table exposed to it to answer questions.
1414
- `./image_processing` contains code for linking **Azure Document Intelligence** with AI Search to process complex documents with charts and images, and uses **multi-modal models (gpt4o)** to interpret and understand these. With this custom skill, the RAG application can **draw insights from complex charts** and images during the vector search. This function app also contains a **Semantic Text Chunking** method that aims to intelligently group similar sentences, retaining figures and tables together, whilst separating out distinct sentences.
15-
- `./deploy_ai_search` provides an easy Python based utility for deploying an index, indexer and corresponding skillset for AI Search and for Text2SQL.
15+
- `./deploy_ai_search_indexes` provides an easy Python based utility for deploying an index, indexer and corresponding skillset for AI Search and for Text2SQL.
1616

1717
The above components have been successfully used on production RAG projects to increase the quality of responses.
1818

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,6 @@
1-
1+
# Environment variables for the deploying AI Search Indexes
22
FunctionApp__Endpoint=<FunctionAppEndpoint>
33
FunctionApp__Key=<FunctionAppKey>
4-
FunctionApp__LayoutAnalysis__FunctionName=layout_analysis
5-
FunctionApp__FigureAnalysis__FunctionName=figure_analysis
6-
FunctionApp__LayoutAndFigureMerger__FunctionName=layout_and_figure_merger
7-
FunctionApp__MarkUpCleaner__FunctionName=mark_up_cleaner
8-
FunctionApp__SemanticTextChunker__FunctionName=semantic_text_chunker
94
FunctionApp__AppRegistrationResourceId=<App registration in form api://appRegistrationclientId if using identity based connections>
105
IdentityType=key # system_assigned or user_assigned or key
116
AIService__AzureSearchOptions__Endpoint=<AzureSearchEndpoint>
File renamed without changes.

deploy_ai_search/src/deploy_ai_search/ai_search.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/ai_search.py

File renamed without changes.

deploy_ai_search/src/deploy_ai_search/deploy.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/deploy.py

File renamed without changes.

deploy_ai_search/src/deploy_ai_search/environment.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/environment.py

Lines changed: 3 additions & 49 deletions
Original file line numberDiff line numberDiff line change
@@ -205,41 +205,6 @@ def function_app_app_registration_resource_id(self) -> str:
205205
"""
206206
return os.environ.get("FunctionApp__AppRegistrationResourceId")
207207

208-
@property
209-
def function_app_mark_up_cleaner_route(self) -> str:
210-
"""
211-
This function returns function app data cleanup function name
212-
"""
213-
return os.environ.get("FunctionApp__MarkUpCleaner__FunctionName")
214-
215-
@property
216-
def function_app_semantic_text_chunker_route(self) -> str:
217-
"""
218-
This function returns function app semantic text chunker name
219-
"""
220-
return os.environ.get("FunctionApp__SemanticTextChunker__FunctionName")
221-
222-
@property
223-
def function_app_layout_analysis_route(self) -> str:
224-
"""
225-
This function returns function app adi name
226-
"""
227-
return os.environ.get("FunctionApp__LayoutAnalysis__FunctionName")
228-
229-
@property
230-
def function_app_figure_analysis_route(self) -> str:
231-
"""
232-
This function returns function app figure analysis name
233-
"""
234-
return os.environ.get("FunctionApp__FigureAnalysis__FunctionName")
235-
236-
@property
237-
def function_app_layout_and_figure_merger_route(self) -> str:
238-
"""
239-
This function returns function app layout and figure merger name
240-
"""
241-
return os.environ.get("FunctionApp__LayoutAndFigureMerger__FunctionName")
242-
243208
@property
244209
def open_ai_embedding_dimensions(self) -> str:
245210
"""
@@ -257,29 +222,18 @@ def use_private_endpoint(self) -> bool:
257222
This function returns true if private endpoint is used
258223
"""
259224
return (
260-
os.environ.get("AIService__AzureSearchOptions__UsePrivateEndpoint").lower()
225+
os.environ.get(
226+
"AIService__AzureSearchOptions__UsePrivateEndpoint").lower()
261227
== "true"
262228
)
263229

264230
def get_custom_skill_function_url(self, skill_type: str):
265231
"""
266232
Get the function app url that is hosting the custom skill
267233
"""
268-
if skill_type == "mark_up_cleaner":
269-
route = self.function_app_mark_up_cleaner_route
270-
elif skill_type == "layout_analysis":
271-
route = self.function_app_layout_analysis_route
272-
elif skill_type == "figure_analysis":
273-
route = self.function_app_figure_analysis
274-
elif skill_type == "layout_and_figure_merger":
275-
route = self.function_app_layout_and_figure_merger
276-
elif skill_type == "semantic_text_chunker":
277-
route = self.function_app_semantic_text_chunker_route
278-
else:
279-
raise ValueError(f"Invalid skill type: {skill_type}")
280234

281235
full_url = (
282-
f"{self.function_app_end_point}/api/{route}?code={self.function_app_key}"
236+
f"{self.function_app_end_point}/api/{skill_type}?code={self.function_app_key}"
283237
)
284238

285239
return full_url

deploy_ai_search/src/deploy_ai_search/image_processing.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/image_processing.py

File renamed without changes.

deploy_ai_search/src/deploy_ai_search/text_2_sql_column_value_store.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/text_2_sql_column_value_store.py

File renamed without changes.

deploy_ai_search/src/deploy_ai_search/text_2_sql_query_cache.py renamed to deploy_ai_search_indexes/src/deploy_ai_search_indexes/text_2_sql_query_cache.py

File renamed without changes.

0 commit comments

Comments
 (0)