Multiple Data Source

[nhtkid]

Hey Fam,

Not an issue but I'd like to know how to connect to multiple data sources like SharePoint or the Azure Storage?

Thanks!

[itmilos]

Hi @nhtkid I agree with you 100%, please look at #225

[aymiee]

This amazing demo was a great tutorial on how to respond using Enterprise Data, but the approach I used was Microsoft Graph API to retrieve the data from our SharePoint Document Libraries. I had more control this way then using a Sharepoint Indexer. I was able to insert the data in the Azure storage, chunked the data and insert into the Index. I will be creating several indexes for difference departments in our organizations. Our document libraries have pdf, doc, excel so using different libraries to chunk the data prior to inserting into the index (similar to the demo). Using Microsoft Graph API to retrieve documents that are marked for indexing will also allow us to upload changes to Azure Blob and Index. Would love to hear what others are doing.

[vrajroutu]

Microsoft is preparing to launch plugins in coming days. These plugins will enable users to seamlessly connect with a wide range of data stores, including databases and other relevant sources of information.

[kristofrabay]

@aymiee is there any way I could contact you with a couple of questions regarding your approach to multiple types of documents and their integrability with OpenAI service?

[aymiee]

Sure, my linkedIn: https://www.linkedin.com/in/aymiee-lee-1ab2a486/

[vrajroutu]

@aymiee would you like to share your implementation?

[Tesax123]

Hello @aymiee , I sent you a request on LinkedIn too (I am Tessa).
I am extending the same things as you are. Right now I support pdf, docx, ppt(x) and xlsx.
However I still need to implement the Microsoft Graph API. I would love to connect and exchange thoughts and issues with each other. Thank you.

[yadavdilip183]

Hi @Tesax123 Can you please share us the implementation. How you did for other file formats as well.?
My Linkedin : https://www.linkedin.com/in/dilipkumar5/

[tickx-cegeka]

Hi @Tesax123 Can you please share us the implementation. How you did for other file formats as well.?

Writing from my other account.
I can tell you that I personally used python-docx, python-pptx and openpyxl libraries for other file supports. Implementation very similar to the pypdf code that is already there. Good luck

[vrajroutu]

I just completed integrating SharePoint. All you need to follow this instructions here https://learn.microsoft.com/en-us/azure/search/search-howto-index-sharepoint-online
And modify app.py to add another search client and modify approaches to search in SharePoint index as well.

[vrajroutu]

Hello @aymiee , I sent you a request on LinkedIn too (I am Tessa).

I am extending the same things as you are. Right now I support pdf, docx, ppt(x) and xlsx.

However I still need to implement the Microsoft Graph API. I would love to connect and exchange thoughts and issues with each other. Thank you.

Hello @Tesax123 how are you ingesting your xslx files?

[aymiee]

I am sharing my code changes for retrieving data from Sharepoint Document Libraries in hopes that others can assist with my challenges. This is POC and not production ready.

You will need to create a Azure App per https://learn.microsoft.com/en-us/azure/search/search-howto-index-sharepoint-online. You can stop there and just use the Sharepoint Indexer. However, it didn't give me the control I needed. Basically, instead of pointing to a folder, I retrieved my documents from Sharepoint Docoument Library via the Microsoft Graph API.

However, I am faced with challenges. The challenges I have is is chunking up PDF's, docx, xlsx and saving in the index to be served to ChatGPT. PDF's and docx work fine; however, when chunking up a table in excel:

1. I had to make sure that only values not formulas were in the cells. I'm using openpyxl which does not evaluate formulas very well. Need to look into pyexcelerate or xlwings.
2. Even though, the values were saved and inserted into the index, there's no frame of reference ..ie column names. When prompt ChatGPT, results were inconsistent.
3. So my currently implementation for excel is indexing each row of data as a separate document with the column names. But, this leads to situations where a row is split across multiple documents, or where a single document contains parts of multiple rows. When you chunk the data in this way, the reference to the original rows (e.g., the identifiers in column 'A') is lost.

..oh! Make sure your column headings are one one line

To run, (back up your prepdocs.py and use mine), just type prepdocs.ps1. While testing, I toggle between setting this args.removeall from True to False delete the blobs and index.

[nhtkid]

Hi @aymiee,

ACS just had an update and now you can connect to your own data in the Playground.

https://techcommunity.microsoft.com/t5/ai-cognitive-services-blog/introducing-azure-openai-service-on-your-data-in-public-preview/ba-p/3847000

Not only that, you could generate the code and deploy the app directly within the Studio.

As suggested in the comment of above link from a MS employee, direct connection with SPO is not yet supported.
However, it now supports Azure Blob and ACS Index.

I am asking whether you could just turn the SPO content to ACS Index so you could connect to it as a workaround?

[nhtkid]

I just completed integrating SharePoint. All you need to follow this instructions here https://learn.microsoft.com/en-us/azure/search/search-howto-index-sharepoint-online And modify app.py to add another search client and modify approaches to search in SharePoint index as well.

Did you have to apply the preview for SharePoint Index in ACS?

[aymiee]

Thanks @nhtkid, when I tried the Sharepoint Indexer a few weeks, it worked great! but I didn't have the control I needed. At the time, I couldn't

1. Point to a specific folder in a document library.
2. I couldn't specify what files I wanted indexed. I don't want all files indexed. There could be 1000's. Right now, we created a column in Sharepoint called IndexYN. If it's Y, then the Graph API picks up the file for insertion into the blob and index.
3. The Sharepoint Indexer is an all or nothing.... I only want files that have been modified and can do this with the Graph API. I couldn't do this with the indexer. Perhaps I need to look at the property called dataChangeDetectionPolicy in the datasource of the Indexer?
4. And what about chunking? When using the Sharepoint Indexer, how are you handling the chunking before you insert it into the index? I got an error regarding length when prompting with ChatGPT (Azure OpenAI)

I wrote this as a POC with Microsoft Graph API in an azure function and also modified it in the python demo for ease of use and to get feedback. But like I said, I tried the Sharepoint Indexer weeks ago, if it has changed to allow for those issues above, I definitely need to re-examine Sharepoint Indexer. Please let me know. I loved the ease of the Sharepoint Indexer.

My challenge remains with excel. Ours are massive workbooks. I can specify what sheets need to be Indexed if I code it manually. Does the Sharepoint Indexer handle excel better?

EDIT: I reconnected Sharepoint Indexer so I can add it as a Data Source in the Chat PlayGround, works well for docx and pdf but excel files are a mess.

Please let me know your experiences. Thanks again.