Will Pinecone ever be an integration or just a core document store?

[benharrell]

Just curious if integrations cover a different type of 3rd party "plugin" vs a more integrated core solution?

[silvanocerza]

Hey @benharrell, I guess you're talking about the deepset-ai/haystack-extras repo?

As of now no plans of moving Pinecone out of the Haystack core repository.

If I misunderstood the question let me know.

[benharrell]

Thank you, I should have linked to this page to be more clear: https://haystack.deepset.ai/integrations

Is extras repo something different?

[silvanocerza]

Ah, got it! The integrations are 3rd party library that are not part of Haystack core. We created it to have a centralized place where the community can search for other libraries that integrate with Haystack. We launched it quite recently, a week ago if I remember correctly, so there's still some stuff missing. We're adding more and more stuff as time passes.

The haystack-extras repo is maintained by the core Haystack team directly. We maintain it in a best effort basis, most of the times it doesn't have top priority. It contains modules that we removed from Haystack core but we didn't want to completely delete so people can still use them somehow.

[benharrell]

that’s great, how can I get Pinecone on the integration list? is that an MR? also i would like to contribute towards hybrid search in the Pinecone doc store. Is that also just an MR, or is that any additional steps since it is a core piece?

[silvanocerza]

To add new integration you can find all the instruction in its repository README.md.

If you want to contribute feel free to! We welcome PRs from external contributors. We also have a small guide for first time contributors to set up their local env if that's helpful.

I'd also suggest to join our community Discord. You can discuss anything about Haystack in there, and even find people to collaborate with. The Haystack team hangs around there too. :)