Source Salesforce: allow to have conditional queries

[DanielTrontsios]

Hello, Airbyte community,

After setting up a few connectors with Salesforce I wasn't able to find a way to make conditional queries to my org. Is there a way to achieve that?

[marcosmarxm]

Today this is not possible. Airbyte has the option to filter streams to reduce the payload returned during the discover step and make the connector faster.

Airbyte connectors always try to retrieve all records and you need to filter downstream. This is helpful if you need this data in the future and follows the ELT paradigm. Sometimes, because you have a huge data probably you want to have ways to filter or reduce the ingestion... I changed your discussion to be an Idea and let's see what other users think about.

[PilarIH]

I'm looking for a way to specify the tables that you'd need to ingest from Salesforce without having to create a connector per each table or having an issue if I create a new table in SF that would comply with the filter but I don't want it in the E/L pipeline. Is there any solution for this so far?