[source-facebook-marketing] Skip Inaccessible Accounts Instead of Failing Entire Sync #64898
vai-airbyte
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Problem Summary:
When we configure the Facebook Marketing connector to pull data from a list of multiple
account_ids
, the entire sync job fails if we lose access permission to just one of the accounts in that list. Instead of skipping the account with the error and proceeding with the others, the entire job is aborted.Context and Impact:
We are a digital marketing agency that manages dozens of client accounts. It is common for clients to come and go, which means our access to their Facebook Ads accounts is frequently granted and revoked.
Due to the connector's current behavior, whenever a client relationship ends and we lose access, our data pipeline for all other clients stops working. This requires a team member to manually edit the
account_ids
list in the connector's configuration to remove the problematic account.This causes:
Current Behavior (What Happens Now):
account_ids
: [account_A, account_B, account_C].Result: No data is synced, not even for account_A and account_B, for which we still have valid permissions.
Expected Behavior (What Should Happen):
a. Attempts to sync account_C and encounters a permission error.
b. Logs a clear WARNING or ERROR in the logs, stating that account_C was skipped due to a permission error (e.g., "Skipping account_id 'account_C' due to permission error.").
c. Continues the process and successfully syncs the data for account_A and account_B.
Result: The job finishes successfully (or with a "partial success" status), and the data from the valid accounts is imported into our destination (BigQuery), ensuring service continuity for our other clients.
Beta Was this translation helpful? Give feedback.
All reactions