[source-intercom] New Data Export Stream

[neddinn]

Goal

Expose Intercom’s new async Reporting-data-export endpoint as a stream in the Airbyte source-intercom connector.

Context

We recently released an async export API at Intercom (see docs ↗️).
It lets users enqueue an export job for arbitrary datasets (e.g., conversations) and download the result once the job is complete.

Airbyte customers need this data for historical analytics that are not available through the REST pagination endpoints, or are slow to back-fill.

Scope of work

1. Declarative manifest changes

   • Add a new DeclarativeStream dataset_export that:
     • Uses an AsyncRetriever with
       creation_requester ➜ POST /export/reporting_data/enqueue
polling_requester ➜ GET /export/reporting_data/{job_identifier}
download_requester ➜ GET {{download_url}}
     • Applies Intercom bearer auth.
     • Decodes the payload.
   • Add the stream to the source’s check.stream_names list.
   • Extend the Spec with the required user inputs (api_key, dataset_id, attribute_ids, start_time, end_time).

2. Schema stub

   • Add a permissive schema (additionalProperties: true) named dataset_export until we can derive the CSV header dynamically.

References

• Intercom Export API: https://developers.intercom.com/docs/references/unstable/rest-api/api.intercom.io/reporting-data-export/paths/~1export~1reporting_data~1enqueue/post