Not having "Incremental" option for Postgres table has primary key

[hongbo-miao]

We have a table in Postgres: _airbyte_heartbeat table

create table if not exists public._airbyte_heartbeat (
     id serial primary key,
     timestamp timestamptz not null default now()
);
grant insert, update on table public._airbyte_heartbeat to airbyte_user;

I expect it has all four options because it has primary key:

• Incremental | Append + Deduped
• Full refresh | Overwrite
• Incremental | Append
• Full refresh | Append

But it only has two options:

[johnwasserman]

@hongbo-miao - for CDC can you confirm you have followed the set up guide correctly:

1. There is an active replication slot
2. The publication configured in Airbyte exists and contains this table
3. The table's Replica Identity set to Default or Full
4. Run schema discovery in the Airbyte Connection

Full guide is here

[hongbo-miao]

Thanks! @johnwasserman I can confirm:

1. Have replication slot (I am not sure why it is not active, but Airbyte sync well)
   

2. The publication configured in Airbyte exists and contains _airbyte_heartbeat table
   

3. Replica Identity set to Default.
   

I am wondering could it related to underscore _airbyte_heartbeat?

[hongbo-miao]

Hmm, when I check today, the "Incremental" options of table _airbyte_heartbeat show up for all my databases. I am not entirely sure what happened though. Because before I manually synced a few times, it still does not show up. Today when I check it shows up. 🤔

[johnwasserman]

@hongbo-miao - one final thing I forgot to mention initially is that if you had made the changes I suggested, a schema discovery would be required to see the new options appear. It's likely a schema discovery was triggered overnight and now this is visible.

[hongbo-miao]

Could be, thanks @johnwasserman !