Skip to content

Conversation

@badmonster0
Copy link
Member

postgre example docs

postgre example docs
@badmonster0 badmonster0 merged commit 90e1d33 into main Sep 3, 2025
2 checks passed

![Add PostgreSQL Source](/img/examples/postgres_source/source.png)

- Incremental Sync: When new or updated rows are found, only those rows are run through the pipeline, so downstream indexes and search results reflect the latest data while unchanged rows are untouched.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/are run through/run through/


## Field lineage
When the transform flow starts to getting complex, it's hard to understand how each field is derived.
CocoIndex provides a way to visualize the lineage of each field, to make it easier to trace and troubleshoot field origins and downstream dependencies.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/CocoIndex/CocoInsight/?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not resolved yet.


- One mental model: Treat files, APIs, and databases uniformly; AI steps are ordinary ops.
- Incremental by default: Use an ordinal column to sync only changes; no fragile glue jobs.
- Consistency: Embeddings are always derived from the exact transformed row state.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does "state" mean here exactly?

Don't quite understand the point it wants to emphasize on.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And this is also not resolved yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants