Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion config.toml
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ rdi_redis_gears_version = "1.2.6"
rdi_debezium_server_version = "2.3.0.Final"
rdi_db_types = "cassandra|mysql|oracle|postgresql|sqlserver"
rdi_cli_latest = "latest"
rdi_current_version = "v1.4.4"
rdi_current_version = "v1.6.0"

[params.clientsConfig]
"Python"={quickstartSlug="redis-py"}
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
Title: redis.lookup
alwaysopen: false
categories:
- docs
- integrate
- rs
- rdi
description: Lookup data from Redis using the given command and key
group: di
linkTitle: redis.lookup
summary:
Redis Data Integration keeps Redis in sync with the primary database in near
real time.
type: integration
weight: 10
---

**Properties**

|Name|Type|Description|Required|
|----|----|-----------|--------|
| **connection** |`string`| Connection name |yes|
| **cmd** | `string` |The command to execute |yes|
| [**args**](#args) | `string[]` | Redis command arguments | yes |
| **language** | `string` |Language<br/>Enum: `"jmespath"`, `"sql"`<br/>| yes |
| **field** | `string` |The target field to write the result to<br/>| yes |

**Additional Properties:** not allowed

## args\[\]: Redis command arguments {#args}

The list of expressions that produce arguments.


**Items**

**Item Type:** `string`
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
---
Title: Redis Data Integration release notes 1.6.0 (February 2025)
alwaysopen: false
categories:
- docs
- operate
- rs
description: Installation on Kubernetes with a Helm chart. Improvements for installation on VMs.
linkTitle: 1.6.0 (February 2025)
toc: 'true'
weight: 992
---

> This maintenance release replaces the 1.4.4 release.

RDI’s mission is to help Redis customers sync Redis Enterprise with live data from their slow disk-based databases to:

- Meet the required speed and scale of read queries and provide an excellent and predictable user experience.
- Save resources and time when building pipelines and coding data transformations.
- Reduce the total cost of ownership by saving money on expensive database read replicas.

RDI keeps the Redis cache up to date with changes in the primary database, using a [_Change Data Capture (CDC)_](https://en.wikipedia.org/wiki/Change_data_capture) mechanism.
It also lets you _transform_ the data from relational tables into convenient and fast data structures that match your app's requirements. You specify the transformations using a configuration system, so no coding is required.

## Headlines
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@spicy-sauce can we add something about lookup

Copy link
Collaborator

@ZdravkoDonev-redis ZdravkoDonev-redis Feb 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@andy-stark-redis

Headline to add:

  • added denormalisation lookup block - [Link to the redis docs for the lookup transformation block]

Add this to the Reference docs:
Docs for the transformation block from datayoga - https://github.com/datayoga-io/datayoga/blob/main/docs/reference/blocks/redis_lookup.md

This is the reference docs - https://redis.io/docs/latest/integrate/redis-data-integration/reference/data-transformation/

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.


- RDI now requires the RDI database to have the following properties set, otherwise
RDI will not start:
- `maxmemory_policy`: `noeviction`,
- `aof_enabled`: `1`

- Allow RDI to run in any K8s namespace

- Fix metadata API to support Oracle and SQL Server

- Added [denormalisation lookup block]({{< relref "/integrate/redis-data-integration/reference/data-transformation/lookup" >}})

- Many bug fixes

## Limitations

RDI can write data to a Redis Active-Active database. However, it doesn't support writing data to two or more Active-Active replicas. Writing data from RDI to several Active-Active replicas could easily harm data integrity as RDI is not synchronous with the source database commits.