You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
RDFConnect is a modular framework for building and executing multilingual data processing pipelines using RDF as the configuration and orchestration layer.
16
+
RDF-Connect is a modular framework for building and executing multilingual data processing pipelines using RDF as the configuration and orchestration layer.
17
17
18
18
It enables fine-grained, reusable processor components that exchange streaming data, allowing workflows to be described declaratively across programming languages and environments.
19
-
RDFConnect is especially well suited for data transformation, integration, and linked data publication.
19
+
RDF-Connect is especially well suited for data transformation, integration, and linked data publication.
20
20
21
21
# Usage Paths
22
22
@@ -45,7 +45,7 @@ This section is complete in terms of content, but may be reorganized or rewritte
45
45
46
46
# Concepts
47
47
48
-
This section introduces the core concepts of the RDFConnect framework.
48
+
This section introduces the core concepts of the RDF-Connect framework.
49
49
50
50
## Pipeline
51
51
@@ -65,7 +65,7 @@ A runner is an execution strategy for processors — for example, a processor in
65
65
66
66
The orchestrator is the core component responsible for executing a pipeline.
67
67
It reads the configuration, initializes runners, dispatches processor instantiations, and coordinates data flow between them.
68
-
It acts as the runtime conductor that interprets RDFConnect’s declarative configuration.
68
+
It acts as the runtime conductor that interprets RDF-Connect’s declarative configuration.
69
69
70
70
## Reader / Writer
71
71
@@ -79,7 +79,7 @@ These provide an idiomatic way to transport streaming data between processors.
79
79
🚧 This section is a work in progress and will be expanded soon.
80
80
</div>
81
81
82
-
This section provides a high-level overview of how to define and run a pipeline in RDFConnect. The rest of the specification provides detail on how each part works.
82
+
This section provides a high-level overview of how to define and run a pipeline in RDF-Connect. The rest of the specification provides detail on how each part works.
83
83
84
84
Here's a simple example:
85
85
@@ -95,7 +95,7 @@ The orchestrator parses the configuration, resolves all runner and processor def
95
95
96
96
# SHACL as Configuration Schema
97
97
98
-
RDFConnect uses SHACL [[shacl]] not only as a data validation mechanism but also as a schema language for defining the configuration interface of components such as processors and runners.
98
+
RDF-Connect uses SHACL [[shacl]] not only as a data validation mechanism but also as a schema language for defining the configuration interface of components such as processors and runners.
99
99
These SHACL shapes enable:
100
100
101
101
* Static validation of component descriptions.
@@ -106,7 +106,7 @@ Shapes define required and optional configuration properties, which are transfor
106
106
107
107
<div class="example" title="From SHACL to JSON configuration">
108
108
This SHACL shape definition defines a configuration structure for a processor.
109
-
In RDFConnect, such shapes are used to describe required parameters.
109
+
In RDF-Connect, such shapes are used to describe required parameters.
110
110
They result in a well-typed JSON object that developers can rely on during implementation.
111
111
112
112
Shacl shape defining some required configuration for a processor
@@ -198,13 +198,13 @@ This declares a configuration field named input whose value is an instance of `r
198
198
199
199
* `sh:class` is used in a property constraint to indicate the expected class of the object (i.e., the RDF resource at that property).
200
200
* `sh:targetClass` is used on a `sh:NodeShape` to associate it with a class, so that tools can look up the shape when encountering a value with that class.
201
-
* In RDFConnect, `sh:targetClass` shapes define reusable schemas for configuration blocks that can be nested using sh:class.
201
+
* In RDF-Connect, `sh:targetClass` shapes define reusable schemas for configuration blocks that can be nested using sh:class.
202
202
203
203
This allows composable, type-safe configuration structures where nested components follow their own validation and extraction rules.
204
204
205
205
### Special Component Types: rdfc:Reader and rdfc:Writer
206
206
207
-
`rdfc:Reader` and `rdfc:Writer` are special component types in RDFConnect.
207
+
`rdfc:Reader` and `rdfc:Writer` are special component types in RDF-Connect.
208
208
Unlike generic nested objects, these represent runtime injection points for data input and output, respectively.
209
209
210
210
* Fields with `sh:class rdfc:Reader` or `rdfc:Writer` must be instantiated by the runner environment.
@@ -294,12 +294,12 @@ This results in the following JSON object:
294
294
295
295
296
296
297
-
# RDFConnect by Layer
297
+
# RDF-Connect by Layer
298
298
299
299
300
300
## Orchestrator
301
301
302
-
The orchestrator is the central runtime entity in RDFConnect.
302
+
The orchestrator is the central runtime entity in RDF-Connect.
303
303
It reads the pipeline configuration, sets up the runners, initiates processors, and routes messages between them.
304
304
It ensures the dataflow graph described by the pipeline is brought to life across isolated runtimes.
305
305
The orchestrator acts as a coordinator, not an executor. Each runner is responsible for running the actual processor code, but the orchestrator ensures the pipeline as a whole behaves as intended.
@@ -315,7 +315,7 @@ Responsibilities:
315
315
* Handle retries, streaming, and backpressure.
316
316
317
317
<div class=note>
318
-
The remained of this section is intended for developers building custom runners or integrating RDFConnect into infrastructure.
318
+
The remained of this section is intended for developers building custom runners or integrating RDF-Connect into infrastructure.
319
319
</div>
320
320
321
321
### Protobuf Messaging Protocol
@@ -342,7 +342,7 @@ path: ./message.mdd
342
342
343
343
### Streaming Messages
344
344
345
-
For large messages or real-time input, RDFConnect supports a streaming model.
345
+
For large messages or real-time input, RDF-Connect supports a streaming model.
346
346
Instead of sending entire payloads as a single message, the message can be broken into chunks and sends them over time.
347
347
This is handled by the StreamChunk message type.
348
348
@@ -381,7 +381,7 @@ This is the main unit most users interact with when defining workflows.
381
381
382
382
# Ontology Reference
383
383
384
-
The RDFConnect ontology provides the terms used in RDF pipeline definitions. See the full [RDFConnect Ontology](https://w3id.org/rdf-connect/ontology.ttl) for details.
384
+
The RDF-Connect ontology provides the terms used in RDF pipeline definitions. See the full [RDF-Connect Ontology](https://w3id.org/rdf-connect/ontology.ttl) for details.
385
385
386
386
387
387
# Putting It All Together: Example Flow and Use Case
0 commit comments