Skip to content

Commit b06d22b

Browse files
[Enhancement/Document] ServiceNow instance support document (#68)
* ServiceNow instance support document * updated image * updated image * updated image --------- Co-authored-by: Vipul Mittal <[email protected]>
1 parent 6beebc0 commit b06d22b

File tree

3 files changed

+5
-3
lines changed

3 files changed

+5
-3
lines changed

README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ SyGra Framework is created to generate synthetic data. As it is a complex proces
3737
- Define a task, which involves graph node configuration, flow between nodes and conditions between the node
3838
- Define the output location to dump the generated data
3939

40-
Seed data can be pulled from either Huggingface or file system. Once the seed data is loaded, SyGra platform allows datagen users to write any data processing using the data transformation module. When the data is ready, users can define the data flow with various types of nodes. A node can also be a subgraph defined in another yaml file.
40+
Seed data can be pulled from various data source, few examples are Huggingface, File system, ServiceNow Instance. Once the seed data is loaded, SyGra platform allows datagen users to write any data processing using the data transformation module. When the data is ready, users can define the data flow with various types of nodes. A node can also be a subgraph defined in another yaml file.
4141

4242
Each node can be defined with preprocessing, post processing, and LLM prompt with model parameters. Prompts can use seed data as python template keys.
4343
Edges define the flow between nodes, which can be conditional or non-conditional, with support for parallel and one-to-many flows.
@@ -114,8 +114,10 @@ workflow.run(num_records=1)
114114
The SyGra architecture is composed of multiple components. The following diagrams illustrate the four primary components and their associated modules.
115115

116116
### Data Handler
117-
Data handler is used for reading and writing the data. Currently, it supports file handler with various file types and huggingface handler.
118-
When reading data from huggingface, it can read the whole dataset and process, or it can stream chunk of data.
117+
Data handler is used for reading and writing the data. Currently, it supports following handlers:
118+
- File handler with various file types like JSON, JSONL, CSV, Parquet, Folder with supported type.
119+
- Huggingface handler: When reading data from huggingface, it can read the whole dataset and process, or it can stream chunk of data.
120+
- ServiceNow Handler to connect a ServiceNow instance : Currently it reads or writes into a single table per dataset configuration.
119121

120122
<kbd> ![DataHandler](https://raw.githubusercontent.com/ServiceNow/SyGra/refs/heads/main/docs/resources/images/component_data_handler.png) </kbd>
121123

17.7 KB
Loading
-741 KB
Loading

0 commit comments

Comments
 (0)