Add config and table renames

Author: natoverse

docs/config/yaml.md

@@ -66,7 +66,7 @@ models:
 - `parallelization_num_threads` **int** - The maximum number of work threads.
 - `async_mode` **asyncio|threaded** The async mode to use. Either `asyncio` or `threaded.
 
-### embeddings
+### embed_text
 
 By default, the GraphRAG indexer will only export embeddings required for our query methods. However, the model has embeddings defined for all plaintext fields, and these can be customized by setting the `target` and `names` fields.
 
@@ -143,7 +143,7 @@ This section controls the cache mechanism used by the pipeline. This is used to
 - `base_dir` **str** - The base directory to write cache to, relative to the root.
 - `storage_account_blob_url` **str** - The storage account blob URL to use.
 
-### storage
+### output
 
 This section controls the storage mechanism used by the pipeline used for exporting output tables.
 
@@ -179,7 +179,7 @@ This section controls the reporting mechanism used by the pipeline, for common e
 - `base_dir` **str** - The base directory to write reports to, relative to the root.
 - `storage_account_blob_url` **str** - The storage account blob URL to use.
 
-### entity_extraction
+### extract_graph
 
 #### Fields
 
@@ -215,7 +215,7 @@ Defines settings for NLP-based graph extraction methods.
   - noun_phrase_tags **list[str]** - List of noun phrase tags to ignore.
   - noun_phrase_grammars **dict[str, str]** - Noun phrase grammars for the model (cfg-only).
 
-### claim_extraction
+### extract_claims
 
 #### Fields
 
@@ -286,7 +286,6 @@ Indicates whether we should run UMAP dimensionality reduction. This is used to p
 
 - `embeddings` **bool** - Export embeddings snapshots to parquet.
 - `graphml` **bool** - Export graph snapshots to GraphML.
-- `transient` **bool** - Export transient workflow tables snapshots to parquet.
 
 ## Query
 
@@ -376,4 +375,4 @@ Indicates whether we should run UMAP dimensionality reduction. This is used to p
 
 ### workflows
 
-**str** - This is a list of workflow names to run, in order. GraphRAG has built-in pipelines to configure this, but you can run exactly and only what you want by specifying the list here. Useful if you have done part of the processing yourself.
+**list[str]** - This is a list of workflow names to run, in order. GraphRAG has built-in pipelines to configure this, but you can run exactly and only what you want by specifying the list here. Useful if you have done part of the processing yourself.

docs/index/outputs.md

@@ -10,7 +10,7 @@ All tables have two identifier fields:
 | id                | str  | Generated UUID, assuring global uniqueness |
 | human_readable_id | int  | This is an incremented short ID created per-run. For example, we use this short ID with generated summaries that print citations so they are easy to cross-reference visually. |
 
-## create_final_communities
+## communities
 This is a list of the final communities generated by Leiden. Communities are strictly hierarchical, subdividing into children as the cluster affinity is narrowed.
 
 | name             | type  | description |
@@ -25,7 +25,7 @@ This is a list of the final communities generated by Leiden. Communities are str
 | period           | str   | Date of ingest, used for incremental update merges. ISO8601 |
 | size             | int   | Size of the community (entity count), used for incremental update merges. |
 
-## create_final_community_reports
+## community_reports
 This is the list of summarized reports for each community.
 
 | name              | type  | description |
@@ -43,7 +43,7 @@ This is the list of summarized reports for each community.
 | period            | str   | Date of ingest, used for incremental update merges. ISO8601 |
 | size              | int   | Size of the community (entity count), used for incremental update merges. |
 
-## create_final_covariates
+## covariates
 (Optional) If claim extraction is turned on, this is a list of the extracted covariates. Note that claims are typically oriented around identifying malicious behavior such as fraud, so they are not useful for all datasets.
 
 | name           | type | description |
@@ -59,7 +59,7 @@ This is the list of summarized reports for each community.
 | source_text    | str  | Short string of text containing the claimed behavior. |
 | text_unit_id   | str  | ID of the text unit the claim text was extracted from. |
 
-## create_final_documents
+## documents
 List of document content after import.
 
 | name          | type  | description |
@@ -69,7 +69,7 @@ List of document content after import.
 | text_unit_ids | str[] | List of text units (chunks) that were parsed from the document. |
 | metadata      | dict  | (optional) If specified during CSV import, this is a dict of metadata for the document. |
 
-## create_final_entities
+## entities
 List of all entities found in the data by the LM.
 
 | name          | type  | description |
@@ -78,22 +78,11 @@ List of all entities found in the data by the LM.
 | type          | str   | Type of the entity. By default this will be "organization", "person", "geo", or "event" unless configured differently or auto-tuning is used. |
 | description   | str   | Textual description of the entity. Entities may be found in many text units, so this is an LM-derived summary of all descriptions. |
 | text_unit_ids | str[] | List of the text units containing the entity. |
+| degree        | int   | Node degree (connectedness) in the graph. |
+| x             | float | X position of the node for visual layouts. If graph embeddings and UMAP are not turned on, this will be 0. |
+| y             | float | Y position of the node for visual layouts. If graph embeddings and UMAP are not turned on, this will be 0. |
 
-## create_final_nodes
-This is graph-related information for the entities. It contains only information relevant to the graph such as community. There is an entry for each entity at every community level it is found within, so you may see "duplicate" entities.
-
-Note that the ID fields match those in create_final_entities and can be used for joining if additional information about a node is required.
-
-| name      | type  | description |
-| --------- | ----- | ----------- |
-| title     | str   | Name of the referenced entity. Duplicated from create_final_entities for convenient cross-referencing. |
-| community | int   | Leiden community the node is found within. Entities are not always assigned a community (they may not be close enough to any), so they may have a ID of -1. |
-| level     | int   | Level of the community the entity is in. |
-| degree    | int   | Node degree (connectedness) in the graph. |
-| x         | float | X position of the node for visual layouts. If graph embeddings and UMAP are not turned on, this will be 0. |
-| y         | float | Y position of the node for visual layouts. If graph embeddings and UMAP are not turned on, this will be 0. |
-
-## create_final_relationships
+## relationships
 List of all entity-to-entity relationships found in the data by the LM. This is also the _edge list_ for the graph.
 
 | name            | type  | description |
@@ -105,7 +94,7 @@ List of all entity-to-entity relationships found in the data by the LM. This is
 | combined_degree | int   | Sum of source and target node degrees. |
 | text_unit_ids   | str[] | List of text units the relationship was found within. |
 
-## create_final_text_units
+## text_units
 List of all text chunks parsed from the input documents.
 
 | name              | type  | description |