Add parsing of toc from docset.yml

This now also emits errors when

- files are linked that do not exists
- files appear on disk that are not linked.

It also parses the TableOfContents as a tree to be used to render the navigation in a follow up PR

Author: Mpdreamz

docs/source/docset.yml

@@ -3,14 +3,30 @@ exclude:
   - '_*.md'
 toc:
   - file: index.md
-  - file: config.md
-  - file: search.md
+  - folder: markup
+  - folder: elastic
     children:
-      - file: search-part2.md
-      - folder: search
-  - folder: my-folder1
-  - folder: my-folder2
+      - file: index.md
+      - folder: observability
+      - folder: reference
+      - folder: semantic-search
+      - folder: search-labs
+        children:
+          - file: index.md
+          - file: chat.md
+            children:
+              - file: chat/req.md
+              - file: chat/rag.md
+          - file: search.md
+            children:
+              - file: search/req.md
+              - file: search/setup.md
+          - file: install.md
+            children:
+              - file: install/cloud.md
+              - file: install/docker.md
+  - folder: nested
     children:
-      - file: subpath/file.md
-      - file: file.md
-      - folder: sub/folder
+      - folder: content
+      - file: index.md
+  - folder: versioning

docs/source/elastic/semantic-search/snippets/index-mapping.md renamed to docs/source/elastic/semantic-search/_snippets/index-mapping.md

@@ -38,7 +38,7 @@ The examples in this tutorial use the `amazon.titan-embed-text-v1` model from th
 
 ## Create an inference endpoint
 
-```{include} snippets/inference-endpoint.md
+```{include} _snippets/inference-endpoint.md
 ```
 
 ```{code-block} bash
@@ -67,7 +67,7 @@ PUT _inference/text_embedding/amazon_bedrock_embeddings
 
 ## Create the index mapping
 
-```{include} snippets/index-mapping.md
+```{include} _snippets/index-mapping.md
 ```
 
 ```{code-block} bash

docs/source/elastic/semantic-search/snippets/inference-endpoint.md renamed to docs/source/elastic/semantic-search/_snippets/inference-endpoint.md

@@ -39,7 +39,7 @@ The examples in this tutorial use models available through [Azure AI Studio](htt
 
 ## Create an inference endpoint
 
-```{include} snippets/inference-endpoint.md
+```{include} _snippets/inference-endpoint.md
 ```
 
 ```{code-block} bash
@@ -67,7 +67,7 @@ PUT _inference/text_embedding/azure_ai_studio_embeddings
 
 ## Create the index mapping
 
-```{include} snippets/index-mapping.md
+```{include} _snippets/index-mapping.md
 ```
 
 ```{code-block} bash

docs/source/elastic/semantic-search/amazon-bedrock.md

@@ -39,7 +39,7 @@ The examples in this tutorial use models available through [Azure OpenAI](https:
 
 ## Create an inference endpoint
 
-```{include} snippets/inference-endpoint.md
+```{include} _snippets/inference-endpoint.md
 ```
 
 ```{code-block} bash
@@ -67,7 +67,7 @@ PUT _inference/text_embedding/azure_openai_embeddings
 
 ## Create the index mapping
 
-```{include} snippets/index-mapping.md
+```{include} _snippets/index-mapping.md
 ```
 
 ```{code-block} bash

docs/source/elastic/semantic-search/azure-ai-studio.md

@@ -37,7 +37,7 @@ A [Cohere account](https://cohere.com/) is required to use the inference API wit
 
 ## Create an inference endpoint
 
-```{include} snippets/inference-endpoint.md
+```{include} _snippets/inference-endpoint.md
 ```
 
 ```{code-block} bash
@@ -65,7 +65,7 @@ When using this model the recommended similarity measure to use in the dense_vec
 
 ## Create the index mapping
 
-```{include} snippets/index-mapping.md
+```{include} _snippets/index-mapping.md
 ```
 
 ```{code-block} bash

docs/source/elastic/semantic-search/azure-openai.md

@@ -34,7 +34,7 @@ ELSER is a model trained by Elastic. If you have an Elasticsearch deployment, th
 
 ## Create an inference endpoint
 
-```{include} snippets/inference-endpoint.md
+```{include} _snippets/inference-endpoint.md
 ```
 
 ```{code-block} bash
@@ -57,7 +57,7 @@ You don’t need to download and deploy the ELSER model upfront, the API request
 
 ## Create the index mapping
 
-```{include} snippets/index-mapping.md
+```{include} _snippets/index-mapping.md
 ```
 
 ```{code-block} bash

docs/source/elastic/semantic-search/cohere.md

@@ -42,14 +42,6 @@ project:
   subject: MyST Markdown
 ```
 
-```{sidebar}
-This code is very helpful.
-
-It does lots of things.
-
-But it does not sing.
-```
-
 ```{code-block} python
     :caption: Code blocks can also have sidebars.
     :linenos: