You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: examplecode/codesamples/api/huggingchat.mdx
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
title: Query processed PDF with HuggingChat
3
3
---
4
4
5
-
This example uses the [Unstructured Ingest Python library](/ingestion/overview#unstructured-ingest-python-library) or the
5
+
This example uses the [Unstructured Ingest Python library](/ingestion/python-ingest) or the
6
6
[Unstructured JavaScript/TypeScript SDK](/platform-api/partition-api/sdk-jsts) to send a PDF file to
7
7
the [Unstructured Platform Partition Endpoint](/platform-api/partition-api/overview) for processing. Unstructured processes the PDF and extracts the PDF's content.
8
8
This example then sends some of the content to [HuggingChat](https://huggingface.co/chat/), Hugging Face's open-source AI chatbot,
@@ -11,7 +11,7 @@ along with some queries about this content.
11
11
To run this example, you'll need:
12
12
13
13
- The [hugchat](https://pypi.org/project/hugchat/) package for Python, or the [huggingface-chat](https://www.npmjs.com/package/huggingface-chat) package for JavaScript/TypeScript.
14
-
- Your Unstructured API key and API URL. [Get an API key and API URL](/platform-api/parition-api/overview).
14
+
- Your Unstructured API key and API URL. [Get an API key and API URL](/platform-api/partition-api/overview).
15
15
- Your Hugging Face account's email address and account password. [Get an account](https://huggingface.co/join).
16
16
- A PDF file for Unstructured to process. This example uses a sample PDF file containing the text of the United States Constitution,
17
17
available for download from [https://constitutioncenter.org/media/files/constitution.pdf](https://constitutioncenter.org/media/files/constitution.pdf).
@@ -37,7 +37,7 @@ import HuggingChatTSExampleCode from '/snippets/examples/huggingchat.ts.mdx';
37
37
</Accordion>
38
38
<Accordiontitle="JavaScript/TypeScript SDK">
39
39
<Warning>
40
-
Unstructured recommends that you use the [Unstructured Ingest Python library](/ingestion/overview#unstructured-ingest-python-library) instead.
40
+
Unstructured recommends that you use the [Unstructured Ingest Python library](/ingestion/python-ingest) instead.
41
41
42
42
The Ingest Python library provides faster processing of larger individual files, and faster and easier processing of multiple files at a time in batches.
Copy file name to clipboardExpand all lines: examplecode/tools/langflow.mdx
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -246,7 +246,7 @@ To do this, you can:
246
246
247
247
-[Use Unstructured Ingest to create a pipeline](/ingestion/overview) that relies on any available
248
248
[source connector](/ingestion/source-connectors/overview) to connect to
249
-
[Astra DB](/ingestion/destination-connector/astradb). Run this pipeline outside of Langflow anytime you have new documents in that non-local source location that
249
+
[Astra DB](/ingestion/destination-connectors/astradb). Run this pipeline outside of Langflow anytime you have new documents in that non-local source location that
250
250
you want Unstructured to process and then insert the new processed data into Astra DB. Then, back in the Langflow project,
251
251
use the **Playground** to ask additonal questions, which will now include the new data when generating answers.
252
252
@@ -274,16 +274,16 @@ Or, [use Unstructured Ingest to create a pipeline](/ingestion/overview) that rel
274
274
[source connector](/ingestion/source-connectors/overview) to connect to
275
275
one of the following available vector stores that Langflow also supports:
Copy file name to clipboardExpand all lines: ingestion/ingest-cli.mdx
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ The Unstructured Ingest CLI enables you to use command-line scripts to send file
8
8
<Note>
9
9
The Unstructured Ingest CLI does not work with the Unstructured Platform API.
10
10
11
-
For information about the Unstructured Platform API, see the [Unstructured Platform API Overview](/platform/api/overview).
11
+
For information about the Unstructured Platform API, see the [Unstructured Platform API Overview](/platform-api/api/overview).
12
12
</Note>
13
13
14
14
## Installation
@@ -34,7 +34,7 @@ For additional installation options, see [Unstructured Ingest CLI](/ingestion/ov
34
34
To call the Unstructured Ingest CLI, follow this calling pattern, where:
35
35
36
36
-`<source>` is the command name for one of the available [source](/ingestion/source-connectors/overview) (input) connectors, such as `local` for a local source location, `azure` for an Azure Storage account source, `s3` for an Amazon S3 bucket source, and so on.
37
-
-`<destination>` is the command name for one of the available [destination](/ingestion/destination-connector/overview) (output) connectors, such as `local` for a local destination, `azure` for an Azure Storage account destination, `s3` for an Amazon S3 bucket destination, and so on.
37
+
-`<destination>` is the command name for one of the available [destination](/ingestion/destination-connectors/overview) (output) connectors, such as `local` for a local destination, `azure` for an Azure Storage account destination, `s3` for an Amazon S3 bucket destination, and so on.
38
38
-`<setting>` is one or more command-line options for specifying how and where Unstructured will ingest the files from the `<source>`, or how and where to deliver the processed data to the `<destination>`.
39
39
40
40
```bash CLI
@@ -51,6 +51,6 @@ unstructured-ingest \
51
51
--<settingN><valueN>
52
52
```
53
53
54
-
To learn how to use the Unstructured Ingest CLI to work with a specific source (input) and destination (output) location, see the CLI script examples for the [source](/ingestion/source-connectors/overview) and [destination](/ingestion/destination-connector/overview) connectors that are available for you to choose from.
54
+
To learn how to use the Unstructured Ingest CLI to work with a specific source (input) and destination (output) location, see the CLI script examples for the [source](/ingestion/source-connectors/overview) and [destination](/ingestion/destination-connectors/overview) connectors that are available for you to choose from.
55
55
56
56
See also the [ingest configuration](/ingestion/ingest-configuration/overview) settings for command-line options that enable you to further control how batches are sent and processed.
Copy file name to clipboardExpand all lines: ingestion/overview.mdx
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -127,7 +127,7 @@ import GeneratePythonCodeExamples from '/snippets/ingestion/code-generator.mdx';
127
127
128
128
-[Ingest configuration](/ingestion/ingest-configuration/overview) settings enable you to control how batches are sent and processed.
129
129
-[Source connectors](/ingestion/source-connectors/overview) enable you to send batches from local or remote locations to be ingested by Unstructured for processing.
130
-
-[Destination connectors](/ingestion/destination-connector/overview) enable Unstructured to send the processed data to local or remote locations.
130
+
-[Destination connectors](/ingestion/destination-connectors/overview) enable Unstructured to send the processed data to local or remote locations.
Copy file name to clipboardExpand all lines: ingestion/python-ingest.mdx
+3-5Lines changed: 3 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ The Unstructured Ingest Python library enables you to use Python code to send fi
8
8
<Note>
9
9
The Unstructured Ingest Python library does not work with the Unstructured Platform API.
10
10
11
-
For information about the Unstructured Platform API, see the [Unstructured Platform API Overview](/platform/api/overview).
11
+
For information about the Unstructured Platform API, see the [Unstructured Platform API Overview](/platform-api/api/overview).
12
12
</Note>
13
13
14
14
The following 3-minute video shows how to use the Unstructured Ingest Python library to send multiple PDFs from a local directory in batches to be ingested by Unstructured for processing:
@@ -23,8 +23,6 @@ The following 3-minute video shows how to use the Unstructured Ingest Python lib
One approach to get started quickly with the Unstructured Ingest Python library is to install Python and then run the following command:
@@ -39,7 +37,7 @@ import AdditionalIngestDependencies from '/snippets/general-shared-text/ingest-d
39
37
40
38
<AdditionalIngestDependencies />
41
39
42
-
For additional installation options, and information about v2 and v1 implementations in this library, see the [Unstructured Ingest Python library](/ingestion/overview#unstructured-ingest-python-library) in the [Ingest](/ingestion/overview) section.
40
+
For additional installation options, and information about v2 and v1 implementations in this library, see the [Unstructured Ingest Python library](/ingestion/python-ingest) in the [Ingest](/ingestion/overview) section.
43
41
44
42
<Info>To migrate from older, deprecated versions of the Ingest Python library that used `pip install unstructured`, see the [migration guide](/ingestion/overview#migration-guide).</Info>
45
43
@@ -58,6 +56,6 @@ import AzureAPIPyV1 from '/snippets/destination_connectors/azure.v1.py.mdx';
58
56
59
57
</CodeGroup>
60
58
61
-
To learn how to use the Unstructured Ingest Python library to work with a specific source (input) and destination (output) location, see the Python code examples for the [source](/ingestion/source-connectors/overview) and [destination](/ingestion/destination-connector/overview) connectors that are available for you to choose from.
59
+
To learn how to use the Unstructured Ingest Python library to work with a specific source (input) and destination (output) location, see the Python code examples for the [source](/ingestion/source-connectors/overview) and [destination](/ingestion/destination-connectors/overview) connectors that are available for you to choose from.
62
60
63
61
See also the [ingest configuration](/ingestion/ingest-configuration/overview) settings that enable you to further control how batches are sent and processed.
Copy file name to clipboardExpand all lines: open-source/core-functionality/embedding.mdx
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ title: Embedding
4
4
5
5
The Unstructured open-source library does not offer built-in support for calling embedding providers to obtain embeddings for pieces of text.
6
6
7
-
Alternatively, the [Unstructured Ingest CLI](/ingestion/overview#unstructured-ingest-cli) and the [Unstructured Ingest Python library](/ingestion/overview#unstructured-ingest-python-library)
7
+
Alternatively, the [Unstructured Ingest CLI](/ingestion/overview#unstructured-ingest-cli) and the [Unstructured Ingest Python library](/ingestion/python-ingest)
8
8
offer built-in support for calling embedding providers as part of an ingest pipeline. [Learn how](/platform-api/partition-api/embedding).
9
9
10
10
Also, you can use common third-party tools and libraries to get embeddings for document elements' text within JSON files that are
0 commit comments