Skip to content

Commit 2a527ba

Browse files
committed
Merge branch 'main' of https://github.com/ClickHouse/clickhouse-docs into vertical_stepper_support_all
2 parents 7b4faf0 + 6bc4eab commit 2a527ba

File tree

845 files changed

+40672
-32324
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

845 files changed

+40672
-32324
lines changed

docs/getting-started/install/install.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ import MacOSProd from './_snippets/_macos.md'
1616
import Docker from './_snippets/_docker.md'
1717
import {CardPrimary} from '@clickhouse/click-ui/bundled';
1818

19-
# Installation Instructions
19+
# Installation instructions
2020

2121
<CardPrimary
2222
alignContent="center"

docs/integrations/data-ingestion/clickpipes/index.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ import S3svg from '@site/static/images/integrations/logos/amazon_s3_logo.svg';
1414
import Amazonkinesis from '@site/static/images/integrations/logos/amazon_kinesis_logo.svg';
1515
import Gcssvg from '@site/static/images/integrations/logos/gcs.svg';
1616
import DOsvg from '@site/static/images/integrations/logos/digitalocean.svg';
17+
import ABSsvg from '@site/static/images/integrations/logos/azureblobstorage.svg';
1718
import Postgressvg from '@site/static/images/integrations/logos/postgresql.svg';
1819
import Mysqlsvg from '@site/static/images/integrations/logos/mysql.svg';
1920
import redpanda_logo from '@site/static/images/integrations/logos/logo_redpanda.png';
@@ -42,7 +43,7 @@ import Image from '@theme/IdealImage';
4243
| Amazon S3 | <S3svg class="image" alt="Amazon S3 logo" style={{width: '3rem', height: 'auto'}}/> |Object Storage| Stable | Configure ClickPipes to ingest large volumes of data from object storage. |
4344
| Google Cloud Storage | <Gcssvg class="image" alt="Google Cloud Storage logo" style={{width: '3rem', height: 'auto'}}/> |Object Storage| Stable | Configure ClickPipes to ingest large volumes of data from object storage. |
4445
| DigitalOcean Spaces | <DOsvg class="image" alt="Digital Ocean logo" style={{width: '3rem', height: 'auto'}}/> | Object Storage | Stable | Configure ClickPipes to ingest large volumes of data from object storage.
45-
46+
| Azure Blob Storage | <ABSsvg class="image" alt="Azure Blob Storage logo" style={{width: '3rem', height: 'auto'}}/> | Object Storage | Private Beta | Configure ClickPipes to ingest large volumes of data from object storage.
4647
| Amazon Kinesis | <Amazonkinesis class="image" alt="Amazon Kenesis logo" style={{width: '3rem', height: 'auto'}}/> |Streaming| Stable | Configure ClickPipes and start ingesting streaming data from Amazon Kinesis into ClickHouse cloud. |
4748
| Postgres | <Postgressvg class="image" alt="Postgres logo" style={{width: '3rem', height: 'auto'}}/> |DBMS| Public Beta | Configure ClickPipes and start ingesting data from Postgres into ClickHouse Cloud. |
4849
| MySQL | <Mysqlsvg class="image" alt="MySQL logo" style={{width: '3rem', height: 'auto'}}/> |DBMS| Private Beta | Configure ClickPipes and start ingesting data from MySQL into ClickHouse Cloud. |

docs/integrations/data-ingestion/clickpipes/object-storage.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@ title: 'Integrating Object Storage with ClickHouse Cloud'
88
import S3svg from '@site/static/images/integrations/logos/amazon_s3_logo.svg';
99
import Gcssvg from '@site/static/images/integrations/logos/gcs.svg';
1010
import DOsvg from '@site/static/images/integrations/logos/digitalocean.svg';
11+
import ABSsvg from '@site/static/images/integrations/logos/azureblobstorage.svg';
1112
import cp_step0 from '@site/static/images/integrations/data-ingestion/clickpipes/cp_step0.png';
1213
import cp_step1 from '@site/static/images/integrations/data-ingestion/clickpipes/cp_step1.png';
1314
import cp_step2_object_storage from '@site/static/images/integrations/data-ingestion/clickpipes/cp_step2_object_storage.png';
@@ -23,7 +24,7 @@ import cp_overview from '@site/static/images/integrations/data-ingestion/clickpi
2324
import Image from '@theme/IdealImage';
2425

2526
# Integrating Object Storage with ClickHouse Cloud
26-
Object Storage ClickPipes provide a simple and resilient way to ingest data from Amazon S3, Google Cloud Storage, and DigitalOcean Spaces into ClickHouse Cloud. Both one-time and continuous ingestion are supported with exactly-once semantics.
27+
Object Storage ClickPipes provide a simple and resilient way to ingest data from Amazon S3, Google Cloud Storage, Azure Blob Storage, and DigitalOcean Spaces into ClickHouse Cloud. Both one-time and continuous ingestion are supported with exactly-once semantics.
2728

2829

2930
## Prerequisite {#prerequisite}
@@ -95,6 +96,7 @@ Image
9596
| Amazon S3 |<S3svg class="image" alt="Amazon S3 logo" style={{width: '3rem', height: 'auto'}}/>|Object Storage| Stable | Configure ClickPipes to ingest large volumes of data from object storage. |
9697
| Google Cloud Storage |<Gcssvg class="image" alt="Google Cloud Storage logo" style={{width: '3rem', height: 'auto'}}/>|Object Storage| Stable | Configure ClickPipes to ingest large volumes of data from object storage. |
9798
| DigitalOcean Spaces | <DOsvg class="image" alt="Digital Ocean logo" style={{width: '3rem', height: 'auto'}}/> | Object Storage | Stable | Configure ClickPipes to ingest large volumes of data from object storage.
99+
| Azure Blob Storage | <ABSsvg class="image" alt="Azure Blob Storage logo" style={{width: '3rem', height: 'auto'}}/> | Object Storage | Private Beta | Configure ClickPipes to ingest large volumes of data from object storage.
98100

99101
More connectors will get added to ClickPipes, you can find out more by [contacting us](https://clickhouse.com/company/contact?loc=clickpipes).
100102

@@ -126,13 +128,13 @@ To increase the throughput on large ingest jobs, we recommend scaling the ClickH
126128
- There are limitations on the types of views that are supported. Please read the section on [exactly-once semantics](#exactly-once-semantics) and [view support](#view-support) for more information.
127129
- Role authentication is not available for S3 ClickPipes for ClickHouse Cloud instances deployed into GCP or Azure. It is only supported for AWS ClickHouse Cloud instances.
128130
- ClickPipes will only attempt to ingest objects at 10GB or smaller in size. If a file is greater than 10GB an error will be appended to the ClickPipes dedicated error table.
129-
- S3 / GCS ClickPipes **does not** share a listing syntax with the [S3 Table Function](/sql-reference/table-functions/s3).
131+
- S3 / GCS ClickPipes **does not** share a listing syntax with the [S3 Table Function](/sql-reference/table-functions/s3), nor Azure with the [AzureBlobStorage Table function](/sql-reference/table-functions/azureBlobStorage).
130132
- `?` — Substitutes any single character
131133
- `*` — Substitutes any number of any characters except / including empty string
132134
- `**` — Substitutes any number of any character include / including empty string
133135

134136
:::note
135-
This is a valid path:
137+
This is a valid path (for S3):
136138

137139
https://datasets-documentation.s3.eu-west-3.amazonaws.com/http/**.ndjson.gz
138140

@@ -143,7 +145,7 @@ https://datasets-documentation.s3.eu-west-3.amazonaws.com/http/{documents-01,doc
143145
:::
144146

145147
## Continuous Ingest {#continuous-ingest}
146-
ClickPipes supports continuous ingestion from S3, GCS, and DigitalOcean Spaces. When enabled, ClickPipes will continuously ingest data from the specified path, it will poll for new files at a rate of once every 30 seconds. However, new files must be lexically greater than the last ingested file, meaning they must be named in a way that defines the ingestion order. For instance, files named `file1`, `file2`, `file3`, etc., will be ingested sequentially. If a new file is added with a name like `file0`, ClickPipes will not ingest it because it is not lexically greater than the last ingested file.
148+
ClickPipes supports continuous ingestion from S3, GCS, Azure Blob Storage, and DigitalOcean Spaces. When enabled, ClickPipes continuously ingests data from the specified path, and polls for new files at a rate of once every 30 seconds. However, new files must be lexically greater than the last ingested file. This means that they must be named in a way that defines the ingestion order. For instance, files named `file1`, `file2`, `file3`, etc., will be ingested sequentially. If a new file is added with a name like `file0`, ClickPipes will not ingest it because it is not lexically greater than the last ingested file.
147149

148150
## Archive table {#archive-table}
149151
ClickPipes will create a table next to your destination table with the postfix `s3_clickpipe_<clickpipe_id>_archive`. This table will contain a list of all the files that have been ingested by the ClickPipe. This table is used to track files during ingestion and can be used to verify files have been ingested. The archive table has a [TTL](/engines/table-engines/mergetree-family/mergetree#table_engine-mergetree-ttl) of 7 days.
@@ -167,6 +169,8 @@ The Service Account permissions attached to the HMAC credentials should be `stor
167169
### DigitalOcean Spaces {#dospaces}
168170
Currently only protected buckets are supported for DigitalOcean spaces. You require an "Access Key" and a "Secret Key" to access the bucket and its files. You can read [this guide](https://docs.digitalocean.com/products/spaces/how-to/manage-access/) on how to create access keys.
169171

172+
### Azure Blob Storage {#azureblobstorage}
173+
Currently only protected buckets are supported for Azure Blob Storage. Authentication is done via a connection string, which supports access keys and shared keys. For more information, read [this guide](https://learn.microsoft.com/en-us/azure/storage/common/storage-configure-connection-string).
170174

171175
## F.A.Q. {#faq}
172176

docusaurus.config.ru.js

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@ import math from "remark-math";
33
import katex from "rehype-katex";
44
import chHeader from "./plugins/header.js";
55
import fixLinks from "./src/hooks/fixLinks.js";
6+
const remarkCustomBlocks = require('./plugins/remark-custom-blocks');
67

78
// Helper function to skip over index.md files.
89
function skipIndex(items) {
@@ -128,7 +129,7 @@ const config = {
128129
showLastUpdateTime: false,
129130
sidebarCollapsed: true,
130131
routeBasePath: "/",
131-
remarkPlugins: [math],
132+
remarkPlugins: [math, remarkCustomBlocks],
132133
beforeDefaultRemarkPlugins: [fixLinks],
133134
rehypePlugins: [katex],
134135
},

i18n/ru/code.json

Lines changed: 120 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,7 @@
131131
},
132132
"theme.navbar.mobileSidebarSecondaryMenu.backButtonLabel": {
133133
"message": "← Перейти к главному меню",
134-
"description": "The label of the back button to return to main menu, inside the mobile navbar sidebar (notably used to display the docs sidebar)"
134+
"description": "The label of the back button to return to main menu, inside the mobile navbar sidebar secondary menu (notably used to display the docs sidebar)"
135135
},
136136
"theme.ErrorPageContent.title": {
137137
"message": "На странице произошёл сбой.",
@@ -868,5 +868,124 @@
868868
},
869869
"Report an issue": {
870870
"message": "Сообщите о проблеме"
871+
},
872+
"topNav.navItems.Products": {
873+
"message": "Products"
874+
},
875+
"topNav.navItems.Use cases": {
876+
"message": "Use cases"
877+
},
878+
"topNav.navItems.Docs": {
879+
"message": "Docs"
880+
},
881+
"topNav.navItems.Resources": {
882+
"message": "Resources"
883+
},
884+
"topNav.navItems.Pricing": {
885+
"message": "Pricing"
886+
},
887+
"topNav.navItems.Contact us": {
888+
"message": "Contact us"
889+
},
890+
"theme.IdealImageMessage.loading": {
891+
"message": "Загрузка...",
892+
"description": "When the full-scale image is loading"
893+
},
894+
"theme.IdealImageMessage.load": {
895+
"message": "Нажмите для загрузки {sizeMessage}",
896+
"description": "To prompt users to load the full image. sizeMessage is a parenthesized size figure."
897+
},
898+
"theme.IdealImageMessage.offline": {
899+
"message": "Ваш браузер находится в автономном режиме. Изображение не загружено",
900+
"description": "When the user is viewing an offline document"
901+
},
902+
"theme.IdealImageMessage.404error": {
903+
"message": "404. Изображение не найдено",
904+
"description": "When the image is not found"
905+
},
906+
"theme.IdealImageMessage.error": {
907+
"message": "Ошибка. Нажмите для перезагрузки",
908+
"description": "When the image fails to load for unknown error"
909+
},
910+
"topNav.navItems.products.clickhouse_cloud_1": {
911+
"message": "The best way to use ClickHouse."
912+
},
913+
"topNav.navItems.products.clickhouse_cloud_2": {
914+
"message": "Available on AWS, GCP, and Azure."
915+
},
916+
"topNav.navItems.products.byoc_1": {
917+
"message": "Bring Your Own Cloud"
918+
},
919+
"topNav.navItems.products.byoc_2": {
920+
"message": "A fully managed ClickHouse Cloud service,"
921+
},
922+
"topNav.navItems.products.byoc_3": {
923+
"message": "deployed in your own AWS account."
924+
},
925+
"topNav.navItems.products.oss": {
926+
"message": "Spin up a database with open-source"
927+
},
928+
"topNav.navItems.products.oss_2": {
929+
"message": "ClickHouse"
930+
},
931+
"topNav.navItems.products.integrations": {
932+
"message": "View 100+ integrations"
933+
},
934+
"topNav.navItems.resources.User stories": {
935+
"message": "User stories"
936+
},
937+
"topNav.navItems.resources.Blog": {
938+
"message": "Blog"
939+
},
940+
"topNav.navItems.resources.Learning and Certification": {
941+
"message": "Learning and Certification"
942+
},
943+
"topNav.navItems.resources.ClickHouse Academy": {
944+
"message": "ClickHouse Academy"
945+
},
946+
"topNav.navItems.resources.Free live training": {
947+
"message": "Free live training"
948+
},
949+
"topNav.navItems.resources.ClickHouse Certification": {
950+
"message": "ClickHouse Certification"
951+
},
952+
"topNav.navItems.resources.Comparisons": {
953+
"message": "Comparisons"
954+
},
955+
"topNav.navItems.resources.BigQuery": {
956+
"message": "BigQuery"
957+
},
958+
"topNav.navItems.resources.PostgreSQL": {
959+
"message": "PostgreSQL"
960+
},
961+
"topNav.navItems.resources.Redshift": {
962+
"message": "Redshift"
963+
},
964+
"topNav.navItems.resources.Rockset": {
965+
"message": "Rockset"
966+
},
967+
"topNav.navItems.resources.Snowflake": {
968+
"message": "Snowflake"
969+
},
970+
"topNav.navItems.resources.Videos": {
971+
"message": "Videos"
972+
},
973+
"topNav.navItems.resources.Demos": {
974+
"message": "Demos"
975+
},
976+
"topNav.navItems.use_cases.Real-time analytics": {
977+
"message": "Real-time analytics"
978+
},
979+
"topNav.navItems.use_cases.Machine learning and GenAI": {
980+
"message": "Machine learning and GenAI"
981+
},
982+
"topNav.navItems.use_cases.Business intelligence": {
983+
"message": "Business intelligence"
984+
},
985+
"topNav.navItems.use_cases.Logs, events, and traces": {
986+
"message": "Logs, events, and traces"
987+
},
988+
"topNav.navItems.use_cases.All use cases": {
989+
"message": "All use cases"
871990
}
872991
}

i18n/ru/docusaurus-plugin-content-blog/options.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,4 +11,4 @@
1111
"message": "Все статьи базы знаний",
1212
"description": "The label for the left sidebar"
1313
}
14-
}
14+
}

i18n/ru/docusaurus-plugin-content-docs/current.json

Lines changed: 78 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -413,7 +413,7 @@
413413
},
414414
"sidebar.managingData.doc.ReplacingMergeTree": {
415415
"message": "ReplacingMergeTree",
416-
"description": "The label for the doc item ReplacingMergeTree in sidebar managingData, linking to the doc migrations/postgres/replacing-merge-tree"
416+
"description": "The label for the doc item ReplacingMergeTree in sidebar managingData, linking to the doc guides/developer/replacing-merge-tree"
417417
},
418418
"sidebar.managingData.doc.Lightweight Deletes": {
419419
"message": "Легкое удаление",
@@ -685,7 +685,7 @@
685685
},
686686
"sidebar.dropdownCategories.link.Native Clients & Interfaces": {
687687
"message": "Нативные клиенты и интерфейсы",
688-
"description": "The label for link Native Clients & Interfaces in sidebar dropdownCategories, linking to /interfaces/"
688+
"description": "The label for link Native Clients & Interfaces in sidebar dropdownCategories, linking to /interfaces/natives-clients-and-interfaces"
689689
},
690690
"sidebar.dropdownCategories.link.Data Sources": {
691691
"message": "Источники данных",
@@ -730,5 +730,81 @@
730730
"sidebar.dropdownCategories.link.Development and Contributing": {
731731
"message": "Разработка и вклад",
732732
"description": "The label for link Development and Contributing in sidebar dropdownCategories, linking to /development/developer-instruction"
733+
},
734+
"sidebar.docs.category.Install": {
735+
"message": "Установка",
736+
"description": "The label for category Install in sidebar docs"
737+
},
738+
"sidebar.docs.category.Best Practices": {
739+
"message": "Лучшие практики",
740+
"description": "The label for category Best Practices in sidebar docs"
741+
},
742+
"sidebar.docs.category.Time-Series": {
743+
"message": "временной ряд",
744+
"description": "The label for category Time-Series in sidebar docs"
745+
},
746+
"sidebar.docs.category.Data lake": {
747+
"message": "ДатаЛэйк",
748+
"description": "The label for category Data lake in sidebar docs"
749+
},
750+
"sidebar.docs.doc.Overview": {
751+
"message": "Обзор",
752+
"description": "The label for the doc item Overview in sidebar docs, linking to the doc migrations/postgres/overview"
753+
},
754+
"sidebar.cloud.link.API Reference": {
755+
"message": "Справочник по API",
756+
"description": "The label for link API Reference in sidebar cloud, linking to https://clickhouse.com/docs/cloud/manage/api/swagger"
757+
},
758+
"sidebar.sqlreference.category.Специальные типы данных": {
759+
"message": "Специальные типы данных",
760+
"description": "The label for category Специальные типы данных in sidebar sqlreference"
761+
},
762+
"sidebar.sqlreference.category.Движки баз данных": {
763+
"message": "Движки баз данных",
764+
"description": "The label for category Движки баз данных in sidebar sqlreference"
765+
},
766+
"sidebar.sqlreference.category.Движки Таблиц": {
767+
"message": "Движки Таблиц",
768+
"description": "The label for category Движки Таблиц in sidebar sqlreference"
769+
},
770+
"sidebar.sqlreference.category.Семейство MergeTree": {
771+
"message": "Семейство MergeTree",
772+
"description": "The label for category Семейство MergeTree in sidebar sqlreference"
773+
},
774+
"sidebar.sqlreference.category.Семейство журналов": {
775+
"message": "Семейство журналов",
776+
"description": "The label for category Семейство журналов in sidebar sqlreference"
777+
},
778+
"sidebar.sqlreference.category.Интеграции": {
779+
"message": "Интеграции",
780+
"description": "The label for category Интеграции in sidebar sqlreference"
781+
},
782+
"sidebar.sqlreference.category.Специальные": {
783+
"message": "Специальные",
784+
"description": "The label for category Специальные in sidebar sqlreference"
785+
},
786+
"sidebar.sqlreference.category.Гео": {
787+
"message": "Гео",
788+
"description": "The label for category Гео in sidebar sqlreference"
789+
},
790+
"sidebar.sqlreference.category.Агрегатные функции": {
791+
"message": "Агрегатные функции",
792+
"description": "The label for category Агрегатные функции in sidebar sqlreference"
793+
},
794+
"sidebar.sqlreference.category.Combinator examples": {
795+
"message": "Примеры комбинаторов",
796+
"description": "The label for category Combinator examples in sidebar sqlreference"
797+
},
798+
"sidebar.integrations.category.Operations": {
799+
"message": "Операции",
800+
"description": "The label for category Operations in sidebar integrations"
801+
},
802+
"sidebar.integrations.category.ClickPipes for MySQL": {
803+
"message": "ClickPipes для MySQL",
804+
"description": "The label for category ClickPipes for MySQL in sidebar integrations"
805+
},
806+
"sidebar.integrations.category.Azure Data Factory": {
807+
"message": "Azure Data Factory",
808+
"description": "The label for category Azure Data Factory in sidebar integrations"
733809
}
734810
}

i18n/ru/docusaurus-plugin-content-docs/current/_snippets/_aws_regions.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,4 +10,3 @@
1010
|us-east-1 c1 | com.amazonaws.vpce.us-east-1.vpce-svc-096c118db1ff20ea4 | use1-az6 use1-az4 use1-az2 |
1111
|us-east-2 | com.amazonaws.vpce.us-east-2.vpce-svc-0b99748bf269a86b4 | use2-az1 use2-az2 use2-az3 |
1212
|us-west-2 | com.amazonaws.vpce.us-west-2.vpce-svc-049bbd33f61271781 | usw2-az2 usw2-az1 usw2-az3 |
13-
```

0 commit comments

Comments
 (0)