Skip to content

Commit f8f4e92

Browse files
authored
Merge pull request #3137 from ClickHouse/Blargian-patch-5
Fix grammar
2 parents e38e64c + 83b3ecb commit f8f4e92

File tree

1 file changed

+10
-9
lines changed

1 file changed

+10
-9
lines changed

docs/en/about-us/history.md

Lines changed: 10 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -2,16 +2,17 @@
22
slug: /en/about-us/history
33
sidebar_label: ClickHouse History
44
sidebar_position: 40
5-
description: Where it all began...
5+
description: History of ClickHouse development
6+
tags: ['history', 'development', 'Metrica']
67
---
78

89
# ClickHouse History {#clickhouse-history}
910

10-
ClickHouse has been developed initially to power [Yandex.Metrica](https://metrica.yandex.com/), [the second largest web analytics platform in the world](http://w3techs.com/technologies/overview/traffic_analysis/all), and continues to be the core component of this system. With more than 13 trillion records in the database and more than 20 billion events daily, ClickHouse allows generating custom reports on the fly directly from non-aggregated data. This article briefly covers the goals of ClickHouse in the early stages of its development.
11+
ClickHouse was initially developed to power [Yandex.Metrica](https://metrica.yandex.com/), [the second largest web analytics platform in the world](http://w3techs.com/technologies/overview/traffic_analysis/all), and continues to be its core component. With more than 13 trillion records in the database and more than 20 billion events daily, ClickHouse allows generating custom reports on the fly directly from non-aggregated data. This article briefly covers the goals of ClickHouse in the early stages of its development.
1112

12-
Yandex.Metrica builds customized reports on the fly based on hits and sessions, with arbitrary segments defined by the user. Doing so often requires building complex aggregates, such as the number of unique users. New data for building a report arrives in real-time.
13+
Yandex.Metrica builds customized reports on the fly based on hits and sessions, with arbitrary segments defined by the user. Doing so often requires building complex aggregates, such as the number of unique users, with new data for building reports arriving in real-time.
1314

14-
As of April 2014, Yandex.Metrica was tracking about 12 billion events (page views and clicks) daily. All these events must be stored to build custom reports. A single query may require scanning millions of rows within a few hundred milliseconds, or hundreds of millions of rows in just a few seconds.
15+
As of April 2014, Yandex.Metrica was tracking about 12 billion events (page views and clicks) daily. All these events needed to be stored, in order to build custom reports. A single query may have required scanning millions of rows within a few hundred milliseconds, or hundreds of millions of rows in just a few seconds.
1516

1617
## Usage in Yandex.Metrica and Other Yandex Services {#usage-in-yandex-metrica-and-other-yandex-services}
1718

@@ -26,30 +27,30 @@ ClickHouse also plays a key role in the following processes:
2627
- Running queries for debugging the Yandex.Metrica engine.
2728
- Analyzing logs from the API and the user interface.
2829

29-
Nowadays, there are multiple dozen ClickHouse installations in other Yandex services and departments: search verticals, e-commerce, advertisement, business analytics, mobile development, personal services, and others.
30+
Nowadays, there are a multiple dozen ClickHouse installations in other Yandex services and departments: search verticals, e-commerce, advertisement, business analytics, mobile development, personal services, and others.
3031

3132
## Aggregated and Non-aggregated Data {#aggregated-and-non-aggregated-data}
3233

3334
There is a widespread opinion that to calculate statistics effectively, you must aggregate data since this reduces the volume of data.
3435

35-
But data aggregation comes with a lot of limitations:
36+
However data aggregation comes with a lot of limitations:
3637

3738
- You must have a pre-defined list of required reports.
3839
- The user can’t make custom reports.
3940
- When aggregating over a large number of distinct keys, the data volume is barely reduced, so aggregation is useless.
4041
- For a large number of reports, there are too many aggregation variations (combinatorial explosion).
4142
- When aggregating keys with high cardinality (such as URLs), the volume of data is not reduced by much (less than twofold).
4243
- For this reason, the volume of data with aggregation might grow instead of shrink.
43-
- Users do not view all the reports we generate for them. A large portion of those calculations is useless.
44-
- The logical integrity of data may be violated for various aggregations.
44+
- Users do not view all the reports we generate for them. A large portion of those calculations are useless.
45+
- The logical integrity of the data may be violated for various aggregations.
4546

4647
If we do not aggregate anything and work with non-aggregated data, this might reduce the volume of calculations.
4748

4849
However, with aggregation, a significant part of the work is taken offline and completed relatively calmly. In contrast, online calculations require calculating as fast as possible, since the user is waiting for the result.
4950

5051
Yandex.Metrica has a specialized system for aggregating data called Metrage, which was used for the majority of reports.
5152
Starting in 2009, Yandex.Metrica also used a specialized OLAP database for non-aggregated data called OLAPServer, which was previously used for the report builder.
52-
OLAPServer worked well for non-aggregated data, but it had many restrictions that did not allow it to be used for all reports as desired. These included the lack of support for data types (only numbers), and the inability to incrementally update data in real-time (it could only be done by rewriting data daily). OLAPServer is not a DBMS, but a specialized DB.
53+
OLAPServer worked well for non-aggregated data, but it had many restrictions that did not allow it to be used for all reports as desired. These included a lack of support for data types (numbers only), and the inability to incrementally update data in real-time (it could only be done by rewriting data daily). OLAPServer is not a DBMS, but a specialized DB.
5354

5455
The initial goal for ClickHouse was to remove the limitations of OLAPServer and solve the problem of working with non-aggregated data for all reports, but over the years, it has grown into a general-purpose database management system suitable for a wide range of analytical tasks.
5556

0 commit comments

Comments
 (0)