updated search scripts

Author: gingerwizard

docs/en/managing-data/deleting-data/overview.md

@@ -1,6 +1,6 @@
 ---
 slug: /en/deletes/overview
-title: Overview
+title: Delete Overview
 description: How to delete data in ClickHouse
 keywords: [delete, truncate, drop, lightweight delete]
 ---

scripts/search/README.md

@@ -34,4 +34,11 @@ options:
 | **Date**    | **Average nDCG** | **Results**                                                                                  | **Changes**                                   |
 |-------------|------------------|----------------------------------------------------------------------------------------------|----------------------------------------------|
 | 20/01/2024  | 0.4700           | [View Results](https://pastila.nl/?008231f5/bc107912f8a5074d70201e27b1a66c6c#cB/yJOsZPOWi9h8xAkuTUQ==) | Baseline                                     |
-| 21/01/2024  | 0.4783           | [View Results](https://pastila.nl/?00bb2c2f/936a9a3af62a9bdda186af5f37f55782#m7Hg0i9F1YCesMW6ot25yA==) | Index `_` character and move language to English |
+| 21/01/2024  | 0.5021           | [View Results](https://pastila.nl/?00bb2c2f/936a9a3af62a9bdda186af5f37f55782#m7Hg0i9F1YCesMW6ot25yA==) | Index `_` character and move language to English |
+
+
+## Issues
+
+1. Some pages are not optimized for retrieval e.g. 
+   a. https://clickhouse.com/docs/en/sql-reference/aggregate-functions/combinators#-if will never return for `countIf`.
+2. 

scripts/search/compute_ndcg.py

@@ -3,13 +3,19 @@
 import argparse
 from algoliasearch.search.client import SearchClientSync
 
+ALGOLIA_INDEX_NAME = "clickhouse"
+
+
 # Initialize Algolia client
 ALGOLIA_APP_ID = "5H9UG7CX5W"
 ALGOLIA_API_KEY = "4a7bf25cf3edbef29d78d5e1eecfdca5"
-ALGOLIA_INDEX_NAME = "clickhouse"
 
-client = SearchClientSync(ALGOLIA_APP_ID, ALGOLIA_API_KEY)
+# old search engine using crawler
+# ALGOLIA_APP_ID = "62VCH2MD74"
+# ALGOLIA_API_KEY = "b78244d947484fe3ece7bc5472e9f2af"
+
 
+client = SearchClientSync(ALGOLIA_APP_ID, ALGOLIA_API_KEY)
 
 def compute_dcg(relevance_scores):
     """Compute Discounted Cumulative Gain (DCG)."""
@@ -32,7 +38,6 @@ def main(input_csv, detailed, k=3):
     with open(input_csv, mode='r', newline='', encoding='utf-8') as file:
         reader = csv.reader(file)
         rows = list(reader)
-
     results = []
     total_ndcg = 0
     for row in rows: