fix: data service changelog

changelog/data-service.mdx

@@ -0,0 +1,297 @@
+---
+title: "Data Service"
+sidebarTitle: "Data Service [1.2.4]"
+---
+
+<Update label="1.2.4" description="2025-06-17">
+## v1.2.4
+---
+
+### Fixes and Improvements
+- Fixed issue with custom batches missing cost calculation for some provider models
+</Update>
+
+<Update label="1.2.3" description="2025-06-17">
+## v1.2.3
+---
+
+### Fine-tuning and Batch Processing
+- Added support for configurable `FINETUNE_STATUS_CHECK_INTERVAL` for provider fine-tuning status check operations.
+- Added support for configurable `BATCH_STATUS_CHECK_INTERVAL` for provider batch processing status check operations.
+- Both values should be in milliseconds. Minimum value is 10000 milliseconds.
+- If not provided, will default to 10 seconds.
+
+</Update>
+
+<Update label="1.2.2" description="2025-05-31">
+## v1.2.2
+---
+
+### Observability
+- Added support for below Prometheus Counters
+    - `batch_count`
+    - `batch_cost`
+    - `batch_input_tokens`
+    - `batch_total_tokens`
+    - `batch_process_time`
+    - `batch_success_row_count`
+    - `batch_failure_row_count`
+    - `batch_row_count`
+- With the below labels
+    - `provider`
+    - `type` (provider/custom)
+
+### Fixes and Improvements
+- Fixed issue with attributing incorrect created at time stamp for batch processing
+- Including error source as `control plane` for control plane failures
+</Update>
+
+<Update label="1.2.1" description="2025-05-21">
+## v1.2.1
+---
+
+### Data exports
+- Added support for [Data exports](/api-reference/admin-api/data-plane/logs/log-exports-beta/start-a-log-export) for hybrid deployments.
+
+### Fixes and Improvements
+- Fixed issue with custom batches for small batch files
+</Update>
+
+<Update label="1.2.0" description="2025-05-17">
+## v1.2.0
+---
+
+### Custom S3 Support
+- Added support for `s3_custom` log store option for batches and fine-tunes.
+
+### Fixes and Improvements
+- Fixed issue with STS token generation for AWS.
+</Update>
+
+<Update label="1.1.12" description="2025-05-09">
+## v1.1.12
+---
+
+### Fixes and Improvements
+- Fixed issue with cost calculation for custom batches.
+</Update>
+
+<Update label="1.1.11" description="2025-05-03">
+## v1.1.11
+---
+
+### Fixes and Improvements
+- Fixed issue where queue remains stuck in a queued state during file validation.
+</Update>
+
+
+<Update label="1.1.10" description="2025-04-21">
+## v1.1.10
+---
+
+### S3 Upload Improvements
+- Added support for passing encryption headers while uploading stream data to S3.
+- Added support for both file path and direct value from environment variables for secrets like redis connection.
+
+### Stream Handling
+- Improved stream cleanup for validation processes.
+</Update>
+
+<Update label="1.1.9" description="2025-04-10">
+## v1.1.9
+---
+
+### File Handling Fixes
+- Fixed issue with extra bytes being added to files during processing.
+</Update>
+
+<Update label="1.1.8" description="2025-04-04">
+## v1.1.8
+---
+
+### File Upload Improvements
+- Updated socket timeout for long requests during file uploads to prevent timeouts.
+</Update>
+
+<Update label="1.1.7" description="2025-03-28">
+## v1.1.7
+---
+
+### Fireworks Fine-tuning Support
+- Added support for `Fireworks` fine-tuning operations using Version2.
+
+### Batch Processing Improvements
+- Included response tokens calculation in provider batch output.
+- Fixed file loading in memory issues for better performance.
+</Update>
+
+<Update label="1.1.6" description="2025-03-25">
+## v1.1.6
+---
+
+### S3 SDK Updates
+- Upgraded S3 SDK to latest version for fixing issue with S3 streaming.
+</Update>
+
+<Update label="1.1.5" description="2025-03-21">
+## v1.1.5
+---
+
+### Batch Processing Enhancements
+- Improved provider batch output handling.
+- Added support for custom batch output paths.
+- Increased maximum lines for custom batches to 500k and chunk size to 5MB for better performance.
+</Update>
+
+<Update label="1.1.4" description="2025-03-20">
+## v1.1.4
+---
+
+### Vertex Embeddings Batches Support
+- Added support for `Vertex` batch embeddings.
+
+### Batch Processing Updates
+- Included model information in log objects.
+- Implemented custom batch processing output generations.
+
+### Internal POD to POD HTTPS Support
+- Added support for internal POD to POD HTTPS communication.
+- This can be enabled by mounting a volume with certificate and key.
+- `TLS_KEY_PATH` and `TLS_CERT_PATH` environment variables will be used to fetch the certificate and key from the volume.
+
+</Update>
+
+<Update label="1.1.3" description="2025-03-07">
+## v1.1.3
+---
+
+### Infrastructure Updates
+- Streamlined uploaded file location for `Bedrock` operations.
+</Update>
+
+<Update label="1.1.2" description="2025-02-27">
+## v1.1.2
+---
+
+### Vertex Integration
+- Added support for `Vertex` provider options for batches.
+
+### Infrastructure Updates
+- Implemented cluster mode Redis for queues.
+- Updated fine-tune status handling.
+</Update>
+
+<Update label="1.1.1" description="2025-02-20">
+## v1.1.1
+---
+
+### S3 Enhancements
+- Made S3 bucket optional for Bedrock batches.
+- Added S3 encryption header support for finetunes and batches.
+- Implemented SSE file upload support.
+
+### Logging Improvements
+- Added filtering for log exports.
+- Implemented end limit for log export records.
+
+### Performance Optimizations
+- Implemented internal memory cache for better performance.
+</Update>
+
+<Update label="1.1.0" description="2025-02-10">
+## v1.1.0
+---
+
+### Bull Board Integration
+- Added Bull Board for visualizing job queues and their status.
+
+### Batch Job Retry Support
+- Implemented retry functionality for batch jobs to handle failures gracefully.
+
+### Prometheus Metrics Enhancements
+- Added Prometheus metrics for batch jobs and fine-tuning operations.
+
+</Update>
+
+<Update label="1.0.8" description="2025-02-04">
+## v1.0.8
+---
+
+### Azure Fine-tuning Support
+- Added support for `Azure OpeAI` fine-tuning operations.
+
+</Update>
+
+<Update label="1.0.7" description="2025-01-13">
+## v1.0.7
+---
+
+### Fine-tune v2
+- Implemented version 2 of the [fine-tuning](/product/ai-gateway/fine-tuning) functionality.
+</Update>
+
+<Update label="1.0.6" description="2024-01-08">
+## v1.0.6
+---
+
+### Prompt Slug Filter
+- Added support for data exports filtering by PromptSlug.
+
+</Update>
+
+<Update label="1.0.5" description="2024-01-06">
+## v1.0.5
+---
+
+### Batch Processing
+- Added provider and custom [Batch] (/product/ai-gateway/batches) processing functionality.
+
+</Update>
+
+<Update label="1.0.4" description="2023-12-17">
+## v1.0.4
+---
+
+### Code Quality Improvements
+- Fixed dynamic port retrieval from environment variables.
+</Update>
+
+<Update label="1.0.3" description="2023-11-28">
+## v1.0.3
+---
+
+### Vision Fine-tuning Support
+- Added support for vision fine-tuning validation for OpenAI.
+- Implemented S3 bucket support for fine-tunes.
+
+### AWS Integration Improvements
+- Fixed assumed role handling for Bedrock fine-tuning dataset URLs.
+- Improved S3 bucket path handling for Bedrock fine-tune operations.
+- Achieved parity with Enterprise Gateway for data sources.
+</Update>
+
+<Update label="1.0.2" description="2023-11-20">
+## v1.0.2
+---
+
+### Fine-tuning Enhancements
+- Added support for OpenAI job start and Fireworks upload.
+- Improved handling of chunk type failures with JSON.
+</Update>
+
+<Update label="1.0.1" description="2023-10-25">
+## v1.0.1
+---
+
+### Fireworks Fine-tuning Support
+- Added support for Fireworks fine-tuning operations.
+
+</Update>
+
+<Update label="1.0.0" description="2023-10-04">
+## v1.0.0
+---
+
+### Initial Release
+- Base version of the Data Service with core functionality.
+</Update>

docs.json

@@ -932,7 +932,7 @@
               },
               {
                 "group": "Enterprise Releases",
-                "pages": ["changelog/enterprise", "changelog/helm-chart"]
+                "pages": ["changelog/enterprise", "changelog/helm-chart", "changelog/data-service"]
               },
               {
                 "group": "Product Releases",
@@ -1836,7 +1836,7 @@
               },
               {
                 "group": "Enterprise Releases",
-                "pages": ["changelog/enterprise", "changelog/helm-chart"]
+                "pages": ["changelog/enterprise", "changelog/helm-chart", "changelog/data-service"]
               },
               {
                 "group": "Product Releases",