Skip to content

add cuda support to mosaicdb#1

Merged
allen-munsch merged 11 commits intomainfrom
cuda
Nov 30, 2025
Merged

add cuda support to mosaicdb#1
allen-munsch merged 11 commits intomainfrom
cuda

Conversation

@allen-munsch
Copy link
Owner

  • CUDA Integration & Performance: Introduced comprehensive CUDA support with new Dockerfiles, docker-compose configurations, and benchmarking scripts. This includes performance
    optimizations across the API, hybrid query engine, and indexer to leverage CUDA capabilities.
  • Major Core Refactoring (Refactors 0 & 1):
    • Refactor 1: Overhauled query handling by introducing new modules for aggregation, planning, routing, and classification. Replaced the resilience module with a dedicated
      connection_pool and updated DuckDB integration.
    • Refactor 0: Focused on the query engine, introducing helpers, shard router workers, and a worker pool. Significant changes were made to caching, federated queries, indexing
      and search, with the removal of the circuit breaker.
  • Advanced Ranking System: Implemented a new, modular ranking framework including fusion, a generic ranker, and various scorers (freshness, PageRank, text match, vector similarit
    to improve search relevance.
  • Caching Mechanism Overhaul: Refactored the internal caching system, introducing new ETS and Redis-backed cache implementations, along with dedicated tests and helpers for robus
    cache eviction policies.
  • Load Testing & Infrastructure: Integrated k6 for load testing, adding scripts and updating Docker and Nginx configurations to support performance testing.
  • Documentation & Development Context: Updated README.md, ARCHITECTURE.md, and added various context/*.txt files to guide ongoing development and architectural understandin
  • Minor Improvements: Simplified the embedding service and added a mosaic_demo.sh script for easier application demonstration.

Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
Signed-off-by: allen-munsch <james.a.munsch@gmail.com>
@allen-munsch allen-munsch merged commit ec4396b into main Nov 30, 2025
1 check failed
@allen-munsch allen-munsch deleted the cuda branch November 30, 2025 02:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant