Skip to content

Feature Store Docker Images Missing Dream11-Specific Maven Dependencies #115

@dhruvmehtad11

Description

@dhruvmehtad11

Describe the Bug

Feature-store service Docker images do not include Dream11-specific Maven plugins and their dependencies (migrations-maven-plugin, config-maven-plugin) required by pre-deploy scripts. This causes Maven to fail when trying to execute database migrations during the pre-deployment phase, even when the pre-deploy scripts are correctly triggered.

Service Affected

  • darwin-compute
  • darwin-cluster-manager
  • feature-store
  • mlflow
  • ml-serve-app
  • artifact-builder
  • chronos
  • darwin-catalog
  • darwin-workflow
  • hermes-cli
  • Helm charts / Deployment
  • Other: ___

To Reproduce

Steps to reproduce the behavior:

  1. Fix the service name mismatch issue (Issue #114)
  2. Deploy Darwin with feature-store services enabled
  3. Pre-deploy scripts now execute but fail with Maven errors
  4. Check darwin-datastore-health-check-* pod logs
  5. See Maven plugin resolution errors

Expected Behavior

The Docker images for feature-store services should include:

  1. All Dream11-specific Maven plugins (JARs and POMs)
  2. Plugin dependencies (JARs and POMs)
  3. Parent POM files for proper dependency resolution

Actual Behavior

Maven fails with errors like

Screenshots / Logs

Logs
[ERROR] Plugin com.dream11.migrations:migrations-maven-plugin:2.2.16 or one of its dependencies could not be resolved
[ERROR] Failed to read artifact descriptor for com.dream11:config-maven-plugin:jar:1.1.21
[ERROR] A required class was missing: com/dream11/migrations/core/main/Migrations

Environment

Item Value
Darwin Version v0.0.2
Kubernetes Version v1.28.0
Helm Version v3.12.0
OS macOS 15.6
Cluster Type Kind

Additional Context

The issue affects all feature-store services:

  • darwin-ofs-v2 (main service)
  • darwin-ofs-v2-admin
  • darwin-ofs-v2-consumer
  • darwin-ofs-v2-populator
  • darwin-ofs-v2-writer

The internal artifacts are stored in AWS CodeArtifact but need to be bundled into Docker images for local/open-source deployments.

Possible Solution

Update all feature-store/.odin/darwin-ofs-v2*/build.sh scripts to copy the required Maven artifacts from feature-store/local-repo into the Docker images.
Another possible solution is to upload internal dependencies to maven central.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions