Skip to content

Conversation

@MarcusSorealheis
Copy link
Collaborator

@MarcusSorealheis MarcusSorealheis commented Oct 6, 2025

Description

There are limitations to a distributed system where a cluster of workers are independently working through the same queue of tasks. This configuration will enable workers in a cluster to have immediate visibility into updates to the CAS. Worker 1 can upload digest 59859858y5, and Workers 2-100 can immediately read it immediately.

There have been some interesting race conditions and other related issues with the filesystem that have come up recently (#1863, #1928, #1931, #1934, etc.). The list is much longer in reality because this was always an issue.

Fixes #1949

Type of change

Please delete options that aren't relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to
    not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

Please also list any relevant details for your test configuration

Checklist

  • Updated documentation if needed
  • Tests added/amended
  • bazel test //... passes locally
  • PR is contained in a single commit, using git amend see some docs

This change is Reviewable

Copy link
Member

@palfrey palfrey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't work without docker plugin install juicedata/juicefs being run first


## Next Steps

- **Production Deployment**: See [juicefs-integration.md](../docs/juicefs-integration.md) for Kubernetes deployment
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't find the linked file

5. Monitor worker metrics
6. Set up log aggregation

See [Kubernetes deployment](../kubernetes/) for production-grade configurations or [JuiceFS with Kubernetes](../kubernetes/juicefs-deployment.yaml) for distributed storage on K8s.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not seeing the juicefs with k8s doc

@palfrey
Copy link
Member

palfrey commented Oct 6, 2025

This doesn't work without docker plugin install juicedata/juicefs being run first

Actually, more problems. juicefs-mount service gives me Error response from daemon: Encountered remote "application/vnd.docker.plugin.v1+json"(plugin) when fetching

@MarcusSorealheis MarcusSorealheis marked this pull request as draft October 6, 2025 17:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Introduce Fuse

2 participants