Skip to content

Add Flower alongside live environment Celery workers #1617

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ryanjjung wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Add Flower alongside live environment Celery workers #1617

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
f967bdb
Install flower for local dev; add explicit 'api' CONTAINER_ROLE
ryanjjung Apr 8, 2026
07b980f
Upgrade tb_pulumi, restructure dev task definitions
ryanjjung Apr 8, 2026
c8a6941
Build new log destination and cluster in dev
ryanjjung Apr 8, 2026
df37314
Allow Celery and Flower containers to speak to Redis
ryanjjung Apr 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions backend/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ celery[redis]==5.*
cryptography==46.*
dnspython==2.*
fastapi[standard]==0.*
flower>=2.0.1,<3
fluent.runtime==0.4.0
fluent.syntax==0.19.0
google-api-python-client==2.*
Expand Down
7 changes: 6 additions & 1 deletion backend/scripts/entry.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,9 @@ if [[ "$CONTAINER_ROLE" == "worker" ]]; then
elif [[ "$CONTAINER_ROLE" == "beat" ]]; then
echo "Starting Celery beat scheduler..."
celery -A appointment.celery_app:celery beat -l INFO
else
elif [[ "$CONTAINER_ROLE" == "flower" ]]; then
celery -A appointment.celery_app:celery flower -l INFO
elif [[ "$CONTAINER_ROLE" == "api" ]]; then
if [[ "$IS_LOCAL_DEV" == "yes" ]]; then
echo "Running setup"
run-command main setup
Expand All @@ -35,4 +37,7 @@ else

echo "Running uvicorn with these arguments: '$ARGS'"
uvicorn $ARGS
else
echo "Unrecognized CONTAINER_ROLE: $CONTAINER_ROLE"
exit 1
fi
11 changes: 11 additions & 0 deletions docker-compose.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,17 @@ services:
- backend
- redis

celery-flower:
<<: *backend
ports:
- 5555:5555
Copy link
Copy Markdown
Contributor

@davinotdavid davinotdavid Apr 8, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As a reminder to myself as well, can we switch this to 5556:5555 instead? It is becoming more common for me to run both thunderbird-accounts and appointment locally so the ports here would collide with ports there.

Suggested change
- 5555:5555
- 5556:5555

environment:
- CONTAINER_ROLE=flower
- FLOWER_UNAUTHENTICATED_API=true
depends_on:
- backend
- redis

frontend:
build: ./frontend
volumes:
Expand Down
21 changes: 21 additions & 0 deletions pulumi/__main__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,16 @@
resources = project.config.get('resources')
cloudflare_zone_id = project.pulumi_config.require_secret('cloudflare_zone_id')

# Create CloudWatch Logs groups to store application logs, etc. in
logdests = {
dest_name: tb_pulumi.cloudwatch.LogDestination(
f'{project.name_prefix}-logdest-{dest_name}',
project=project,
**dest_config,
)
for dest_name, dest_config in resources.get('tb:cloudwatch:LogDestination', {}).items()
}

# Create some private network space
vpc_opts = resources['tb:network:MultiCidrVpc'].get('appointment', {})
vpc = tb_pulumi.network.MultiCidrVpc(name=f'{project.name_prefix}-vpc', project=project, **vpc_opts)
Expand Down Expand Up @@ -70,6 +80,17 @@
vpc=vpc,
)

# AutoscalingFargateClusters, the newer class that replaces the above model. For now, we run it alongside.
afcs = {
afc_name: tb_pulumi.fargate.AutoscalingFargateCluster(
f'{project.name_prefix}-afc-{afc_name}',
project=project,
subnets=vpc.resources['subnets'],
**afc_config,
)
for afc_name, afc_config in resources.get('tb:fargate:AutoscalingFargateCluster', {}).items()
}

# CloudFront function to handle request rewrites headed to the backend
rewrite_function = cloudfront.rewrite_function(project=project)
project.resources['cf_rewrite_function'] = rewrite_function
Expand Down
Loading
Loading