v1.22

Manual Interventions

Main Instance

Some of the changes will require a migration and collectstatic commands to be run:

docker compose build && docker compose up -d
docker compose exec django python manage.py migrate
docker compose exec django python manage.py collectstatic --no-input

There is a new environment variable for the contact email:

CONTACT_EMAIL=info@codabench.org

Make sure to add it to your .env file before launching the containers

Compute Workers

Major compute workers changes will require updating the Compute Worker images for both Docker and Podman. Podman workers will also need Podman 5.4 minimum to work on the host

New Features (Participants, Organizers, Hosters)

• Feature - Banned User functionality added
• Compute Worker Use docker-py instead of the current subprocess way of doing things (for podman and docker)
• Colored JSON logs; Made run argument prettier for compute worker

Improvements

• Initial Playwright integration
• Tests - datasets API delete tests added
• Chahub cleanup
• Cleanup - remaining references of chahub removed
• Email - Added CONTACT_EMAIL
• Django Admin Interface Upgrades

Bug fix

• Phase creation from UI with starting_kit/public_data bug fixed
• Submission delete API bug fixed. More restrictions added
• Changed domain name setting to not show example.com but the actual domain name defined in the .env
• Put back partners logo

Documentation

• Change old wiki link to docs.codabench.org links
• Docs - removed : and %3A from docs
• Remove docs/ since we do not need it anymore and it's unmaintained

v1.21.1

Manual Interventions

This release updates the Compute Worker code. You will need to pull the updated images or recreate ones.

Changes

• Circle Ci - Reorganised circle ci config file

Bug Fixes

• Updated requests websockets and pyyaml of compute worker to fix some vulnerabilities
• Remove certificate verification from celery in the compute worker
• Fix BestModeStrategy to exclude soft-deleted and non-finished submissions
  • Fix BestModeStrategy to exclude soft-deleted and non-finished submissions
• Added back submissions files copy into prediction out that was removed in the Podman PR by accident
• Changed hardcoded email as per issue #2040
• Datasets PR#2 Croissant metadata added
• Cleanup - Datagroup and related code removed
• Docs - Email updated to info@codabench.org
• Comment out the non working tests while we find a way to fix them

Full Changelog: v1.21.0...v1.21.1

1.21.0

Manual Intervention

1. MinIO migration (depending on setup) (#1964)

If you are running MinIO locally (defined by .env and docker-compose.yml, you may require to follow the following MinIO upgrade instructions, to duplicate and mirror your buckets and convert them to the new format:
https://docs.min.io/community/minio-object-store/operations/deployments/baremetal-migrate-fs-gateway.html

2. Rebuild all containers (#2025)

docker compose build && docker compose up -d

3. Django migration (#1955)

docker compose exec django ./manage.py migrate

4. Collect static files (#1982)

docker compose exec django ./manage.py collectstatic --no-input

5.Compute Workers

We have updated the compute worker codes. If you have deployed your own workers, you will need to update your images to either :latest or :cpu1.3

New Features

• Added mkdocs based documentation files for the new wiki
• Added the recent changes from the wiki into the new wiki
• Change staticfiles to static, django 3 updates
• Fixed MC image version and bumped MinIO version
• Added custom filter that shows competitions with more than 10 participants and 25 submissions that are private
• Datasets PR#1 - New datasets public page and related updates
• Leaderboard always visible
• Podman updates & More Competition container security
• Changed logger to Loguru

Bug Fixes

• Removed a test checking for validated tasks since we removed the validation in https://github.com/codalab/codabench/pull/1963
• Update logo path so that it uses the Django template tag {% static %}
  • Update logo path so that it uses the Django template tag {% static %}
• Fix leaderboard columns and title
• Fix DEBUG variable in base.py
• Fix API docs page not loading

Changes

• Removed urls
  • Removed unused urls
• Removed a test checking for validated tasks since we removed the validation in https://github.com/codalab/codabench/pull/1963

Full Changelog: 1.20.0...v1.21.0

1.20.0

Manual Intervention needed if upgrading

Codabench Instance

If you are upgrading from a previous version, you will need to run the following commands:

docker compose build && docker compose up -d
docker compose exec django ./manage.py makemigrations
docker compose exec django ./manage.py migrate
docker compose exec django ./manage.py collectstatic --noinput

Compute workers

If you have your own compute workers, you will also need to update them. You can simply do a docker compose pull && docker compose up -d if you are still using the latest tag inside the docker-compose.yml. Otherwise, change the tag to latest then run the previous command.

New Features

• Filters added in public competitions page
• Delete non active users
• code documentation - public competitions api documentation added
• clamp length of competition search results description
• Option added to download all participants
• Improved organization delete error + Remove organization reference from submission on soft deletion
• File size for submissions clarified
• Compute worker - Allow to unzip files with parent directory - We have reverted this change for now as it would bug out some competitions
  • Revert "Compute worker - Allow to unzip files with parent directory"
• Update mc command from "config host add" to "alias set"
• Set page titles on some pages

Changes

• Removed num entries from leaderboard
• Caddy image update
• User model filters - remove deleted
• Django to 3.0
• Docker worker updates

Bug Fixes

• fix Caddyfile indentation
• Submission files duplication - We have reverted this change for now as it would bug out some competitions
  • Put back copy of submission files into prediction output in compute worker
• Do not allow signup with email with *
• Markdown rendering problems fixed
• Remove validation logic from tasks.py
• fix missing username in email template, improve message

Full Changelog: 1.19.0...1.20.0

1.19.0

Manual Intervention needed if upgrading

You will need to launch a migration with the following command after upgrading:

docker compose exec django ./manage.py migrate

New Features

• Add remove button for cancelled submissions
• Clarify warning message "Detailed results not written" in compute_worker.py
• Add hide_score_output option
• Version update workflow removed
• Add hide_prediction_output option

Bug Fixes

• Add permissions check for bulk download
• Phase end date - calendar fixed

Full Changelog: 1.18.0...1.19.0

1.18.0

Manual Intervention needed if upgrading

This release changes things in the database. You will need to stop new submissions on your server while you launch the commands needed. You can use the new maintenance mode to achieve this.

More information on this page.

New Features

• Updated release-version PR title to distinguish from other PRs
• Competition pages are now clickable without any active phase
• Home page competitions updates
• Competition results API fixed
• Double approve/deny participant
• Enable/Disable competition forum
• Competition Create form UI updates
• Do not allow special chars in usernames
• Email in lowercase
• Latest competition fields added to dump
• User quota is updated to GB from Bytes
• File Sizes cleanup
• Resetting file sizes task removed
• Resource interface: quota unit is now GB instead of B
• Create CODE_OF_CONDUCT.md
• Added log rolling to limit log size to 5GB for now, can be changed
• Maintenance mode option added in Caddyfile, used by creating a maintenance.on file in the maintenance_mode/ directory

Fixes

• Show server error instead of frontend parsing/JSON error
• Exclude soft-deleted submissions from leaderboard
• Task list pagination issues resolved

Full Changelog: 1.17.0...1.18.0

1.17.0

Manual Intervention needed if upgrading

You will need to run a migration if upgrading, more details here.

New Features

• Platform yearly statistics
• Delete User Updates
  • Delete User Updates # 2 - user id added to DeletedUser modal
• Forum Updates - restrictions added for non-participants
• Submission soft-delete functionality added

Full Changelog: 1.16.0...1.17.0

1.16.0

Manual Intervention needed if upgrading

You will need to run a migration if upgrading, more details here.

New Features

• Update version.json for release 1.15.0
• Feature/remove user/soft removal (#1691)
  • Fix/remove user/soft removal
  • Fix URLs in user deletion email
• Updated the filters to show the new "Is Deleted"
• .gitingore update to ignore the home page counters file. Also removed the file from cache so that it's not tracked anymore

Full Changelog: 1.15.0...1.16.0

1.15.0

Manual Intervention needed if upgrading

You will need to recreate the docker containers if updating to this version from a previous version.

docker compose build && docker compose up -d

To avoid waiting a day for the homepage counters to update, you can also run the commands shown here

New Features

• Upload task from resource interface
• Update podman containers
• Optimization PR#3 - Home page counters
• Caddy image update
• Added search bar in Django Admin Users page for emails and username
• Some more interesting fields for the Users page on the Django Admin Interface
• Search field + more information displayed on the Competition page of the django admin interface

Bug Fixes

• remove d-r-c and upgrade channels-redis
• Release version updates

Full Changelog: 1.14.0...1.15.0

1.14.0

Manual intervention needed if upgrading

You will need Django/Postgres to compute the numbers of participants and submissions on all competitions by running a couple of commands found here.
This is part of the optimization effort to make the website smoother for everyone without losing functionality.

New Features

• Update to create a robot submission
• Update documentation to create a robot submission
• Some package upgrades
• Updated version workflow for auto releases

Optimizations

• Optimization PR#2 - Submissions and Participants Count
• Optimization PR#2 Update Submissions count
• Optimization PR#1 - Featured competitions

Full Changelog: 1.13.0...1.14.0