Skip to content

[pull] master from celery:master #35

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 38 commits into
base: master
Choose a base branch
from
Open

Conversation

pull[bot]
Copy link

@pull pull bot commented Nov 9, 2022

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

sondrelg and others added 2 commits November 9, 2022 10:13
* Update test_schedules.py

* Update test_cache.py
@pull pull bot added the ⤵️ pull label Nov 9, 2022
Nusnus and others added 27 commits November 9, 2022 14:47
* Fix for test_revoked_by_headers_simple_canvas()

* Fix for test_revoked_by_headers_complex_canvas()
* feat: add global keyprefix for result keys

* docs: added documentation for global keyprefix for result backend
* Enhanced doc for canvas._chain.unchain_tasks()

* Enhanced doc for canvas._chain.prepare_steps()

* Enhanced doc for canvas._chain.run()

* Update celery/canvas.py

Co-authored-by: Asif Saif Uddin <[email protected]>

* Update celery/canvas.py

Co-authored-by: Asif Saif Uddin <[email protected]>

* Update celery/canvas.py

Co-authored-by: Asif Saif Uddin <[email protected]>

Co-authored-by: Asif Saif Uddin <[email protected]>
* Added reference in comment to issue #6973 regarding slow downs when using a group with a generator of many tasks

* Added TODO comment to group.skew() to consider removing it

* Enhanced doc for canvas.group.from_dict()

* Enhanced doc for canvas.group._prepared()

* Enhanced doc for canvas.group._apply_tasks()

* Enhanced doc for canvas.group._freeze_gid()

* Enhanced doc for canvas.group._freeze_unroll()

* Enhanced doc for canvas.group._unroll_tasks()

* Enhanced doc for canvas.group._freeze_tasks()

* Enhanced doc for canvas.group._freeze_group_tasks()

* Update celery/canvas.py

Co-authored-by: Omer Katz <[email protected]>

* Added example doc for group.from_dict()

Co-authored-by: Omer Katz <[email protected]>
updates:
- [github.com/asottile/pyupgrade: v3.2.0 → v3.2.2](asottile/pyupgrade@v3.2.0...v3.2.2)
- [github.com/pre-commit/mirrors-mypy: v0.982 → v0.990](pre-commit/mirrors-mypy@v0.982...v0.990)
* Ensure all implementations of BasePool._get_info() use the super()
results as a base.

* Have BasePool._get_info() report the implementation class of the pool
using the standard Celery class naming convention.

* Allow for an out-of-tree worker pool implementation. This is used as follows:

  - Set the environment variable CELERY_CUSTOM_WORKER_POOL to the name of
    an implementation of :class:`celery.concurrency.base.BasePool` in the
    standard Celery format of "package:class".
  - Select this pool using '--pool custom'.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixes for missed test breakage.

* Silence test code deprecation warnings (warning count reduced from 1674 to 45).

The deprecations were of the form:

=======
t/unit/worker/test_worker.py::test_WorkController::test_Pool_create
  /main/srhaque/kdedev/celery/.eggs/pytest-7.2.0-py3.10.egg/_pytest/fixtures.py:900: PytestRemovedIn8Warning: Support for nose tests is deprecated and will be removed in a future release.
  t/unit/worker/test_worker.py::test_WorkController::test_Pool_create is using nose-specific method: `setup(self)`
  To remove this warning, rename it to `setup_method(self)`
  See docs: https://docs.pytest.org/en/stable/deprecations.html#support-for-tests-written-for-nose
    fixture_result = next(generator)

t/unit/worker/test_worker.py::test_WorkController::test_Pool_create
  /main/srhaque/kdedev/celery/.eggs/pytest-7.2.0-py3.10.egg/_pytest/fixtures.py:916: PytestRemovedIn8Warning: Support for nose tests is deprecated and will be removed in a future release.
  t/unit/worker/test_worker.py::test_WorkController::test_Pool_create is using nose-specific method: `teardown(self)`
  To remove this warning, rename it to `teardown_method(self)`
  See docs: https://docs.pytest.org/en/stable/deprecations.html#support-for-tests-written-for-nose
    next(it)
=======

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Ensure all implementations of BasePool._get_info() use the super()
results as a base.

* Have BasePool._get_info() report the implementation class of the pool
using the standard Celery class naming convention.

* Allow for an out-of-tree worker pool implementation. This is used as follows:

  - Set the environment variable CELERY_CUSTOM_WORKER_POOL to the name of
    an implementation of :class:`celery.concurrency.base.BasePool` in the
    standard Celery format of "package:class".
  - Select this pool using '--pool custom'.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixes for missed test breakage.

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Enhanced doc for canvas._chord.set_immutable()

* Enhanced doc for canvas._chord.link()

* Enhanced doc for canvas._chord.link_error()

* Enhanced doc for canvas._chord.__length_hint__()

* Enhanced doc for canvas._chord._descend()

* Enhanced doc for canvas._chord.from_dict()

* Enhanced doc for canvas._chord.run()
… of casting it to a list even when the value is a single item
* Added test_properties_not_affected_from_stamping

* Removed stamped headers from task options before sending to broker

* Fixed linter issues
updates:
- [github.com/pre-commit/mirrors-mypy: v0.990 → v0.991](pre-commit/mirrors-mypy@v0.990...v0.991)
* Reproduced Bug from Issue #5958

* Fixed Issue #5958

* Added unit test: test_chord__or__group_of_single_task()

* Added unit test: test_chord_upgrade_on_chaining()

* Added unit test: test_chain_of_chord__or__group_of_single_task()

* Added unit test: test_chain_of_chord_upgrade_on_chaining()
…king the stamps in the 'stamps' property (#7928)

* Added integration test: test_task_received_has_access_to_stamps()

* Fixed bug in Request.stamps property where the 'stamps' key wasn't used to access the stamps
…ding behind 'ExceptionWithTraceback' (#7930)

* Fix bug in TraceInfo._log_error() where the real exception obj was hiding behind 'ExceptionWithTraceback'

* Commit 629bc63 introduced a bug in test_execute_jail_failure.
This reverts the bug in the test, now that the real bug is fixed in the TraceInfo._log_error() method
…lidating stamping works with complex canvas on all tasks per the doc (#7931)
during the replacement, would remove the original stamp from the `stamps` key
(stamped_headers key does have it, as it should).

Tested with new integration test: test_replace_merge_stamps()
…n task replace. (#7935)

This adds a new test case to reproduce it + fix.
New test case: test_replace_group_merge_stamps()
…le canvas is calculated correctly using automatic tests
* Removed pass from @AbstractMethod StampingVisitor.on_signature()

* Added unit test: test_repr_empty_group()

* Added unit test: test_signature_on_error_adds_error_callback()

* Cleaned chord.link_error() implementation

* Added a new test suite: test_merge_dictionaries

* Fixed bug in _merge_dictionaries() function when using None values, tested with test_none_values()

* Added test case for "Signature | non-Signature" in unit test: test_OR()

* Added new unit test: test_freezing_args_set_in_options()

* Added new unit test: test_group_prepared(), for the inner method of group._prepared()

* Added unit test for chord: test_link_error_on_chord_header(), using the task_allow_error_cb_on_chord_header flag

* Added subtests explanation to test_OR() unit test for "sig | non-sig" test case

* Added unit test: test_on_signature_gets_the_signature()

* Matched (copied) the unit tests "Install tox" step to the integration tests to have the same command for both
* [pre-commit.ci] pre-commit autoupdate

updates:
- [github.com/asottile/pyupgrade: v3.2.2 → v3.3.1](asottile/pyupgrade@v3.2.2...v3.3.1)
- [github.com/PyCQA/flake8: 5.0.4 → 6.0.0](PyCQA/flake8@5.0.4...6.0.0)
- [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0](pre-commit/pre-commit-hooks@v4.3.0...v4.4.0)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
pyup-bot and others added 9 commits December 13, 2022 18:15
* Update sphinx-click from 4.3.0 to 4.4.0

* Update mypy from 0.982 to 0.991

* Update cryptography from 38.0.3 to 38.0.4

* Pin elasticsearch to latest version 8.5.3

* Update pycurl from 7.43.0.5 to 7.45.1

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update requirements/test-ci-default.txt

* Update requirements/extras/elasticsearch.txt

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Asif Saif Uddin <[email protected]>
* try Python 3.11 and pypy 3.9 in CI

* Update python-package.yml

* Update .github/workflows/python-package.yml
* sqlalchemy==1.4.44

* sqlalchemy==2.0.0b4

* sqlalchemy==1.4.45

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
For example in case you want to implement strict type checking that relay on annotations or the dataclass object you may just set `Celery.type_checker` with valid interface.
* feat: add broker_channel_error_retry option

* docs: add configuration doc

* test: add unit test for broker_channel_error_retry

* remove empty 76

* docs: add version annotation

Co-authored-by: Asif Saif Uddin <[email protected]>
…#7945)

* add beat_cron_starting_deadline to prevent unwanted cron tasks from running

* update cron_starting_deadline docs with verisonadded
updates:
- [github.com/pycqa/isort: 5.10.1 → v5.11.3](PyCQA/isort@5.10.1...v5.11.3)
* Pin isort to latest version 5.11.3

* Pin elasticsearch to latest version 8.5.3

* Update pycurl from 7.43.0.5 to 7.45.2

* Update requirements/extras/elasticsearch.txt

* Update requirements/test-ci-default.txt

Co-authored-by: Asif Saif Uddin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.