v1.15.0

What's Changed

• Fix lazy import by @pingsutw in #2987
• fix: dbt-test by @taieeuu in #2989
• Async tasks and eager revamp by @wild-endeavor in #2927
• GH-5989: Fix task registration with node_dependency_hints by @Tom-Newton in #2992
• Remove eager exception doc by @wild-endeavor in #2995
• Introduce pod_spec_from_resources()ray helper function by @fiedlerNr9 in #2943
• pin ollama version by @samhita-alla in #2997
• Remove open_async usage in put raw data by @wild-endeavor in #2998
• Specify minio env vars in integration tests by @eapolinario in #3001
• Correct links that end up surfacing in docs by @ppiegaze in #3000
• Unify dependencies in agent image by @eapolinario in #3008
• Faster GitIgnore directory check by @fellhorn in #3007
• Use the same source of time in flaky test by @eapolinario in #3009
• Use correct name in flyteagent test by @eapolinario in #3011
• vscode decorator for the dynamic task by @pingsutw in #2994
• fix: Improve error details and logging config handling by @pingsutw in #3012
• Add python interpreter into vscode settings by @thomasjpfan in #3014
• add support for toggling data mode for array node by @pvditt in #2940
• Store protos in local cache by @eapolinario in #3022
• Bump aiohttp from 3.9.5 to 3.10.11 by @dependabot in #3018
• Fix bug in FlyteDirectory.listdir on local files by @pimdh in #2926
• Fix unit tests in airflow plugin by @pingsutw in #3024
• fix: Fix resource meta typos for async agent by @JiangJiaWei1103 in #3023
• fix: format commands output by @vincent0426 in #3026
• Fix pydantic basemodel default input by @Future-Outlier in #3013
• [BUG] Open FlyteFile from remote path by @JiangJiaWei1103 in #2991
• vllm inference plugin by @dansola in #2967
• Add poetry to image spec by @thomasjpfan in #3025
• [test] Add integration test for accessing sd sttr in dc by @JiangJiaWei1103 in #2969
• [BUG] Map task logging level fixed at 30 for default logger by @pvditt in #3032
• add Optuna plugin by @granthamtaylor in #3035
• add managed environment POC by @granthamtaylor in #3021
• Make launch plan registrable by removing requirement for name by @wild-endeavor in #3043
• Make FlyteFile and FlyteDirectory pickleable by @cosmicBboy in #3030
• fix: set asyncio_default_fixture_loop_scope by @machichima in #3034
• Bump jinja2 from 3.1.3 to 3.1.5 in /plugins/flytekit-onnx-pytorch by @dependabot in #3044
• pin grpcio and grpcio-status <= 1.68.0 by @cosmicBboy in #3046
• Prevent register_launch_plan from re-registering already registered workflow by @wild-endeavor in #3049
• Remove Pydantic V1 plugin by @Future-Outlier in #3040
• Add advanced Optuna plugin authoring methods by @granthamtaylor in #3051
• Place venv in /root when using uv.lock as well by @thomasjpfan in #3062
• Make FlyteUserRuntimeException to return error_code in Container Error by @RRap0so in #3059
• Improve Type Engine Error Msg by @Future-Outlier in #3063
• [Flytekit] Separate remote signal functions by @mao3267 in #2933
• Only copy over cat-certificates.crt if it does not exist in base image by @thomasjpfan in #3067
• Update eager task launching & monitoring by @wild-endeavor in #3042
• Support with_overrides setting metadata for map_task subnode instead of parent node by @pvditt in #2982
• fix: remove duplication log when execute by @vincent0426 in #3052
• Fix: Always propagate pytorch task worker process exception timestamp to task exception by @fg91 in #3057
• Eager deck name by @wild-endeavor in #3072
• Allow user-defined dataclass type transformer (again) by @eapolinario in #3075
• [flyteagent][CLI] Make agent prometheus port configurable by @Future-Outlier in #3064
• Adds python_exec into ImageSpec by @thomasjpfan in #3069
• Add a test for union/dc by @wild-endeavor in #3074
• Add the Flyte agent to provision and manage K8s (data) service for deep learning (GNN) use cases by @shuyingliang in #3004
• Bugfix Omegaconf plugin: Properly deal with NoneType values by @adrianloy in #3056
• Adds secret env_var by @thomasjpfan in #3048
• Fix async coroutine limit not respected and add s3/gcs chunk size by @wild-endeavor in #3080
• Structured datasets in containers (dc/pydantic) by @wild-endeavor in #3086
• Add pip_extra_args by @amitani in #3081
• Enable pydoclint by @eapolinario in #3077
• Also run unit tests on arm64 by @eapolinario in #3085
• Regenerate baseline by @eapolinario in #3090
• Silence union warning by @wild-endeavor in #3091
• Add request and limit to ray config by @pingsutw in #3087
• [BUG] Fix StructuredDataset empty-str file_format in dc attr access by @JiangJiaWei1103 in #3027
• Gatenode local execution, was parsing the input twice by @kumare3 in #3101
• prevent compile err for ReferenceWorkflow by @machichima in #3102
• Improve Union Transformer Ambiguous Error Message by @Future-Outlier in #3076
• add ReferenceWorkflow into return type hint by @machichima in #3103
• Tracks progress for package creation, upload and kickoff by @kumare3 in #2935
• Support overriding task pod_template via with_overrides by @arbaobao in #2981
• add project & domain endpoint for FlyteRemote by @fiedlerNr9 in #3108
• [flyte deck] Streaming Decks by @Future-Outlier in #2779
• Fixed type hint by @pimdh in #3110
• Upgrade flyteidl version to 1.14.3 by @arbaobao in #3112
• Bump snowflake-connector-python from 3.12.3 to 3.13.1 by @dependabot in #3113
• Adds validation to Secrets.env_var by @thomasjpfan in #3114
• Fix for keyring errors when initializing Flyte for_sandbox config client by @taieeuu in #2962
• fix: keyring refresh twice by @taieeuu in #3119
• Support mounting secrets by default builder. by @amitani in #3082
• prevent compile err for all reference entities by @machichima in #3122
• Fix dict annotations by @wild-endeavor in #3123
• Attempt to use more specific transformer when executing remote entities by @wild-endeavor in #3111
• Support FlyteRemote.execute interruptible flag override by @redartera in #2885
• Improve podtemplate override logic by @arbaobao in #3117
• Bug when calling wf in eager task with thread by @wild-endeavor in #3125
• Bump certifi from 2023.7.22 to 2024.7.4 in /plugins/flytekit-onnx-pytorch by @dependabot in #3127
• Skip test_get_container_error_timestamp on windows by @eapolinario in #3128
• [Flytekit][Test] Structured dataset pickleable test by @mao3267 in #3121
• Flytekit remote updates for notebooks and versions by @kumare3 in #3109
• Execute launchplans declared locally and automatically adjust input params based on fixed and default values by @kumare3 in #3115
• Do not import kubernetes in flytekit core by @thomasjpfan in #3118
• Cache polish work - including the introduction of cache policies to the new top level Cache object by @eapolinario in #3129
• publish pandera deck by @cosmicBboy in #3131
• Fix DeprecationWarning in pythonjsonlogger>=3.1.0 by @patrick-kidger in #3120
• Add shared_memory to task with extended resources by @thomasjpfan in #3096
• Added msgpack support for pyflyte fetch, storing as JSON by @pimdh in #3130
• Improve Flyte Literal Converter logic by @Future-Outlier in #3134
• Refactor extract_types in Dict Transformer by @Future-Outlier in #3124
• Eager rate limit by @wild-endeavor in #3133
• Add instructions for how to handle failures coming from cache policies by @eapolinario in #3135
• Remove hardcoded ref to docs by @ppiegaze in #3068
• Fix array node empty task executions when using remote by @troychiu in #3136

New Contributors

• @taieeuu made their first contribution in #2989
• @pimdh made their first contribution in #2926
• @vincent0426 made their first contribution in #3026
• @machichima made their first contribution in #3034
• @shuyingliang made their first contribution in #3004
• @adrianloy made their first contribution in #3056
• @amitani made their first contribution in #3081
• @patrick-kidger made their first contribution in #3120

Full Changelog: v1.14.0...v1.15.0