3.3.0

Added

• Add host_config_options to allow configuration of DockerTask for GPU resources #3234

Fixed

• Fix bigquery retry #3238
• Fix for applying logging configurations using the a TOML configuration file #3237

3.2.1

Fixed

luigi

• Fix XSS vulnerability #3230
• Fix typo in range_test.py #3228
• Using default_scheduler_url as a mounting point for not root pat… #3216
• Deduplicate outputs in luigi.task.flatten_output (#3106) #3174

3.2.0

Added

luigi

• Improve control over dynamic requirements #3179
• Can pass a JSON schema to DictParameter and ListParameter #3217
• support Python 3.10 #3140

Fixed

luigi

• Update random seed for python 3.11 compatibility #3204
• Fix md5 hash error for FIPS in python 3.9 #3209
• Catch io.UnsupportedOperation exception #3215
• Fix schema validation and add custom validators #3220

3.1.1

3.1.1

Added

luigi

• Add worker config to cache task completion results. (#3178)

Fixed

luigi

• Close requests.Socket in RemoteScheduler before exiting (#3173) (#3175)
• Use int-parameters for random.randrange() (#3177)
• Alternate (probably more correct) fix for #3182 (supercedes #3183) #3185

3.1.0

3.1.0

Added

luigi

• Documentation guidance around release version increments #3074
• Add support for naming tasks in @requires #3077
• Add traceback_max_length parameter for error email notifications #3086
• Document cause of Unfulfilled dependency error #3105
• Add additional OptionalParameter datatype options #3079
• UI: Add rerun command snippet on "show error" modal #3117
• Add support for updating default config parser after loading luigi #3135
• Allow batch_email.email_interval to be set in config as email-internal-minutes #3125
• Allow TimeDeltaParameter to accept input as "seconds" #3125
• Add EnumListParameter to top-level attribute imports #3144
• Enable metrics_custom_import for MetricCollectors #3146
• Improve warning when a parameter is not consumed by a task #3170

luigi.contrib

• Add configure_job BigQuery property #3098
• Add parquet support to BigQuery #3099
• Add network retry logic to BigQuery #3088
• Add run_task_kwargs property to ECS #3083
• Add pickle_protocol attribute and configuration option to Spark #3001
• Add pg8000 driver support to Postgres #3142

Fixed

luigi

• Fix default value for task.disable_window #3081
• Fix deconstructor of LocalTarget when is_tmp attribute dne #3085
• Improved documentation reference to luigi.format.Nop import #3047
• Fix Python 3.10 deprecation warnings #3150
• Remove unnecessary extra call to cls.get_task_namespace() #3129
• Fix documentation typo in notifications_test.py #3151
• Fix docs ci #3158
• Fix task history rendering #3153
• Move max_shown_tasks and max_graph_nodes documentation to correct section #3156
• Fix ability to subclass Task's Register metaclass #3154
• Replace legacy TravicCI readme badge with GithubActions #3159

luigi.contrib

• Fix apache ci
  • #3091
  • #3113
• Fix documentation typo in sqla #3110
• Fix spark cluster mode error for missing path #3111
• Fix connection object passed to rdbms.CopyToTable's _add_metadata_columns() #3011

Removed

luigi

• Remove @Tarrasch from codeowners #3127

Changed

luigi

• Update license copyright year #3108
• Improve error message on parsing default parameter value #3115
• Group tasks by task class in svg graph #3122
• Upgrade tenacity version #3147
• Enable task search to be case insensitive #3157

luigi.contrib

• Update ExternalPythonProgramTask parameters to OptionalParameter #3130
• Allow newer versions of prometheus-client package #3163

3.0.3

Added:

luigi

• Adding retry on _obj_exists #3022
• don't use absolute path in redirect for visualizer #2785

luigi.contrib

• kubernetes: labels are applied to pod #3007

Fixed:

luigi

• Flush stream_for_searching_tracking_url #3000

luigi.contrib

• Fix azureblob tests: use json instead of numpy #3032

Changed:

luigi

• replace naive retry with tenacity #3026

3.0.2

3.0.2

Fixed:

luigi

• Garbage collect task result queue when worker context exits #2973
• Fixing problem with ListParameter and Dynamic Dependencies #2970

Changed:

luigi

• Drop Python 3.3 and 3.4 support #2978

luigi.contrib

• Use updated uri for gcs batch reqs #2998

3.0.1

Added:

luigi

• Worker_timeout can be 0. #2968
• Return bq job id from biquery.run_job() #2957
• Documentation for check_complete_on_run config #2961

3.0.0

3.0.0

This is a major release without many feature changes compared to 2.8.13. The reason we decided to give it a major bump is the drop of Python2 support. From this version on, Luigi stops supporting Python2 for the obvious reason. 3.0.0 release includes a series of PRs deprecating Python2, plus a few other changes listed below. Special thanks go to @drowoseque for doing all the great work!

Added:

luigi

• Show task progress in visualizer workers tab. #2932

Fixed:

luigi

• Fix TravisCI build #2948
• Use is_alive in favour of isAlive for Python 3.9 compatibility. #2940

2.8.13

Added:

luigi.contrib

• Presto support in Luigi (#2885)

Fixed:

luigi

• removed wrong type of Target.init path arg from doc master (#2927)
• remove StreamingBodyAdaptor that didn't allow choosing the chunk size (#2929)
• Fix docs explaining write modes for Luigi Targets. Closes #2783 (#2931)
• All configuration parameters in docs now use underscore in their names for consistency. (#2890)

Changed:

luigi

• Allowed wider popovers in grapth. (#2093)
• update documentation to prefer pykube-ng (#2924)