Lithops-2.4.1

Fixes

• [IBM VPC] Fixed a data inconsistency on consume mode, by @JosepSampe

Version 2.4.0

Added

• [Storage] Added MinIO storage backend, by @JosepSampe
• [Core] Allow to pass function args as part of the invocation payload in FaaS backends, by @JosepSampe
• [Core] Optimize call_async() calls with an internal function caching system, by @JosepSampe
• [AWS Lambda] New invoke method that reduces total invocation time, by @aitorarjona
• [Core] Allow to set the bucket name at storage backend level in config, by @JosepSampe
• [localhost] stop running jobs processes on ctrl-c or exception, by @JosepSampe
• [AWS S3] Added region_name parameter in config, by @aitorarjona

Changed

• [Core] Improved performance and efficiency of the lithops cleaner background process, by @JosepSampe
• [AWS Lambda] Use layer from Klayers API for pre-compiled Amazon Linux numpy binaries, by @aitorarjona
• [Core] Moved invoke_pool_threads param from map and map_reduce calls. Now it must be set at backend level in config, by @JosepSampe

Fixes

• [Localhost] Fixed error when processing localhost objects, by @JosepSampe
• [Localhost] Allow to create a localhost storage instance when a config file exists with a cloud configuration, by @JosepSampe
• [Core] Fixed an unusual inconsistency in configuration between 'backend' and 'mode' parameters, by @JosepSampe
• [Core] Fixed customized_runtime feature, by @JosepSampe
• [Core] Fixed get_result() execution after wait() when throw_except is set to False, by @JosepSampe
• [Core] Fixed internal executions, by @JosepSampe
• [Core] Fixed 'lithops storage list' CLI when a bucket is empty, by @JosepSampe
• [Standalone] Fixed execution, by @JosepSampe

Lithops-2.3.5

Added

• [Core] Add function chaining pattern in the Futures API, by @JosepSampe
• [Core] ob.data_stream is now also an iterator when using the partitioner, by @JosepSampe
• [AWS Lambda] Add 'account_id' parameter in config (used if present instead of querying STS), by @aitorarjona
• [k8s] Allow to set the maximum number of parallel workers, by @JosepSampe
• [Localhost] Allow the partitioner to process local directories, by @JosepSampe

Changed

• [Core] Add 'key' and 'bucket' attrs in localhost partitioner for compatibility with OS, by @JosepSampe
• [Serverless] runtime, runtime_memory and runtime_timeout can only be set at backend level, by @JosepSampe

Fixed

• [Standalone] Fix execution, by @JosepSampe
• [Core] Avoid loading the config file twice, by @JosepSampe

Lithops-2.3.4

Added

• [Core] Allow to execute a Class as lithops function, by @JosepSampe
• [CE] Allow to to run code engine without kubecfg file, by @JosepSampe
• [CE] Allow private container registries, by @JosepSampe
• [k8s] Allow private container registries, by @JosepSampe
• [knative] Allow private container registries, by @JosepSampe
• [Localhost] Allow the partitioner to process local files, by @JosepSampe
• [joblib] Added joblib entry in extras_require for joblib backend dependencies, by @aitorarjona

Changed

• [CE] CPU and memory values must match predefined flavors, by @JosepSampe
• [multiprocessing] Improved nanomsg Pipe implementation, by @aitorarjona
• [joblib] Optimized joblib backend (concurrent args data upload/download), by @aitorarjona

Fixed

• [Core] Fixed module analyzer, by @JosepSampe
• [Core] Clear only present jobs instead of all after wait() or get_result(), by @JosepSampe
• [multiprocessing] Fix put/get slice to/from mp.Array or mp.RawArray, by @aitorarjona

Lithops-2.3.3

Fixed

• [Core] Allow to execute class methods as lithops function, by @JosepSampe

Lithops-2.3.2

Added

• [Core] New "warm_container" and "func_result_size" in future statistics, by @aitorarjona
• [Core] New logic to detect referenced modules/libs, by @JosepSampe

Changed

• [Core] New monitoring system, by @JosepSampe
• [Core] Deleted strong dependency to pika==0.13.1, by @JosepSampe

Fixed

• [Partitioner] Fixed partitioner when obj url contains more than one subfolder, by @JosepSampe
• [Cli] Fixed serverless runtime lifecycle methods, by @JosepSampe

Deleted

• [Core] Removed cloudpickle from lithops.libs, by @JosepSampe

Version 2.3.1

Added

• [Core] Allow Support for Python 3.9, by @JosepSampe
• [Core] Added standalone get_result() and wait() methods, by @JosepSampe
• [knative] Include GCP and Azure storage libs into default knative runtime, by @JosepSampe
• [CodeEngine] Enable internal kubernetes pod executions, by @JosepSampe
• [k8s] Enable internal kubernetes pod executions, by @JosepSampe
• [Cli] Added 'empty' function to storage cli to empty a bucket, by @JosepSampe
• [Core] Added new method to FunctionExecutor() to calculate execution costs, by @Cohen-J-Omer
• [IBM CF] Added formula to calculate execution costs, by @Cohen-J-Omer
• [Multiprocessing] Added Nanomsg connection type for addressable backends, by @aitorarjona
• [Multiprocessing] Added expiry time for Redis multiprocessing resources, by @aitorarjona
• [Multiprocessing] Added Listener and Client for multiprocessing using Redis, by @aitorarjona
• [Azure Functions] Added support for http trigger, by @JosepSampe
• [Core] Set lithops to localhost mode when config files is empty, by @JosepSampe
• [Joblib] Add Pool args to joblib backend, by @gfinol

Changed

• [IBM CF] Change user_key to API-key pass instead of user, by @aitorarjona
• [Azure] Changed configuration keys, by @JosepSampe
• [Core] Improved worker when chunksize is set to values > 1, by @JosepSampe
• [Core] Check lithops version mismatch in host instead of in worker, by @JosepSampe

Fixed

• [Core] Overwrite the runtime set in config with the runtime set in the FunctionExecutor, by @JosepSampe
• [Cli] Fixed --config param in lithops cli, by @JosepSampe
• [Standalone] Fixed internal executions, by @JosepSampe
• [Core] Fixed rabbitmq monitor when get_result() is called after wait(), by @JosepSampe
• [GCP Storage] Fix GCP Storage backend put obj as stream, by @aitorarjona
• [GCP Functions] Improved runtime create time, by @aitorarjona
• [Azure blob] Fix in azure blob get method, by @JosepSampe
• [Azure Functions] Fix build runtime command, by @JosepSampe

Lithops-2.3.0

Added

• [Core] Added multiprocessing support in workers, by @JosepSampe
• [Core] Added 'cunksize' param to API calls, by @JosepSampe
• [Core] Added 'worker_processes' param to API calls, by @JosepSampe
• [Core] Allow a worker to process more than one call trough 'chunksize' param, by @JosepSampe
• [Core] All Functions logs are now synchronized with the client, by @JosepSampe
• [Config] Allow 'log_level' and 'log_format' keys in configuration, by @JosepSampe
• [Config] Allow 'log_stream' and 'log_filename' keys in configuration, by @JosepSampe
• [Config] Allow 'runtime' being configured at serverless backend level, by @JosepSampe
• [Config] Allow 'invoke_pool_threads' being configured at serverless backend level, by @JosepSampe
• [Multiprocessing] Added generic Manager, by @aitorarjona
• [Kubernetes] Add kubernetes job backend, by @JosepSampe
• [CLI] Extended lithops cli with storage put, get, delete and list options, by @JosepSampe
• [Azure Functions] Added missing azure functions backend methods, by @pablogs98

Changed

• [Core] Improved Standalone execution mode, by @JosepSampe
• [Core] Renamed utils.setup_logger() method to utils.setup_lithops_logger(), by @JosepSampe
• [Core] Renamed partitioner 'chunk_size' param to 'obj_chunk_size', by @JosepSampe
• [Core] Renamed partitioner 'chunk_n' param to 'obj_chunk_number', by @JosepSampe
• [GCP Cloud Run] Refactor backend, removed 'gcloud' CLI calls, by @JosepSampe
• [IBM VPC] Improved IBM VPC backend, by @gilv
• [AWS Lambda] Lambda layer modules update, by @aitorarjona

Fixed

• [Multiprocessing] Fix issues related to Pipes and Queues, by @aitorarjona
• [Multiprocessing] Fix multiprocessing.context methods, by @aitorarjona
• [CodeEngine/knative] Fix getting docker username in MAC OS hosts, by @JosepSampe

Lithops-2.2.17b1

Fixed

• [Core] Clear current executor jobs, by @JosepSampe
• [Standalone] Fix for ssh key filename, by @JosepSampe
• [Standalone] minor fix in master logging, by @JosepSampe

Lithops-2.2.16

Fixed

• [Code Engine] Fixing code engine docker image, by @gilv