v0.2.2
- Use watchdog timeout to catalog properties (#48). This pull request introduces a new
RemoveAfterproperty for catalogs, which allows for marking them for skipping by the watchdog. This change addresses the current implementation gap, which does not explicitly indicate when catalogs are being used. The new property will specify the time from which objects can be purged. A corresponding fixturewatchdog_remove_afterhas been added to the list of available fixtures, and themake_catalogfixture has been updated to include this new property. Additionally, a timeout mechanism for catalogs has been implemented, which improves the system's efficiency and safety by marking catalogs as in use. A test for themake_catalogfunction has been included to ensure that theRemoveAfterentry is correctly added to the catalog properties. However, the specific call parameters for thecatalogs.createmethod cannot be accurately determined in the test. - use tags instead of name suffix for queries (#47). This release introduces updates to the testing library for Databricks, enhancing the naming conventions for queries to improve readability and comprehension. The previous implementation used name suffixes, which have been replaced with watchdog query tags. The
watchdog_purge_suffixfixture has been renamed towatchdog_remove_after, and the newmake_queryfixture has been added to the documentation. In addition, themake_queryandcreatefunctions now accept an optionaltagsargument, and the query name is generated with a unique identifier. Iftagsare provided, theRemoveAftertag is added. Theoriginal_query_tagis no longer hardcoded in thecreatefunction and has been removed. These changes improve the overall user experience and maintainability of the project.
Contributors: @ericvergnaud