Metadata Driven DW Automation v2.0.2

Some minor performance improvements and a workaround for a rare bug in SQL Server.

Metadata Driven DW Automation v2.0.1

Fixed a bug in Sisulate.ps1 where files were not generated if there wasn't already an existing file that could be overwritten. Added a script Sign-Sisulate.ps1 with the intention of signing the script for running in environments where PowerShell scripts need signing to be allowed to execute.

Metadata Driven DW Automation v2.0

This is the first release of the rewrite to PowerShell + JavaScript (through Jint). The legacy versions using HTA and the older JScript are still bundled and runnable until Microsoft drops them completely from the OS. They're both deprecated technologies, and sometimes blocked by corporate policies. There could still be bugs in the new PS+JS version, even if all regression tests made so far now pass, so keep an eye on the generated code if you switch and please file any bugs under the issue tracker here on GitHub.

Metadata Driven DW Automation v1.16.6

This release adds additional support for SQL Server 2022 (with an updated Utilities.DLL). It also fixes a bug in the IsType CLR UDF where numeric/decimal target types were wrongly flagged as non-compatible if the input was a negative number. If you were using IsType you may want to upgrade. If you are already using an earlier version on 2022 and do not use IsType, there's no real need to upgrade to this version, since the older DLL-file also works there.

Metadata Driven DW Automation v1.16.5

This release focuses on performance improvements in the stored procedures that read and write metadata. Slowdowns were seen when you had millions of rows in your Work table, particularly if you are using microbatches, where the time taken for metadata management was no longer insignificant relative the whole running time.

We now also force UTF-8 (without BOM) for generated SQL and XML files. For some reason the Sisulate script could produce files with different formats on different systems, which should now be avoided. UTF-8 is also a safe bet when it comes to versioning systems.

Metadata Driven DW Automation v1.16.4

This is a minor release fixing a bug where the Deletable column is not set in the UPDATE part of a MERGE statement even though a mapping target is marked with deletable="true".

Metadata Driven DW Automation v1.16.3

This is a minor release that fixes a bug causing the Utilities assembly to alternatingly be installed and uninstalled when you had several source XML files.

Metadata Driven DW Automation v1.16.2

This release contains some minor bug fixes since v1.16. There is also a new feature in the MultiSplitter utility function. It will now also return the name of the capturing group. In the following example:

select *
from GolfStage.dbo.MultiSplitter(
	'Hello stuff NN111, NN112 and the thing X001 in the cloud.', 
	'(?<stuff>[A-Z]{2}[0-9]{3})|(?<thing>[A-Z][0-9]{3})'
);

the output is now extended with an additional column named group:

match	index	group
NN111	12	stuff
NN112	19	stuff
X001	39	thing

Metadata Driven DW Automation v1.16

Loads in the target definition can now be marked as type="insert" (defaults to "merge"), which will generate an INSERT statement instead of a MERGE. This improves performance when you are certain that whatever it is you are adding is entirely new, since the insert avoids the key lookup required by the merge. One way of ensuring this is to prepare your target model in the section, by doing desired updates and deletes there when the merge performance is not as good as required (yes, this happens).

Metadata Driven DW Automation v1.15.3

A cut and paste bug had left a reference to the non-existing table #JB_ID in the _JobStopping SP. This minor release fixes that bug. If you are affected by this issue, rerun the script metadata/06_CreateLoggingProcedures.sql to upgrade the stored procedure in the database containing your metadata.