You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG.md
+81-46Lines changed: 81 additions & 46 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,9 +1,44 @@
1
1
# Changelog
2
2
3
+
### v1.4.1
4
+
5
+
This is a minor release following up on 1.4.0 with fixes for long outstanding issues.
6
+
Contributors to this release are [@cbini](https://github.com/cbini), [@rlshuhart](https://github.com/rlshuhart), [@jacobm001](https://github.com/jacobm001), [@baldwicc](https://github.com/baldwicc) and [@sdebruyn](https://github.com/sdebruyn).
7
+
8
+
#### Features
9
+
10
+
* Added support for a custom schema owner. You can now add `schema_authorization` (or `schema_auth`) to your profile.
11
+
If you do so, dbt will create schemas with the `authorization` option suffixed by this value.
12
+
If you are authorizing dbt users or service principals on Azure SQL based on an Azure AD group,
13
+
it's recommended to set this value to the name of the group. [#153](https://github.com/dbt-msft/dbt-sqlserver/issues/153)[#382](https://github.com/dbt-msft/dbt-sqlserver/issues/382)
14
+
* Documentation: added more information about the permissions which you'll need to grant to run dbt.
15
+
* Support for `DATETIMEOFFSET` as type to be used in dbt source freshness tests. [#254](https://github.com/dbt-msft/dbt-sqlserver/issues/254)[#346](https://github.com/dbt-msft/dbt-sqlserver/issues/346)
16
+
* Added 2 options related to timeouts to the profile: `login_timeout` and `query_timeout`.
17
+
The default values are `0` (no timeout). [#162](https://github.com/dbt-msft/dbt-sqlserver/issues/162)[#395](https://github.com/dbt-msft/dbt-sqlserver/issues/395)
18
+
19
+
#### Bugfixes
20
+
21
+
* Fixed issues with databases with a case-sensitive collation
22
+
and added automated testing for it so that we won't break it again. [#212](https://github.com/dbt-msft/dbt-sqlserver/issues/212)[#391](https://github.com/dbt-msft/dbt-sqlserver/issues/391)
23
+
* Index names are now MD5 hashed to avoid running into the maximum amount of characters in index names
24
+
with index with lots of columns with long names. [#317](https://github.com/dbt-msft/dbt-sqlserver/issues/317)[#386](https://github.com/dbt-msft/dbt-sqlserver/issues/386)
25
+
* Fixed the batch size calculation for seeds. Seeds will run more efficiently now. [#396](https://github.com/dbt-msft/dbt-sqlserver/issues/396)[#179](https://github.com/dbt-msft/dbt-sqlserver/issues/179)[#210](https://github.com/dbt-msft/dbt-sqlserver/issues/210)[#211](https://github.com/dbt-msft/dbt-sqlserver/issues/211)
26
+
* Added `nolock` to queries for all information_schema/sys tables and views.
27
+
dbt runs a lot of queries on these metadata schemas.
28
+
This can often lead to deadlock issues if you are using a high number of threads or dbt processes.
29
+
Adding `nolock` to these queries avoids the deadlocks. [#379](https://github.com/dbt-msft/dbt-sqlserver/issues/379)[#381](https://github.com/dbt-msft/dbt-sqlserver/issues/381)
30
+
* Fixed implementation of `{{ hash(...) }}` for null values. [#392](https://github.com/dbt-msft/dbt-sqlserver/issues/392)
31
+
32
+
#### Under the hood
33
+
34
+
* Fixed more concurrency issues with automated Azure integration testing.
35
+
* Removed extra `__init__.py` files. [#171](https://github.com/dbt-msft/dbt-sqlserver/issues/171)[#202](https://github.com/dbt-msft/dbt-sqlserver/issues/202)
36
+
* Added commits to be ignored in git blame for easier blaming. [#385](https://github.com/dbt-msft/dbt-sqlserver/issues/385)
37
+
3
38
### v1.4.0
4
39
5
-
*@Elliot2718 made their first contribution in https://github.com/dbt-msft/dbt-sqlserver/pull/204
6
-
*@i-j made their first contribution in https://github.com/dbt-msft/dbt-sqlserver/pull/345
40
+
*[@Elliot2718](https://github.com/Elliot2718) made their first contribution in https://github.com/dbt-msft/dbt-sqlserver/pull/204
41
+
*[@i-j](https://github.com/i-j) made their first contribution in https://github.com/dbt-msft/dbt-sqlserver/pull/345
7
42
8
43
#### Features
9
44
@@ -15,10 +50,10 @@
15
50
16
51
#### Bugfixes
17
52
18
-
* Add `nolock` query hint to several metadata queries to avoid deadlocks by @Elliot2718 in https://github.com/dbt-msft/dbt-sqlserver/pull/204
19
-
* Rework column metadata retrieval to avoid duplicate results and deadlocks by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/368
20
-
* Model removal will now cascade and also drop related views so that views are no longer in a broken state by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/366
21
-
* Fixed handling of on_schema_change for incremental models by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/376
53
+
* Add `nolock` query hint to several metadata queries to avoid deadlocks by [@Elliot2718](https://github.com/Elliot2718) in https://github.com/dbt-msft/dbt-sqlserver/pull/204
54
+
* Rework column metadata retrieval to avoid duplicate results and deadlocks by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/368
55
+
* Model removal will now cascade and also drop related views so that views are no longer in a broken state by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/366
56
+
* Fixed handling of on_schema_change for incremental models by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/376
22
57
23
58
#### Under the hood
24
59
@@ -30,34 +65,34 @@
30
65
<details><summary>PR changelog</summary>
31
66
<p>
32
67
33
-
* Bump pre-commit from 2.20.0 to 3.2.0 by @dependabot in https://github.com/dbt-msft/dbt-sqlserver/pull/344
34
-
* Bump docker/build-push-action from 3.2.0 to 4.0.0 by @dependabot in https://github.com/dbt-msft/dbt-sqlserver/pull/331
35
-
*[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/dbt-msft/dbt-sqlserver/pull/316
36
-
* Bump wheel from 0.38.4 to 0.40.0 by @dependabot in https://github.com/dbt-msft/dbt-sqlserver/pull/343
37
-
* Copy for workflow schtuff by @dataders in https://github.com/dbt-msft/dbt-sqlserver/pull/350
38
-
* avoid publishing docker from other branches than master by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/351
39
-
* bump pre-commit by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/353
40
-
* fix pre-commit for python 3.7 by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/354
41
-
* use 127.0.0.1 to avoid issues with local testing by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/358
42
-
* allow for more flexible local testing with azure auth by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/359
43
-
* credit where due by @dataders in https://github.com/dbt-msft/dbt-sqlserver/pull/355
44
-
* remove condition for azure testing by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/360
45
-
* ignore owner when testing docs in azure by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/365
46
-
* impl of information_schema name closer to default by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/367
47
-
* Add nolock by @Elliot2718 in https://github.com/dbt-msft/dbt-sqlserver/pull/204
48
-
* Fix concurrency issues and document create as by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/368
49
-
* add debug tests by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/363
50
-
* add concurrency test by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/362
51
-
* add aliases tests by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/361
52
-
* add ephemeral error handling test by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/364
53
-
* mark db-wide tests as flaky by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/369
54
-
* remove azure max parallel test runs by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/370
55
-
* add nolock to more metadata calls to avoid deadlocks by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/374
56
-
* add query comment tests by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/375
57
-
* add seed tests and add cascade to drop relation by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/366
58
-
* make testing faster by running multithreaded by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/372
59
-
* add tests for changing relation type by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/373
60
-
*[incremental models] add tests, various bugfixes and support for incremental predicates by @sdebruyn in https://github.com/dbt-msft/dbt-sqlserver/pull/376
68
+
* Bump pre-commit from 2.20.0 to 3.2.0 by [@dependabot](https://github.com/dependabot) in https://github.com/dbt-msft/dbt-sqlserver/pull/344
69
+
* Bump docker/build-push-action from 3.2.0 to 4.0.0 by [@dependabot](https://github.com/dependabot) in https://github.com/dbt-msft/dbt-sqlserver/pull/331
70
+
*[pre-commit.ci] pre-commit autoupdate by [@pre-commit-ci](https://github.com/pre-commit-ci) in https://github.com/dbt-msft/dbt-sqlserver/pull/316
71
+
* Bump wheel from 0.38.4 to 0.40.0 by [@dependabot](https://github.com/dependabot) in https://github.com/dbt-msft/dbt-sqlserver/pull/343
72
+
* Copy for workflow schtuff by [@dataders](https://github.com/dataders) in https://github.com/dbt-msft/dbt-sqlserver/pull/350
73
+
* avoid publishing docker from other branches than master by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/351
74
+
* bump pre-commit by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/353
75
+
* fix pre-commit for python 3.7 by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/354
76
+
* use 127.0.0.1 to avoid issues with local testing by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/358
77
+
* allow for more flexible local testing with azure auth by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/359
78
+
* credit where due by [@dataders](https://github.com/dataders) in https://github.com/dbt-msft/dbt-sqlserver/pull/355
79
+
* remove condition for azure testing by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/360
80
+
* ignore owner when testing docs in azure by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/365
81
+
* impl of information_schema name closer to default by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/367
82
+
* Add nolock by [@Elliot2718](https://github.com/Elliot2718) in https://github.com/dbt-msft/dbt-sqlserver/pull/204
83
+
* Fix concurrency issues and document create as by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/368
84
+
* add debug tests by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/363
85
+
* add concurrency test by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/362
86
+
* add aliases tests by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/361
87
+
* add ephemeral error handling test by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/364
88
+
* mark db-wide tests as flaky by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/369
89
+
* remove azure max parallel test runs by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/370
90
+
* add nolock to more metadata calls to avoid deadlocks by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/374
91
+
* add query comment tests by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/375
92
+
* add seed tests and add cascade to drop relation by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/366
93
+
* make testing faster by running multithreaded by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/372
94
+
* add tests for changing relation type by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/373
95
+
*[incremental models] add tests, various bugfixes and support for incremental predicates by [@sdebruyn](https://github.com/sdebruyn) in https://github.com/dbt-msft/dbt-sqlserver/pull/376
61
96
62
97
</p>
63
98
</details>
@@ -67,7 +102,7 @@
67
102
####
68
103
69
104
Minor release to loosen dependency on dbt-core and pyodbc
70
-
105
+
71
106
### v1.3.0
72
107
73
108
#### Features
@@ -186,7 +221,7 @@ Please see [dbt-core v1.0.0 release notes](https://github.com/dbt-labs/dbt-core/
186
221
### v0.21.0
187
222
188
223
Please see [dbt-core v0.21.0 release notes](https://github.com/dbt-labs/dbt-core/releases/tag/v0.21.0) for upstream changes
189
-
224
+
190
225
#### fixes
191
226
192
227
- in dbt-sqlserver v0.20.0, users couldn't use some out of the box tests, such as accepted_values. users can now also use CTEs in their ~bespoke~ custom data tests
@@ -210,7 +245,7 @@ Please see [dbt-core v0.21.0 release notes](https://github.com/dbt-labs/dbt-core
210
245
211
246
-`sqlserver__load_csv_rows` now has a safety provided by `calc_batch_size()` to ensure the insert statements won't exceed SQL Server's 2100 parameter limit. [#127](https://github.com/dbt-msft/dbt-sqlserver/issues/127) and [#151](https://github.com/dbt-msft/dbt-sqlserver/pull/151) thanks [@jacobm001](https://github.com/jacobm001)
212
247
- switched to using a `MANIFEST.in` to declare which files should be included
213
-
- updated `pyodbc` and `azure-identity` dependencies to their latest versions
248
+
- updated `pyodbc` and `azure-identity` dependencies to their latest versions
214
249
### v0.19.2
215
250
216
251
#### fixes
@@ -239,7 +274,7 @@ Please see [dbt-core v0.21.0 release notes](https://github.com/dbt-labs/dbt-core
239
274
### v0.19.0.2
240
275
241
276
#### fixes
242
-
- solved a bug in snapshots introduced in v0.19.0. Fixes: [#108](https://github.com/dbt-msft/dbt-sqlserver/issues/108), [#117](https://github.com/dbt-msft/dbt-sqlserver/issues/117).
277
+
- solved a bug in snapshots introduced in v0.19.0. Fixes: [#108](https://github.com/dbt-msft/dbt-sqlserver/issues/108), [#117](https://github.com/dbt-msft/dbt-sqlserver/issues/117).
243
278
244
279
### v0.19.0.1
245
280
@@ -267,18 +302,18 @@ Please see [dbt-core v0.21.0 release notes](https://github.com/dbt-labs/dbt-core
267
302
### v0.18.1
268
303
#### New Features:
269
304
Adds support for:
270
-
- SQL Server down to version 2012
305
+
- SQL Server down to version 2012
271
306
- authentication via:
272
-
- Azure CLI (see #71, thanks @JCZuurmond !), and
273
-
- MSFT ODBC Active Directory options (#53#55#58 thanks to @NandanHegde15 and @alieus)
274
-
- using a named instance (#51 thanks @alangsbo)
307
+
- Azure CLI (see #71, thanks [@JCZuurmond](https://github.com/JCZuurmond) !), and
308
+
- MSFT ODBC Active Directory options (#53#55#58 thanks to [@NandanHegde15](https://github.com/NandanHegde15) and [@alieus](https://github.com/alieus))
309
+
- using a named instance (#51 thanks [@alangsbo](https://github.com/alangsbo))
275
310
- Adds support down to SQL Server 2012
276
-
- The adapter is now automatically tested with Fishtowns official adapter-tests to increase stability when making
311
+
- The adapter is now automatically tested with Fishtowns official adapter-tests to increase stability when making
277
312
changes and upgrades to the adapter.
278
313
279
314
#### Fixes:
280
315
- Fix for lack of precision in the snapshot check strategy. Previously when executing two check snapshots the same
281
-
second, there was inconsistent data as a result. This was mostly noted when running the automatic adapter tests.
316
+
second, there was inconsistent data as a result. This was mostly noted when running the automatic adapter tests.
282
317
NOTE: This fix will create a new snapshot version in the target table
283
318
on first run after upgrade.
284
319
@@ -287,10 +322,10 @@ on first run after upgrade.
287
322
- Adds support for Azure Active Directory as authentication provider
288
323
289
324
#### Fixes:
290
-
- Fix for lack of precision in the snapshot check strategy. (#74 and #56 thanks @qed) Previously when executing two check snapshots the same second, there was inconsistent data as a result. This was mostly noted when running the automatic adapter tests.
325
+
- Fix for lack of precision in the snapshot check strategy. (#74 and #56 thanks [@qed](https://github.com/qed)) Previously when executing two check snapshots the same second, there was inconsistent data as a result. This was mostly noted when running the automatic adapter tests.
291
326
NOTE: This fix will create a new snapshot version in the target table
- The adapter is now automatically tested with Fishtowns official adapter-tests to increase stability when making changes and upgrades to the adapter. (#62#64#69#74)
0 commit comments