v0.5.11

Summary

Hotfix release to bump FlushAll minimum version from 2.6.9 to 2.6.11 due to FlushAll issues on earlier Milvus versions that may cause metadata corruption.

If you are using Milvus 2.6.9 or above, please use this release instead of v0.5.10.

See milvus-io/milvus#47637 for details.

What's Changed

• backup: bump FlushAll minimum version to 2.6.11 by @huanghaoyuanhhy in #942

Full Changelog: v0.5.10...v0.5.11

v0.5.10

⚠️ Warning: This release uses FlushAll API for Milvus >= 2.6.9, but FlushAll has known issues on Milvus 2.6.9 and 2.6.10 that may cause metadata corruption. If your Milvus version is 2.6.9 or above, please upgrade to v0.5.11 instead. See milvus-io/milvus#47637 for details.

What's Changed

• test: add struct array for backup and restore by @zhuwenxing in #819
• ci: update mergify condition by @zhuwenxing in #822
• build(deps): bump helm/kind-action from 1.12.0 to 1.13.0 by @dependabot[bot] in #823
• *: refactor delete backup logic by @huanghaoyuanhhy in #821
• client: retry GetLoadingProgress on errors by @huanghaoyuanhhy in #825
• storage: improve error message by @huanghaoyuanhhy in #827
• *: refactor list backup by @huanghaoyuanhhy in #828
• *: refactor create backup by @huanghaoyuanhhy in #829
• storage: use multipart copy when object size too big by @huanghaoyuanhhy in #832
• *: move client to internal by @huanghaoyuanhhy in #833
• storage: set part size to 10MB by @huanghaoyuanhhy in #834
• taskmgr: fix backup progress trace by @huanghaoyuanhhy in #837
• *: support backup and restore with ezk by @huanghaoyuanhhy in #835
• storage: support hwc by @huanghaoyuanhhy in #839
• *: improve code format by @huanghaoyuanhhy in #840
• server: correct dbCollections -> filter conversion by @huanghaoyuanhhy in #841
• *: remove backup context struct by @huanghaoyuanhhy in #842
• *: replace meta manager with meta builder by @huanghaoyuanhhy in #843
• *: move meta to internal by @huanghaoyuanhhy in #844
• mpath: compatibility with cases where path is empty by @huanghaoyuanhhy in #845
• build(deps): bump golang.org/x/crypto from 0.43.0 to 0.45.0 by @dependabot[bot] in #847
• restore, milvus: support restore multiple L0 segment in one job by @huanghaoyuanhhy in #848
• configs, doc: fix typo by @huanghaoyuanhhy in #846
• config, paramtable: remove unused config by @huanghaoyuanhhy in #850
• *: split backup coll ddl and dml task by @huanghaoyuanhhy in #852
• build(deps): bump actions/checkout from 5 to 6 by @dependabot[bot] in #853
• *: support migrate to gcp volume by @huanghaoyuanhhy in #854
• *: use FlushAll API to speed up flush by @huanghaoyuanhhy in #856
• backup: improve write meta logic by @huanghaoyuanhhy in #857
• github: enforce version info in bug template by @huanghaoyuanhhy in #860
• client: use set instead of append for grpc headers by @huanghaoyuanhhy in #861
• backup: add segment size to total by @huanghaoyuanhhy in #866
• *: use strategy to replace multiple parameters by @huanghaoyuanhhy in #865
• restore: split DDL tasks from collection task by @huanghaoyuanhhy in #867
• backup, proto: backup extra metadata to restore secondary by @huanghaoyuanhhy in #868
• *: support collection level gc ctrl by @huanghaoyuanhhy in #870
• docker, workflows: update golang to 1.25 by @huanghaoyuanhhy in #873
• backup, proto: backup extra metadata to restore secondary by @huanghaoyuanhhy in #872
• *: support backup extra index info by @huanghaoyuanhhy in #874
• restore: support restore index by @huanghaoyuanhhy in #876
• server: support set root path from request by @huanghaoyuanhhy in #877
• build(deps): bump actions/upload-artifact from 5 to 6 by @dependabot[bot] in #879
• restore: support restore dml to secondary by @huanghaoyuanhhy in #878
• server: support set path from request by @huanghaoyuanhhy in #881
• backup, restore: support send load collection message by @huanghaoyuanhhy in #883
• *: support send restore rbac message by @huanghaoyuanhhy in #884
• *: use add field to avoid field mismatch by @huanghaoyuanhhy in #887
• *: improve task mgr by @huanghaoyuanhhy in #889
• go.mod: update dep by @huanghaoyuanhhy in #891
• backup: backup collection alias by @huanghaoyuanhhy in #892
• tests: add test case for backup/restore with dynamically added fields by @zhuwenxing in #888
• *: fix get ezk logic by @huanghaoyuanhhy in #893
• restore: Guess dynamic field ID for restore by @huanghaoyuanhhy in #894
• restore: disable func check when restore by @huanghaoyuanhhy in #899
• restore: retry send msg when stream eof by @huanghaoyuanhhy in #902
• client: update FlushAll version constraint by @huanghaoyuanhhy in #903
• backup: refactor GC controller code by @huanghaoyuanhhy in #904
• *: update generated files by @huanghaoyuanhhy in #905
• [backup]prevent overlapping backup tasks by checking task state by @wg1026688210 in #901
• backup: add log for describe collection response by @huanghaoyuanhhy in #907
• test: mark add_field test case as MASTER only, add 2.6 to nightly matrix by @zhuwenxing in #909
• backup: skip segment when partition not found by @huanghaoyuanhhy in #908
• restore: set dynamic field as nullable with default empty JSON by @huanghaoyuanhhy in #910
• backup: remove duplicate SetBackupSuccess call in skipFlushStrategy by @huanghaoyuanhhy in #911
• fix(deps): replace jax/jaxlib with ml-dtypes for bfloat16 support by @zhuwenxing in #915
• milvus: enhance statusOk function to check for errorCode by @huanghaoyuanhhy in #914
• backup: change cipher detection from cipher.enabled to cipher.ezID/key by @huanghaoyuanhhy in #916
• filter: unify filter implementation between backup and restore by @huanghaoyuanhhy in #917

New Contributors

• @wg1026688210 made their first contribution in #901

Full Changelog: v0.5.9...v0.5.10

v0.5.9

What's Changed

• core: return error msg when fail by @huanghaoyuanhhy in #753
• storage, paramtable : support alicloud by @huanghaoyuanhhy in #755
• meta: support read from level file by @huanghaoyuanhhy in #752
• *: move server to core by @huanghaoyuanhhy in #756
• build(deps): bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 by @dependabot[bot] in #757
• build(deps): bump actions/checkout from 4 to 5 by @dependabot[bot] in #760
• storage: improve azure paging logic by @huanghaoyuanhhy in #759
• *: refactor for support filter option by @huanghaoyuanhhy in #761
• storage: use original context for semaphore acquisition by @huanghaoyuanhhy in #762
• storage: retry when azure copy object fail by @huanghaoyuanhhy in #763
• cmd/restore: rename restore_index to rebuild_index by @huanghaoyuanhhy in #764
• cmd/server: fix validate and add ut by @huanghaoyuanhhy in #766
• *: support get meta size by @huanghaoyuanhhy in #765
• readme: add milvus 2.6 by @huanghaoyuanhhy in #768
• *: make golangci-lint happy by @huanghaoyuanhhy in #769
• ci: add azure storage test pipeline by @zhuwenxing in #772
• test: use sentence-transformers/all-MiniLM-L6-v2 model for ci by @zhuwenxing in #773
• build(deps): bump deepdiff from 6.7.1 to 8.6.1 in /tests by @dependabot[bot] in #774
• storage: return file info directly when prefix is a file by @huanghaoyuanhhy in #780
• cmd/restore: add --filter option by @huanghaoyuanhhy in #779
• build(deps): bump actions/setup-go from 5 to 6 by @dependabot[bot] in #776
• build(deps): bump actions/setup-python from 5 to 6 by @dependabot[bot] in #777
• storage, proto: format code by @huanghaoyuanhhy in #785
• fix(log): correct file logging config by @rere950303 in #783
• configs, log: use filename instead of rootPath by @huanghaoyuanhhy in #788
• *: support read backup root path from request by @huanghaoyuanhhy in #787
• docs: Point to env_variables.md in README.md by @neelaundhia in #794
• restore, storage: support keep temp file by @huanghaoyuanhhy in #795
• ci: remove pull_request trigger from azure workflow to avoid secrets access issues by @zhuwenxing in #796
• meta, backup: add task id to meta map by @huanghaoyuanhhy in #798
• proto: support new datatype by @huanghaoyuanhhy in #802
• backup: use collection semaphore instead of copy semaphore by @huanghaoyuanhhy in #803
• go.mod: update dep by @huanghaoyuanhhy in #805
• server: register pprof router by @huanghaoyuanhhy in #804
• backup: improve log format by @huanghaoyuanhhy in #806
• backup, restore: support struct array by @huanghaoyuanhhy in #808
• proto: remove unused message by @huanghaoyuanhhy in #811
• *: move taskmgr to internal by @huanghaoyuanhhy in #810
• test: add geometry datatype in test by @zhuwenxing in #809
• *: move storage to internal by @huanghaoyuanhhy in #813
• build(deps): bump actions/upload-artifact from 4 to 5 by @dependabot[bot] in #815
• release v0.5.9 by @huanghaoyuanhhy in #820

New Contributors

• @rere950303 made their first contribution in #783
• @neelaundhia made their first contribution in #794

Full Changelog: v0.5.8...v0.5.9

v0.5.9-rc1

What's Changed

• core: return error msg when fail by @huanghaoyuanhhy in #753
• storage, paramtable : support alicloud by @huanghaoyuanhhy in #755
• meta: support read from level file by @huanghaoyuanhhy in #752
• *: move server to core by @huanghaoyuanhhy in #756
• build(deps): bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 by @dependabot[bot] in #757
• build(deps): bump actions/checkout from 4 to 5 by @dependabot[bot] in #760
• storage: improve azure paging logic by @huanghaoyuanhhy in #759
• *: refactor for support filter option by @huanghaoyuanhhy in #761
• storage: use original context for semaphore acquisition by @huanghaoyuanhhy in #762
• storage: retry when azure copy object fail by @huanghaoyuanhhy in #763
• cmd/restore: rename restore_index to rebuild_index by @huanghaoyuanhhy in #764
• cmd/server: fix validate and add ut by @huanghaoyuanhhy in #766
• *: support get meta size by @huanghaoyuanhhy in #765
• readme: add milvus 2.6 by @huanghaoyuanhhy in #768
• *: make golangci-lint happy by @huanghaoyuanhhy in #769
• ci: add azure storage test pipeline by @zhuwenxing in #772
• test: use sentence-transformers/all-MiniLM-L6-v2 model for ci by @zhuwenxing in #773
• build(deps): bump deepdiff from 6.7.1 to 8.6.1 in /tests by @dependabot[bot] in #774
• storage: return file info directly when prefix is a file by @huanghaoyuanhhy in #780
• cmd/restore: add --filter option by @huanghaoyuanhhy in #779
• build(deps): bump actions/setup-go from 5 to 6 by @dependabot[bot] in #776
• build(deps): bump actions/setup-python from 5 to 6 by @dependabot[bot] in #777
• storage, proto: format code by @huanghaoyuanhhy in #785
• fix(log): correct file logging config by @rere950303 in #783
• configs, log: use filename instead of rootPath by @huanghaoyuanhhy in #788
• *: support read backup root path from request by @huanghaoyuanhhy in #787
• docs: Point to env_variables.md in README.md by @neelaundhia in #794
• restore, storage: support keep temp file by @huanghaoyuanhhy in #795
• ci: remove pull_request trigger from azure workflow to avoid secrets access issues by @zhuwenxing in #796
• meta, backup: add task id to meta map by @huanghaoyuanhhy in #798
• proto: support new datatype by @huanghaoyuanhhy in #802
• backup: use collection semaphore instead of copy semaphore by @huanghaoyuanhhy in #803
• go.mod: update dep by @huanghaoyuanhhy in #805
• server: register pprof router by @huanghaoyuanhhy in #804
• backup: improve log format by @huanghaoyuanhhy in #806
• backup, restore: support struct array by @huanghaoyuanhhy in #808
• proto: remove unused message by @huanghaoyuanhhy in #811
• *: move taskmgr to internal by @huanghaoyuanhhy in #810
• test: add geometry datatype in test by @zhuwenxing in #809
• *: move storage to internal by @huanghaoyuanhhy in #813
• build(deps): bump actions/upload-artifact from 4 to 5 by @dependabot[bot] in #815

New Contributors

• @rere950303 made their first contribution in #783
• @neelaundhia made their first contribution in #794

Full Changelog: v0.5.8...v0.5.9-rc1

v0.5.8

What's Changed

• *: abstract filter and mapping logic into planner for task generation by @huanghaoyuanhhy in #726
• paramtable, storage: support alibaba by @huanghaoyuanhhy in #731
• restore: parallel restore L0 segment by @huanghaoyuanhhy in #711
• restore, paramtable: parallelize BulkImport tasks by @huanghaoyuanhhy in #733
• backup: parallel backup segments by @huanghaoyuanhhy in #729
• *: support int8 vector by @huanghaoyuanhhy in #734
• *: remove unused code by @huanghaoyuanhhy in #736
• readme: add compatibility and v2 restore mode by @huanghaoyuanhhy in #737
• readme: recommend using latest milvus-backup release in README by @huanghaoyuanhhy in #738
• cloud, migrate: use new migrate api by @huanghaoyuanhhy in #739
• *: fix log params by @huanghaoyuanhhy in #740
• *: support backup and restore v2 segment by @huanghaoyuanhhy in #741
• test: enable storage v2 for backup&restore by @zhuwenxing in #732
• Create env_variables.md by @jaelgu in #743
• .goreleaser: add version by @huanghaoyuanhhy in #749

New Contributors

• @jaelgu made their first contribution in #743

Full Changelog: v0.5.7...v0.5.8

v0.5.8-rc1

What's Changed

• *: abstract filter and mapping logic into planner for task generation by @huanghaoyuanhhy in #726
• paramtable, storage: support alibaba by @huanghaoyuanhhy in #731
• restore: parallel restore L0 segment by @huanghaoyuanhhy in #711
• restore, paramtable: parallelize BulkImport tasks by @huanghaoyuanhhy in #733
• backup: parallel backup segments by @huanghaoyuanhhy in #729
• *: support int8 vector by @huanghaoyuanhhy in #734
• *: remove unused code by @huanghaoyuanhhy in #736
• readme: add compatibility and v2 restore mode by @huanghaoyuanhhy in #737
• readme: recommend using latest milvus-backup release in README by @huanghaoyuanhhy in #738
• cloud, migrate: use new migrate api by @huanghaoyuanhhy in #739
• *: fix log params by @huanghaoyuanhhy in #740
• *: support backup and restore v2 segment by @huanghaoyuanhhy in #741
• test: enable storage v2 for backup&restore by @zhuwenxing in #732
• Create env_variables.md by @jaelgu in #743

New Contributors

• @jaelgu made their first contribution in #743

Full Changelog: v0.5.7...v0.5.8-rc1

v0.5.7

What's Changed

• milvus: retry on Bulkinsert task status fetch failure by @huanghaoyuanhhy in #716
• storage, migrate: support migrate to zilliz via ali by @huanghaoyuanhhy in #723
• cloud: hiding confidential information in logs by @huanghaoyuanhhy in #724
• storage: use azureAccountName directly in URL instead of accessKeyID by @huanghaoyuanhhy in #727
• *: support auto-renewal of GC pause during backup by @huanghaoyuanhhy in #718
• milvus: skip retry if server not support get segment info by @huanghaoyuanhhy in #730

Full Changelog: v0.5.7-rc1...v0.5.7

v0.5.7-rc1

What's Changed

• restore: edit error msg by @huanghaoyuanhhy in #676
• *: refine storage pkg by @huanghaoyuanhhy in #673
• *: remove some unnecessary dependencies by @huanghaoyuanhhy in #683
• storage: use GetCredential to get ali cred by @huanghaoyuanhhy in #684
• backup: skip describe db if not support by @huanghaoyuanhhy in #687
• ci: add 2.2 and 2.3 as source tag for cross version br by @zhuwenxing in #681
• backup, client: check feature before backup by @huanghaoyuanhhy in #688
• build(deps): bump requests from 2.32.0 to 2.32.4 in /tests by @dependabot in #689
• Parallelize restore v1 bulk inserts by @sonakshireddym in #675
• Get backup field values in backup.yaml from environment variables by @sonakshireddym in #693
• *: support migrate to zilliz by @huanghaoyuanhhy in #690
• storage: improve copy retry logic by @huanghaoyuanhhy in #694
• backup: improve backup rbac logic by @huanghaoyuanhhy in #696
• migrate, storage: re apply stage cred when expire by @huanghaoyuanhhy in #698
• milvus: retry GetPersistentSegmentInfo when return error by @huanghaoyuanhhy in #699
• params, storage: add region and token config by @huanghaoyuanhhy in #700
• *: estimate copy to cloud speed and remaining time by @huanghaoyuanhhy in #704
• restore: fix typo by @huanghaoyuanhhy in #706
• test: add property check after restore by @zhuwenxing in #707
• backup, restore: support br collection properties by @huanghaoyuanhhy in #708
• storage: pass the region parameter to the newClient function by @huanghaoyuanhhy in #709
• test: add more case for useV2Restore param by @zhuwenxing in #712
• build(deps): bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot in #713
• storage: fix azure list iter by @huanghaoyuanhhy in #715

New Contributors

• @sonakshireddym made their first contribution in #675

Full Changelog: v0.5.6...v0.5.7-rc1

v0.5.6

What's Changed

• *: update dep by @huanghaoyuanhhy in #650
• storage: remove list object operation from copy function by @huanghaoyuanhhy in #651
• cmd: return 1 when fail by @huanghaoyuanhhy in #653
• storage: skip empty file when copy by @huanghaoyuanhhy in #654
• *: fix restore progress tracking by @huanghaoyuanhhy in #657
• cmd: export v2 restore flag by @huanghaoyuanhhy in #658
• taskmgr: add read lock by @huanghaoyuanhhy in #660
• restore, client: improve retry logic by @huanghaoyuanhhy in #665
• backup, client: improve flush logic by @huanghaoyuanhhy in #666
• backup: improve rpc backup error msg by @huanghaoyuanhhy in #667
• backup: read gc addr from backup cfg by @huanghaoyuanhhy in #669
• backup: fix check flush by @huanghaoyuanhhy in #671
• client: use outside ctx by @huanghaoyuanhhy in #672

Full Changelog: v0.5.5...v0.5.6

v0.5.5

⚠️ Breaking Change (Carried over from previous version)

Previously, the milvus-backup tool only backed up databases that contained at least one collection.
Now, it backs up all databases, including those without any collections, and also includes database-level parameters (such as database.diskQuota.mb and database.replica.number ).

⚠️ Requires additional permission: DescribeDatabase — the backup will fail without it.

Additionally:

• Backup files now include metadata for empty databases and their parameters;
• Restoring these parameters is still not supported — only backup is performed;
• During restore, the empty databases will be recreated.

---

What's Changed

• ci: use custom config for deployment by @zhuwenxing in #631
• backup, restore: use base64 to encode default value proto by @huanghaoyuanhhy in #646
• fix: update golang.org/x/oauth2 to address CVE-2025-22868 by @songohannyc in #645
• backup: sort by field id by @huanghaoyuanhhy in #648
• client: add identifier to outgoing ctx by @huanghaoyuanhhy in #644
• restore: fix skip rbac not work by @huanghaoyuanhhy in #649

New Contributors

• @songohannyc made their first contribution in #645

Full Changelog: v0.5.4...v0.5.5