feat: unified CLI with profile-based authentication

[joshsmithxrm]

Summary

Major release introducing a unified CLI (ppds) with profile-based authentication, replacing the former ppds-migrate tool. This PR also introduces the new PPDS.Auth package for reusable authentication across the ecosystem.

New Packages

Package	Purpose
PPDS.Auth	Authentication profiles with encrypted credential storage
PPDS.Cli	Unified CLI tool (replaces PPDS.Migration.Cli)

Key Features

• Profile-based authentication: Create auth profiles once, use everywhere
• 10 authentication methods: Interactive, device code, client secret, certificates, managed identity, GitHub OIDC, Azure DevOps OIDC, username/password
• Environment discovery: Global Discovery Service integration for easy environment selection
• Multi-profile pooling: Use multiple Application Users for high-throughput scenarios
• DOP-based parallelism: Server-recommended parallelism instead of adaptive rate control

Command Structure

ppds
├── auth      Authentication profile management
├── env       Environment discovery and selection  
├── data      Data operations (export, import, copy, analyze)
├── schema    Schema generation and entity listing
└── users     User mapping for cross-environment migrations

Breaking Changes

• ppds-migrate command is now ppds
• Authentication flags (--auth env) replaced with profile-based auth (ppds auth create)
• Adaptive rate presets removed in favor of DOP-based parallelism

Architectural Decisions

• ADR-0005: DOP-Based Parallelism
• ADR-0006: Connection Source Abstraction
• ADR-0007: Unified CLI and Shared Authentication

Versioning

Package	Version	Notes
PPDS.Plugins	1.1.1	MinVer addition
PPDS.Dataverse	1.0.0-beta.1	DOP-based parallelism
PPDS.Migration	1.0.0-beta.1	CLI separated
PPDS.Auth	1.0.0-beta.1	New package
PPDS.Cli	1.0.0-beta.1	New package

Test plan

• Build passes: dotnet build
• Tests pass: dotnet test
• CLI installs: dotnet tool install --global PPDS.Cli --version 1.0.0-beta.1
• Auth flow: ppds auth create --name test
• Environment discovery: ppds env list
• Data export: ppds data export --schema schema.xml --output data.zip
• Data import: ppds data import --data data.zip

🤖 Generated with Claude Code

[Copilot]

Pull request overview

This PR introduces a unified CLI (ppds) with profile-based authentication, replacing the former ppds-migrate tool, and introduces the new PPDS.Auth package for reusable authentication. The architecture shifts from adaptive rate control to DOP-based parallelism using server-recommended values from the x-ms-dop-hint header.

Key Changes:

• Unified CLI tool replacing ppds-migrate with profile-based authentication
• DOP-based parallelism using server's RecommendedDegreesOfParallelism instead of adaptive rate control
• Schema generation improvements with metadata-driven field filtering

Reviewed changes

Copilot reviewed 136 out of 141 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
tests/PPDS.Dataverse.Tests/Progress/ProgressSnapshotTests.cs	New test file for ProgressSnapshot computed properties and edge cases
tests/PPDS.Dataverse.Tests/Pooling/PoolSizingTests.cs	Updated to test DOP-based pool sizing instead of per-connection sizing
tests/PPDS.Dataverse.Tests/Pooling/PoolExhaustedExceptionTests.cs	New test file for pool exhaustion exception handling
tests/PPDS.Dataverse.Tests/Pooling/DataverseConnectionPoolTests.cs	Updated to remove adaptive rate controller dependency
src/PPDS.Migration/Schema/DataverseSchemaGenerator.cs	Enhanced field filtering with metadata-driven approach
src/PPDS.Migration/Import/TieredImporter.cs	Added schema mismatch detection and field validity checking
src/PPDS.Dataverse/Pooling/DataverseConnectionPool.cs	Refactored to use DOP-based sizing and removed adaptive rate control
src/PPDS.Dataverse/BulkOperations/BulkOperationExecutor.cs	Replaced adaptive rate control with DOP-based parallelism
src/PPDS.Cli/Program.cs	New unified CLI entry point

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[gemini-code-assist]

Summary of Changes

Hello @joshsmithxrm, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request represents a significant architectural shift, introducing a unified command-line interface for Power Platform development. The core purpose is to streamline user experience, enhance authentication flexibility, and optimize data operations through a more robust and adaptive parallelism model. By centralizing CLI functionality and leveraging profile-based authentication, developers can manage their Dataverse interactions more efficiently and securely, particularly in high-throughput and CI/CD scenarios.

Highlights

• Unified CLI: The ppds-migrate tool has been replaced by a new unified CLI named ppds, consolidating all Dataverse operations under a single command structure. This includes authentication, environment management, data operations (export, import, copy, analyze), schema generation, and user mapping.
• Profile-Based Authentication: A new PPDS.Auth package introduces profile-based authentication, allowing users to create and manage authentication profiles with encrypted credential storage. This supports 10 different authentication methods, including interactive browser, device code, client secret, certificates, managed identity, and OIDC for GitHub and Azure DevOps.
• DOP-Based Parallelism: The dataverse connection pool now utilizes server-recommended Degrees of Parallelism (DOP) based on the x-ms-dop-hint header, replacing the previous adaptive rate control mechanism. This ensures optimal throughput while preventing throttling, with scaling achieved by adding multiple Application Users.
• Breaking Changes: Existing users will need to update their commands from ppds-migrate to ppds. Authentication flags (--auth env) are replaced by the new profile-based authentication system (ppds auth create). Adaptive rate presets have been removed in favor of DOP-based parallelism.
• Schema Generation Enhancements: The schema generation now includes metadata-driven field filtering, allowing for more precise control over which fields are included based on their validity for create/update operations and customizability. A new SchemaMismatchException is introduced for clearer error reporting during import when target columns are missing.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	/gemini review	Performs a code review for the current pull request in its current state.
Pull Request Summary	/gemini summary	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	/gemini help	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

[github-advanced-security]

CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.

[gemini-code-assist]

Code Review

This is a major and impressive refactoring that introduces a unified CLI, a shared authentication package, and a more robust DOP-based parallelism model. The new architecture is a significant improvement in terms of extensibility, user experience, and reliability. The profile-based authentication is well-implemented with support for numerous methods, and the new CLI command structure is logical and follows industry best practices. The detailed error reporting with actionable suggestions is a fantastic addition. I have two medium-severity comments regarding security: one about an empty catch block that could hide certificate store issues, and another about the use of simple obfuscation for credentials on non-Windows platforms, suggesting a move to platform-native secure storage in the future. Overall, this is an excellent pull request that greatly enhances the capabilities and quality of the SDK.

[joshsmithxrm]

Re: Gemini Code Assist review

Thanks for the thorough review. Addressing the two medium-severity items:

1. Empty catch block in certificate store - Fixed. Added warning output to CertificateFileCredentialProvider.StoreCertificateTemporarily() so certificate store issues are now visible to users.

2. Credential obfuscation on non-Windows - Acknowledged. This is a known limitation documented in ADR-0007. Platform-native secrets (libsecret/keychain) would add dependencies. Current XOR obfuscation is acceptable for developer workstations; CI/CD uses environment variables or OIDC which don't store credentials locally. Future enhancement tracked.