Skip to content
Merged
Show file tree
Hide file tree
Changes from 4 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions custom-words.txt
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ clickjacking
codebases
CODEOWNERS
CQRS
CQS
CTAP2
deinitializer
deinitializers
Expand Down
33 changes: 24 additions & 9 deletions docs/architecture/adr/0008-server-CQRS-pattern.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,19 @@ date: 2022-07-15
tags: [server]
---

# 0008 - Server: Adopt CQRS
# 0008 - Server: Adopt CQS

<AdrTable frontMatter={frontMatter}></AdrTable>

:::note Terminology clarification

This ADR originally used "CQRS" (Command Query Responsibility Segregation) terminology. However, our
implementation more accurately reflects CQS (Command Query Separation), which is a simpler pattern
focused on breaking up large service classes rather than separating read/write data models. The
content has been updated to use the more accurate CQS terminology.

:::

## Context and problem statement

In Bitwarden Server, we currently use an `<<Entity>>Service` pattern to act on our entities. These
Expand All @@ -30,27 +39,26 @@ method parameters, which goes against our typical DI pattern.
- **`<<Entity>>Services`** -- Discussed above
- **Queries and Commands** -- Fundamentally our problem is that the `<<Entity>>Service` name
encapsulates absolutely anything you can do with that entity and excludes any code reuse across
different entities. The CQRS pattern creates classes based on the action being taken on the
entity. This naturally limits the classes scope and allows for reuse should two entities need to
implement the same command behavior.
https://docs.microsoft.com/en-us/azure/architecture/patterns/cqrs
different entities. The CQS pattern creates classes based on the action being taken on the entity.
This naturally limits the classes scope and allows for reuse should two entities need to implement
the same command behavior.
- **Small Feature-based services** -- This design would break `<<Entity>>Service` into
`<<Feature>>Service`, but ultimately runs into the same problems. As a feature grows, this service
would become bloated and tightly coupled to other services.

## Decision outcome

Chosen option: **Queries and Commands**
Chosen option: **Queries and Commands (CQS pattern)**

Commands seem all-around the better decision to the incumbent. We gain code reuse and limit class
scope. In addition, we have an iterative path to a full-blown CQRS pipeline, with queued work.
Commands seem all-around the better decision to the incumbent, primarily because it limits class
scope.

Queries are already basically done through repositories and/or services, but would require some
restructuring to be obvious.

## Transition plan

We will gradually transition to a CQRS pattern over time. If a developer is making changes that use
We will gradually transition to a CQS pattern over time. If a developer is making changes that use
or affect a service method, they should consider whether it can be extracted to a query/command, and
include it in their work as tech debt.

Expand All @@ -59,3 +67,10 @@ up all at once. It's acceptable to refactor "one level deep" and then leave othe
are. This may result in the new query/command still being somewhat coupled with other service
methods. This is acceptable during the transition phase, but these interdependencies should be
removed over time.

## Further reading

- [Server Architecture](../server/index.md) - Practical guide on implementing CQS in the server
codebase
- [Martin Fowler on CQS](https://martinfowler.com/bliki/CommandQuerySeparation.html) - High-level
summary of the CQS principle
2 changes: 1 addition & 1 deletion docs/architecture/adr/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ work.
**Example scenarios:**

- A technology choice has been agreed upon (e.g., "Use Jest for testing")
- A pattern has been established as the standard approach (e.g., "Use CQRS for server architecture")
- A pattern has been established as the standard approach (e.g., "Use CQS for server architecture")
- A decision is complete and being followed across teams

### Rejected
Expand Down
105 changes: 56 additions & 49 deletions docs/architecture/server/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,22 +4,33 @@ sidebar_position: 6

# Server Architecture

## CQRS ([ADR-0008](../adr/0008-server-CQRS-pattern.md))
## Command Query Separation (CQS)

Our server architecture uses the the Command and Query Responsibility Segregation (CQRS) pattern.
Our server architecture uses the Command Query Separation (CQS) pattern.

The main goal of this pattern is to break up large services focused on a single entity (e.g.
`CipherService`) and move towards smaller, reusable classes based on actions or tasks (e.g.
`CreateCipher`). In the future, this may enable other benefits such as enqueuing commands for
execution, but for now the focus is on having smaller, reusable chunks of code.
`CipherService`, which handles everything to do with a cipher) and move towards smaller classes
based on discrete actions (e.g. `CreateCipherCommand`, which handles only creating a cipher). This
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

๐ŸŽจ I don't think that this sentence is needed because it detracts from the main goal of CQS.

This results in smaller classes with fewer interdependencies that are easier to change and test.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this sentence belongs now, because the paragraph is discussing our motivation rather than the pattern itself. Let me know what you think.

results in smaller classes with fewer interdependencies that are easier to change and test.

:::note
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

โš ๏ธ I think the following note block detracts from the purpose of the document which is to direct the engineer as to what pattern to implement. I think it's best to be left in the ADR but removed from here.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lots of people have seen/used the CQRS language by now. I was concerned that developers would either be confused about the change in terminology, or miss why it's significant and keep referring to CQRS.

Publicizing it in the #architecture channel can help with this though, and that way we don't have a historical note on this page forever. I'll remove it.


Previously this pattern was referred to as Command Query Responsibility Segregation (CQRS). However,
CQRS is a far more complex architecture with larger impacts than we wanted or needed. Our
implementation in practice more closely resembled CQS, which has a more modest (but still effective)
aim of simply breaking up large classes. This documentation has been rewritten to better reflect our
practice and therefore refers only to CQS.

:::

### Commands vs. queries

**Commands** are write operations, e.g. `RotateOrganizationApiKeyCommand`. They should never read
from the database.
**Commands** are write operations, e.g. `RotateOrganizationApiKeyCommand`. They change the state of
the system. They may return data about the operation result (e.g. the updated object or an error
message), but otherwise should not be used to return data to its caller.

**Queries** are read operations, e.g. `GetOrganizationApiKeyQuery`. They should never write to the
database.
**Queries** are read operations, e.g. `GetOrganizationApiKeyQuery`. They should only return a value
and should never change the state of the system.

The database is the most common data source we deal with, but others are possible. For example, a
query could also get data from a remote server.
Expand All @@ -28,18 +39,17 @@ Each query or command should have a single responsibility. For example: delete a
file, rotate an API key. They are designed around verbs or actions (e.g.
`RotateOrganizationApiKeyCommand`), not domains or entities (e.g. `ApiKeyService`).

### Writing commands or queries
Which you use will often follow the HTTP verb: a POST operation will generally call a command,
whereas a GET operation will generally call a query.

A simple query may just be a repository call to fetch data from the database. (We already use
repositories, and this is not what we're concerned about here.) However, more complex queries can
require additional logic around the repository call, which will require their own class. Commands
always need their own class.
Teams have wide discretion in how they structure their commands and queries.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

โ“๐Ÿค” Curious, why do teams have wide discretion in structuring commands and queries? Shouldn't we strive for more homogenous flow and structure so our application feels like one application instead of many applications?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"wide" is overstating it. But the first version of this document was very prescriptive, and we ended up breaking all of the rules in practice, and it became out of date very quickly. So my goal here is to sketch out some guidance without being overly prescriptive; that necessarily leaves it to teams to fill in the blanks. We can become more prescriptive, but that needs someone to review our current practices and requirements across teams, and then work with tech leads to align them.

Either way - I do think this sentence is superfluous so I'll remove it.


The class, interface and public method should be named after the action. For example:
### Structure of a command

```csharp
namespace Bit.Core.OrganizationFeatures.OrganizationApiKeys;
A command is just a class. The class, interface and public method should be named after the action.
For example:

```csharp
public class RotateOrganizationApiKeyCommand : IRotateOrganizationApiKeyCommand
{
public async Task<OrganizationApiKey> RotateApiKeyAsync(OrganizationApiKey organizationApiKey)
Expand All @@ -49,51 +59,43 @@ public class RotateOrganizationApiKeyCommand : IRotateOrganizationApiKeyCommand
}
```

The query/command should only expose public methods that run the complete action. It should not have
The command should only expose public methods that run the complete action. It should not have
public helper methods.

The directory structure and namespaces should be organized by feature. Interfaces should be stored
in a separate sub-folder. For example:

```text
Core/
โ””โ”€โ”€ OrganizationFeatures/
โ””โ”€โ”€ OrganizationApiKeys/
โ”œโ”€โ”€ Interfaces/
โ”‚ โ””โ”€โ”€ IRotateOrganizationApiKeyCommand.cs
โ””โ”€โ”€ RotateOrganizationApiKeyCommand.cs
```
A command will usually follow these steps:

### Maintaining the command/query distinction
1. Fetch additional data required to process the request (if required)
1. Validate the request
1. Perform the action (state change)
1. Perform any side effects (e.g. sending emails or push notifications)
1. Return information about the outcome to the user (e.g. an error message or the successfully
created or updated object)

By separating read and write operations, CQRS encourages us to maintain loose coupling between
classes. There are two golden rules to follow when using CQRS in our codebase:
If you have complex validation logic, it can be useful to move it to a separate validator class.
This makes the validator and the command easier to understand, test and maintain.

- **Commands should never read and queries should never write**
- **Commands and queries should never call each other**
Some teams have defined their own request and result objects to pass data to and from commands and
validators. This is optional but can be useful to avoid primitive obsession and have strongly typed
interfaces.

Both of these lead to tight coupling between classes, reduce opportunities for code re-use, and
conflate the command/query distinction.
### Structure of a query

You can generally avoid these problems by:
A simple query may not require its own class if it is appropriately encapsulated by a single
database call. In that case, the "query" is just a repository method.

- writing your commands so that they receive all the data they need in their arguments, rather than
fetching the data themselves
- calling queries and commands sequentially (one after the other), passing the results along the
call chain
However, more complex queries can require additional logic in addition to the repository call. In
this case, it is appropriate to define a separate query class.

For example, if we need to update an API key for an organization, it might be tempting to have an
`UpdateApiKeyCommand` which fetches the current API key and then updates it. However, we can break
this down into two separate queries/commands, which are called separately:
A query is just a class. The class, interface and public method should be named after the data being
queried. For example:

```csharp
var currentApiKey = await _getOrganizationApiKeyQuery.GetOrganizationApiKeyAsync(orgId);
await _rotateOrganizationApiKeyCommand.RotateApiKeyAsync(currentApiKey);
public interface IGetOrganizationApiKeyQuery
{
Task<OrganizationApiKey> GetOrganizationApiKeyAsync(Guid organizationId, OrganizationApiKeyType organizationApiKeyType);
}
```

This has unit testing benefits as well - instead of having lengthy "arrange" phases where you mock
query results, you can simply supply different argument values using the `Autodata` attribute.

### Avoid [primitive obsession](https://refactoring.guru/smells/primitive-obsession)

Where practical, your commands and queries should take and return whole objects (e.g. `User`) rather
Expand All @@ -103,3 +105,8 @@ than individual properties (e.g. `userId`).

Lots of optional parameters can quickly become difficult to work with. Instead, consider using
method overloading to provide different entry points into your command or query.

## Further reading

- [ADR-0008: Server CQS Pattern](../adr/0008-server-CQRS-pattern.md) - Architectural decision to
adopt CQS for breaking up large service classes
2 changes: 1 addition & 1 deletion docs/contributing/code-style/web/angular.md
Original file line number Diff line number Diff line change
Expand Up @@ -212,7 +212,7 @@ component "Organization Reports Module" {
@enduml
```

## Reactivity ([ADR-0003](../../../architecture/adr/0003-observable-data-services.md) & ADR-0028)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Broken reference that was caught as part of this work. There is no ADR 28, this was presumably meant to reference the Signals ADR here: #632 however that has not been merged yet.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd omit this personally as it's not part of this PR's scope. This mention has been sitting for a bit because the Angular docs are a work-in-progress.

## Reactivity ([ADR-0003](../../../architecture/adr/0003-observable-data-services.md))

We make heavy use of reactive programming using [Angular Signals][signals] & [RxJS][rxjs]. Generally
components should always derive their state reactively from services whenever possible.
Expand Down
Loading