-
Notifications
You must be signed in to change notification settings - Fork 271
ci/performance testing #2304
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
ci/performance testing #2304
Changes from 1 commit
Commits
Show all changes
32 commits
Select commit
Hold shift + click to select a range
b7cb5f0
ci: performance project scaffolding
baywet e90dcca
chore: moves benchmark to dedicated directory
baywet f39bc77
chore: commits initial benchmark results
baywet 317e2f6
ci: adds a comparison project for benchmark results
baywet 4ba642c
ci: adds benchmark runs and comparison
baywet 41bf122
ci: renames empty models tests
baywet b82594f
Merge branch 'main' into ci/performance-testing
baywet 1c991f6
chore: refactors to a command structure
baywet 1cbeab6
chore: moves models to a dedicated source file
baywet a08fc97
ci: fixes missing project argument
baywet a491315
ci: fixes reports path
baywet 308b022
chore: moves policies to own directory
baywet 4671651
chore: no warn on static method for perf test project
baywet be4f841
Merge branch 'main' into ci/performance-testing
baywet 3bc2c97
chore: linting
baywet 51c63bb
chore: reduces run time for empty performance tests
baywet 240fb54
chore: linting
baywet 8b4fd00
fix: a bug where the input stream would be disposed not matter what
baywet b78b847
ci: fixes working directory for benchmark run
baywet 93ef172
ci: adds basic infrastructure for descriptions based performance tests
baywet c306a76
chore: refresh empty object tests
baywet ad1a454
ci: adds comparison run for descriptions comparisons
baywet e603b74
ci: adds percentage based comparisons
baywet 9793500
ci: adds large description to performance tests
baywet 0a5a07d
ci: adds yaml descriptions perf tests to compare
baywet 562b4a3
ci: adds truncation in percentage difference to reduce noise
baywet b35bf35
chore: updates benchmark reports
baywet 4ea8391
chore: updates benchmark reports from WSL
baywet 1c74c70
Merge branch 'main' into ci/performance-testing
baywet c012e94
chore: refreshes performance measurements after collection updates
baywet 3211ed5
Merge branch 'main' into ci/performance-testing
baywet 4602c62
ci: adds a point 2 policy to reduce noise
baywet File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,21 @@ | ||
| using System; | ||
| using BenchmarkDotNet; | ||
| using BenchmarkDotNet.Attributes; | ||
|
|
||
| namespace performance | ||
| { | ||
| public class Benchmarks | ||
| { | ||
| [Benchmark] | ||
| public void Scenario1() | ||
| { | ||
| // Implement your benchmark here | ||
| } | ||
|
|
||
| [Benchmark] | ||
| public void Scenario2() | ||
| { | ||
| // Implement your benchmark here | ||
| } | ||
| } | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| <Project Sdk="Microsoft.NET.Sdk"> | ||
| <PropertyGroup> | ||
| <TargetFramework>net8.0</TargetFramework> | ||
| <OutputType>Exe</OutputType> | ||
| </PropertyGroup> | ||
| <PropertyGroup> | ||
| <PlatformTarget>AnyCPU</PlatformTarget> | ||
| <DebugType>pdbonly</DebugType> | ||
| <DebugSymbols>true</DebugSymbols> | ||
| <AllowUnsafeBlocks>true</AllowUnsafeBlocks> | ||
| <Optimize>true</Optimize> | ||
| <Configuration>Release</Configuration> | ||
| <IsPackable>false</IsPackable> | ||
| </PropertyGroup> | ||
| <ItemGroup> | ||
| <PackageReference Include="BenchmarkDotNet" Version="0.14.0" /> | ||
| <PackageReference Include="BenchmarkDotNet.Diagnostics.Windows" Version="0.14.0" /> | ||
| </ItemGroup> | ||
| <ItemGroup> | ||
| <ProjectReference Include="..\src\Microsoft.OpenApi\Microsoft.OpenApi.csproj" /> | ||
| </ItemGroup> | ||
| </Project> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| using BenchmarkDotNet.Configs; | ||
| using BenchmarkDotNet.Running; | ||
|
|
||
| namespace performance | ||
| { | ||
| public class Program | ||
| { | ||
| public static void Main(string[] args) | ||
| { | ||
| var config = DefaultConfig.Instance; | ||
| var summary = BenchmarkRunner.Run<Benchmarks>(config, args); | ||
|
|
||
| // Use this to select benchmarks from the console: | ||
| // var summaries = BenchmarkSwitcher.FromAssembly(typeof(Program).Assembly).Run(args, config); | ||
| } | ||
| } | ||
| } | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ioj