Skip to content

Commit 8655e9c

Browse files
committed
Reorder tasks of roadmap issue template to allow tagging a release before doing the big evaluation run
This should ensure that we are working on bugfixes only, instead of new features.
1 parent fbc5055 commit 8655e9c

File tree

1 file changed

+20
-24
lines changed

1 file changed

+20
-24
lines changed

.github/ISSUE_TEMPLATE/3-roadmap.md

Lines changed: 20 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -39,19 +39,6 @@ Release version of this roadmap issue:
3939

4040
> ❓ When should a release happen? Check the [`README`](../../README.md#when-and-how-to-release)!
4141
42-
- [ ] Do a full evaluation with the version
43-
- [ ] Exclude certain Openrouter models by default
44-
- [ ] `nitro` cause they are just faster
45-
- [ ] `extended` cause longer context windows don't matter for our tasks
46-
- [ ] `free` and `auto` cause these are just "aliases" for existing models
47-
- [ ] Exclude special-purpose models
48-
- [ ] Vision models
49-
- [ ] Roleplay and creative writing models
50-
- [ ] Classification models
51-
- [ ] Models with internet access (usually denoted by `-online` suffix)
52-
- [ ] Models with extended context windows (usually denoted by `-1234K` suffix)
53-
- [ ] Always prefer fine tuned (`-instruct`, `-chat`) models over a plain base model
54-
- [ ] Tag version (tag can be moved in case important merges happen afterwards)
5542
- [ ] For all issues of the current milestone, one by one, add them to the roadmap tasks (it is ok if a task has multiple issues) with the users that worked on it
5643
- Fixed bugs should always be sorted into respective relevant categories and not in a generic "Bugs" category!
5744
- [ ] For all PRs of the current milestone, one by one, add them to the roadmap tasks (it is ok if a task has multiple issues) with the users that worked on it
@@ -60,18 +47,31 @@ Release version of this roadmap issue:
6047
- [ ] Unassigned issues that are closed, and assign them someone
6148
- [ ] Issues without a milestone, and assign them a milestone
6249
- [ ] Issues without a label, and assign them at least one label
63-
- [ ] Write the release notes:
64-
- [ ] Use the tasks that are already there for the release note outline
65-
- [ ] Add highlighted features based on the done tasks, sort by how many users would use the feature
66-
- [ ] Do the release for version X.Y.Z with a new major, minor or bugfix version
67-
- [ ] Execute `go run scripts/eval-dev-quality-release/main.go X.Y.Z`
68-
- [ ] Do release notes for version
69-
- [ ] Set release as latest release
7050
- [ ] Prepare the next roadmap
7151
- [ ] Create a milestone for the next release
7252
- [ ] Create a new roadmap issue for the next release
7353
- [ ] Move all open tasks/TODOs from this roadmap issue to the next roadmap issue.
7454
- [ ] Move every comment of this roadmap issue as a TODO to the next roadmap issue. Mark when done with a :rocket: emoji.
55+
- [ ] Write the release notes
56+
- [ ] Use the tasks that are already there for the release note outline
57+
- [ ] Add highlighted features based on the done tasks, sort by how many users would use the feature
58+
- [ ] Do the tag and release for version X.Y.Z with a new major, minor or bugfix version
59+
- [ ] Execute `go run scripts/eval-dev-quality-release/main.go X.Y.Z`
60+
- [ ] Do release notes for version
61+
- [ ] Set release as latest release
62+
- [ ] In case important changes happen afterwards, do bugfix release but keep the release notes updated referencing the new bugfix releases.
63+
- [ ] Do a full evaluation with the version
64+
- [ ] Exclude certain Openrouter models by default
65+
- [ ] `nitro` cause they are just faster
66+
- [ ] `extended` cause longer context windows don't matter for our tasks
67+
- [ ] `free` and `auto` cause these are just "aliases" for existing models
68+
- [ ] Exclude special-purpose models
69+
- [ ] Vision models
70+
- [ ] Roleplay and creative writing models
71+
- [ ] Classification models
72+
- [ ] Models with internet access (usually denoted by `-online` suffix)
73+
- [ ] Models with extended context windows (usually denoted by `-1234K` suffix)
74+
- [ ] Always prefer fine tuned (`-instruct`, `-chat`) models over a plain base model
7575
- [ ] Blog post containing evaluation results, new features and learnings
7676
- [ ] Update README with blog post link and new header image
7777
- [ ] Update repository link with blog post link
@@ -93,7 +93,3 @@ Release version of this roadmap issue:
9393
- [ ] Close the current milestone
9494
- [ ] Announce release
9595
- [ ] Eat cake 🎂
96-
97-
TODO sort and sort out:
98-
99-
- [ ] TODO

0 commit comments

Comments
 (0)