-
Notifications
You must be signed in to change notification settings - Fork 26
Open
Description
In #145, I just needed to update a bunch of reftest images again. We somehow need to change how we handle them. Problems:
- All assets are stored in the git repo. This is not ideal since the git repo will grow over time.
- Currently, the reftests are numbered based on their ordering in the containing file; therefore, if you want to introduce another reference test in between, all the following tests change their name.
- There is no "interactive" way of going through the tests and accepting updates.
On the other hand, I like the simplicity of the system, and I like that I only need to mark plot commands in the docs with @reftest to test them. Some time ago, I created a experimental reftest package based on those ideas in GraphMakie, https://github.com/hexaeder/PlotReferenceTests.jl which solves 2 by changing the syntax to something like
@reftest "reference name" plot(...)
Problem 3 is also easy to solve by implementing some tooling.
However, I don't really know how to deal with 1, which blocks further improvements. Ideas?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels