Idea: Conformance Tests and Test Vectors

[burdiyan]

I wish Cap'n Web had a set of conformance tests to help implementing the protocol in other languages. It could include various test vectors mapping exact client message to the expected server responses and vice-versa.

Have you thought about this? Do you have any specific edge cases in mind that would be worth testing? Maybe things like disposing, distinguishing property access vs. method calls vs. getters, and so on?

[kentonv]

This sounds like a good idea but also somewhat laborious, so I'm not sure when we'll have the eng-hours to do it.

Perhaps test vectors could be mined from the unit test? Maybe we could literally have it run in a mode where it spits out the protocol messages produced in each test case, and then you could replay those against alternate implementations of the client or server...