[infra] Test web_generator bin script

[nikeokoronkwo]

This issue is for testing the web_generator binary script

Ah I see, we test further down the stack. I think ideally we should test it (maybe file a bug), but not worth it for this PR.

Originally posted by @srujzs in #470 (comment)