Revise fallible casts

[mversic]

          I'm opposed to this. Seems like it can fail easily?

Originally posted by @mversic in #357 (comment)