The behavior was inconsistent between arrow-rs and spark. This may have been addressed by this change in arrow-rs: https://github.com/apache/arrow-rs/pull/7055