When indexing into resource arrays with non-uniform indices you need to use the NonUniformResourceIndex intrinsic to ensure that the resource indies are communicated to the driver as non-uniform.
Several of the tests we've added in the offload test suite require this annotation for correctness.