Currently ISD::BITCAST nodes fallback to the default implementation (which tests all elements), but we should be rescaling the input demanded elts to match the vector element count of the input operand, typically with APIntOps::ScaleBitMask but there will need to be special case handling of src/dst scalar types as well.
Test coverage will be the main issue