Is it possible to apply GRPOTrainer directly to handle interactive environments?

[Some-random]

Say for example agentic environments, where some parts of the trajectory shouldn't participate in gradient calculation (e.g. environment responses). I'm not sure whether this is supported currently as I think the trainer assumes all tokens in a sequence are generated by the model and should be part of gradient computation.