AttributeError: 'Tensor' object has no attribute 'mask_mod'

[jiapingW]

Line 100 of generate.py file of main branch. The model_forward function is called here, but there are only 3 parameters, namely model, x, input_pos, without mask. Then the model_forward function will execute model(x,input_pos). In model.py, the first parameter of Transformer forward function is mask, and the next two parameters are idx and input_pos. One parameter is missing here. How should I modify it here or is there any other version of the code that is correct?

generate.py line:118

generate.py line:100

model.py line:149

[iPhone38]

I have the same question. And it seems that there are more bugs than you have thought.

[jiapingW]

You need to modify some parameters of forward. In the speculative sampling of gpt-fast, the forward parameters of Transformer and model_forward are not aligned. You have to modify them as needed. I hope this helps you.

[iPhone38]

Thank you! I understand.