BUG: Buffer expansion causes position to exceed bounds, consider strategies.

[shoutsid]

BUG: Buffer expansion causes position to exceed bounds, consider strategies

This issue can appear in transformer blocks

    /app/models/llama/llama.py", line 260, in <module>
      probs = llama.model(
    /app/models/llama/transformer.py", line 83, in __call__
      pos = variable("pos", 1, 1024).bind(start_pos)
    /ext/tinygrad/tinygrad/shape/symbolic.py", line 155, in bind
      assert self.val is none and self.min<=val<=self.max, f"cannot bind {val} to {self}"

townhall/app/models/llama/transformer_block.py

Lines 68 to 75 in 25fda45

	# BUG: Buffer expansion causes postion to exceed bounds, consider strategies.
	#
	# /app/models/llama/llama.py", line 260, in <module>
	# probs = llama.model(
	# /app/models/llama/transformer.py", line 83, in __call__
	# pos = Variable("pos", 1, 1024).bind(start_pos)
	# /ext/tinygrad/tinygrad/shape/symbolic.py", line 155, in bind
	# assert self.val is None and self.min<=val<=self.max, f"cannot bind {val} to {self}"