[task] Code Snippet Optimization

[jon-tow]

🚀 The Task

Given a code snippet and an instruction for performance optimization, the model should generate the appropriate source code replacements for optimality. ((Can be at least partially grounded by checking results are similar and runtime is faster).

Example

Optimize the runtime of the following code snippet by using dynamic programming:
...

Vectorize the following loop:
...

Additional Notes

• Reference: @amarmet in the CarperAI Discord server.
• Google Sheets Reference: CarperAI: Instruct-GPT Tasks