@@ -25,6 +25,8 @@ pip install -U transformers optimum accelerate auto-gptq --extra-index-url https
2525``` python
2626from roy import Roy, Roys
2727roy = Roy()
28+ s = ' "What date is today? Which big tech stock has the largest year-to-date gain this year? How much is the gain?'
29+ roy.generate(roy.format(s))
2830```
2931
3032### ** Rapid Benchmarking**
@@ -38,7 +40,7 @@ Roy provides a simple way to evaluate and iterate on your model architecture.. T
3840- Identify agent's areas of strengths and weaknesses
3941
4042``` python
41- from util import piecewise_human_eval
43+ from Roy. util import piecewise_human_eval
4244
4345# Comparing different language models
4446piecewise_human_eval(0 , lm_id = ' TheBloke/WizardCoder-Python-7B-V1.0-GPTQ' )
@@ -54,18 +56,9 @@ piecewise_human_eval(0, fx=<your_custom_Roy_agent>)
5456
5557* Takes around 30 minutes each on a free Google Colab runtime.*
5658
57- ### ** Template-Based Generation**
58-
59- Use templates to structure conversations and provide context.
60-
61- ``` python
62- s = ' "What date is today? Which big tech stock has the largest year-to-date gain this year? How much is the gain?'
63- roy.generate(roy.format(s))
64- ```
65-
6659### ** Constrained Beam Search**
6760
68- Control output length, format, etc.
61+ Use templates to structure conversations (control output length, format, etc)
6962
7063``` python
7164roy.generate(s, (' \n ```python' , ' \n ```' )) # Generate a python code block
0 commit comments