Skip to content

Commit 83b66c5

Browse files
joerundenjhill
authored andcommitted
Python tests revival
This PR does a bit of tidying to bring back in the python tests. This mainly kills off the broken tests from before the grand schism with TGI, which was mainly tests/models and things involving StoppingCriteria. After fixing a few other tests that seem to have been broken by recent changes, make python-tests is good to go again.
1 parent 5f67482 commit 83b66c5

File tree

7 files changed

+14
-1010
lines changed

7 files changed

+14
-1010
lines changed

server/tests/conftest.py

Lines changed: 1 addition & 41 deletions
Original file line numberDiff line numberDiff line change
@@ -1,41 +1 @@
1-
import pytest
2-
3-
from transformers import AutoTokenizer
4-
5-
from text_generation_server.pb import generate_pb2
6-
7-
8-
@pytest.fixture
9-
def default_pb_parameters():
10-
return generate_pb2.NextTokenChooserParameters(
11-
temperature=0.0, # Greedy
12-
top_k=0,
13-
top_p=1.0,
14-
#do_sample=False,
15-
)
16-
17-
18-
@pytest.fixture
19-
def default_pb_stop_parameters():
20-
return generate_pb2.StoppingCriteriaParameters(stop_sequences=[], max_new_tokens=10)
21-
22-
23-
@pytest.fixture(scope="session")
24-
def bloom_560m_tokenizer():
25-
return AutoTokenizer.from_pretrained("bigscience/bloom-560m", padding_side="left")
26-
27-
28-
@pytest.fixture(scope="session")
29-
def gpt2_tokenizer():
30-
tokenizer = AutoTokenizer.from_pretrained("gpt2", padding_side="left")
31-
tokenizer.pad_token_id = 50256
32-
return tokenizer
33-
34-
35-
@pytest.fixture(scope="session")
36-
def mt0_small_tokenizer():
37-
tokenizer = AutoTokenizer.from_pretrained(
38-
"bigscience/mt0-small", padding_side="left"
39-
)
40-
tokenizer.bos_token_id = 0
41-
return tokenizer
1+
"""nada"""

server/tests/models/test_bloom.py

Lines changed: 0 additions & 306 deletions
This file was deleted.

0 commit comments

Comments
 (0)