Skip to content

Commit 0a13afc

Browse files
committed
Add length method to RequestSession
1 parent f998e67 commit 0a13afc

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

src/guidellm/request/session.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,9 @@
1313

1414

1515
class RequestSession(ABC, Generic[RequestT, ResponseT]):
16+
@abstractmethod
17+
def __len__(self) -> int: ...
18+
1619
@abstractmethod
1720
def get_next_request(self) -> RequestT: ...
1821

@@ -36,6 +39,9 @@ def __init__(self, prompts: list[GenerationRequest]) -> None:
3639
self.prompts = prompts
3740
self.responses: list[str] = []
3841

42+
def __len__(self) -> int:
43+
return len(self.prompts)
44+
3945
def get_next_request(self) -> GenerationRequest:
4046
completed_responses = len(self.responses)
4147
base_request = self.prompts[completed_responses].model_copy()

0 commit comments

Comments
 (0)