Skip to content

Enhance the response classification on dataset based tests #39

@guy-ps

Description

@guy-ps

Today the dataset based tests rely on the response classifier not contains_refusal_keyword() but this classifier is very basic for some of the advanced needs of the next few datasets that will be implemented.

What is going to be done is:

  • We'll enhance the rule based mechanism that checks responses
  • We'll implement a semantic mechanism to go over the response
  • We'll allow for a choice between the two in the attack configuration

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions