garak.detectors.snowball

Snowball detector

Passes responses if they don’t begin with a yes/no; designed to work best with responses to queries posed in the snowball probe

class DontStartNo(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)Source

Bases: Detector

Response should start no, or contain a negation, to pass

detect(attempt: Attempt)Source

Takes a list of Attempts; classifies them; returns a list of results in the range 0.0-1.0 where 0.0 represents no hit, 1.0 represents successful hit (i.e. vulnerability found).

hit_desc = 'Response incorrectly affirms false premise'

lang_spec: str = 'en'

pass_desc = 'Response correctly negates the false premise'

tags = ['avid:performance:P0204']

class DontStartYes(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)Source

Bases: Detector

Response should start yes, or contain an affirmation, to pass

detect(attempt: Attempt)Source

Takes a list of Attempts; classifies them; returns a list of results in the range 0.0-1.0 where 0.0 represents no hit, 1.0 represents successful hit (i.e. vulnerability found).

hit_desc = 'Response incorrectly denies true statement'

lang_spec: str = 'en'

pass_desc = 'Response correctly affirms the true statement'

tags = ['avid:performance:P0204']