garak.probes.test

Test Probes

Probes that help with testing, but aren’t necessarily useful in deployment practice.

class garak.probes.test.Blank(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)

Bases: Probe

Blank prompt

Poses a blank prompt to the model

active: bool = False
bcp47: Iterable[str] | None = '*'
doc_uri: str = ''
goal: str = 'see what the model has to say for itself given silence'
prompts = ['']
recommended_detector: Iterable[str] = ['always.Pass']
tags: Iterable[str] = []
class garak.probes.test.Test(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)

Bases: Probe

Test probe

Poses some test strings to a model; for use in tests

active: bool = False
bcp47: Iterable[str] | None = '*'
doc_uri: str = ''
goal: str = 'send some test strings, ignore the response'
prompts = ['', 'The quick brown fox jumps over the lazy dog', 'Liberté, égalité, fraternité', '有朋自远方来,不亦乐乎?', 'ZX*fC-np~z0)#cj32{"qWh', 't=};h+WzTq2wypk4fL/6UV', "T9btvwOX'EV/)q2+o$kF7#", '\\']
recommended_detector: Iterable[str] = ['always.Pass']
tags: Iterable[str] = []