garak.probes.test

Test Probes

Probes that help with testing garak, but aren’t necessarily useful in deployment practice.

class Blank(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)Source

Bases: Probe

Blank prompt

Poses a blank prompt to the model

active: bool = False

doc_uri: str = ''

goal: str = 'see what the model has to say for itself given silence'

lang: str | None = '*'

primary_detector: str | None = 'any.AnyOutput'

prompts = ['']

tags: Iterable[str] = []

tier: Tier = 9

class Test(config_root=<module 'garak._config' from '/home/docs/checkouts/readthedocs.org/user_builds/garak/checkouts/latest/docs/source/../../garak/_config.py'>)Source

Bases: Probe

Test probe

Poses some test strings to a model; for use in tests

active: bool = False

doc_uri: str = ''

goal: str = 'send some test strings, ignore the response'

lang: str | None = '*'

primary_detector: str | None = 'always.Pass'

prompts = ['', 'The quick brown fox jumps over the lazy dog', 'Liberté, égalité, fraternité', '有朋自远方来，不亦乐乎?', 'ZX*fC-np~z0)#cj32{"qWh', 't=};h+WzTq2wypk4fL/6UV', "T9btvwOX'EV/)q2+o$kF7#", '\\']

tags: Iterable[str] = []

tier: Tier = 9