Reportingο
By default, garak
outputs a JSONL file, with the name garak.<uuid>.report.jsonl
, that stores outcomes from a scan. garak
provides a CLI option to further structure this file for downstream consumption. The open data schema of AI vulnerability Database (AVID) is used for this purpose.
The syntax for this is as follows:
python3 -m garak -r <path_to_file>
Examplesο
As an example, letβs load up a garak
report from scanning gpt-3.5-turbo-0613
.
wget https://gist.githubusercontent.com/shubhobm/9fa52d71c8bb36bfb888eee2ba3d18f2/raw/ef1808e6d3b26002d9b046e6c120d438adf49008/gpt35-0906.report.jsonl
python3 -m garak -r gpt35-0906.report.jsonl
This produces the following output.
π Converting garak reports gpt35-0906.report.jsonl
π AVID reports generated at gpt35-0906.avid.jsonl