experiment: integrate audio S2S probe stack (PRs 1-6) - #7

Closed

codingshreyash wants to merge 145 commits into

mainfrom

experiment/audio-s2s-probes

Commits on Mar 28, 2026

fix: add self to constructor in ZeroToleranceEvaluator
r3v5
committed
445a2f7
test: add tests for evaluators
r3v5
committed
1c9befa

Commits on May 1, 2026

allow configration based override of `generation_params`
jmartin-tech
committed
c40703d

Commits on May 2, 2026

@zw5 has signed the CLA in NVIDIA/garak#1733
github-actions[bot]
authored
c3308f0

Commits on May 3, 2026

Commits on May 4, 2026

Commits on May 5, 2026

test: add unit tests for 5 probe modules
markd88
committed
fd6b601

Commits on May 7, 2026

Commits on May 9, 2026

@nuthalapativarun has signed the CLA in NVIDIA/garak#1751
github-actions[bot]
authored
339d881

Commits on May 10, 2026

@francose has signed the CLA in NVIDIA/garak#1756
github-actions[bot]
authored
3c6a541

Commits on May 11, 2026

Commits on May 12, 2026

fix: enhance error handling for Mistral API responses
jka236
committed
c0a50a8

Commits on May 18, 2026

test: address PR review feedback for evaluator tests

r3v5
and
claude
committed
ed05808
test: simplify z-score mock return value

r3v5
and
claude
committed
adc26e8

Commits on May 22, 2026

test(config): regression test for config_files dedup (closes #1249)
ppradyoth
committed
961ae3a

Commits on May 24, 2026

fix: inherit base DEFAULT_PARAMS in function generators
adityasingh2400
committed
b3f1011

Commits on May 26, 2026

fix: clearer error when probespec module has only inactive plugins (#830)
notnick2
committed
e5d1e6e

Commits on May 29, 2026

Commits on May 30, 2026

tests: cover a completed parallel_attempts run
EphraiemSarabamoun
committed
2454df7

Commits on Jun 1, 2026

fix: clearer error when probespec module has only inactive plugins (#1797)
jmartin-tech
committed
78f335a
test: add unit tests for phrasing and sata probe modules (#1747)
jmartin-tech
committed
2b12c25
section on new probe scope
leondz
committed
5c1988e
decenter linkedin
leondz
committed
a830469
point to specific docs on contrib/extend
leondz
committed
d7693c8
update social media accts
leondz
committed
5c9f1df
add specifics on style; explicitly point to contribution docs
leondz
committed
3b942f4
Skip invalid payloads in _scan_payload_dir instead of crashing (#1810)
leondz
authored
2e9b3f5

Commits on Jun 2, 2026

Commits on Jun 4, 2026

Commits on Jun 5, 2026

bump javascript dependencies
jmartin-tech
committed
ac8ed97
Address review on missing-lexicon test
adityasingh2400
committed
b8e8335
feat: add suppressed_params support to BedrockGenerator
u7k4rs6
committed
3dc5682
bump javascript dependencies (#1839)
jmartin-tech
committed
71dfb5d
Merge 'signatures' from contributors
jmartin-tech
committed
7777168
add contributors
jmartin-tech
committed
d1e1935
typo fix
jmartin-tech
committed
5f0ea6f
add contributors
jmartin-tech
committed
0f193ea
bump version
jmartin-tech
committed
c43aed7
postrel version bump
jmartin-tech
committed
bc57471

Commits on Jun 6, 2026

fix calibration pathlib paths
ron1po
committed
e34f52b

Commits on Jun 8, 2026

test(buffs): mock paraphrase model in load_and_transform to cut runtime
patriciapampanelli
committed
8772c1c

Commits on Jun 9, 2026

test: reduce test-suite runtime (#1854)
jmartin-tech
committed
8ba17db
test(detectors): mock data to manage avoid HF Hub 5xx instead of failing (#1833)
jmartin-tech
committed
35b7d27
probe: drop AdaptiveAttacksFull, ship single capped probe

neerazz-parafin
authored and
neerazz
committed
90eb9f9
probe(adaptiveattacks): remove aliases from new probe
Neeraj Kumar Singh
committed
91b7074

Commits on Jun 11, 2026

Commits on Jun 12, 2026

fix(openai): catch AuthenticationError before multiprocessing pickle
DevamShah
committed
cb83d9c

Commits on Jun 13, 2026

test(detectors): parameterize snowball detector test cases
nuthalapativarun
committed
65b7cb5

Commits on Jun 15, 2026

Commits on Jun 16, 2026

align probe name and initialize prompts in class
jmartin-tech
committed
a462062

Commits on Jun 17, 2026

Commits on Jun 28, 2026

fix(generators): repair dead blank-prompt guard in NVCF 400 handling

anxkhn
and
claude
committed
17d4566

Commits on Jul 1, 2026

Commits on Jul 4, 2026

test(probes): un-shadow leakreplay probe structure test

anxkhn
and
claude
committed
ff845f0

Commits on Jul 6, 2026

refactor test to avoid revising a CONSTANT during testing
jmartin-tech
committed
63a1197

Commits on Jul 7, 2026

test: un-shadow leakreplay probe structure test (#1914)
jmartin-tech
committed
89da6f5

Commits on Jul 19, 2026

Fix continuation probe not pruning triggers with prompts
Osamaali313
committed
84124dc

Commits on Jul 20, 2026

test: assert continuation prompt/trigger alignment after prompt-cap pruning
Osamaali313
committed
97d95b9

Commits on Jul 21, 2026

Commits on Jul 22, 2026