Skip to content

Issues: leondz/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

289 Open 265 Closed
289 Open 265 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

cli: warn if generator supports parallelisation but none is used cli Command-line interface functions enhancement Architectural upgrades generators Interfaces with LLMs ux Interface & interaction improvements
#928 opened Sep 23, 2024 by leondz
security: warn if api_key given in config and config is world-readable cli Command-line interface functions enhancement Architectural upgrades
#927 opened Sep 23, 2024 by leondz
configurable should validate dict format expectations enhancement Architectural upgrades
#926 opened Sep 23, 2024 by leondz
@jmartin-tech
1
support JSON config as well as YAML enhancement Architectural upgrades
#913 opened Sep 13, 2024 by leondz
PackageHallucinationProbe shouldn't show in --list_probes cli Command-line interface functions enhancement Architectural upgrades probes Content & activity of LLM probes
#904 opened Sep 6, 2024 by leondz
Map existing probes to policies policy Related to policy scanning
#894 opened Sep 4, 2024 by leondz 24.10
Add pre-scan model output policy checks policy Related to policy scanning
#893 opened Sep 4, 2024 by leondz 24.10
Build typology of model behaviours policy Related to policy scanning
#892 opened Sep 4, 2024 by leondz 24.10
enable loading resources from XDG_DATA_HOME before hitting package dir enhancement Architectural upgrades
#891 opened Sep 4, 2024 by leondz 24.10
1
@jmartin-tech
update divergence detector, rename replay probe module to divergence detectors work on code that inherits from or manages Detector
#890 opened Sep 4, 2024 by leondz 24.10
add support for loading renamed plugins enhancement Architectural upgrades
#889 opened Sep 4, 2024 by leondz 24.10
@jmartin-tech
2
docs: centralise FAQ, make things point to it documentation Improvements or additions to documentation
#887 opened Sep 4, 2024 by leondz
2 tasks
24.10
docs: add guide to first engaging with a good first issue documentation Improvements or additions to documentation
#886 opened Sep 4, 2024 by leondz 24.10
docs: config option descriptions documentation Improvements or additions to documentation
#884 opened Sep 4, 2024 by leondz
3 tasks
24.10
@leondz
Bug in Leakreplay Probe bug Something isn't working probes Content & activity of LLM probes
#879 opened Sep 4, 2024 by bleszily
2
Extend refactoring of calibration enhancement Architectural upgrades reporting Reporting, analysis, and other per-run result functions
#869 opened Aug 30, 2024 by leondz
separate package name from package usage code in packagehallucination enhancement Architectural upgrades probes Content & activity of LLM probes
#863 opened Aug 29, 2024 by leondz
checking out branch w/ new plugin class updated skips cache rebuild, making class inaccessible bug Something isn't working
#853 opened Aug 26, 2024 by leondz
@jmartin-tech
2
atbash cipher encoding probes Content & activity of LLM probes
#845 opened Aug 21, 2024 by leondz
migrate away from conda enhancement Architectural upgrades
#844 opened Aug 21, 2024 by leondz
1
1
probe: pdf injection new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#841 opened Aug 20, 2024 by leondz
calibration symlink broken bug Something isn't working windows Windows-specific issues
#839 opened Aug 20, 2024 by leondz
4
see if we can migrate to either nltk or wn and not both enhancement Architectural upgrades
#835 opened Aug 15, 2024 by leondz
ux: indicate when module-based probespec leaves nothing to do cli Command-line interface functions ux Interface & interaction improvements
#830 opened Aug 14, 2024 by leondz
try to enable parallel_attempts > 1 by default quality-speed This affects the speed of program use ux Interface & interaction improvements
#829 opened Aug 14, 2024 by leondz
2 tasks
24.10
2
ProTip! Mix and match filters to narrow down what you’re looking for.