ch0ic3/h4cker
1
0
Fork 0
mirror of https://github.com/The-Art-of-Hacking/h4cker.git synced 2025-01-31 06:37:30 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge pull request #259 from The-Art-of-Hacking/santosomar-patch-17

Browse Source 
Update ai_security_tools.md
This commit is contained in:
Omar Santos 2025-01-26 21:11:52 -05:00 committed by GitHub
commit ef36a77194
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
ai_research/ai_security_tools.md
View File

@ -40,8 +40,12 @@ _Products that intercept prompts and responses and apply security or privacy rul
- [Skyflow LLM Privacy Vault](https://www.skyflow.com/product/llm-privacy-vault) - Redacts PII from prompts flowing to LLMs.
- [Guardrails AI](https://www.guardrailsai.com) - Guardrails runs Input/Output Guards in your application that detect, quantify and mitigate the presence of specific types of risks. [![code](https://img.shields.io/github/license/guardrails-ai/guardrails)](https://github.com/guardrails-ai/guardrails/)
## OWASP Security Resources
- [OWASP's List of AI Security Tools](https://owaspai.org/docs/5_testing/#open-source-tools-for-predictive-ai-red-teaming)
## AI Red Teaming Datasets
- [AttaQ Dataset](https://huggingface.co/datasets/ibm/AttaQ) - a red teaming dataset consisting of 1402 carefully crafted adversarial questions
## AI Red Teaming Guidance
- [OWASP AI Testing Guidance](https://owaspai.org/docs/5_testing/)
- [HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal](https://arxiv.org/pdf/2402.04249)