h4cker/ai_research/README.md

# AI Security Research Resources

## Langchain Resources
- [Tools, Learning, Notebooks, Bots, Agent examples, etc.](https://github.com/The-Art-of-Hacking/h4cker/tree/master/ai_research/LangChain/README.md)

## LLM Frameworks
- [Popular LLM Frameworks](https://github.com/The-Art-of-Hacking/h4cker/tree/master/ai_research/LLM-frameworks)

## Collection of Jupyter Notebooks
This is (by far) the best collection of colab notebooks I have found. A bit overwhelming and I wish I had time to go through most of them… Tons of links to papers, videos, etc.: https://github.com/amrzv/awesome-colab-notebooks
  
## AI Security Best Practices and Tools
- [AI Security Tools](https://github.com/The-Art-of-Hacking/h4cker/blob/master/ai_research/ai_security_tools.md)
- [OWASP AI Security Testing Guidance](https://owaspai.org/docs/5_testing/)
- [AI Security Tools and Frameworks](https://github.com/The-Art-of-Hacking/h4cker/blob/master/ai_research/ai_security_tools.md)
- [Cisco AI Security Website](https://aisecurity.cisco.com/)
- [Securing AI Training and Fine-Tuning Environments](https://github.com/The-Art-of-Hacking/h4cker/tree/master/ai_research/training_environment_security)
- [Prompt Injection](https://github.com/The-Art-of-Hacking/h4cker/tree/master/ai_research/prompt_injection)

## AI Security Resources from Omar's Training Sessions
This section provides a curated list of resources that delve into foundational cybersecurity concepts, frequently explored in my O'Reilly training sessions and other educational offerings.

###  Live Training
**Upcoming Live Cybersecurity and AI Training in O'Reilly:** [Register before it is too late](https://learning.oreilly.com/search/?q=omar%20santos&type=live-course&rows=100&language_with_transcripts=en) (free with O'Reilly Subscription)

### Reading List

Despite the rapidly evolving landscape of AI and technology, these books offer a comprehensive roadmap for understanding the intersection of these technologies with cybersecurity:

- **Redefining Hacking**
A Comprehensive Guide to Red Teaming and Bug Bounty Hunting in an AI-driven World [Available on O'Reilly](https://learning.oreilly.com/library/view/redefining-hacking-a/9780138363635/)

- **Developing Cybersecurity Programs and Policies in an AI-Driven World**  
  Explore strategies for creating robust cybersecurity frameworks in an AI-centric environment. [Available on O'Reilly](https://learning.oreilly.com/library/view/developing-cybersecurity-programs/9780138073992)

- **Beyond the Algorithm: AI, Security, Privacy, and Ethics**  
  Gain insights into the ethical and security challenges posed by AI technologies. [Available on O'Reilly](https://learning.oreilly.com/library/view/beyond-the-algorithm/9780138268442)

- **The AI Revolution in Networking, Cybersecurity, and Emerging Technologies** Understand how AI is transforming networking and cybersecurity landscapes.  
[Available on O'Reilly](https://learning.oreilly.com/library/view/the-ai-revolution/9780138293703)

### Video Courses

Enhance your practical skills with these video courses designed to deepen your understanding of cybersecurity:

- **Building the Ultimate Cybersecurity Lab and Cyber Range (video)** [Available on O'Reilly](https://learning.oreilly.com/course/building-the-ultimate/9780138319090/)

---

- **AI-Enabled Programming, Networking, and Cybersecurity**
Learn to use AI for cybersecurity, networking, and programming tasks.
Use examples of practical, hands-on activities and demos that emphasize real-world tasks.
Implement AI tools as a programmer, developer, networking, or security professional.
[Available on O'Reilly](https://learning.oreilly.com/course/ai-enabled-programming-networking/9780135402696/)
 
---

- **Securing Generative AI**
Explore security for deploying and developing AI applications, RAG, agents, and other AI implementations
Learn hands-on with practical skills of real-life AI and machine learning cases
Incorporate security at every stage of AI development, deployment, and operation
[Available on O'Reilly](https://learning.oreilly.com/course/securing-generative-ai/9780135401804/)

---


- **Practical Cybersecurity Fundamentals**  
  A comprehensive video course covering essential cybersecurity principles.  [Available on O'Reilly](https://learning.oreilly.com/course/practical-cybersecurity-fundamentals/9780138037550/)
 
---

- **The Art of Hacking**  
  A series of video courses offering over 26 hours of training in ethical hacking and penetration testing techniques. Ideal for those preparing for certifications like OSCP or CEH.  
  [Visit The Art of Hacking](https://theartofhacking.org)

---

## AWESOME Lists
- [Awesome-LLM](https://github.com/Hannibal046/Awesome-LLM) - a huge collection of resources related to Gen AI and LLMs
- [Awesome ChatGPT Prompts](https://github.com/f/awesome-chatgpt-prompts) - A collection of prompt examples to be used with the ChatGPT model.
- [awesome-chatgpt-prompts-zh](https://github.com/PlexPt/awesome-chatgpt-prompts-zh) - A Chinese collection of prompt examples to be used with the ChatGPT model.
- [Awesome ChatGPT](https://github.com/humanloop/awesome-chatgpt) - Curated list of resources for ChatGPT and GPT-3 from OpenAI.
- [Chain-of-Thoughts Papers](https://github.com/Timothyxxx/Chain-of-ThoughtsPapers) -  A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models.
- [LLM Reading List](https://github.com/crazyofapple/Reading_groups/) - A paper & resource list of large language models.
- [Reasoning using Language Models](https://github.com/atfortes/LM-Reasoning-Papers) - Collection of papers and resources on Reasoning using Language Models.
- [Chain-of-Thought Hub](https://github.com/FranxYao/chain-of-thought-hub) - Measuring LLMs' Reasoning Performance
- [Awesome GPT](https://github.com/formulahendry/awesome-gpt) - A curated list of awesome projects and resources related to GPT, ChatGPT, OpenAI, LLM, and more.
- [Awesome GPT-3](https://github.com/elyase/awesome-gpt3) - a collection of demos and articles about the [OpenAI GPT-3 API](https://openai.com/blog/openai-api/).
- [Awesome LLM Human Preference Datasets](https://github.com/PolisAI/awesome-llm-human-preference-datasets) - a collection of human preference datasets for LLM instruction tuning, RLHF and evaluation.
- [RWKV-howto](https://github.com/Hannibal046/RWKV-howto) - possibly useful materials and tutorial for learning RWKV.
- [ModelEditingPapers](https://github.com/zjunlp/ModelEditingPapers) - A paper & resource list on model editing for large language models.
- [Awesome LLM Security](https://github.com/corca-ai/awesome-llm-security) - A curation of awesome tools, documents and projects about LLM Security.
- [Awesome-Align-LLM-Human](https://github.com/GaryYufei/AlignLLMHumanSurvey) - A collection of papers and resources about aligning large language models (LLMs) with human.
- [Awesome-Code-LLM](https://github.com/huybery/Awesome-Code-LLM) - An awesome and curated list of best code-LLM for research.
- [Awesome-LLM-Compression](https://github.com/HuangOwen/Awesome-LLM-Compression) - Awesome LLM compression research papers and tools.
- [Awesome-LLM-Systems](https://github.com/AmberLJC/LLMSys-PaperList) - Awesome LLM systems research papers.
- [awesome-llm-webapps](https://github.com/snowfort-ai/awesome-llm-webapps) - A collection of open source, actively maintained web apps for LLM applications.