Risk Atlas Nexus aims to provide tooling to help bring together disparate resources related to governance of foundation models. We support a community driven approach to curating and cataloguing resources such as datasets, benchmarks and mitigations. Our goal is to turn abstract risk definitions into actionable workflows that streamline AI governance processes. By connecting fragmented resources, Risk Atlas Nexus seeks to fill a critical gap in AI governance, enabling stakeholders to build more robust, transparent, and accountable systems. Risk Atlas Nexus builds on the IBM AI Risk Atlas making this educational resource a nexus of governance assets and tooling. An AI System's Knowledge Graph is used to provide a unified structure that links and contextualize the very heterogeneous domain data.
Our intention is to create a starting point for an open AI Systems ontology whose focus is on risk and that the community can extend and enhance. This ontology serves as the foundation that unifies innovation and tooling in the AI risk space. By lowering the barrier to entry for developers, it fosters a governance-first approach to AI solutions, while also inviting the broader community to contribute their own tools and methodologies to expand its impact.
- 🏗️📊 An ontology has been provided, that combines the AI risk view (taxonomies, risks, actions) with an AI model view (AI systems, AI models, model evaluations) into one coherent schema
- 📚
⚠️ AI Risks were collected from IBM AI Risk Atlas, IBM Granite Guardian, MIT AI Risk Repository, NIST Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile, and OWASP Top 10 for Large Language Model Applications - 🔗📌 Mappings are proposed between the taxonomies and between risks and actions
- 🐍🔍 Use the python library methods to quickly explore available risks, relations and actions
- 🚨🧐 Use the python library methods to detect potential risks in your usecase
- 📤📈 Download an exported graph populated with data instances
- Tooling to convert the LinkML schema and instance data into a Cypher representation to populate a graph database
- Example use-case of auto-assistance in compliance questionnaires using CoT examples and Risk Atlas Nexus
- AI Risk Ontology
- Notebooks:
- Risk identification Uncover risks related to your usecase
- Risk Atlas Nexus Quickstart Overview of library functionality
- Additional Resources:
This project targets python version ">=3.11, <3.12". You can download specific versions of python here: https://www.python.org/downloads/
Install the risk_atlas_nexus library
git clone [email protected]:IBM/risk-atlas-nexus.git
cd risk-atlas-nexus
python -m venv vrisk-atlas-nexus
source vrisk-atlas-nexus/bin/activate
pip install -e .
Risk Atlas Nexus uses Large Language Models (LLMs) to infer risks and risks data. Therefore, requires access to LLMs to inference or call the model. The following LLM inference APIs are supported:
When using the WML platform, you need to:
- Add configuration to
.envfile as follows. Please follow this documentation on obtaining WML credentials.
WML_API_KEY=<WML api key goes here>
WML_API_URL=<WML url key goes here>
WML_PROJECT_ID=<WML project id goes here, Optional>
WML_SPACE_ID=<WML space id goes here, Optional>Either 'WML_PROJECT_ID' or 'WML_SPACE_ID' need to be specified.
- Install WML dependencies as follows:
pip install -e ".[wml]"When using the RITS platform, you need to:
- Add configuration to
.envfile as follows:
RITS_API_KEY=<RITS api key goes here>
RITS_API_URL=<RITS url key goes here>- Install RITS dependencies as follows:
pip install -e ".[rits]"- View the changelog.
- Get started by checking our contribution guidelines.
- Read the wiki for more technical and design details.
- If you have any questions, just ask!
Tip: Use the makefile provided to regenerate artifacts provided in the repository by running make in this repository.
- IBM's AI Risk Atlas
- Read the the IBM AI Ethics Board publication Foundation models: Opportunities, risks and mitigations which goes into more detail about the risk taxonomy, and describes the point of view of IBM on the ethics of foundation models.
- 'Usage Governance Advisor: From Intent to AI Governance' presents a system for semi-structured governance information, identifying and prioritising risks according to the intended use case, recommending appropriate benchmarks and risk assessments and proposing mitigation strategies and actions.
Risk Atlas Nexus has been brought to you by IBM.