Skip to content

Commit

Permalink
Merge pull request #135 from nhsengland/hs-ai-ethics
Browse files Browse the repository at this point in the history
HS Create Ethical AI page
  • Loading branch information
harrietrs authored Sep 3, 2024
2 parents 4c68c1c + 2978790 commit 1ac3de3
Show file tree
Hide file tree
Showing 5 changed files with 72 additions and 23 deletions.
5 changes: 3 additions & 2 deletions CONTRIBUTE.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ If you want to contribute to our resources:
4. Make your change
5. Check how your change looks on our website by hosting the website locally (follow [the steps below](#contribute-to-nhs-england-data-science-website) on how to do this)
6. Content Review (follow the [instructions](#content-review))
6. Push to your fork and [submit a pull request][pr]
7. Push to your fork and [submit a pull request][pr]

Your pull request will then be reviewed. You may receive some feedback and suggested changes before it can be approved and your pull request merged.

Expand Down Expand Up @@ -58,7 +58,8 @@ The website currently uses the [Material for MkDocs](https://squidfunk.github.io
Here is a good [cheat sheet](https://yakworks.github.io/docmark/cheat-sheet/) for what features can be used in MkDocs and also interesting features in [Material for MkDocs](https://squidfunk.github.io/mkdocs-material/reference/).

### Content Review
Prior to making a pull request, ensure that, if the changes involve a change or addition of content (rather than technical or spelling changes) to the site, you have gone through a content review as outlined [here](https://nhsd-confluence.digital.nhs.uk/display/DAT/Website+Gateway). This is to ensure that no sensitive or policy content goes into your PR, as whilst PRs aren't live on the website they are still public (as the repo is public).

Prior to making a pull request, ensure that, if the changes involve a change or addition of content (rather than technical or spelling changes) to the site, you have gone through a content review as outlined [here](https://nhsd-confluence.digital.nhs.uk/display/DAT/C&M:+Website+Gateway). This is to ensure that no sensitive or policy content goes into your PR, as whilst PRs aren't live on the website they are still public (as the repo is public).

#### Blog / Article

Expand Down
8 changes: 3 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
# [NHS England Data Science](https://nhsengland.github.io/datascience/)

![CI](https://github.com/nhsengland/datascience/actions/workflows/pages-build-deployment.yml/badge.svg "CI badge indicating passing or failing status")
[![Release Version](https://img.shields.io/github/v/release/nhsengland/datascience "Release version")](https://github.com/nhsengland/datascience/releases)
[![MkDocs Material](https://img.shields.io/badge/style-MkDocs%20Material-darkblue "Markdown Style: MkDocs")](https://squidfunk.github.io/mkdocs-material/reference/)
[![licence: MIT](https://img.shields.io/badge/Licence-MIT-yellow.svg)](https://opensource.org/licenses/MIT "MIT License")
[![licence: OGL3](https://img.shields.io/badge/Licence-OGL3-darkgrey "licence: Open Government Licence 3")](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)


> **This material is maintained by the [NHS England Data Science team](mailto:[email protected])**.
>
> See our other work here: [NHS Digital Analytical Services](https://github.com/NHSDigital/data-analytics-services).
Expand All @@ -18,12 +18,10 @@ Visit our [website](https://nhsengland.github.io/datascience/) for more informat

[<kbd> <br> Data Science team website <br> </kbd>](https://nhsengland.github.io/datascience/)


## Licence

Unless stated otherwise, the codebase is released under the [MIT Licence][2]. This covers both the codebase and any sample code in the documentation.
Unless stated otherwise, the codebase is released under the [MIT Licence][1]. This covers both the codebase and any sample code in the documentation.

HTML and Markdown documentation is © Crown copyright and available under the terms of the [Open Government 3.0](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/) licence.

[1]: ./CONTRIBUTE.md
[2]: ./LICENCE
[1]: ./LICENCE
48 changes: 48 additions & 0 deletions docs/our_work/ai-ethics.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
---
title: 'AI Ethics in Practice at NHS England'
summary: 'Defining ethical AI development best practice for data practitioners in the NHS'
origin: 'NHS England'
tags: ['AI', 'ETHICS', 'TRANSPARENCY', 'QUALITY', 'DOCUMENTATION', 'RESEARCH', 'GUIDANCE', 'BEST PRACTICE']
---
!!! warning

This project is currently in development, and as such the following is subject to change.

## Background

AI presents transformative opportunities in healthcare, but the technology brings with it risks to people, the natural environment and society at large. NHS England has a responsibility to effectively harness AI to support the provision of better care to all patients.

To do this, data scientists (among others) need to ensure ethical considerations are embedded in the development, evaluation and implementation of AI and data science projects more generally.

However, there are few practical examples of what ethical AI in health looks like for those involved in its design and implementation. This is despite the proliferation of guidance from research institutions and other organisations.

## Aim

We have written a White Paper in which we identify the characteristics of ethical AI that data scientists should be concerned with at the NHS. This takes into account other actors in AI development at the NHS, including cybersecurity, assurance and governance colleagues.

This paper proposes that data scientists specifically focus on trying to ensure four characteristics of AI: fair, transparent, value-adding and reliable.

Our practical suggestions of how we can work towards embedding these characteristics in working practices include:

* Trialling tools and frameworks on live and emerging projects and to share learnings with the wider community. This will eventually constitute a portfolio of real examples that can inform future projects, similar to the use cases features in the [OECD's Catalogue of Tools & Metrics for Trustworthy AI](https://oecd.ai/en/catalogue/tool-use-cases).
* Coordinating a series of interactive workshops to build awareness of ethical risks, and to create and sustain a shared vocabulary to document and help mitigate these risks effectively along each project’s lifecycle.
* Developing standardised resources that can be flexible to different types of data science projects, but ensure a minimum level of consideration and proportionate action.
* Mapping the development processes and involved actors of AI at the NHS and growing a platform to share knowledge and experiences. This will help us to identify how to incorporate ethical considerations into the data science lifecycle.

## Outputs

We have:

* Developed a [Model Card Template](https://github.com/nhsengland/model-card).
* Coordinated the publication of a record for the [Automatic Moderation of Ratings & Reviews project](./ratings-and-reviews.md) on the government's [Algorithmic Transparency Recording Standard](https://www.gov.uk/algorithmic-transparency-records/nhs-england-nhs-dot-uk-reviews-automoderation-tool).
* Written a (currently internal) White Paper defining the scope of operationalising AI Ethics in NHS England.

## In progress

We are currently exploring:

* Using the [Data Hazards project](https://datahazards.com/) to communicate potential harms of our work.
* Developing a generic statement detailing how projects have taken ethical considerations into account.
* Supporting our information governance teams on whether additional instruments (such as model cards) can help inform a Data Protection Impact Assessment for AI use cases.

#
2 changes: 1 addition & 1 deletion docs/our_work/p14_mcr.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
layout: base
title: Using Model Class Reliance to Understand the Impact of Commerical Data on Predictions
permalink: p14_mcr.html
summary: How to asses the value that commercial sales data of over-the-counter prescriptions has on respiratory death predictions
summary: How to assess the value that commercial sales data of over-the-counter prescriptions has on respiratory death predictions
tags: ['MCR', 'PYTHON', 'MORTALITY', 'RESPIRATORY']
---

Expand Down
32 changes: 17 additions & 15 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ plugins:
blog_dir: ./articles
authors_file: "{blog}/.authors.yml"
- tags:
tags_file: our_work/tags.md
tags_file: our_work/tags.md
- exclude-search:
exclude:
- our_work/template-project.md
Expand All @@ -19,29 +19,30 @@ plugins:
nav:
- Home: index.md
- About the team: about.md
- Projects:
- Projects:
- Our Work: our_work/index.md
- Project Tags: our_work/tags.md
- Past/Current Projects:
- Current Projects:
- AI Dictionary: our_work/ai-dictionary.md
- AI Ethics in Practice: our_work/ai-ethics.md
- Data Linkage Hub: our_work/data-linkage-hub/
- NHS.UK Automatic Moderation of Ratings & Reviews: our_work/ratings-and-reviews.md
- Reproducible Analytical Pipelines Squad: our_work/ds218_rap_community_of_practice.md
- Tool to Asses Privacy Risk of Text Data - Extended: our_work/ds255_privacyfp.md
- Tool to Assess Privacy Risk of Text Data - Extended: our_work/ds255_privacyfp.md
- A&E Forecasting Tool: our_work/a_and_e_forecasting_tool.md
- Reusable Data Validation Process: our_work/sde_data_validation.md
- RAG: our_work/ds251_RAG.md
- Primary Care Data Generator: our_work/swpclab.md
- Past Projects:
- Past Projects:
- 2023:
- AI Models for Shortlisting Interview Candidates: our_work/casestudy-recruitment-shortlisting.md
- AI Skunkworks Team: our_work/ai-skunkworks.md
- Deep Learning to Detect Adrenal Lesions in CT Scans: our_work/adrenal-lesions.md
- Enriching Clinical Coding for Neurology Pathways using MedCAT: our_work/p43_medcat.md
- Including Mortality in our Implementation of Hypergraphs: our_work/p42_hypergraphs2.md
- Parkinson's Disease Pathology Prediction: our_work/parkinsons-detection.md
- Tool to Asses Privacy Risk of Text Data: our_work/c399_privfinger.md
- Tool to Assess Privacy Risk of Text Data: our_work/c399_privfinger.md
- 2022:
- Adding a Clinical Focus to Evaluating MM Data Representations: our_work/p31_txtrayalign2.md
- Ambulance Handover Delay Predictor: our_work/ambulance-delay-predictor.md
Expand All @@ -57,11 +58,11 @@ nav:
- Synthetic Data From Real Data: our_work/casestudy-synthetic-data-pipeline.md
- Synthetic Data Generation Pipeline: our_work/synthetic-data-pipeline.md
- Understanding the Impact of Co-Morbidities: our_work/p34_hypergraphs.md
- 2021:
- 2021:
- AI Deep Dive Workshops: our_work/ai-deep-dive.md
- CT Alignment & Lesion Detection: our_work/ct-alignment.md
- Creating a Generic Adversarial Attack for Synthetic Data: our_work/c339_sas.md
- Developing SynthVAE: our_work/p21_synthvae.md
- Developing SynthVAE: our_work/p21_synthvae.md
- Differential Privacy in a VAE for Synthetic Data Generation: our_work/p12_synthvae.md
- Impact of Commercial Data on Predictions: our_work/p14_mcr.md
- Length of Hospital Day Prediction: our_work/long-stay.md
Expand All @@ -71,7 +72,7 @@ nav:
- SynPath Simulator on Diabetes Pathway: our_work/p11_synpathdiabetes.md
- Text Analysis using Structural Topic Modelling: our_work/p23_stm.md
- TxtRayAlign: our_work/p22_txtrayalign.md
- 2020:
- 2020:
- Data Lens: our_work/data-lens.md
- Main Work Areas:
- Predictive Analytics Products:
Expand All @@ -85,7 +86,7 @@ nav:
- Renal Health Prediction: our_work/renal-health-prediction.md
- A&E Forecasting Tool: our_work/a_and_e_forecasting_tool.md
- Data Science for Linked/Longitudinal Data:
- Data Linkage Hub:
- Data Linkage Hub:
- our_work/data-linkage-hub/index.md
# - ... | flat | our_work/data-linkage-hub/*.md
- ... | flat | our_work/data-linkage-hub/linkage-projects/*.md
Expand All @@ -94,11 +95,12 @@ nav:
- AI Models for Shortlisting Interview Candidates: our_work/casestudy-recruitment-shortlisting.md
- Data Lens: our_work/data-lens.md
- NHS.UK Automatic Moderation of Ratings & Reviews: our_work/ratings-and-reviews.md
- Tool to Asses Privacy Risk of Text Data: our_work/c399_privfinger.md
- Tool to Asses Privacy Risk of Text Data - Extended: our_work/ds255_privacyfp.md
- Tool to Assess Privacy Risk of Text Data: our_work/c399_privfinger.md
- Tool to Assess Privacy Risk of Text Data - Extended: our_work/ds255_privacyfp.md
- Data Science Capability:
- AI Deep Dive Workshops: our_work/ai-deep-dive.md
- AI Dictionary: our_work/ai-dictionary.md
- AI Ethics in Practice: our_work/ai-ethics.md
- AI Skunkworks Team: our_work/ai-skunkworks.md
- NHS @Home Programme: our_work/open-safely.md
- Reproducible Analytical Pipelines Squad: our_work/ds218_rap_community_of_practice.md
Expand All @@ -120,7 +122,7 @@ nav:
- Understanding the Impact of Co-Morbidities: our_work/p34_hypergraphs.md
- Synthetic Data:
- Creating a Generic Adversarial Attack for Synthetic Data: our_work/c339_sas.md
- Developing SynthVAE: our_work/p21_synthvae.md
- Developing SynthVAE: our_work/p21_synthvae.md
- Differential Privacy in a VAE for Synthetic Data Generation: our_work/p12_synthvae.md
- Generic Patient Simulator: our_work/c245_synpath.md
- Primary Care Data Generator: our_work/swpclab.md
Expand All @@ -131,12 +133,12 @@ nav:
- SDE Service Data Wranglers:
- Reusable Data Validation Process: our_work/sde_data_validation.md
- Our Team's Publications: our_work/Publications.md
# This allows any projects that get added to appear in the main page of the navigation, makes it easy to spot when people have forgotten to categorize them.
# This allows any projects that get added to appear in the main page of the navigation, makes it easy to spot when people have forgotten to categorize them.
- ... | flat | regex=our_work/(?!template-project\.md).*\.md
# - Tools:
# - Tools:
# - ... | flat | tools/*.md
- PHDInterns: PhDInterns.md
- Articles:
- Articles:
- ... | flat | articles/*.md
- Playbooks: playbooks.md
# - Codebases: codebases.md
Expand Down

0 comments on commit 1ac3de3

Please sign in to comment.