NHSX AU-Data Engineering - Azure Databricks Analytics

Azure Databricks Analytics

NHSX Analytics Unit - Data Engineering Team
Explore the docs »

Report Bug · Request Feature

Table of Contents

1. About The Project
   • Built With
2. Getting Started
   • Installation
3. Usage
4. Roadmap
5. Contributing
6. License
7. Contact

About The Project

NHSX Analytics Unit - Data Engineering Team. Databricks analytics repository. Contains ETL pipeline notebooks for NHSX analytics projects.

Note: No data, public or private are shared in this repository.

Folder Stucture

Name	Link	Description
Orchestrator Notebooks	[Link]	Azure Data Factory notebooks for running ephemeral job clusters
Function Notebooks	[Link]	Helper functions used across all notebooks
Analytics Notebooks	[Link]	Analytical pipeline specific code
Ingestion Notebooks	[Link]	Data ingestion pipeline specific code
Debug Notebooks	[Link]	For testing new code and reference

Built With

• Databricks
• Python 3
• Azure

Getting Started

To get a local copy up and running follow these simple steps.

Installation

1. Clone the repo

   git clone https://github.com/nhsx/au-azure-databricks.git

2. Link to Azure Databricks, see databricks documentation

Usage

Please refer to our Read the Docs site

Roadmap

See the open issues for a list of proposed features (and known issues).

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

See CONTRIBUTING.md for detailed guidance.

License

Distributed under the MIT License. See LICENSE.md for more information.

About

Project contact email: [email protected]

To find out more about the Analytics Unit visit our project website or get in touch at [email protected]