-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add initial page for ANT-ACE for CGO 2025 tutorial
- Loading branch information
1 parent
bac8479
commit 5569f97
Showing
1 changed file
with
39 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,39 @@ | ||
--- | ||
layout: default | ||
--- | ||
|
||
<h2>CGO Tutorial</h2> | ||
<h2>ANT-ACE: Advanced Compiler Ecosystem for Domain Specific Computing and Its Application in Fully Homomorphic Encryption</h2> | ||
|
||
**ANT-ACE** is currently being developed at the Ant Research Institute to establish a cutting-edge compiler ecosystem, specifically tailored to meet the dynamic compilation needs of domain-specific languages and advanced computer architectures. ANT-ACE is dedicated to providing a stable and robust compiler infrastructure that features a flexible and extensible type system, complemented by robust support for domain-specific operations. | ||
|
||
Leveraging the ANT-ACE compiler infrastructure, the Ant Research Institute has developed an FHE compiler designed to facilitate neural network inference on encrypted data. This compiler accepts ONNX models as input and produces optimized C/C++ programs as output, utilizing the institute's own open-source FHE library. Initial evaluations conducted on CPUs indicate that ANT-ACE delivers a 2.24x performance enhancement in processing ResNet models, surpassing the results of expert-coded implementations. | ||
|
||
This tutorial is based on a CGO’25 Tool Paper titled "An FHE Compiler Framework for Automating Neural Network Inference," recently accepted for presentation at CGO’25. The primary goal of this tutorial is to introduce participants to the ANT-ACE compiler ecosystem, emphasizing the design objectives and foundational principles of the infrastructure. We will discuss how to enhance this infrastructure to create a domain-specific compiler. The session will provide a detailed examination of both the compiler infrastructure and the FHE compiler. Participants will learn how a pre-trained neural network model, provided in an ONNX file, is compiled into a Fully Homomorphic Encryption (FHE) program, enabling the performance of neural network inference on encrypted data. This thorough overview is designed to equip attendees with the knowledge necessary to understand and potentially extend the ANT-ACE ecosystem for their own domain-specific applications. | ||
|
||
Tutorial Outline for CGO’25: ANT-ACE Compiler Ecosystem | ||
1. ANT-ACE Design Objectives, Principles, and Architecture | ||
• Compiler Infrastructure Design Objectives: Overview of the goals driving the ANT-ACE development. | ||
• Design Principles: Core concepts and methodologies guiding the architecture and functionality. | ||
• Architecture: Detailed discussion on the multi-layered architecture, emphasizing continuous lowering through multiple levels of Intermediate Representation (IR) abstraction. | ||
2. ANT-ACE for Automatic FHE Neural Network Inference | ||
• Compilation Pipeline Overview: Step-by-step guide through the ANT-ACE FHE compiler’s workflow. | ||
• FHE Compiler Front-End: Introduction to the initial stages of the compilation process. | ||
• Levels of IR: Exploration of the five levels of IR used to compile a neural network computational graph into an FHE CKKS program. | ||
• CKKS Parameter Selection: Strategies for optimal parameter selection within the CKKS framework. | ||
• FHE Noise Management: Techniques for managing encryption noise to maintain computational accuracy. | ||
• Debug Facilities: Features for debugging including selective encryption, runtime tracing, and validation. | ||
3. ANT-ACE Case Study and Demo: SecureChat via Llama Inference in FHE | ||
• PyTorch Integration: How ANT-ACE interfaces with PyTorch to facilitate neural network modeling. | ||
• Llama Operator Support: How to extend ANT-ACE framework for specific support for new operators. | ||
• Performance Issues: Addressing performance bottlenecks and optimization strategies. | ||
• Data Exploding Issue: Tackling challenges related to data growth during computations. | ||
|
||
The target audience for this tutorial encompasses researchers and graduate students specializing in compiler technology and Fully Homomorphic Encryption (FHE), with particular interest in cryptographic application development, hardware accelerator research, and cryptographic algorithm research. | ||
|
||
Expected duration: half day | ||
|
||
Expected attendance Approximately 30 participants | ||
|
||
URL for tutorial: To be set up | ||
https://ant-research.github.io/ace-compiler/cgo2025-tutorial.html |