Home

Welcome to the AutoGGUF wiki!

Table of Contents

1. Introduction

   • Overview of AutoGGUF
   • Purpose and Features

2. System Requirements

   • RAM and CPU Usage
   • Software Dependencies

3. Installation

   • Downloading AutoGGUF
   • Setting Up the Environment

4. User Interface

   • Main Features and Layout
   • Navigation Guide

5. Quantization Settings

   • Quantization Types
   • Include/Exclude Weights
   • Key Overrides

6. Model Management

   • Refreshing Models
   • Paths for Models and Output

7. Matrix Generation

   • Generating iMatrix
   • Configuration Options
   • Output Frequency and Size

8. LoRA Conversion

   • Input and Output Paths
   • Output Types
   • Converting LoRA Models

9. Export Options

   • Exporting LoRA Models
   • GGML LoRA Adapters
   • Adding and Managing Adapters

10. Tasks

    • Quantizing Models
    • Saving and Loading Presets

11. Troubleshooting

    • Common Issues
    • FAQs

12. References

    • Support and Documentation
    • Additional Resources

13. Contributing

    • How to Contribute