Skip to content

Commit

Permalink
copy
Browse files Browse the repository at this point in the history
  • Loading branch information
paul-gauthier committed Nov 24, 2024
1 parent 1d09e96 commit e56651e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions aider/website/_posts/2024-11-21-quantization.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: Quantization matters
excerpt: Open source LLMs are becoming very powerful, but pay attention to how you (or your provider) is quantizing the model. It can strongly affect code editing skill.
excerpt: Open source LLMs are becoming very powerful, but pay attention to how you (or your provider) is quantizing the model. It can affect code editing skill.
highlight_image: /assets/quantization.jpg
draft: false
nav_exclude: true
Expand All @@ -14,7 +14,7 @@ nav_exclude: true
Open source models like Qwen 2.5 32B Instruct are performing very well on
aider's code editing benchmark, rivaling closed source frontier models.
But pay attention to how your model is being quantized, as it
can strongly impact code editing skill.
can impact code editing skill.
Heavily quantized models are often used by cloud API providers
and local model servers like Ollama or MLX.

Expand Down

0 comments on commit e56651e

Please sign in to comment.