Skip to content

Commit

Permalink
Typo fix in docstring
Browse files Browse the repository at this point in the history
Co-Authored-By: [email protected]

Co-authored-by: Georgi Gerganov <[email protected]>
  • Loading branch information
gabe-l-hart and ggerganov authored Sep 23, 2024
1 parent 474c7fb commit 31ed122
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion convert_hf_to_gguf.py
Original file line number Diff line number Diff line change
Expand Up @@ -4122,7 +4122,7 @@ class GraniteMoeModel(GraniteModel):
def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iterable[tuple[str, Tensor]]:
"""In modeling_granitemoe, the JetMoe implementation of parallel experts
is used. This essentially merges w1 and w3 into a single tensor with 2x
the hidden size that is then split during forward. To keep compativility
the hidden size that is then split during forward. To keep compatibility
with existing mixtral support, we pull them apart here.
"""

Expand Down

0 comments on commit 31ed122

Please sign in to comment.