Skip to content

Commit

Permalink
Typo fix in docstring
Browse files Browse the repository at this point in the history
Co-Authored-By: [email protected]

Co-authored-by: Georgi Gerganov <[email protected]>
Signed-off-by: Gabe Goodhart <[email protected]>
  • Loading branch information
gabe-l-hart and ggerganov committed Sep 23, 2024
1 parent 020349e commit e68431b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion convert_hf_to_gguf.py
Original file line number Diff line number Diff line change
Expand Up @@ -4122,7 +4122,7 @@ class GraniteMoeModel(GraniteModel):
def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iterable[tuple[str, Tensor]]:
"""In modeling_granitemoe, the JetMoe implementation of parallel experts
is used. This essentially merges w1 and w3 into a single tensor with 2x
the hidden size that is then split during forward. To keep compativility
the hidden size that is then split during forward. To keep compatibility
with existing mixtral support, we pull them apart here.
"""

Expand Down

0 comments on commit e68431b

Please sign in to comment.