Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 319 36

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 231 12

  3. MagicPIG MagicPIG Public

    MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 104 4

  4. MagicDec MagicDec Public

    Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 82 4

  5. Sirius Sirius Public

    Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its efficiency gain.

    Python 19 4

  6. Factor Factor Public

    1

Repositories

Showing 10 of 10 repositories
  • MagicDec Public

    Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Infini-AI-Lab/MagicDec’s past year of commit activity
    Python 82 Apache-2.0 4 6 0 Updated Nov 28, 2024
  • MagicPIG Public

    MagicPIG: LSH Sampling for Efficient LLM Generation

    Infini-AI-Lab/MagicPIG’s past year of commit activity
    Python 104 Apache-2.0 4 1 0 Updated Nov 27, 2024
  • Factor Public
    Infini-AI-Lab/Factor’s past year of commit activity
    1 0 0 0 Updated Nov 7, 2024
  • MagicDec-part1 Public

    Speculative decoding for high-throughput long-context inference

    Infini-AI-Lab/MagicDec-part1’s past year of commit activity
    JavaScript 0 Apache-2.0 0 0 0 Updated Sep 10, 2024
  • Sirius Public

    Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its efficiency gain.

    Infini-AI-Lab/Sirius’s past year of commit activity
    Python 19 4 0 0 Updated Sep 10, 2024
  • MagicDec-part2 Public

    MagicDec: Breaking the Latency-Throughput Tradeoff for Long Contexts with Speculative Decoding

    Infini-AI-Lab/MagicDec-part2’s past year of commit activity
    JavaScript 0 Apache-2.0 0 0 0 Updated Sep 5, 2024
  • TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Infini-AI-Lab/TriForce’s past year of commit activity
    Python 231 12 6 (5 issues need help) 0 Updated Aug 31, 2024
  • Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Infini-AI-Lab/Sequoia’s past year of commit activity
    Python 319 36 7 3 Updated Aug 13, 2024
  • lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    Infini-AI-Lab/lm-evaluation-harness’s past year of commit activity
    Python 0 MIT 1,913 0 0 Updated Jun 10, 2024
  • Sequoia-Page Public
    Infini-AI-Lab/Sequoia-Page’s past year of commit activity
    JavaScript 0 0 0 0 Updated May 21, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.