Skip to content

Commit

Permalink
Added metadata for PyPI and bumped version (#52)
Browse files Browse the repository at this point in the history
  • Loading branch information
shimizust authored Aug 23, 2024
1 parent c03a422 commit 95ac0af
Show file tree
Hide file tree
Showing 3 changed files with 23 additions and 3 deletions.
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ __pycache__/
*.egg-info/
site/
.cache/
.venv/

# Misc
.DS_Store
Expand Down
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,14 @@
## Supercharge Your Model with Liger Kernel


![Banner](/docs/images/banner.GIF)
![Banner](https://raw.githubusercontent.com/linkedin/Liger-Kernel/main/docs/images/banner.GIF)

With one line of code, Liger Kernel can increase throughput by more than 20% and reduce memory usage by 60%, thereby enabling longer context lengths, larger batch sizes, and massive vocabularies.


| Speed Up | Memory Reduction |
|--------------------------|-------------------------|
| ![Speed up](docs/images/e2e-tps.png) | ![Memory](docs/images/e2e-memory.png) |
| ![Speed up](https://raw.githubusercontent.com/linkedin/Liger-Kernel/main/docs/images/e2e-tps.png) | ![Memory](https://raw.githubusercontent.com/linkedin/Liger-Kernel/main/docs/images/e2e-memory.png) |

> **Note:**
> - Benchmark conditions: LLaMA 3-8B, Batch Size = 8, Data Type = `bf16`, Optimizer = AdamW, Gradient Checkpointing = True, Distributed Strategy = FSDP1 on 8 A100s.
Expand Down
21 changes: 20 additions & 1 deletion setup.py
Original file line number Diff line number Diff line change
@@ -1,12 +1,31 @@
from setuptools import find_namespace_packages, setup

__version__ = "0.1.0"
__version__ = "0.1.1"

setup(
name="liger_kernel",
version=__version__,
description="Efficient Triton kernels for LLM Training",
long_description=open("README.md").read(),
long_description_content_type="text/markdown",
license="BSD-2-Clause",
url="https://github.com/linkedin/Liger-Kernel",
package_dir={"": "src"},
packages=find_namespace_packages(where="src"),
classifiers=[
'Development Status :: 4 - Beta',
'Intended Audience :: Developers',
'Intended Audience :: Science/Research',
'Intended Audience :: Education',
'License :: OSI Approved :: BSD License',
'Programming Language :: Python :: 3',
'Programming Language :: Python :: 3.8',
'Programming Language :: Python :: 3.9',
'Programming Language :: Python :: 3.10',
'Topic :: Software Development :: Libraries',
'Topic :: Scientific/Engineering :: Artificial Intelligence',
],
keywords="triton,kernels,LLM training,deep learning,Hugging Face,PyTorch,GPU optimization",
include_package_data=True,
install_requires=[
"torch>=2.1.2",
Expand Down

0 comments on commit 95ac0af

Please sign in to comment.