Initial commit

.clang-format

@@ -0,0 +1,8 @@
+# Run the following command to reformat a file:
+# clang-format -i -style=Google <file>
+# Or use clang-format-diff to only reformat the changed lines:
+# https://clang.llvm.org/docs/ClangFormat.html
+BasedOnStyle: Google
+DerivePointerAlignment: false
+ColumnLimit:     100
+PointerAlignment: Left

.github/ISSUE_TEMPLATE/bug-report.md

@@ -0,0 +1,43 @@
+---
+name: "🐛 Bug Report"
+about: Submit a bug report to help us improve MLC-LLM
+title: '[Bug] '
+labels: ['bug']
+assignees: ''
+
+---
+
+## 🐛 Bug
+
+<!-- A clear and concise description of what the bug is. -->
+
+## To Reproduce
+
+Steps to reproduce the behavior:
+
+1.
+1.
+1.
+
+<!-- If you have a code sample, error messages, stack traces, please provide it here as well -->
+
+## Expected behavior
+
+<!-- A clear and concise description of what you expected to happen. -->
+
+## Environment
+
+ - Platform (e.g. WebGPU/Vulkan/IOS/Android/CUDA):
+ - Operating system (e.g. Ubuntu/Windows/MacOS/...):
+ - Device (e.g. iPhone 12 Pro, PC+RTX 3090, ...)
+ - How you installed MLC-LLM (`conda`, source):
+ - How you installed TVM-Unity (`pip`, source):
+ - Python version (e.g. 3.10):
+ - GPU driver version (if applicable):
+ - CUDA/cuDNN version (if applicable):
+ - TVM Unity Hash Tag (`python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))"`, applicable if you compile models):
+ - Any other relevant information:
+
+## Additional context
+
+<!-- Add any other context about the problem here. -->

.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1,9 @@
+blank_issues_enabled: false
+
+contact_links:
+  - name: Check the MLC-LLM Documentation
+    url: https://llm.mlc.ai/docs/
+    about: Our documentation might provide answers to your questions.
+  - name: Chat on Discord
+    url: https://discord.gg/9Xpy2HGBuD
+    about: Join the Discord Server to live chat with the community.

.github/ISSUE_TEMPLATE/documentation.md

@@ -0,0 +1,17 @@
+---
+name: "\U0001F4DA Documentation"
+about: Report an issue related to https://llm.mlc.ai/docs/
+title: '[Doc] '
+labels: ['documentation']
+assignees: ''
+
+---
+
+## 📚 Documentation
+
+### Suggestion
+<!-- Please leave your general suggestion to our documentation here. -->
+
+### Bug
+- Link to the buggy documentation/tutorial: 
+- Description of the bug:

.github/ISSUE_TEMPLATE/feature-request.md

@@ -0,0 +1,23 @@
+---
+name: "\U0001F680 Feature Request"
+about: Submit a proposal/request for a new MLC-LLM feature, or an enhancement on existing features.
+title: '[Feature Request] '
+labels: ['feature request']
+assignees: ''
+
+---
+
+## 🚀 Feature
+<!-- A brief description of the feature proposal -->
+
+## Motivation
+
+<!-- Please outline the motivation for the proposal, and how could this feature benefit the MLC-LLM project/community. -->
+
+## Alternatives
+
+<!-- A clear and concise description of any alternative solutions or features you've considered, if any. -->
+
+## Additional context
+
+<!-- Add any other context or screenshots about the feature request here. -->

.github/ISSUE_TEMPLATE/general.md

@@ -0,0 +1,13 @@
+---
+name: "❓ General Questions"
+about: General questions you have about MLC-LLM.
+title: '[Question] '
+labels: ['question']
+assignees: ''
+
+---
+
+## ❓ General Questions
+
+<!-- Describe your questions -->
+

.github/ISSUE_TEMPLATE/model-request.md

@@ -0,0 +1,17 @@
+---
+name: "️️⚙️  Model Request"
+about: Request a new model in MLC-LLM
+title: '[Model Request] '
+labels: ['new-models']
+assignees: ''
+
+---
+
+## ⚙️  Request New Models
+
+- Link to an existing implementation (e.g. Hugging Face/Github): <!-- Link to the model -->
+- Is this model architecture supported by MLC-LLM? (the list of [supported models](https://llm.mlc.ai/docs/prebuilt_models.html)) <!-- Yes/No -->
+
+## Additional context
+
+<!-- Add any other context that you think would be helpful for the community to add this model -->

.github/ISSUE_TEMPLATE/speed-report.md

@@ -0,0 +1,24 @@
+---
+name: " 🏎️  Speed Report"
+about: Submit a speed report of an model running in MLC-LLM
+title: '[Speed] '
+labels: ['performance']
+assignees: ''
+
+---
+
+# 🏎️  Speed Report
+
+<!-- Please search if there are existing issues discuss the speed of the model you are using, if there are, we encourage you reply in the existed issue instead of creating a new one. -->
+
+- The model code: <!-- e.g. vicuna-7b-1.1 -->
+
+
+- The model configuration (e.g. quantization mode, running data type, etc.):
+- Device (e.g. MacBook Pro M2, PC+RTX 3080): 
+- OS (if applicable):
+- Encode speed (Token/s):
+- Decode speed (Token/s):
+- Memory usage (if applicable):
+
+<!-- Note that the measured speed might reflect peak performance if the prompt/chat history is short. -->

.github/ISSUE_TEMPLATE/tracking.md

@@ -0,0 +1,40 @@
+---
+name: "Tracking"
+about: A tracking issue that tracks ongoing item in the project
+title: '[Tracking] '
+labels: ['status: tracking']
+assignees: ''
+
+---
+
+<!--
+
+A tracking issue contains a list of action items
+that can be executed to complete a feature or fix.
+
+We use tracking issues when we have a clear list of action items
+related to feature items as they provide fine-grained
+view of action items and provide clarity on what it takes to implement a feature.
+
+When to open a tracking issue: Open a new tracking issue when you have
+clear, actionable items (as a rule of thumb, make sure action items
+items can be carried through if you are assigned to work on it and
+you can provide enough guides to others who plan to work on these actions).
+-->
+
+
+## Overview
+<!-- A brief overview of the task  -->
+
+
+
+## Action Items
+<!-- Please list set of action items to complete -->
+
+- [ ]
+
+
+## Links to Related Issues and PRs
+
+<!-- Cross link feature requests bug report issues related to the tracking item -->
+<!-- When there are new PRs, open up new PRs -->

.github/workflows/documentation.yml

@@ -0,0 +1,39 @@
+name: Build Docs
+
+on:
+  push:
+    branches:
+      - main
+
+jobs:
+  test_linux:
+    name: Deploy Docs
+    runs-on: ubuntu-latest
+
+    steps:
+    - uses: actions/checkout@v2
+      with:
+        submodules: recursive
+
+    - name: Configuring build Environment
+      run: |
+        sudo apt-get update
+        python -m pip install -U pip wheel
+
+    - name: Setup Ruby
+      uses: ruby/setup-ruby@v1
+      with:
+        ruby-version: '3.0'
+
+    - name: Installing dependencies
+      run: |
+        python -m pip install -r docs/requirements.txt
+        gem install jekyll jekyll-remote-theme
+
+    - name: Deploying on GitHub Pages
+      if: github.ref == 'refs/heads/main'
+      run: |
+        git remote set-url origin https://x-access-token:${{ secrets.MLC_GITHUB_TOKEN }}@github.com/$GITHUB_REPOSITORY
+        git config --global user.email "mlc-gh-actions-bot@nomail"
+        git config --global user.name "mlc-gh-actions-bot"
+        ./scripts/gh_deploy_site.sh

.github/workflows/update-relax.yml

@@ -0,0 +1,32 @@
+name: 'Relax Submodule Sync'
+
+on:
+  workflow_dispatch:
+
+jobs:
+  sync:
+    name: 'Relax Submodule Sync'
+    runs-on: ubuntu-latest
+
+    defaults:
+      run:
+        shell: bash
+
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+      with:
+        submodules: true
+
+    - name: Git Sumbodule Update
+      run: |
+        git submodule update --remote 3rdparty/tvm
+
+    - name: Commit update
+      env:
+        GITHUB_TOKEN: ${{ secrets.MLC_GITHUB_TOKEN }}
+      run: |
+        git config --global user.name 'Git bot'
+        git config --global user.email '[email protected]'
+        git remote set-url origin https://[email protected]/mlc-ai/mlc-llm
+        git commit -am "Auto updated submodule references" && git push || echo "No changes to commit"