Skip to content

evakravi/llm-hosting-container

 
 

Repository files navigation

LLM Hosting Container

Welcome to the LLM Hosting Container GitHub repository!

This repository contains Dockerfile and associated resources for building and hosting containers for large language models.

  • HuggingFace Text Generation Inference (TGI) container

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.

About

Large Language Model Hosting Container

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Dockerfile 93.8%
  • Python 4.6%
  • Shell 1.6%