Skip to content

Commit

Permalink
Deployed c87fcfb to 0.4 with MkDocs 1.6.0 and mike 2.1.3
Browse files Browse the repository at this point in the history
  • Loading branch information
@gitlawr
gitlawr committed Dec 6, 2024
1 parent c87fcfb commit 990b339
Show file tree
Hide file tree
Showing 5 changed files with 65 additions and 53 deletions.
16 changes: 16 additions & 0 deletions 0.4/installation/air-gapped-installation/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1688,6 +1688,16 @@ <h3 id="step-1-download-the-required-packages">Step 1: Download the Required Pac
<span class="c1"># Download dependency tools and save them as an archive</span>
gpustack<span class="w"> </span>download-tools<span class="w"> </span>--save-archive<span class="w"> </span>gpustack_offline_tools.tar.gz
</code></pre></div>
<p>Optional: Additional Dependencies for macOS.</p>
<div class="highlight"><pre><span></span><code><span class="c1"># Deploying the speech-to-text CosyVoice model on macOS requires additional dependencies.</span>
brew<span class="w"> </span>install<span class="w"> </span>openfst
<span class="nv">CPLUS_INCLUDE_PATH</span><span class="o">=</span><span class="k">$(</span>brew<span class="w"> </span>--prefix<span class="w"> </span>openfst<span class="k">)</span>/include
<span class="nv">LIBRARY_PATH</span><span class="o">=</span><span class="k">$(</span>brew<span class="w"> </span>--prefix<span class="w"> </span>openfst<span class="k">)</span>/lib

<span class="nv">AUDIO_DEPENDENCY_PACKAGE_SPEC</span><span class="o">=</span><span class="s2">&quot;wetextprocessing&quot;</span>
pip<span class="w"> </span>wheel<span class="w"> </span><span class="nv">$AUDIO_DEPENDENCY_PACKAGE_SPEC</span><span class="w"> </span>-w<span class="w"> </span>gpustack_audio_dependency_offline_packages
mv<span class="w"> </span>gpustack_audio_dependency_offline_packages/*<span class="w"> </span>gpustack_offline_packages/<span class="w"> </span><span class="o">&amp;&amp;</span><span class="w"> </span>rm<span class="w"> </span>-rf<span class="w"> </span>gpustack_audio_dependency_offline_packages
</code></pre></div>
<div class="admonition note">
<p class="admonition-title">Note</p>
<p>This instruction assumes that the online environment uses the same GPU type as the air-gapped environment. If the GPU types differ, use the <code>--device</code> flag to specify the device type for the air-gapped environment. Refer to the <a href="../../cli-reference/download-tools/">download-tools</a> command for more information.</p>
Expand All @@ -1706,6 +1716,12 @@ <h3 id="step-3-install-gpustack">Step 3: Install GPUStack</h3>
<span class="c1"># Load and apply the pre-downloaded tools archive</span>
gpustack<span class="w"> </span>download-tools<span class="w"> </span>--load-archive<span class="w"> </span>gpustack_offline_tools.tar.gz
</code></pre></div>
<p>Optional: Additional Dependencies for macOS.</p>
<div class="highlight"><pre><span></span><code><span class="c1"># Install the additional dependencies for speech-to-text CosyVoice model on macOS.</span>
brew<span class="w"> </span>install<span class="w"> </span>openfst

pip<span class="w"> </span>install<span class="w"> </span>--no-index<span class="w"> </span>--find-links<span class="o">=</span>gpustack_offline_packages<span class="w"> </span>wetextprocessing
</code></pre></div>
<p>Now you can run GPUStack by following the instructions in the <a href="../manual-installation/#run-gpustack">Manual Installation</a> guide.</p>


Expand Down
8 changes: 2 additions & 6 deletions 0.4/overview/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1762,12 +1762,8 @@ <h2 id="supported-accelerators">Supported Accelerators</h2>
<p>We plan to support the following accelerators in future releases.</p>
<ul class="task-list">
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> AMD ROCm</li>
<li class="task-list-item">
<p><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Intel oneAPI</p>
</li>
<li class="task-list-item">
<p><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Qualcomm AI Engine</p>
</li>
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Intel oneAPI</li>
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Qualcomm AI Engine</li>
</ul>
<h2 id="supported-models">Supported Models</h2>
<p>GPUStack uses <a href="https://github.com/gpustack/llama-box">llama-box</a> (bundled <a href="https://github.com/ggerganov/llama.cpp">llama.cpp</a> and <a href="https://github.com/leejet/stable-diffusion.cpp">stable-diffusion.cpp</a> server), <a href="https://github.com/vllm-project/vllm">vLLM</a> and <a href="https://github.com/gpustack/vox-box">vox-box</a> as the backends and supports a wide range of models. Models from the following sources are supported:</p>
Expand Down
2 changes: 1 addition & 1 deletion 0.4/search/search_index.json
View file

Large diffs are not rendered by default.

92 changes: 46 additions & 46 deletions 0.4/sitemap.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,232 +2,232 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://docs.gpustack.ai/0.4/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/api-reference/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/architecture/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/code-of-conduct/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/contributing/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/development/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/overview/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/quickstart/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/scheduler/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/troubleshooting/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/upgrade/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/cli-reference/chat/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/cli-reference/download-tools/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/cli-reference/draw/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/cli-reference/start/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/installation/air-gapped-installation/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/installation/docker-installation/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/installation/installation-script/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/installation/manual-installation/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/installation/uninstallation/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/creating-text-embeddings/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/inference-on-cpus/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/inference-with-function-calling/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/performing-distributed-inference-across-workers/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/running-inference-with-ascend-npus/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/running-inference-with-moorethreads-gpus/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/running-on-copilot-plus-pcs-with-snapdragon-x/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/setting-up-a-multi-node-gpustack-cluster/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/using-audio-models/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/using-image-generation-models/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/using-reranker-models/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/tutorials/using-vision-language-models/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/api-key-management/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/image-generation-apis/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/inference-backends/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/model-management/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/openai-compatible-apis/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/pinned-backend-versions/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/rerank-api/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/user-management/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/audio/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/chat/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/embedding/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/image/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/rerank/</loc>
<lastmod>2024-12-05</lastmod>
<lastmod>2024-12-06</lastmod>
<changefreq>daily</changefreq>
</url>
</urlset>
Binary file modified 0.4/sitemap.xml.gz
View file
Binary file not shown.

0 comments on commit 990b339

Please sign in to comment.