diff --git a/admin_manual/ai/app_assistant.rst b/admin_manual/ai/app_assistant.rst index 4bd058e25ee..7079f1bbeba 100644 --- a/admin_manual/ai/app_assistant.rst +++ b/admin_manual/ai/app_assistant.rst @@ -44,6 +44,7 @@ Machine translation In order to make use of machine translation features in the assistant, you will need an app that provides a translation backend: * :ref:`translate` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request) +* :ref:`translate2 (ExApp)` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request) * *integration_deepl* - Integrates with the deepl API to provide translation functionality from Deepl.com servers (Only community supported) * *integration_libretranslate* - Integrates with the open source LibreTranslate API to provide translation functionality hosted commercially or on your own hardware (Only community supported) diff --git a/admin_manual/ai/app_translate.rst b/admin_manual/ai/app_translate.rst index 3ebcf8e92e2..c8d4bf40b82 100644 --- a/admin_manual/ai/app_translate.rst +++ b/admin_manual/ai/app_translate.rst @@ -94,7 +94,7 @@ Positive: * the trained model is freely available, and thus can be run on-premises * the training data is freely available, making it possible to check or correct for bias or optimise the performance and CO2 usage. -Learn more about the Nextcloud Ethical AI Rating `in our blog`. +Learn more about the Nextcloud Ethical AI Rating `in our blog _`. Known Limitations ----------------- diff --git a/admin_manual/ai/app_translate2.rst b/admin_manual/ai/app_translate2.rst new file mode 100644 index 00000000000..df162946308 --- /dev/null +++ b/admin_manual/ai/app_translate2.rst @@ -0,0 +1,74 @@ +============================================= +App: Local Machine translation 2 (translate2) +============================================= + +.. _ai-app-translate2: + +The *translate2* app is one of the apps that provide machine translation functionality in Nextcloud and act as a translation backend for the :ref:`Nextcloud Assistant app`. The *translate2* app specifically runs only open source models and does so entirely on-premises. Nextcloud can provide customer support upon request, please talk to your account manager for the possibilities. + +The app currently supports 400+ languages. See the complete list here: https://huggingface.co/datasets/allenai/MADLAD-400 + +Requirements +------------ + +* Minimal Nextcloud version: 30 +* This app is built as an External App and thus depends on AppAPI v3.1.0 or higher +* Nextcloud AIO is supported +* We currently support NVIDIA GPUs and x86_64 CPUs +* CUDA >= v12.2.2 on your host system +* GPU Sizing + + * A NVIDIA GPU with at least 4 GB VRAM + * At least 6 GB of system RAM + +* CPU Sizing + + * x86 CPU with 4-8 cores for the app to use (The more cores the faster it will be) + * At least 6 GB of RAM for the app should be enough (includes software+libraries and the model) + +Space usage +~~~~~~~~~~~ + + * ~ 2.95 GB for the docker container + * ~ 2.77 GB for the default model + +Installation +------------ + +0. Make sure the :ref:`Nextcloud Assistant app` is installed +1. :ref:`Install AppAPI and setup a Deploy Demon` +2. Install the "Local Machine Translation" (translate2) ExApp via the "External Apps" page in the Nextcloud web admin user interface + +App store +--------- + +You can also find the app in our app store, where you can write a review: ``_ + +Repository +---------- + +You can find the app's code repository on GitHub where you can report bugs and contribute fixes and features: ``_ + +Nextcloud customers should file bugs directly with our Customer Support. + +Ethical AI Rating +----------------- + +Rating: 🟢 +~~~~~~~~~~ + +Positive: +* the software for training and inference of this model is open source +* the trained model is freely available, and thus can be run on-premises +* the training data is freely available, making it possible to check or correct for bias or optimise the performance and CO2 usage. + +Learn more about the Nextcloud Ethical AI Rating `in our blog `_. + +Known Limitations +----------------- + +* AI translations are not a replacement for human professional translations and in many cases post-editing is required. AI translations can be used for understanding the main content of a text but not for translations that require special knowledge (such as technical content or legal content), or translations that require specific writing style to convey style, deeper meaning, or emotions (such as marketing content or translating books). +* While the quality of the output will be fine for the most common languages (English, French, Spanish) the quality will suffer for languages that have less coverage in the original training set. +* Make sure to test the translation model you are using it for whether it meets the use-case's quality requirements +* Language models notoriously have a high energy consumption +* Customer support is available upon request, however we can't solve false or problematic output, most performance issues, or other problems caused by the underlying models. Support is thus limited only to bugs directly caused by the implementation of the app (connectors, API, front-end, AppAPI) diff --git a/admin_manual/ai/index.rst b/admin_manual/ai/index.rst index d86935c8c0a..0bfab9442c3 100644 --- a/admin_manual/ai/index.rst +++ b/admin_manual/ai/index.rst @@ -8,6 +8,7 @@ Artificial Intelligence overview app_assistant app_translate + app_translate2 app_llm2 app_stt_whisper2 app_recognize diff --git a/admin_manual/ai/overview.rst b/admin_manual/ai/overview.rst index 266fcf3b3ff..c6ab356f73c 100644 --- a/admin_manual/ai/overview.rst +++ b/admin_manual/ai/overview.rst @@ -23,6 +23,7 @@ Nextcloud uses modularity to separate raw AI functionality from the Graphical Us "Related resources","`Related Resources `_","Green","Yes","Yes","Yes","Yes" "Recommended files","recommended_files","Green","Yes","Yes","Yes","Yes" "Machine translation","`Translate `_","Green","Yes","Yes - Opus models by University Helsinki","Yes","Yes" + "","`Local Machine Translation 2 (ExApp) `_","Green","Yes","Yes - MADLAD models by Google","Yes","Yes" "","`LibreTranslate integration `_","Green","Yes","Yes - OpenNMT models","Yes","Yes" "","`DeepL integration `_","Red","No","No","No","No" "","`OpenAI and LocalAI integration (via OpenAI API) `_","Red","No","No","No","No" @@ -85,6 +86,7 @@ Backend apps ~~~~~~~~~~~~ * :ref:`translate` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request) +* :ref:`translate2 (ExApp)` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request) * *integration_deepl* - Integrates with the deepl API to provide translation functionality from Deepl.com servers (Only community supported) * *integration_libretranslate* - Integrates with the open source LibreTranslate API to provide translation functionality hosted commercially or on your own hardware (Only community supported)