How to install the Enterprise grade AI Playground from Hugging Face: Text Generation Inference (TGI)

How to install the Enterprise grade AI Playground from Hugging Face: Text Generation Inference (TGI)

Need a highly scalable backend that’s secure and cost effective? Need it to be ultra-low cost? Want it to be opensource and backed up by a top tier company? The Text Generation Interface (TGI) platform from Hugging Face fits the bill. Host your own AI playground.

With your own Enterprise Grade AI playground, you can host all the top models and use cases for your company. Best of all you can configure the solution to run 100% privately with no Internet requirements. Data stays internal and never leaves your network. We show you how!

In this “How to” video we cover what the Text Generation Interface software is used for, and we share a detailed step by step installation guide. We also share exclusive content on how to run it 100% privately with scripts you can use to do it safely and securely.

Links:
Hugging Face TGI Docs:
https://huggingface.co/docs/text-generation-inference/index

Huggin Face Github:
https://github.com/huggingface/text-generation-inference

WSL2 on Windows11 with Cuda 11.8
https://www.youtube.com/watch?v=1HzYU2_t3yc&t=22s&pp=ygUYd3NsMiB3aW5kb3dzIDExIGFuZCBjdWRh

Ai_by_AI Github link to scripts and files:
https://github.com/jjmlovesgit/TGIfiles/blob/main/README.md

Installation Steps:
https://github.com/jjmlovesgit/TGIfiles/blob/main/Install%20Steps

Leave a Reply

Your email address will not be published. Required fields are marked *

Scroll to top