👨‍🏫 Tutorial List of Self-Hosting Tools

[unit2000]

• You do not have permission to view the full content of this post. Log in or register now. - Self-Hosted
• You do not have permission to view the full content of this post. Log in or register now. - Frontend for LLMs
• You do not have permission to view the full content of this post. Log in or register now. - Self-Host Transformer-Based LLMs / You do not have permission to view the full content of this post. Log in or register now.
• You do not have permission to view the full content of this post. Log in or register now. - llama.cpp with API + GUI / You do not have permission to view the full content of this post. Log in or register now. / You do not have permission to view the full content of this post. Log in or register now.
• You do not have permission to view the full content of this post. Log in or register now. - Single Click AI Model Installer /
• You do not have permission to view the full content of this post. Log in or register now. - Self-Host Models / You do not have permission to view the full content of this post. Log in or register now.
• You do not have permission to view the full content of this post. Log in or register now. - Serve LLMs at Scale with Kobold & OpenAI APIs / You do not have permission to view the full content of this post. Log in or register now.
• You do not have permission to view the full content of this post. Log in or register now. - LLM Playground
• You do not have permission to view the full content of this post. Log in or register now. - Self-Hosted
• You do not have permission to view the full content of this post. Log in or register now. - Self-Hosted
• You do not have permission to view the full content of this post. Log in or register now. - Self-Hosted
• You do not have permission to view the full content of this post. Log in or register now. - Self-Hosted /
• You do not have permission to view the full content of this post. Log in or register now. - Run LLM with Single Files
• You do not have permission to view the full content of this post. Log in or register now. - Generative AI Guides

 

[alist1986]

Ito dapat yung startup sa chatbots sa ngayon para less dependent sa online use. Pag familiar ka na sa iba dyan, just install Pinokio for a near complete AI package for AI - for text, image, audio, video, etc. Kailangan mo lang ng good hardware sa may mataas ang requirements. But most run in cpu mode kung text generation lang locally, or opt for using online LLM apis para bumilis with TTS/STT locally. Additional RAM ang kailangan kung gagamit ng malaking model instead of using high-end GPU. Use "true" C++ based apps and onnx runtime at the least for potato pc para mabilis ang inference. Kalimitan dyan, one or two clicks to run and doesn't need coding or programming knowledge. You just need to learn to follow text instructions using provided documentations. In the end, any AI you want is free giving you the same results compared with the commercial counterparts - combining local and free online apis.

 

[unit2000]

Ito dapat yung startup sa chatbots sa ngayon para less dependent sa online use. Pag familiar ka na sa iba dyan, just install Pinokio for a near complete AI package for AI - for text, image, audio, video, etc. Kailangan mo lang ng good hardware sa may mataas ang requirements. But most run in cpu mode kung text generation lang locally, or opt for using online LLM apis para bumilis with TTS/STT locally. Additional RAM ang kailangan kung gagamit ng malaking model instead of using high-end GPU. Use "true" C++ based apps and onnx runtime at the least for potato pc para mabilis ang inference. Kalimitan dyan, one or two clicks to run and doesn't need coding or programming knowledge. You just need to learn to follow text instructions using provided documentations. In the end, any AI you want is free giving you the same results compared with the commercial counterparts - combining local and free online apis.

ty sa feedback paps