An app that brings language models directly to your phone.

[Primordial Ultima]

PocketPal AI is a pocket-sized AI assistant powered by small language models (SLMs) that run directly on your phone. Designed for both iOS and Android, PocketPal AI lets you interact with various SLMs without the need for an internet connection. Your privacy is fully protected as all processing happens entirely on-device — your conversations, prompts, and data never leave your phone or get stored on external servers.

Features​

• Offline AI Assistance: Run language models directly on your device without internet connectivity.
• Model Flexibility: Download and swap between multiple SLMs, including Danube 2 and 3, Phi, Gemma 2, and Qwen.
• Auto Offload/Load: Automatically manage memory by offloading models when the app is in the background.
• Inference Settings: Customize model parameters like system prompt, temperature, BOS token, and chat templates.
• Real-Time Performance Metrics: View tokens per second and milliseconds per token during AI response generation.
• Message Editing: Edit your messages and retry AI generation.
• Personalized Pals: Create different AI personalities with customized settings.
• Background Downloads: Continue downloading models while using other apps (iOS).
• Screen Awake During Inference: Keep your screen on while the AI is generating responses.
• Multi-device Support: Optimized for both phones and tablets, including iPad.
• Localization: Use the app in your preferred language.
• Hugging Face Integration: Access both public and gated models with authentication.

here is the link You do not have permission to view the full content of this post. Log in or register now.

 

[-Mang Thorney]

thanks ts