Primordial Ultima
Enthusiast
PocketPal AI is a pocket-sized AI assistant powered by small language models (SLMs) that run directly on your phone. Designed for both iOS and Android, PocketPal AI lets you interact with various SLMs without the need for an internet connection. Your privacy is fully protected as all processing happens entirely on-device — your conversations, prompts, and data never leave your phone or get stored on external servers.
You do not have permission to view the full content of this post.
Log in or register now.
Features
- Offline AI Assistance: Run language models directly on your device without internet connectivity.
- Model Flexibility: Download and swap between multiple SLMs, including Danube 2 and 3, Phi, Gemma 2, and Qwen.
- Auto Offload/Load: Automatically manage memory by offloading models when the app is in the background.
- Inference Settings: Customize model parameters like system prompt, temperature, BOS token, and chat templates.
- Real-Time Performance Metrics: View tokens per second and milliseconds per token during AI response generation.
- Message Editing: Edit your messages and retry AI generation.
- Personalized Pals: Create different AI personalities with customized settings.
- Background Downloads: Continue downloading models while using other apps (iOS).
- Screen Awake During Inference: Keep your screen on while the AI is generating responses.
- Multi-device Support: Optimized for both phones and tablets, including iPad.
- Localization: Use the app in your preferred language.
- Hugging Face Integration: Access both public and gated models with authentication.
You do not have permission to view the full content of this post.
Log in or register now.