LLM Server — On-Device AI API Android

LLM Server — On-Device AI API

By: magnus2026 App
Run AI models on your phone and serve them as an API endpoint to any app

Overview

Features & Capabilities

★ Turn Your Phone Into an AI Server ★

LLM Server lets you run large language models directly on your Android device — and expose them as a local API endpoint that any app, script, or AI agent can connect to.

No cloud. No subscriptions. Your phone becomes the AI backend.

━━━━━━━━━━━━━━━━━━━━━━━━━━━━

🧠 ON-DEVICE INFERENCE
• Run open-weight LLMs (Llama, Gemma, Phi, Qwen, Mistral and more)
• Optimized for mobile hardware with GGUF quantization
• Full privacy — your data never leaves your device
• Works completely offline once models are downloaded

🔌 BUILT-IN API SERVER
• OpenAI-compatible REST API served from your phone
• Connect any tool that speaks the OpenAI API format
• Stream responses in real-time via Server-Sent Events
• Serve multiple clients on your local network

🤖 PERFECT FOR AI AGENTS
• Let your AI assistants call your phone as an LLM backend
• Hermes Agent, LangChain, AutoGPT — anything with HTTP
• Tailscale/ZeroTier support for secure remote access
• No API keys needed — you own the model

📱 HOW IT WORKS
1. Download a model from the built-in model browser
2. Tap "Start Server" to launch the API endpoint
3. Point any client to http://your-phone-ip:8080/v1/chat/completions
4. That's it — your phone is now an AI server

🔧 TECHNICAL DETAILS
• llama.cpp backend for fast CPU/GPU inference
• Supports GGUF models (Q4_K_M, Q5_K_M, Q8_0 and more)
• OpenAI-compatible /v1/chat/completions endpoint
• Configurable context length, temperature, and sampling
• Background service keeps serving even when app is minimized
• Battery-optimized inference scheduling

━━━━━━━━━━━━━━━━━━━━━━━━━━━━

💡 USE CASES
• Personal AI assistant that runs 100% on your device
• Development & testing — prototype AI features without cloud costs
• AI agent backend — let autonomous agents use your phone as their brain
• Privacy-first AI — sensitive data never touches the cloud
• Offline AI — works on planes, in tunnels, anywhere

🔒 PRIVACY & SECURITY
• All inference happens on-device
• No data collection, no telemetry, no cloud dependency
• API server only accessible on your local network by default
• Open-source model ecosystem — no vendor lock-in

━━━━━━━━━━━━━━━━━━━━━━━━━━━━

LLM Server bridges the gap between powerful open-source AI models and the devices you carry every day. Stop paying for cloud API calls — run your own AI, on your own terms.

Download now and turn your phone into an AI powerhouse.

User Growth & Download Statistics

App
By:
magnus2026
Downloads:
12
Version:
1.7.0 Last updated: 2026-09-01
Version code:
18
Creation date:
2026-08-28
Publisher country:
HK HK
Permissions:
  • android.permission.RECORD_AUDIO Very high risk
  • android.permission.FOREGROUND_SERVICE_SPECIAL_USE Moderate risk
  • android.permission.ACCESS_WIFI_STATE Low risk
  • android.permission.FOREGROUND_SERVICE Low risk
  • android.permission.INTERNET Low risk
  • android.permission.POST_NOTIFICATIONS Low risk
  • android.permission.ACCESS_NETWORK_STATE Safe
  • com.android.vending.CHECK_LICENSE Safe
  • com.llmserver.DYNAMIC_RECEIVER_NOT_EXPORTED_PERMISSION
Size:
190.58MB
Price:
2.99
Email:
ht*****@gmail.com
Website:
Privacy policy:
Full description:
See detailed description
Source:
Google Play Store
Data ingested on:
2026-11-22
Compare stats and ranking:

Contact the developer

Chrome-Stats does not own this Android app. Please use these information below to contact the Android app developer.

Developed by:
magnus2026
Google Play Store
https://play.google.com/store/apps/details?id=com.llmserver
Email:
ht*****@gmail.com
Website:
https://atrix228.github.io/llm-server/

Best LLM Server — On-Device AI API Alternatives

Here are some Android apps that are similar to LLM Server — On-Device AI API: