Local LLM: MITHRIL

Name: Local LLM: MITHRIL
Rating: 4.4 (14 reviews)
Author: DEPLOY FORWARD LLC

By: DEPLOY FORWARD LLC

Local AI Models On-Device

Features & Capabilities

Run quantized large language models directly on your iPhone. No cloud, no internet required.

Access state-of-the-art quantized AI models optimized for mobile hardware. Download GGUF-format models that compress billion-parameter networks into mobile-friendly sizes while maintaining performance.

COMPLETE MODEL SUITE • Llama 3.2 1B/3B (Meta) - Q4/Q8 quantization • Gemma 3 270M/2B/9B (Google) - IQ4_NL optimization
• Qwen 2.5 0.5B-7B (Alibaba) - Multiple quantization levels • LLaVA 1.5/1.6 (Vision) - Multimodal image understanding • Direct integration with Hugging Face model repository

TECHNICAL FEATURES • GGML/llama.cpp inference engine • Metal GPU acceleration on Apple Silicon • Dynamic context window management (2K-8K tokens) • Retrieval-Augmented Generation (RAG) with embeddings • Real-time streaming with token/second metrics • SQLite conversation storage with vector search

SYSTEM REQUIREMENTS Models run efficiently when file size ≤ available RAM. Recommended minimum 6GB RAM for larger models. iPhone 15 Pro/Pro Max optimal. iOS26 for Apple foundation model.

Zero telemetry. Zero data transmission. Pure local AI computing.

User Growth & Download Statistics

App

By:

DEPLOY FORWARD LLC

Rating:

4.40

(14)

Version:

1.6.2 Last updated: 2025-10-13

Version code:

878829878

Creation date:

2025-09-08

Compatible devices:

Size:

51.92MB

URLs:

Full description:

Source:

Apple Apps Store

Data ingested on:

2026-06-10

Compare stats and ranking:

Ranking

# 334,343 ▼ 1,126

For Developers

Monetize with App Pass Boost with Extension Booster

Contact the developer

Chrome-Stats does not own this Apple app. Please use these information below to contact the Apple app developer.

Developed by:

DEPLOY FORWARD LLC

Apple Apps Store

https://apps.apple.com/us/app/local-llm-mithril/id6751945393

User Reviews

Otherwise great, but lacks copy and paste of generated text… love the hugging face flexibility to import new models, such as the Qwen3.5 family (please make standard!)

by My*****, 2026-03-30

Needs a bit more stuff, like allowing to edit the system prompt. The rog feature is really good.

by Ja*****, 2026-02-19

Bug Report: Model Persistence and Startup Errors (iPhone XS) App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2] Issue Summary I am experiencing two main issues regarding model management and app startup: Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it. ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device. Steps to Reproduce Import a custom model and complete the download process. Select the model for use. Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this). Re-open the app and observe the "ExecuTorch error" notification upon startup. Expected Behavior The app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt. The app should launch without ExecuTorch errors if the model files are valid and present. Additional Notes Despite the error messages, the model does eventually work if I bypass the prompts. I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.