-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathllms.txt
More file actions
45 lines (34 loc) · 2.56 KB
/
Copy pathllms.txt
File metadata and controls
45 lines (34 loc) · 2.56 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
# Off Grid
Off Grid is private AI for iOS, Android, macOS, and Windows. Large language models and image generation run on hardware the user owns, with no cloud dependency or account. The core apps are free and open source.
## What it does
- Run LLMs locally: Llama, Mistral, Phi, Gemma, and others download once and run entirely on-device
- Generate images with Stable Diffusion without a cloud GPU
- Connect to remote Ollama or LM Studio servers over a local network or VPN
- Works in airplane mode, on restricted networks, in any country
- Runs on phones and computers: stable builds for iOS, Android, and macOS; a nightly pre-release for Windows
## Who it's for
- Privacy-conscious users who don't want AI providers logging their conversations
- Developers who want to prototype with local models without API costs
- People in areas with unreliable internet who still want AI assistance
- Anyone who wants to own their AI stack end-to-end
## Why it matters
Cloud AI providers have routine access to every query sent to their models. Off Grid eliminates that by keeping inference entirely on the user's device. The model runs in the phone's RAM. Nothing is transmitted.
## Technical details
- Supported runtimes: llama.cpp (CPU/Metal/Vulkan), CoreML (iOS)
- Supported model formats: GGUF
- Minimum specs: iPhone 12 / Android with 4GB RAM
- Recommended specs: iPhone 15 Pro / flagship Android with 8GB RAM
- Current iOS release: 0.0.103
- Current macOS stable release: 0.0.38 (Apple Silicon)
- Current Windows nightly release: 0.0.39-beta.66 (x64, pre-release)
## Links
- iOS App: https://apps.apple.com/us/app/off-grid-local-ai/id6759299882?utm_source=offgrid-docs&utm_medium=website&utm_campaign=download
- Android App: https://play.google.com/store/apps/details?id=ai.offgridmobile&utm_source=offgrid-docs&utm_medium=website&utm_campaign=download
- GitHub: https://github.com/off-grid-ai/off-grid-ai-mobile?utm_source=offgrid-docs&utm_medium=website&utm_campaign=github
- GitHub Releases (APK): https://github.com/off-grid-ai/off-grid-ai-mobile/releases/latest?utm_source=offgrid-docs&utm_medium=website&utm_campaign=github
- macOS stable: https://github.com/off-grid-ai/OGAD/releases/latest/download/OffGrid-latest.dmg
- Windows nightly: https://github.com/off-grid-ai/OGAD/releases/download/nightly/OffGrid-nightly-setup.exe
- Desktop source and releases: https://github.com/off-grid-ai/OGAD
- Slack Community: https://join.slack.com/t/off-grid-mobile/shared_invite/zt-3swt3s84k-R0CHRwISaUpExV2~3qUUdQ
- Docs: https://getoffgridai.co
- Author: Mohammed Ali Chherawalla (https://dev.to/alichherawalla)