MiddAI - Offline-Online AI from Middae

MiddAI

MiddAI is an offline self hosted AI that runs on your own computer and thus works without an internet connection. IF, however you do have an internet connection, it has the ability to search the internet to verify facts or information. This should reduce hallucinations and providing confident wrong answers. It also has a basic memory system that is still very much WIP!(Memory system is in stage 2 of development!). 

Privacy

Since MiddAI is an offline AI, everything is stored locally on your machine. When you delete chats they're gone for good, when you delete memory its gone for good, delete the mydocuments\middai folder? your user data is gone for good!. MiddAI does not collect, upload, sell, or share your data. The only internet use required is downloading a model through LM Studio. If you choose to use Search mode, MiddAI will also access the web to fetch search results for your question.

User Friendly

All you have to do is extract your download, download LM Studio and run it once and open up MiddAI.exe which will automatically download a model and start a local server. Please read the included README before starting the program!. The program after initial opening saves a config and AI Instructions as well as recorded memory file to "C:\Users\YourName\Documents\MiddAI". 

Cost of Use

Since this is a locally hosted AI the cost is your own processing power and electricity usage. The program is free to download. The AI models use tokens and context length to read prompts and generate outputs. There are 6 models you can download for low, medium and top end equipment, my laptop is only running the lowest model with a low context length so it runs at 3gb.  

Models 

Laptop:   Phi-4-mini, rules memory, 6000 context

Mid-range: Qwen3-4B, rules memory, 16000 context

Mid-range: Qwen3-8B, rules memory, 16000 context

High-end:  Qwen3-30B-A3B, AI Judge memory, 30000 context

Extreme:  Llama 3.3 70B Instruct, AI Judge memory, 30000 context

Extreme:  Mistral Large 2 123B, AI Judge memory, 30000 context

System Requirements

[Base Requirements]

MiddAI requires Windows, LM Studio installed, and enough free storage for whichever AI model you choose to download. The program itself is light; the selected model is what determines RAM, speed, and storage use.

[Laptop / Light Systems]

Recommended for laptops and ordinary PCs.

Suggested: 8GB+ RAM.

Models: Phi-4-mini, Qwen3-4B.

Memory: fast rules-based memory.

Context: 6000-16000 tokens.

Best for: quick local chatting, light search use, and lower-end machines.

[Mid / High Systems]

Recommended for stronger PCs, gaming PCs, or laptops with more memory.

Suggested: 16GB-32GB+ RAM.

Models: Qwen3-8B, Qwen3-30B-A3B.

Memory: Qwen3-8B uses fast rules memory. Qwen3-30B uses AI Judge memory.

Context: 16000-30000 tokens.

Best for: better answers, longer chats, stronger reasoning, and heavier local use.

[Extreme Workstations]

Recommended only for powerful workstation-class computers.

Suggested: 64GB-128GB+ RAM, or strong GPU/VRAM/unified memory setups.

Models: Llama 3.3 70B Instruct, Mistral Large 2 123B.

Memory: AI Judge memory.

Context: 30000 tokens.

Warning: these models are very large and may freeze, crash, or may even break weaker PCs. - You must insert UNDERSTOOD into a locked window before you can download these models so don't worry about accidentally loading them. 

Warning!: As a new developer my apps/games are unsigned and may flag in Windows Smartscreen. If this bothers you then please do not download instead I recommend ChatGPT, I pay for mine, I consider it the best AI app around!. or if you have the know how LM Studio (which is signed!). 

About Me

Hello!, I'm an off-grid TikTok'er that's spent 5 years living in the forests and mountains. I'm now in housing and have started learning about software development though plan to still do camping and horror stories in the forest as well as some game streams of game modding(in the forest, forest yaaay!)!. 

I created this AI because back when I needed a decent offline AI, they were clunky and lacked a lot of features cloud based AI have, so I created this, MiddAI!. 

PAT testing became a thing in the UK and it became very hard to charge phones and battery packs in cafes and pubs so I ended up with 300w 12v/240v solar panels being lugged about but a generally tech positive stay in the mountains. Now I'm on 100w, Lithium phosphate 12v/240v which runs out of my rucksack so I always have about 4 hours of mains electricity available.  

My plan was always to get a laptop and start programming. I created a really cool game in Character.AI (sadly not recommended anymore) that I'll try and be making a standalone follow up to soon. I also ended up with a sailboat (for $250 bucks) which I rigged up ChatGPT to believe it was the onboard AI, something nerdy in you flips when your boat is directing you in rewiring your electrics with 0 experience but heeey we got navigation lights and helm control back!.. hmmm a standalone boat AI could be a thing now.... 

My eventual goal is to work on robots and aware-always on-AI.