backburner

Backburner uses a USB-C-connected iPhone to help a Mac run Qwen3.8-27B locally, reducing prompt-processing waits and extending context for local LLM sessions.

Browse open issues

Pick a small issue you can reproduce, then fix it with your AI coding agent.

Share on XLicense: MIT

Overview

Backburner is a local inference setup that combines a Mac and a connected iPhone to run Qwen3.8-27B. Its llama.cpp-based engine splits prompt processing across the devices, and uses the iPhone to hold older context and compute attention when the Mac's memory limits long sessions. This can reduce prompt-reading waits and keep more context at 8-bit precision. Reported results are from tested Apple devices and do not guarantee the same performance on other setups.

Key features

  • Splits prompt-processing layers between the Mac and iPhone.
  • Uses iPhone memory and compute for older context to extend usable context.
  • Includes Mac-side kernels and DFlash2 speculative decoding in its llama.cpp fork.

Best for

Mac users who want to run Qwen3.8-27B locally and have a compatible iPhone and USB-C connection. It is especially relevant for sessions that process long prompts or need more context.

Upstream
StayLameBro/backburner
Fork on GitHub
Guo-astro/backburner
Upstream stars
1.2k
Category
AI agents and LLM tools
Language
Python
License
MIT
Forked
2026-10-05
Sync status
In syncLast synced 2026-11-08