Apple has new Mac app coming to make running local AI models easy(9to5mac.com)
511 points by linolevan 1 day ago | 520 comments
tl;dr: Apple is reportedly developing a Mac app called Harbor, discovered by leaker Aaron Perris, that turns Macs into private AI inference servers for running open-weight models locally on Apple silicon. The app supports clustering multiple Macs over Thunderbolt 5 to pool unified memory, allowing larger models and higher concurrency than a single machine could handle. Harbor is currently in private preview under Apple's Claris brand, with a public release expected in the coming months.
HN Discussion:
  • ↑Apple is positioned to win the AI race through efficient local models on their silicon
  • ↓Concerned the app will be bloatware or non-removable, adding unwanted gigabytes to Macs
  • ↑Would welcome vendor-supported solution as improvement over existing tools like Ollama/LM Studio
  • ↑Thunderbolt 5 clustering for pooled memory is the key differentiator from existing solutions
  • ~Questions the value of running large local models versus specialized smaller models