Apple is developing a local AI application called Harbor

Apple is developing a new private application called Harbor. The software is designed to turn Mac computers into local inference servers without the need to send data to the cloud.

According to the leak, the application's architecture uses the Thunderbolt 5 interface to cluster multiple devices. This approach allows for combining the computers' RAM to run large models.

The project is focused on local request processing and maintaining user data privacy when working with heavy neural networks.

The tool provides developers and advanced users with the ability to deploy large-scale language models on their own hardware, utilizing the processing power of the Apple ecosystem.