So the time has finally come: Tim Cook is retiring later this year and has named his successor, John Ternus, senior vice president of Hardware Engineering. I liked that someone in hardware is going to lead Apple in its next phase in this new AI paradigm. I've been trying to find a Mac Mini the past couple of weeks; the Apple Stores have a backlog until July and all the marketplaces (Craigslist, Facebook, Swappa, eBay) have Mac Minis or M1 Max Macbooks priced quite high relative to their pre-OpenClaw prices.
Given the successor announcement and my difficulty in locating an affordable Mac Mini, I decided to place a small buy order of AAPL today. I opened a small position of $10,000 to start tracking the stock. From my research, I've noted that the Apple hardware differs from Windows in that the memory is unified (or shared) across OS and GPU. What that means in practice is that the memory can be used flexibly across CPU and GPU which is a powerful combination. In the Windows world, which I am most familiar with, my computer RAM and Nvidia GPU RAM (aka Video RAM or VRAM) are separate.
When loading up local AI models, I'm limited by my GPU's RAM. Since I have an Nvidia 5080 that means my max VRAM is 16GB which is not that much; I can accommodate a model that is has about 13B parameters or so. Whereas a Mac with 32GB can use a much more powerful model.
In my experience as a consumer trying to run AI models, my first preference would be use a local model since my costs are fixed. I don't see a massive market for on-demand inference where consumers are paying for tokens. People like Netflix and YouTube because the costs are known upfront. Given the pace of open source AI models, I expect that Apple silicone is going to be able to power ever more powerful open source models within the next 3 years. That will create demand for Apple hardware. Of course, cloud inference will always be around but will mostly be used by enterprises.
I'm excited for Apple. Having a hardware guy at the helm is the exact type of person they need to lead the company now.
