Private local AI server for small businesses: your data stays inside your company. Founder @ClaryelCom.
Como, Italy
Joined December 2011
- Tweets3.7K
- Following849
- Followers452
- Likes9K
We may still be in for some pleasant surprises. But again, that’s only a possibility. I know for a fact that experiments are underway, at least with a configuration like the one in the photo. Although, for now, they’re using 64 GB of RAM.
🚀 MixAI: I’m Choosing a Mix of Local and Cloud AI — Here’s Why. (1/2)
Almost a year of hands-on experiments. Hardware ranging from $500 to $15,000. Cloud APIs, AI agents, and real-world tasks for businesses and homes. From now on, I’ll be sharing more about this combined approach to AI — one I believe has a very promising future.
Things are changing almost every day. But AI technology has already reached a point where we can achieve reliable results and realistically plan how to use it over the next year or two.
And I’ve come to a simple conclusion: we don’t need to choose between local and cloud AI. We need to learn how to get the best out of both.
This goes far beyond simply connecting different models or orchestrating them. It’s about planning the entire system: which tasks should run locally, which should go to external models, how to distribute computing resources, which subscriptions make sense, and what hardware is actually worth buying.
We also need to plan our physical infrastructure — computers, servers, GPUs, memory, power consumption, and future expansion.
I believe local AI will become an essential part of our lives. It’s already making its way into smartphones, personal computers, and even experimental operating systems.
⚖️ Four Things That Matter Most
1. Real value. The number one priority is getting useful, practical results.
2. Cost. How much are we actually paying to complete a task — not just for hardware, subscriptions, or tokens?
3. Security. This deserves its own category, outside any ranking. Personal data, privacy, and control over our infrastructure require special attention.
4. Ease of use. How easily, quickly, and reliably can we get the job done?
These are the criteria I use to compare technologies and build my own setup.
☁️ Subscriptions and APIs: Two Worlds Starting to Merge
This is an interesting topic that often gets overlooked.
Cloud AI can be accessed through subscriptions with usage limits or through APIs where you pay for what you actually use.
Each approach has its own economics, limitations, and advantages. And they need to be evaluated separately.
But the line between them is starting to blur.
A recent example is OpenAI. Eligible ChatGPT Pro subscribers can receive $100 to $500 per month in API credits, depending on their subscription tier. These credits require separate activation, and API billing remains separate.
That’s a pretty interesting example of two pricing models coming together.
So I’m not just comparing models. I’m also exploring the economics of subscriptions and APIs, their limitations, and how to combine them efficiently.
➡️ Coming up in Part 2/2: The three areas I’m actively researching, my hardware experiments, AI agents working together, and how I plan to make all this information accessible to you. 🚀
🌍 What an incredible world we live in!
(This is my last tweet about the 512GB Mac Studio — because it may already be becoming history. 🤯)
🚨 Mac Studio delivery estimates:
256GB RAM: 13–15 weeks
512GB RAM: 10–12 weeks
Three months! In today’s AI world, that’s enough time to turn everything upside down. I wouldn’t dare plan that far ahead.
💸 The prices are terrifying: $10,799 for 256GB and $22,299 for 512GB. But when you look at what these machines actually offer, where are the alternatives at these prices?
And here’s another strange thing: conventional RAM is still roughly three times cheaper than Apple’s memory upgrade. Will RAM prices rise even further? 🤔
So many questions, so few answers!
🚀 But one thing seems obvious: the 256GB Mac Studio is already one of the best choices on the market — possibly THE best.
The 512GB version? There are more questions. But if you can comfortably afford it, and this isn’t your last money, it’s certainly worth considering.
⏳ The biggest question is availability. These machines are practically unavailable for the foreseeable future, and the opportunity to order the 512GB configuration could disappear literally TODAY.
What an extraordinary time to be building AI systems! 🚀
