Why speed to velocity in AI requires more than just infrastructure

View profile for Keith Townsend

Founder & Executive Strategist | Advisor to CIOs, CTOs & the Vendors Who Serve Them

I had an interesting exchange with Gemini recently. It told me I was looking at the value of Dell or HPE’s “AI Factory” all wrong — that it wasn’t about cost control, but speed to velocity. But here’s the problem: speed to velocity doesn’t come from infrastructure alone. You can have racks full of GPUs ready to go, but if you don’t have the abstractions — the platform layer — you're still moving slow. This is the same mistake we made with private cloud. Just because you’ve virtualized compute doesn’t mean you’ve built a cloud. And just because you’ve installed GPUs doesn’t mean you’ve built an AI platform. If I need a prototype in 3 weeks, I’m not building pipelines from scratch or dealing with YAML and ticket queues. I’m going to Vertex AI, Bedrock, or even Hugging Face — because that’s where the abstraction exists to move fast. Infrastructure is necessary. But it's not sufficient. Speed lives at the service layer.

Bart Heungens

Digital Transformer - Storyteller - Independent IT infrastructure enthousiast - Solution Architect at TD SYNNEX - author at BITCON.be and HPEpedia.com - HPE Certified Instructor - Multi HPE MasterASE

3w

Look at the HPE solution more indepth… it is not only Infrastructure, the abstractions - platform layer is there as well as a part of the solution …

Jeff Frick

I am not telling you something to sell you something. I am sharing something to entertain, educate, and get you to stop and think for a minute. | Top Voice | Friday Five | Turn the Lens | Work 20XX

3w

Can't help but think of an old classic. And operations book built on the story of a group of young campers, headed out on the trail, and how the impact of one slower hiker, impacted the progress (and speed) of the group on their way to the destination, a camping spot for the night. Herbie from The Goal. Timeless lessons from a Timeless classic, bottlenecks and speed - broadly applied https://a.co/d/bygudwp

Matthew Wallace

Co-Founder/CTO Building @Kamiwaza.ai for an #AI Powered World

3w

Yes. And not to pop into your thread and get all commercial, but obviously this is a place where we really have put a ton of effort at KamiwazaAI to enable this. - Install community edition less than an hour - Immediately deploy models - Have 100% api compatibility for the engine (Kamiwaza) and the models to build apps - Now (in 0.5) even create an app garden template Then go to your on-prem, to cloud w a marketplace image; in 1.0, even helm apply into k8s, and you get the same experience. We used to say "Docker for GenAI" a lot because it was a "just works" experience. Although we are putting a ton of focus also into ReBAC, the mesh and Distributed Data Engine, this really matters.

Rael Mussell

Senior Sales Executive | Top Performer Portworx Sales🏆 ➜ Sales Engineering Leader ➜ VP Engineering (Customer Side) ➜ Linux Infrastructure Architect (Customer Side)

3w

100%.

Like
Reply
Rena Baretz

Account Executive - Driving Revenue Growth & Building Strong Client Relationships - Committed to Digital Transformation - Top Performer in Competitive Markets - Fostering Innovation Through Strategic Partnerships

2w

Truth! Great reminder for us all.

Like
Reply
Sandip Lahiri

Distinguished Technologist - HPE GreenLake Cloud Services

3w

Very good point!

Like
Reply
See more comments

To view or add a comment, sign in

Explore content categories