Another company, Replit, had a high-profile failure in July when its coding assistant ignored specific instructions and deleted a production database, one that it wasn’t even supposed to have access to. Replit reacted quickly by separating the development and production environments. But they should have had that in place from the start.
What is AI infrastructure?
AI infrastructure is a many-layered stack, says Will Bass, VP of security services at Flexential, a colocation provider that’s using generative AI to help with cybersecurity, sales and marketing, and to reduce power costs, among other business challenges.
“You’re going to have your hardware layers,” he says. “That’s your GPUs, your storage network. You have your data layers — your database, your data lakes. You have your software — your open-source libraries, your machine learning and deep learning frameworks, and model management. You have CI/CD, pipelines, AI apps, your agents, and it all gets wrapped together from a security and compliance perspective where you’re worrying about authentication, authorization, and governance.” Flexential is using everything in that stack, he says.
