Salesforce ended up temporarily turning it off, Shibani Ahuja, senior vice president of enterprise IT strategy, said during a roundtable discussion at Fortune’s Brainstorm Tech conference in Park City, Utah.
But the agent, it turned out, wasn’t the problem. “What we had noticed was there was an underlying problem with our data,” Ahuja said. When her team investigated what had happened, they found that Salesforce had published contradictory “knowledge articles” on its website.
“It wasn’t actually the agent. It was the agent that helped us identify a problem that always existed,” Ahuja said. “We turned it into an auditor agent that actually checked our content across our public site for anomalies. Once we’d cleaned up our underlying data, we pointed it back out, and it’s been functional.”
“The fact is that the foundation of AI—which is data—people don’t invest in it,” Srivastava said. “So you’ve got 1990s data sitting in a super-expensive, unnamed database over here, you’ve got AI here, you’ve got the CEO telling you to do something, and it’s just not going to work.”
“Pilots in large companies never deliver ROI,” he said. “They might deliver learnings, they might deliver proof points, they might deliver inspiration. But the path to scale—that is where you get the return on investment in any large technology program.”
In order for companies to see a return on investment from new AI tools, they will have to sort through both the data and the scaling issue.
