And yet, one of the first studies to look at AI use in conjunction with employment data finds the technology’s effect on time and money to be negligible.
Humlum, an assistant professor of economics at the University of Chicago’s Booth School of Business, and Emilie Vestergaard, an economics PhD student at the University of Copenhagen, looked at 25,000 workers across 7,000 workspaces, focusing on occupations believed to be susceptible to disruption by AI: accountants, customer support specialists, financial advisors, HR professionals, IT support specialists, journalists, legal professionals, marketing professionals, office clerks, software developers, and teachers.
They pulled records from Denmark, a country whose rates of AI adoption as well as hiring and firing practices are similar to those in the U.S. but where record-keeping is far more detailed, allowing the study to anonymously match survey responses to records of actual hours and pay.
On average, users of AI at work had a time savings of 3%, the researchers found. Some saved more time, but didn’t see better pay, with just 3%-7% of productivity gains being passed on to paychecks.
In other words, while they found no mass displacement of human workers, neither did they see transformed productivity or hefty raises for AI-wielding superworkers.
“While adoption has been rapid, with firms now heavily invested in unlocking the technological potential, the economic impacts remain small,” the authors write.
Productivity, interrupted
But the NBER paper doesn’t mean that earlier findings of AI’s productivity boost have been wrong, said Humlum—just incomplete.
Most of the earlier research has focused “exactly on the occupations where the time savings are largest,” Humlum told Fortune.
“Software, writing code, writing marketing tasks, writing job posts for HR professionals—these are the tasks the AI can speed up. But in a broader occupational survey, where AI can still be helpful, we see much smaller savings,” he said.
Other factors that explain AI’s overall ho-hum impact include employer buy-in and employees’ own time management.
“I might save time drafting an email using a large language model, so I save some time there, but the important question is, what do I use that time savings for?” he said. “Is the marginal task I’m shifting my work toward a productive task?”
Workers in the study allocated more than 80% of their saved time to other work tasks (less than 10% said they took more breaks or leisure time), including new tasks created by the use of AI, such as editing AI-generated copy, or, in Humlum’s own case, adjusting exams to make sure that students aren’t using AI to cheat.
There’s also the fact that real workplaces are much messier than structured experiments.
“In the real world, many workers are using these tools without even the endorsement of the boss. Some don’t even know if they’re allowed to use it; some are allowed but not really encouraged to use it,” Humlum said. “In a workplace where it’s not explicitly encouraged, there’s limited space to go to your boss and say, ‘I’d like to take on more work because AI has made me more productive,’” let alone negotiate for higher pay based on higher productivity.
Some of the findings around hours and pay in workplaces where AI isn’t used “suggest that workers are not exactly knocking on the boss’s door asking for more work,” Humlum said.
Great expectations, mid results
The NBER paper comes on the heels of other indications suggesting that AI’s potential, while tremendous, has been vastly overstated in the media and the market.
That’s a finding backed up by Humlum and Vestegaard, whose paper showed greater productivity gains when employers encouraged AI use and trained workers in it.
It could also be just a matter of time. After all, the Industrial Revolution went on for a century, transforming how people lived and worked long after the invention of the steam engine.
“It took a couple decades to see that we can have an assembly line powered by electricity instead of having everything run centrally via a steam engine,” Humlum said.