"“The problem with AI is ‘not because it’s smarter than us and going to turn us into pets,’ Blankfein said in a new interview on Andreessen Horowitz’s The a16z Show, published Monday, ‘but because we don’t have the ability to test whether it’s right or not.’ When you’re running a big institution, he explained, you can’t make mistakes and numbers really matter.”"
"“Alluding to AI in particular but technological advancement in particular, he said, ‘everything is whirring behind the scenes,’ and you don’t really get a close look at the thought process of the technology on which you’re relying. ‘Now you can leave a piece of software, [and it] could go out and do 70,000 transactions,’ he said, explaining that when he started on the trading floor, everyone could hear every mistake, and the room would get quiet at the smallest slip-up.”"
"“This simple explanation may be the most precise articulation yet of why Wall Street - despite spending billions deploying AI across trading, compliance, and back-office operations - remains deeply reluctant to hand autonomous agents the keys to anything that actually matters.”"
"“The financial industry has long understood that speed creates leverage, and leverage cuts both ways. A well-timed trade amplifies gains. A mistaken one - executed at machine speed, across thousands of positions, before a human can intervene - amplifies losses just as fast.”"
Lloyd Blankfein describes a risk from AI that is not about superintelligence or autonomous weapons. The concern is the inability to test whether AI outputs are correct. In large institutions, mistakes cannot be tolerated and numbers matter. He notes that technological systems operate behind the scenes, limiting visibility into their reasoning. Software can run extensive transaction volumes without human review, unlike earlier trading environments where mistakes were immediately audible and noticeable. He frames speed as leverage in finance, where fast execution can amplify both gains and losses. Without timely human intervention, errors can spread across many positions before they are caught.
Read at Fortune
Unable to calculate read time
Collection
[
|
...
]