Surging AI infrastructure costs could reach $200 billion, with most investments being private.
AI supercomputers are rapidly evolving due to enhancements in chip technology.
While performance is increasing, costs and power requirements are also surging.
Future AI supercomputers may require decentralized training to manage power limitations.