Cutting-Edge Cooling Solutions

🚀 Pumped Two-Phase Direct-to-Chip Cooling: Powering the Future of AI Data Centers Summary: As AI workloads surge, we are entering a new era of compute intensity. Chips like the NVIDIA Blackwell (2000W TDP), AMD MI300X (750W), and Gaudi HL-2080 (600W) are pushing thermal design limits far beyond traditional cooling capabilities. With cooling systems already accounting for up to 40% of an AI data center’s total energy use, the industry must innovate—fast. 🔍 Pumped Two-Phase (P2P) Direct-to-Chip Cooling is emerging as a transformative solution. By leveraging the latent heat of vaporization, P2P cooling removes heat more efficiently than single-phase methods. Cold plates are placed directly on high-power components, and a refrigerant circulates in a closed loop—absorbing heat through flow boiling and returning to the CDU for condensation and recirculation. 💡 Recent research from Vertiv, Intel, NVIDIA, and Binghamton University—presented at ASME InterPACK 2024—has validated P2P D2C cooling as commercially viable (TRL 7, CRL 2). Notable performance metrics include: - Heat load handling up to 170kW per rack - Case temperatures below 56.4°C - Thermal resistance of cold plates as low as 0.012°C/W - Efficient operation across dynamic loads, including hot-swapping scenarios - Stable control via flow regulators (2–32 PSID) to manage vapor quality and avoid dry-out 🔧 Two main system architectures are being optimized: Refrigerant-to-Air (R2A): For integration into existing air-cooled environments. R2A CDUs with microchannel condensers and variable-speed fans deliver up to 40kW in 600mm racks, making them ideal for gradual liquid cooling adoption. Refrigerant-to-Liquid (R2L): Using brazed plate heat exchangers and chilled water loops, R2L systems are ideal for high-power density clusters, leveraging liquid’s superior heat transport. 🧪 In real-world tests, the Vertiv R2L system maintained a constant pump flow of 39 GPM while supporting transient and asymmetric IT loads. Even under high refrigerant saturation temperatures and pressure drops (up to 7.6 psi across cold plates), the system remained within design parameters. Importantly, system resilience was demonstrated under failure simulations (e.g., pump switch-over, loss of heat rejection) without triggering pressure relief valves—ensuring safe shutdown protocols and zero refrigerant release. 🌍 Why it matters: As we push toward 600kW+ rack densities and AI training workloads scale exponentially, efficient and safe heat removal will be the linchpin of sustainable digital infrastructure. P2P D2C cooling isn’t just a stopgap—it may be the definitive pathway for next-gen AI data centers. #AIDataCenters #LiquidCooling #DirectToChip #TwoPhaseCooling #Vertiv #NVIDIA #ThermalManagement #SustainableComputing #HighDensityCooling #DataCenterInnovation #CoolingEfficiency #BlackwellGPU #HPC #GreenDigitalInfrastructure #EnergyEfficiency #PUE #NetZeroTech #FutureOfCooling #R2L #R2A #FlowBoiling #ColdPlate

Liquid cooling is redefining data center efficiency... Delivering a powerful combination of sustainability and cost savings. As computing demands increase, traditional air cooling is falling behind. Data centers are turning to liquid cooling to reduce energy use, cut costs, and support high-performance workloads. Operators are considering direct-to-chip cooling, which circulates liquid over heat-generating components, and immersion cooling, where servers are fully submerged in a dielectric fluid for maximum efficiency. Developed markets, like the U.S. and Europe, are adopting liquid cooling to support AI-driven workloads and reduce carbon footprints in large-scale facilities. Meanwhile, emerging markets in Southeast Asia and Latin America are leveraging liquid cooling to manage high-density computing in regions with hotter climates and less reliable power grids, ensuring operational stability and efficiency. Greater Energy Efficiency Liquid cooling reduces total data center power consumption by 10.2%, with facility-wide savings up to 18.1%. It also uses 90% less energy than air conditioning, improving heat transfer and maintaining stable operating temperatures. Sustainability Gains Lower PUE (Power Usage Effectiveness) means less wasted energy, while reduced electricity use cuts carbon emissions. Closed-loop systems also minimize water consumption, making liquid cooling a more sustainable option. Cost and Performance Advantages Efficient temperature management prevents thermal throttling, optimizing CPU and GPU performance. Higher-density computing lowers construction costs by 15-30%, while cooling energy savings of up to 50% reduce long-term operational expenses. The Future of Cooling As #AI and cloud workloads grow, liquid cooling is becoming a competitive advantage. Early adopters will benefit from lower costs, improved efficiency, and a more sustainable infrastructure. #datacenters

Can Geothermal Cooling Tame Data Centers’ Energy Appetite? Data centers are the digital engines of the global economy — and they’re running hot. Cooling accounts for up to 40% of their electricity consumption, a staggering overhead that grows alongside our demand for streaming, cloud computing, and AI. Full article: https://lnkd.in/gFaK43Uh One of the solutions isn’t flashy — it’s geothermal cooling, a well-understood technology that uses the Earth’s stable underground temperatures (typically 10–15°C) to reject heat efficiently. Instead of fighting ambient weather conditions, these systems leverage the natural consistency of subsurface environments. Projects like Equinix’s AM3 facility in Amsterdam and Epic Systems in Wisconsin show what’s possible — megawatts of reliable cooling with significantly lower operating costs. Microsoft’s Redmond campus, with nearly 1,000 boreholes, demonstrates that large-scale deployment is both feasible and effective when planned carefully. Yes, upfront costs and site-specific constraints require thoughtful planning. But in regions with high power prices or strong environmental regulations — Europe, for example — payback can be achieved in five to seven years. It’s also worth noting that the same drilling innovations developed during the shale boom are now making shallow geothermal systems faster, cheaper, and more predictable to deploy. While deep geothermal electricity generation gets the headlines, it’s shallow geothermal for cooling that’s quietly delivering real-world impact today. The technology is mature. The benefits are quantifiable. The risks are manageable. The timeframes are reasonable. I’m especially focused on this opportunity in Ireland, where I’m supporting an NGO working on clean, secure, affordable energy, and where my firm Trace Intercept Ltd is based. Ireland has a lot of data centers in part because 30% of trans-Atlantic data cables land in the country. I also recently recorded a podcast with geologist and geothermal entrepreneur Simon Todd of Causeway Energies, which is based in the area, exploring the opportunity space in depth. Watch for those episodes on 🎙Redefining Energy - Tech, dropping this month. As electricity costs climb and sustainability pressures mount, data center developers and policymakers have a choice: keep spending more to cool inefficiently, or invest in solutions that align with long-term performance and climate goals. The next generation of digital infrastructure deserves cooling systems as smart as the data they serve.

Liquid Cooling: The $8 Billion Architecture Powering AI & Hyperscale Density Air cooling is officially struggling to keep up. As AI acceleration and HPC (High-Performance Computing) drive server power density past 30kW per rack, operators are rapidly shifting to liquid cooling—the only viable solution that is both efficient and future-ready. According to the latest forecast, the Data Center Liquid Cooling Market is set to surge from $2.2 billion to nearly $8 billion by 2031 🚀. This massive trajectory is fueled by sustainability demands and the insatiable appetite for compute power. 💡 So, What Makes Liquid Cooling Unstoppable? Liquid cooling replaces roaring fans with a targeted, high-precision pipeline, leveraging the superior heat transfer capacity of fluid over air. The primary architectures include: 1. Direct-to-Chip (Cold Plate) Cooling: Heat is transferred directly from the hot chip surface (CPU/GPU) to a Cold Plate. This is highly efficient for high-power chips. 2. Rear-Door Heat Exchanger (RDHx): Liquid-cooled coils in the rear door remove heat from the exhaust air before it enters the data hall. 3. Immersion Cooling: Servers are fully submerged in a non-conductive dielectric fluid, offering the highest possible density. 🧠 The Core Component: Coolant Distribution Units (CDUs) All these systems rely on the Coolant Distribution Unit (CDU). The CDU acts as the intelligent bridge, managing the precise flow, pressure, and temperature of the coolant between the facility's heat rejection system and the IT gear. ✨ Quantifiable Benefits for Operators Liquid cooling is not an upgrade—it's an essential architectural shift delivering powerful ROI: Higher Density: Enables compute density previously impossible with air. Energy Efficiency: Drastically reduced cooling power (PUE), leading to lower operating costs. Sustainability: Supports greener data centers by facilitating heat reuse and lowering the carbon footprint. Reliability: Eliminates thermal strain and hot spots, improving system stability for critical AI + HPC workloads. If you are shaping data center cooling strategies for 2025–2030, understanding the dynamics of D2C, Immersion, and CDU integration is now non-negotiable. High-Impact Hashtags #LiquidCooling #DataCenterCooling #AIWorkloads #HPC #CDU #ImmersionCooling #DirectToChip #ThermalManagement #PUE #GreenDataCenters #Hyperscale #DataCenterDesign #Infrastructure #CoolingArchitecture #Engineering

The Real AI Bottleneck Isn’t Compute. It’s Cooling Every training cycle doesn’t just draw megawatts from the grid. It dumps megawatts of waste heat that must be removed continuously and quickly. Cooling already consumes 30–40% of a data centre’s total electricity use. Traditional air systems max out at ~20–30 kW per rack. But AI racks are already hitting 80–100 kW and beyond. Most systems still rely on air, a 1970s solution for a 2025 problem. Simply put, air can’t keep up.   In our new paper, we looked at cooling from a commercialisation lens, not just lab physics: • Direct liquid cooling → mature and efficient, but costly to retrofit • Immersion → cuts cooling energy by >90%, but fluid lifetimes and vendor lock-in slow adoption • Hybrid systems (RDHx) → retrofit-ready, bridging the gap between air and liquid today • AI-driven optimisation → early pilots show 10–20% extra savings through predictive control   Why this matters: The growth of AI means energy demand may double. If cooling efficiency doesn’t keep pace, the overhead grows even faster. Cooling isn’t just about watts per chip. It’s about water use, carbon intensity, and whether AI build-out is financially and environmentally sustainable.   Published in Sustainable Energy Technologies and Assessments (Elsevier): “AI-driven cooling technologies for high-performance data centres: state-of-the-art review and future directions” 👉 Full article: https://lnkd.in/gy64gx7Y   Grateful for the insight and collaboration of my co-authors Aoife Foley, Fadhli Wong Mohd Hasan Wong, PhD, Andrea Dolfi, and Geetha Srinivasan. A special thanks to PETRONAS for supporting this research. Because in the end: AI won’t stall on silicon. It will stall on heat. #AI #DataCentres #Cooling #HPC #EnergyEfficiency #Sustainability

AI is pushing data center cooling into a new era and CDUs are at the center of the conversation. As data centers scale to support next-generation AI platforms, cooling solutions are evolving just as fast. This past week highlighted that shift, with new systems announced to meet the extreme requirements of NVIDIA upcoming Vera Rubin GPU platform and the broader move toward AI Factories. 🔹DCX LIQUID COOLING SYSTEMS introduced a new cooling architecture with its Facility Distribution Unit, a centralized approach that moves CDUs outside the white space and enables cooling at the data hall level. 🔹 Schneider Electric, through its Motivair liquid cooling portfolio, unveiled the MCDU-70, a 2.5 MW modular CDU designed to scale in 10 MW building blocks, closely aligning with NVIDIA’s Omniverse DSX blueprint for AI factories. Why this matters: With rack densities trending toward 600 kW per rack, the industry is seeing more than just incremental change: A move toward centralized and modular cooling architectures Rising investment and consolidation across the liquid cooling ecosystem New entrants pushing the market forward Alongside established vendors, companies like XNRGY Climate Systems are working to challenge traditional approaches with innovative ideas around high-density thermal systems, scalable manufacturing, and faster deployment models. Bottom line: As NVIDIA AI roadmap accelerates, cooling is becoming a first-order design decision for data centers. The next phase of innovation will be driven by both incumbents and disruptors willing to rethink how cooling infrastructure is designed and deployed. #DataCenters #LiquidCooling #AIInfrastructure #CoolingInnovation #XNRGY #DigitalInfrastructure

🔥 Microsoft's AI cooling breakthrough eliminates the biggest bottleneck to chip progress. AI chips generate so much heat that current cooling methods will hit their limits within 5 years. The problem? Cold plates sitting on top of chips are blocked by multiple packaging layers that act like blankets, limiting heat removal. Microsoft just changed the game. Their microfluidic system etches tiny channels directly into silicon, bringing liquid coolant where heat actually forms - inside the chip itself. 💡 Here's why this matters for everyone: For Engineers: Lab tests show 3x better cooling performance than cold plates and 65% reduction in peak temperatures. This means overclocking without melting chips, enabling faster processing during demand spikes. For Managers: Better cooling improves power usage effectiveness and reduces operational costs. More compute power in smaller spaces means fewer datacenters needed. For CEOs: Removes heat limitations on datacenter design, allowing higher server density without additional buildings. This addresses the infrastructure bottleneck strangling AI growth globally. The breakthrough uses AI to map each chip's unique heat signature, directing coolant through bio-inspired channels that resemble leaf veins. Nature-inspired engineering at its finest. 🌿 Take Action Now: • Assess your cooling infrastructure limitations • Plan for next-gen chip architectures requiring advanced cooling • Consider 3D chip stacking possibilities that microfluidics enables The heat problem isn't coming - it's here. Microsoft plans to work with fabrication partners to bring microfluidics into production across datacenters. What's your biggest cooling challenge? Share below 👇 Read the full technical breakdown: https://lnkd.in/eeFg5ysK

🚀 Pioneering Research: How Liquid Cooling is Reshaping the Future of AI Factories I'm thrilled to announce that our multi-institutional research team has just published groundbreaking findings on NVIDIA's Sustainable Computing platform, revealing how direct-to-chip liquid cooling is transforming AI infrastructure performance and sustainability. It was an absolute privilege to lead this exceptional collaboration bringing together world-class researchers and industry leaders from: Berkeley Lab Brookhaven National Laboratory Florida Atlantic University Kansas State University NVIDIA (James Hooks) and Supermicro (Jim Hetherington) Special thanks to co-authors Alex Newkirk Arslan Munir Hayat Ullah for their outstanding contributions to this work. Why This Matters for AI Factories: As enterprises build the next generation of AI factories—purpose-built facilities designed to train and deploy large language models and advanced AI systems at scale—thermal management has emerged as a critical enabler, not just an operational concern. Our research demonstrates that liquid cooling fundamentally unlocks higher sustained performance, superior energy efficiency, and the thermal headroom needed to push AI workloads to their full potential. These findings provide the technical foundation for designing AI factories that can handle extreme rack densities while maintaining optimal performance and cost efficiency. The implications extend beyond individual nodes to facility-scale operations where thermal efficiency directly impacts both computational capability and sustainability goals. I'm excited to announce that the next phase of our research will explore how Johnson Controls' cutting-edge thermal management solutions can further accelerate AI factory performance and efficiency. As the industry pushes toward 100kW+ rack densities and multi-megawatt AI training clusters, JCI's innovative approach to integrated thermal infrastructure will be instrumental in building the sustainable, high-performance AI factories of tomorrow. The convergence of advanced liquid cooling, intelligent thermal management, and purpose-built AI infrastructure represents a pivotal moment for our industry. This research helps chart the path forward for organizations investing in AI factory deployments. Read the full white paper: https://lnkd.in/eJUPCHfR https://lnkd.in/e266n3kd Johnson Controls #AI #DataCenters #LiquidCooling #AIFactory #Sustainability #Innovation #JohnsonControls #NVIDIA #GreenComputing #HighPerformanceComputing #FutureOfAI

Norway’s underwater data centers are cooled by the Arctic — and powered by the sea In a fjord deep in northern Norway, engineers have launched one of the world’s most energy-efficient data centers — and it sits entirely underwater, cooled by natural Arctic currents. Instead of relying on expensive air-conditioning systems, this submerged facility uses the frigid temperatures of the sea to keep thousands of servers running silently and sustainably. The idea sounds radical, but it works: The data center modules are enclosed in watertight pressure-resistant pods, lowered into the ocean and tethered to floating power buoys. The cold seawater absorbs waste heat directly through thermal conduction — no fans, no coolants, no energy waste. And for power? It taps directly into offshore tidal turbines, generating constant clean electricity. Norway’s engineers say this solution can reduce data center energy use by over 45%, while also extending server life by avoiding thermal wear. The modules are monitored remotely by submarine drones that inspect cables, sensors, and flow rates every 48 hours. Global giants like Microsoft and Google have already tested similar ideas in pilot form, but Norway is the first to deploy this at commercial scale. The underwater pods are also highly secure — tamper-proof, EMP-resistant, and almost invisible to satellite surveillance. This is more than green computing — it’s a glimpse into the ocean-based internet infrastructure of the future. As global data demand surges, cooling becomes the biggest bottleneck. Norway’s ocean approach may be the only truly scalable zero-emission solution. In the frozen silence below the surface, our digital future is already humming