Concrete Logic Podcast: Building Knowledge and Pouring Wisdom, One Episode at a Time
June 2, 2024

Powering Down Data Centers: The Copper Connection

Powering Down Data Centers: The Copper Connection

NVIDIA Corporation, an American multinational corporation and technology company, is a global leader in the realm of artificial intelligence (AI) hardware and software. Founded in 1993, NVIDIA designs and supplies graphics processing units (GPUs), application programming interfaces (APIs) for data science and high-performance computing, as well as system-on-a-chip units (SoCs) for mobile computing and the automotive market.

NVIDIA’s professional line of GPUs is used for edge-to-cloud computing and in supercomputers and workstations for applications in fields such as architecture, engineering, construction, media, entertainment, automotive, scientific research, and manufacturing design.

At the heart of NVIDIA’s technology are semiconductors, materials that have an electrical conductivity value falling between that of a conductor, such as copper, and an insulator, such as glass. Semiconductors are employed in the manufacture of various kinds of electronic devices, including diodes, transistors, and integrated circuits. They are the building blocks of modern electronics, enabling the creation of massively parallel programs that utilize GPUs.

Semiconductors play a crucial role in the development of data centers, which are computer server hubs that collect, store, and process large amounts of data. These centers require extensive network infrastructure and electric power supply, and semiconductors enable the efficient transmission and distribution of electricity.

Copper, one of the best conductors of electricity, is a key element in this infrastructure. Its thermal conductivity helps build efficient heat exchangers, which are vital for cooling in data centers. Copper is used across various electrical applications in data centers, including power cables, busbars, electrical connectors, heat exchangers, and sinks. As the North American data center market grows, copper consumption for data centers is estimated to jump from 197,000 tons in 2020 to 238,000 tons in 2030 and 293,000 tons in 2040.

However, the mining of copper presents several challenges. Many of the world’s largest copper mines are aging and facing declining ore grades, which could lead to a supply shortage in the coming years. In addition, geopolitical risks, such as trade tensions and political instability in major copper-producing countries, could also impact the supply chain. New copper mines take decades to achieve commercial production, and they come with risks including permitting issues and shifting political landscapes. Meanwhile, discoveries are frequently of lower grades, making the copper more expensive to extract.

These challenges in copper mining could have significant implications for data center construction. A potential shortage of copper could increase the cost of building data centers, potentially slowing down their expansion. On the other hand, these challenges could also drive innovation in the industry, leading to the development of more efficient data centers that use less copper or alternative materials.

NVIDIA, semiconductors, and copper are all integral to the development of data centers. However, the challenges in copper mining present potential hurdles for the industry. As we move forward, it will be interesting to see how these challenges are addressed and what innovations they might spark.