Cooling Data Centers Could Prevent Massive Electrical Waste
It is estimated that the data storage sector consumed about 61 billion kilowatt-hours (kWh) in 2006 (1.5% of total U.S. consumption, or roughly equivalent to the amount consumed by 5.8 million average U.S. households). These numbers are only expected to grow.
The energy used by the nation’s servers and data centers is growing at an unsustainable rate. Not only that, but web servers are notoriously inefficient. For example, computer servers are used at only 6 percent of their capacity on average, while data center facilities operate at roughly 65% to 75% efficiency, meaning that 25% to 35% of all the energy consumed by servers is wasted (converted to heat).
If we are to even consider reducing our energy consumption and carbon footprint, the growing demands generated by our web servers must be near the top of the list of possible improvements. And the Department of Energy agrees.
- » Read more on energy efficiency
- » See peer reviews of Efficient Appliances, Lighting, and more at Green Home
Researchers at DOE’s Pacific Northwest National Laboratory (PNNL) in Washington and National Renewable Energy Laboratory (NREL) in Colorado are hard at work figuring out ways to make our data storage infrastructure more efficient by running them at lower temperatures. The technology exists to achieve efficiencies of 80% to 90% in conventional server power supplies. Moving this heat source away from the server allows the cooling efforts to be focused on the computing elements.
Alternative Cooling Approaches
(from PNNL’s Energy Smart Data Center)
- Evolutionary progress is being made with conventional air cooling techniques that are known for their reliability. Current investigation focuses on novel heat sinks and fan technologies with the aim to improve contact surface, conductivity, and heat transfer parameters.
- One of the most effective air cooling options is Air Jet Impingement. The design and manufacturing of nozzles and manifolds for jet impingement is relatively simple.
- The same benefits that apply to Air Jet Impingement are exhibited in Liquid Impingement technologies. In addition, liquid cooling offers higher heat transfer coefficients as a tradeoff for higher design and operation complexity.
- One of the most interesting liquid cooling technologies are microchannel heat sinks in conjunction with micropumps because the channels can be manufactured in the micrometer range with the same process technologies used for electronic devices.
- Liquid metal cooling, used in cooling reactors, is starting to be an interesting alternative for high-power-density micro devices. Large heat transfer coefficients are achieved by circulating the liquid with hydroelectric or hydromagnetic pumps. The pumping circuit is reliable because no moving parts, except for the liquid itself, are involved in the cooling process. Heat transfer efficiency is also increased by high conductivity. The low heat capacity of metals leads to less stringent requirements for heat exchangers.
- Heat extraction with liquids can be increased by several orders of magnitude by exploiting phase changes. Heat pipes and Thermosyphons exploit the high latent heat of vaporization to remove large quantities of heat from the evaporator section. The circuits are closed by either capillary action in the case of heat pipes or gravity in the case of Thermosyphons. These devices are therefore very efficient but are limited in their temperature range and heat flux capabilities.
- Thermoelectric Coolers have the ability to provide localized spot cooling, an important capability in modern processor design. Research in this area focuses on improving materials and distributing control of TEC arrays such that the efficiency over the whole chip improves.
Capturing Waste Heat
Reusing the waste heat from a data center may not make the server room itself more efficient, but depending on how heat is reused, it can save a company a significant sum of money. In its report to Congress last year on data center energy consumption, the federal Environmental Protection Agency suggested the practice. And the idea has gained traction, according to Mark Fontecchio of SearchDataCenter.com.
For example, in Winnipeg, Canada a media company called, Quebecor, efforts have been made to take the heat from the 2,500-square-foot data center on the ground floor and use it to heat other parts of the building.
Because of the cool Winnipeg climate, engineers decided to make use of that cool air by installing air-side economizers that draw in outside air. The economizers include baffles that open to varying degrees depending on the outside temperature and how much cooling the data center needs.
After the air cycles through the approximately 100 eight-way servers, it warms up in the process. It then goes into an overhead plenum, where about 10% of the air is re-circulated to warm the outside air that comes into the data center.
Another duct out of the exhaust plenum to the intake duct of the editorial office upstairs. Quebecor also added a second thermostat to its editorial offices; the first controls the traditional heating furnaces. That whole process used up another 60% of the waste heat. The data center dumps the remaining 30% into the adjacent warehouse.
AC-DC?
For electricity flowing all the way from power plants to the wall socket, alternating current is far superior. But for the short transmissions inside those computers DC power prevails. The search for ways to convert AC to DC more efficiently is leading some data center companies to consider a DC-centric approach.
It’s easier to transmit AC over long distances; DC requires thick copper cables or bars, instead of comparatively lightweight wires. But DC becomes a more serious possibility for power once AC reaches a building.
Converting from one form of power to another in a computing environment may not be performed efficiently, especially at the server level, and even then, the resulting waste heat may be deposited in the rack or computer room at a point that requires further effort to dispose of it with the air handlers. Unfortunately, there is disagreement in the community over how to address these inefficiencies.
- DC advocates argue that plugging servers into AC power is inefficient, and switching systems to DC would cut down on waste heat and component failure.
- Proponents argue that using DC outside the server removes some of the inefficiencies of power supplies that convert AC electricity to DC. Servers without such power supplies don’t have to contend with as much waste heat and attendant component failure.
But according to NPPL, substituting DC power in data centers as a replacement for conventional AC power has not yet made significant inroads into many data centers because the technology is unfamiliar to many facility engineers.
Despite the wide-spread use of DC power in telecommunications, there is reluctance within the computer industry to switch to new technologies without field experience showing that the switch could be done safely and would have operational and economic benefits without causing unanticipated problems.
If DC would in fact be a more efficient type of power within servers themselves, might it be possible to site server farms to take advantage of the DC provided by integrated renewable energy generating systems such as solar PV and wind?
Other Posts on Data Centers:
“Is Paperless Really So Green”:: Green Building Elements
“Don’t Forget to Turn Off the Servers”:: EcoPreneurist
Photos:1.© Eimantas Buzas | Dreamstime.com; 2. Versageek via Flickr under a Creative Commons License









…oh and tansformers don’t work on DC. So the inside of your server, which needs oh I dunno maybe +5VDC at 100 Amps, +12VDC at 5 Amps, +1.blah VDC at a few Amps all out of one power supply is NOT going to get that magically from ONE DC power bus in the data center. It’s going to get it the way it has for the last 30 years, whith an efficient switching power supply. These rectify the AC line, make high freq AC with an oscillator, use a toroidal transformer with multiple secondary windings to supply raw low volt AC, and having rectifiers, filters and regulation after each winding to supply the different regulated DC voltages needed inside the box. Now… the DC power bus proposal would ONLY eliminate the front-side diodes and caps rectifying the input AC input power, i.e. converting it to DC. So every switching power supply takes lo freq hi volt lo current AC in, rectifies it to hi volt lo current DC, uses an oscillator to convert that to low current high volt AC, uses a transformer to step that down to various lo volt AC high current outputs, each of which is independently rectified (very efficiently with synchronous rectifiers) to the various lo volt high current DC power levels needed inside the server box. So the proposed HV DC power bus would only eliminate the front side AC to DC rectification in the switch mode power supply, but not the rest of it. No…. an idle CPU is still burning watt-hours, and I agree that virtualization will yield far more efficiency gains than going to a non-standard-for-the-next-10-years power distribution bus. We will pay thru the nose for that, until economies of scale bring its cost down, and its… oh i dunno… ?5%? power savings might take 30 years to recoup? Show us what THIS bright idea will cost and what real percentage power savings it will bring. Show us some real numbers, and we will compare that to unplugging 2 or 3 servers because virtualization might let us do that, depending on the application loads.
Uh, heat sinks, fans, liquid cooling, etc., don’t make things more efficient. They simply provide a way to move heat from one place to another. Once the heat is given up, it is lost with respect to being useful computationally. I think you’re not understanding this important fact.
The hospital I work for has spent a LOT of money on HVAC for their server rooms. I am talking a LOT of moola.
JT
http://www.FireMe.to/udi
This is a great article and it shows how the times are changing.
We are currently undertaking a air-side economizer project for our data center. You can read more about it here: http://redrocksdatacenter.com/green and we’ve started a blog to cover the construction: http://ae.redrocksdatacenter.com
In addition, we’ll begin construction on a new building next year that will be 100% DC. We sit on over 85 acres and are planning on putting up > 30Kw of solar arrays. These are fun projects and hopefully other data center owners will take notice.
Tom Nats
Red Rocks Data Center
rrdc_info @ redrocksdatacenter.com
A couple of quick points:
1) While industry is using some sub-optimum AC/DC power supplies, the limit of power supplies efficiency may not be at 75% that you referenced.
“Power-converter efficiencies are in the upper nineties and quickly approaching the magic 100% barrier.” (Hearst Electronic Products Monday June 30th 2008, LOU PECHI Power-One, Camarillo, CA
http://www.power-one.com)
2) A more easily achievable goal would be to increase the server use from “6%”. Virtualization is available for most server platforms and increase the usage factor significantly. This approach to reducing the heat load in a data center is true heat savings (Planning figures are about 10 to 1, that is one virtualized server can handle 10 current servers load).
3) New technology hard drives, i.e. solid state drives (SSD), decrease the heat load in a data center by reducing the power needed to turn drives. While still fairly expensive compared to conventional drives, SSDs can quickly pay for themselves by reduced power and heat. If I remember correctly they require about 10% of a conventional HD.
I’m interested in the liquid metal cooling idea. I know of a company called nanocoolers that proposed a cooling system that used gallium as the coolant. They couldn’t get any traction with the idea and have since gone out of business. Is there someone else that’s working on it again?
Also the industry is working very hard to promote and improve energy efficiency. There are two relavent industry agencies: ASHRAE (American Society of Heating, Refrigerating and Air Conditioning Engineers) technical committee 9.9 and The Green Grid. T.C 9.9 has published several books: Best Practices for Datacom Facility Energy Efficiency, High Density Data Centers - Case Studies and Best Practices, Liquid Cooling Guidelines for Datacom Equipment Centers which can be purchased at the ASHRAE.com bookstore. They are also hosting 5 free workshops in NY, http://www.ashrae.org/pressroom/detail/16615. The Green Grid’s website is thegreengrid.org.