Search Results for: cloud

post

Do you want to influence EU policy on green cloud computing?

Cloud

European policymakers are reaching out to ask European citizens for their help in crafting legislation for the better of all its citizens. This is a nice departure from the lobbytocracy which exists in some countries.

Currently, as part of the Digital Agenda for Europe, there is a process in place called the Digital Agenda Assembly which has a call for discussion and feedback on a number of hot IT issues such as Cloud, Data, Security, and Social Media.

Anyone can sign up at the site and contribute.

Via Paul Miller I came across a discussion on Green Cloud, which regular readers here will recognise as an issue I have an interest in.

The Cloud group moderator posted the following question:

The recent report by Greanpeace [sic] (http://www.greenpeace.org/international/Global/international/publications/climate/2012/iCoal/HowCleanisYourCloud.pdf) cast a light on importance of energy efficiency and use of renewable energy sources for cloud environments and data centers.

Should policy address such issues in future EU cloud strategy and how ensure a green and sustainable cloud development?

Your ideas on this subject are more than welcome.

Wow – an opportunity to influence EU policy and possibly make cloud computing more Green – I couldn’t resist. I posted the following response:

Greenpeace are correct – data centers are using dirty power to run their clouds.

Unfortunately this is often outside their control – especially in the US where the utility companies are regional monopolies and there is no choice in energy provider.

In the EU, there is more competition, and data centers should be encouraged to use energy from renewable sources and to site new builds where renewables are available. The greater the demand for renewable energy, the more will be built out.

I think the best way to encourage this is through transparency. Data centres need to be required to report fully and regularly their complete energy and emissions.

Iceland is currently running one of the world’s most reliable energy grids (it doesn’t have any outages). As well as being highly reliable, it has the cheapest energy in the western world and it is 100% renewable.

Iceland is due to become a full member of the EU in the coming year – so that should help the EU in attracting cloud providers looking for a renewable energy source.

But that is quite a local solution.

The real requirement is to move our all energy generation away from fossil fuels as soon as possible – this is important not just for cloud computing, but for every aspect of our life.

As Paul says above, mandating data centres to use Green power is not an answer, moving our generation to renewables (and requiring full transparency and reporting from data centres) is.

So there you have it – my recipe for making Cloud computing Green is to require full (auditable) reporting from all data centres (and every significant energy consumer, why stop at data centres?) of the entirety of their energy and emissions. This will create a significant demand for more renewable energy, leading the generators to re-double their efforts to bring more renewables resources on-line and rewarding those who have already done so.

So if you want to influence EU policy on cloud computing to make it more Green, why not head over to the Green Cloud discussion at the Digital Agenda and let your voice be heard too?

Photo Credit supertin

post

With great power comes great responsibility – or, Cloud companies need to get on-board

Spiderman

With great power comes great responsibility

This great quote from the movie Spider-Man, is just as true for technology, as it is for superheroes.

Technology has made possible tremendous changes in our quality of life in the last couple of decades. Everything from surgery to transportation, education to construction, space exploration and most other fields of human endeavour now depend heavily on IT. However, these great advances in our knowledge and abilities comes at a cost.

Information Technology’s carbon footprint, estimated by Gartner to be 2% of global carbon emissions in 2007, is rapidly increasing and by some estimates may even double by 2020. This is obviously an unsustainable situation. ICT, which can help so many organisations to reduce their carbon footprint, should itself be an shining example of low emissions.

To this end, the EU commission’s new ICT Footprint initiative is to be lauded. The announcement of the project on EU Commissioner Neelie Kroes blog gave the following details of the initiative:

This is why the European Commission has persuaded three leading standards development organisations and a prominent greenhouse gas accounting initiative to pool their measurement efforts. Under our new initiative these organisations will examine the whole sector, the whole lifecycle and the scalability of these methods.

That means measuring everything from the supply of raw materials to their recycling. Measuring not only what it takes to make products like a laptop, but also the impact of services like hosting data in the cloud. It means that in the near future we will be able to measure the ICT environmental footprint of whole cities or countries, including the positive environmental effects that ICT enables.

Several major ICT companies and organisations from Europe, Asia and the US are now trialling such measurement solutions. And from this month onwards, nearly 30 players have joined the European Commission to broaden and speed up the effort. We call on more and more such players to get involved.

It is tremendous to see this kind of global leadership from the EU. While this only applies to the EU, it does require the development of measurement and reporting systems for whole IT ecosystems and that can only be a good thing. In time, the hope would be that these systems are used well beyond the EU and by all IT providers.

The initial participants in the organisation are some of the better known large IT companies – BT, Alcatel-Lucent, Intel, Cisco, Hitachi, Telefonica, Fujitsu, SAP, Nokia, AMD, Dell, HP, etc. However, notably absent are the major Cloud providers. Where are Amazon, Microsoft, IBM, VMWare, RackSpace, Salesforce, even Google who have gone furthest arguably in reporting and reducing their emissions, are not participants.

I have lamented many times on this blog the lack of transparency of Cloud companies and they continue to prove me correct. Unfortunately.

Transparency around energy use and emissions is coming, have no doubt. Cloud companies will eventually have to report this information. They will be dragged into it screaming and kicking, but it will happen. Then we will be able to finally decide which provider to use based not just on price, but also on their impact.

In the meantime, if you are interested in reducing the impact of your Cloud computing, you could do worse than to check out MastodonC – a company that “selects the most efficient and sustainable location for your Hadoop job” and/or Greenqloud – a company offering public compute cloud using only renewable energy to power their cloud (their data centers are based in Iceland where 100% of the electricity comes from hydro and geothermal sources).

Photo Credit Greg and Mellina

post

Tendril courting developers for its cloud-delivered energy app platform

Green Carrot energy usage app

Last August Tendril, a US-based energy platform company, announced that they were opening their API’s and launching an energy application developer program. The idea is to allow developers to build on Tendril’s cloud platform and to deploy the developed applications on Tendril’s Tendril Connect cloud platform.

For developers this is an opportunity to develop applications addressing the energy challenge and have them deployed in a ready-made marketplace of up-to 70 million addressable households. Similar to the Apple App store, Tendril offers co-marketing opportunities for developed applications.

Tendril provides developers with, not just the API’s, but also comprehensive documentation with a “Try it Now” capability as well as a discussion forum (so far lightly used) to have questions answered.

Tendril has also been promoting this initiative to developers by participating in Hackathons in San Francisco and more recently in New York. In conjunction with the New York Hackathon, Tendril ran a contest to see who could come up with the best apps using their API’s. The winner, eMotivator, won $3,000, while 2nd placed Green Carrot (screenshot above) won $2,000 from Tendril and another $1,000 from the Hackathon organisers for ?best user experience?.

And I note that Tendril are listed as one of the Participating Organisations in the London Green Hackathon being organised by AMEE this coming weekend.

Of course, if Tendril really want to talk to developers, they should also be attending our RedMonk Monki Gras conference in London next week (Feb 1-2)! I’m not sure what the collective noun for developers is (I asked on Twitter and received the following suggestions – batch? class? scrum? repository?), but whatever it is, there’ll be a shedload of them there!

One of the interesting things about the Tendril open API initiative is that it should stimulate lots of creativity in the Smart Grid space. So far, as Tendril CTO Kent Dickson noted in a call with me the other day, no-one knows what the Smart Grid killer app will be, but crowdsourcing the ideas is far more likely to lead to compelling results.

post

Is Cloud Computing Green?

I gave the keynote address at the Digital Trends 2011 event organised by HePIS and CEPIS in Athens recently. My talk was on Cloud Computing’s Green Potential and in my presentation, I claimed that Cloud Computing is NOT Green.

I started the talk by explaining what Cloud Computing is and the many advantages it can bring to companies. However, because none of the Cloud providers are publishing energy figures around Cloud computing, we can’t say whether or not Cloud computing is energy efficient.

I went on to point out that even if Cloud is energy efficient (and we have no proof that it is), that is not the same thing as being Green.

My slides are available on my SlideShare account and a transcript of my talk is here:

Okay, so my talk this morning is on Cloud Computing and its Green Potential. So a quick couple of words about myself.

So my name is Tom Raftery, I work for an industry analyst firm called RedMonk. My area of interest within RedMonk or the area I specialize in is energy and sustainability. We have termed the practice within RedMonk that concentrates on energy and sustainability GreenMonk. So the place that I blog at is at GreenMonk.net.

And a little bit about my past. I worked in an organization called Zenith Solutions back in the 90s and early 2000s, and Zenith Solutions was a software company creating what has now become termed cloud applications. At that time we called them web applications, they were web based software with the database backend online.

Then I worked for a company called Chip Electronics in the early 2000s and Chip Electronics was again a company which created Enterprise Resource Planning, ERP applications which were cloud delivered, at the time we called it Software as a Service. No at the time we called it active service provisions, since become Software as a Service. And I am also a co-founder and Director of CIX, which is a hyper energy efficient data center based in Cork in Ireland. So I know both from the hardware side and the software side.

I mentioned my blog on GreenMonk.net, I am on Twitter and twitter.com/tomraftery. My email address is there, my mobile phone number is there, please don?t ring it now. And this site here, slideshare.net the last line there and I am sorry for the bullet points, I don?t normally use them, but I did just here and in one other slide. slideshare.net is a site where you can upload a presentations.

So, this presentation I am giving this morning, I uploaded it to SlideShare earlier this morning, so it?s already online there at that site and if you go there now you?ll see it has already been viewed over 277 times so far. So, it?s a great site for getting your talks out all available, it?s also downloadable there.

One thing you?ll notice as well about the structure of my talks is a lot of them have images like this, but they also have this bit of text at the bottom which you can?t read, don?t try right now, but what they are is those are links to the source material. So, if at any point you do download the presentation you can go and click on the links, they are clickable links you can click on them and see where I?ve got the information from.

So that?s me, who are you guys?

A couple of questions, so how many people here have deployed applications to the cloud? Not very many. How many plan to? A few more, okay. How many people here think that cloud computing is green? Okay, good few people. Right. I hope to burst that bubble, unlike Nancy who spoke just a minute ago, I am not a, I am not a believer that cloud computing is green and I hope to explain why. I am a huge fan of cloud computing, I have to say, I use it extensively, going back to the slide for a second.

The Chip application, the Zenith stuff, the GreenMonk, Twitter, SlideShare even my email are all cloud delivered. Our organization RedMonk we use Google applications for domains for our email, so my email is cloud delivered as well. So I am a big user of and believer in cloud for lots of things. But I just don?t happen to believe it?s green.

So what is cloud computing? Well at kind of first blush it?s software that?s delivered in a browser, so that?s an very easy definition of it, something we can all kind of sign up to it. It?s a lot more complex than that at various other levels and I?ll go through a couple of those other levels as well, just very briefly to kind of give you that the kind of complexity that?s involved in it, but I am not going to go into any great depth. So it?s also nothing that?s very new, this is the original sign up screen for Hotmail.

Hotmail was an email application developed and sold to Microsoft back in ?97 for $450 million if memory serves. But this was before it was sold to Microsoft, this was the original sign up screen when they launched in July ?96 and it was one of the first widely used Software as a Service or cloud application.

So cloud is nothing new, it keeps getting rebranded, so the cloud name is newish alright, but the delivery mechanism is not that new. It actually harps back to mainframe computing back in the 60s.

So there are several types of cloud computing and the first type, the first level of cloud computing is kind of Software as a Service. That?s where you kind of take your packaged software and convert it into something as I mentioned already delivered in a browser. And I mean you probably are aware of these I mentioned Hotmail and its analogs the Google applications, there is also Zoho, there is social networking the Twitter that I mentioned, SlideShare all these kind of things, they are all Software as a Service.

So they are just basic applications that you access through a browser. But you can go back one level of abstraction from that to where you get to what?s called platform as a service. And don?t worry about these acronyms basically a lot of the times you don?t need to know this stuff, the platform as a service stuff is where you, as I could say, you go back one level of abstraction and you give people a platform on which to deploy cloud applications.

And the kind of platforms that you can get are ones like the Google app engine and Amazon and Microsoft?s Azure, these are the kind of platforms that are available if you want go down that route. Most people don?t need to go there, but if you do that kind of stuff is available as well. And then you can go back one further level of abstraction where you are actually delivering Hardware as a Service and this is called Hardware as a Service or Infrastructure as a Service and both names are valid, HaaS for hardware or IaaS for infrastructure as a service and that?s where you?re delivering stuff like networking, storage, compute, CPU cycles that kind of thing as a service.

And VMware, Rackspace, OpenStack again Amazon with their EC2 and their S3 services are those kinds of types of cloud computing. If that?s a little confusing and I know it can be, this is a slide which is also confusing, but if you actually stop and study it in your own time, you could download this application and if you are interested about it, this is a good way of seeing how the different types of cloud computing stack up as it were.

So over here on the very left, you have your traditional packaged software with the entire stack from networking up through applications where you manage the entire stack on your machine. So that?s the traditional Microsoft Office whatever applications, you do the whole thing.

Over on the other side you got your Software as a Service, something like Google apps or domains or one of these things where the provider the Google or whoever are responsible for the entire stack, all you have is a browser. And then in the middle you have the two other ones, the platform as a service, where the vendor managers up to here and you manage the applications and data or infrastructure where the vendor managers is just this part and you manage the rest.

So that?s the kind of way it stacks up. As I say on the deck itself there is a link down there to where you can find that image if you are interested in checking into it. It?s quite a nice way of seeing the differences between the different types of cloud computing.

And then just to complicate things a little further, there are different deployment mechanisms. You can have private cloud, private cloud is hosted by yourself on your own infrastructure behind your own firewall. You can have public cloud which is what most people are familiar with or you can have a hybrid where you have some stuff private, some stuff public and that?s one that a lot of people are looking at, because it means you can have your data behind your firewall, but the functionality you are accessing it from public. So your stuff remains on premise.

And that?s quite important, because as Nancy alluded to, there can be a lot of issues with the data in cloud computing, because for example if you are a European company do you really want your data hosted on servers in US territories where for example the data privacy laws are a lot more lax. So I have spoken to several European companies who have said categorically they will not use cloud computing if their data is going to be hosted in US territories. It?s only if it?s in the EU and only if they know where in the EU. So you are noticing cloud providers taking that on board and starting to become aware of those issues and while they can?t change US law, they can start providing storage mechanisms that they are guaranteed to be in region.

So that?s cloud computing and the next question we get to is, is this really energy efficient because lots of people say it is and even Nancy alluded to that report from the Carbon Disclosure Project which I?ll blow apart in a minute. They aren?t the only ones Microsoft, Accenture and WSP environment brought out this story in November of last year. And this is the actual title of the story, where they say it shows significant energy in carbon emissions reduction potential from cloud computing and again the link to the report is down there at the bottom.

The difficulties I have with that are several, first is Microsoft are a cloud computing provider so they kind of skin in the game. The second is that, they don?t actually use any hard data, it?s all imputed. And the third is that after months and months of work from all these people the best they could come up with is they could say it has potential. Yeah it has potential to end world hunger and bring on world peace and fix the euro, anything kind of potential. So that?s a non-report.

Cloud computing has phenomenal advantages, don?t get me wrong, I am a big fan. So if you are into traditional IT, you know well that if you are deploying a new application or a new server it?s pain staking, you have to go through an RFP process, a tender process, PO process. You have to put, you have to go to tender and you have to get that — when you have to place the order, the order then can take several weeks from the supplier. When it comes in, it goes into the logistics area, if you got to get the guys in warehousing to tell you where the server is, you have to get the server, you have got to put the company image on the server, you got to install the applications, you got to do testing, you got to patch the server, the list goes on and on. Basically you want to deploy a new server, it?s a process that can take weeks to months.

You deploy a cloud application, there is usually no RFP and no PO process because there is — the capital cost is minimal. So typically the time to deploy for a cloud application shrinks from weeks to months to hours to minutes depending on what you are deploying, so phenomenal, cloud is fantastic for streamlining that kind of stuff.

It?s also great for what?s called dynamic provisioning. So this is the Alexa graph, the website traffic of a website for the Australian Open. The Australian Open is a big tennis competition happens in Australia every January. So you?ll notice 11 months of the year no traffic to the site, come December, January vroom, spike, that?s 2006, 2007, larger spike 2008, larger spike and the spikes keep getting bigger as you go in that direction.

So if you were the website owner for the AustralianOpen.com website you would need to have — if there were no cloud computing options you would need to have servers that could hit and deal with the traffic at this growing spike for 12 months of the year when the traffic is only there one month of the year. But with dynamic provisioning and cloud computing you can use the elasticity of the cloud to turn up the resources assigned to that site as the traffic starts to build up in December and January and then as the traffic falls off, you turn it back down again.

So in that respect cloud computing is fantastic as well, you are not using resources needlessly. You?ve also got the idea of multi-tenancy and if you can?t see what?s in this picture it?s actually a Mini Cooper with 26 people inside in her, EMC sponsored it as the world record attempt to fit people into a Mini Cooper and they fit 26 people into it. So they stuff people into it with multi-tenancy in cloud computing it means you are sharing applications across companies, lots of different companies often competitors are using the same single version of the application.

And that?s fantastic, that adds greater value. You know, you have only one instance of the application which is great as well for updates, updates of the application are instantly deployed. You know, you don?t have to download the latest update and apply it to the test server and make sure it works in the environment, the whole thing, you know, it?s just instantly on.

This is the issue of server utilization which again Nancy referred to, Nancy you stole my talk, come on. So this is a typical graph of server utilization and you can see this the memory part, but this is the server utilization and it?s at zero percent here. And well that?s a bit of a outlier, you?ll often and get in normal server, you?ll often get utilizations in single digits 7, 8% server utilization for traditional servers in data center environments. But with the advent of virtualization and cloud computing you can ramp that up significantly. So that should be quite energy efficient.

Then you have got this kind of outlier thing called chasing the moon, which you may or may not have heard off. It?s one I am kind of found of as an idea, but not many people have deployed it yet. People are kind of talking about it as out there, and what it is, is with cloud computing if you?ve got data centers in say, US, West Coast, another in Northern Europe or Southern Europe, Northern European typically because it?s cooler there and cooler I mean colder not more ?hip?. And you?ve got another data center say somewhere in Asia or Eastern Russia. Then you?ve got the time zones covered about eight hours apart. So if you have an application in those three centers, you can move the compute to where energy is cheapest at any particular point in time. So if you are doing that typically energy is cheapest when it?s in highest supply, when it?s in highest supply and it?s cheapest, its actually, this is on the wholesale markets, it?s actually greenest as well.

So when electricity is at its cheapest, it?s actually also at its greenest that?s ? it?s kind of counter intuitive but I can explain that if any one who is interested later.

So if you move your compute to where the energy and the compute is cheapest at any point in time, it?s typically night time when wind is blowing and at that time you are chasing the moon, you are putting your applications wherever the moon is out, it?s called chasing the moon.

And so it?s something you could only do — something that?s only made possible by the likes of cloud computing. Your information is ubiquitous, it?s wherever you have an internet connection, so your road warriors, your sales people on the road, can access the application while sitting up in the beach.

It also enables a lot more home working, homeshoring, teleworking whatever you want to call it. And people like ATT, IBM, lots of big companies are huge fans of this. IBM reported a couple of years back that 25% of their employees did teleworking and those 25% were saving IBM $700 million a year. That?s significant savings and a lot of that savings comes from a lower real estate footprint and a lower energy footprint because of the lower real estate footprints.

So is it energy efficient or lot of those savings coming from less commuting or from less building stock or are they from offsetting your energy? So if you are working from home you are still burning energy, it?s just not in your company?s building, your company isn?t accounting for it anymore. These are kind of questions we are not sure of, there hasn?t been any definitive studies either way, and it?s difficult anyway because it differs in every company and every geography.

One huge problem I have with cloud computing and people saying that cloud computing is energy efficient is that none of the cloud providers are publishing data around their energy utilization, not one of them. So I often do a kind of a hands up exercise at this point and I don?t know if it?ll work here, because very few people admitted that they were going to be putting stuff in the cloud, but let?s raise hands again. Hands up everyone who has or plan to deploy applications to the cloud? Okay, so keep your hands up, keep your hands up. Now keep your hands up if you know the current energy utilization of the applications you are going to deploy to the cloud or the energy applications you have already deployed to the cloud, if you know how much energy your applications burn, keep your hands up. Okay we got one, anyone else just the one? Good. Okay, keep your hand up, we are not finished. Okay keep your hand up if you know the energy utilization of that application in the cloud. You do, is it a private cloud?

And they are giving you the energy utilization of that?

Okay, I am interested in that because I do a lot of work for SAP and they can never tell me the energy utilization of any of their cloud infrastructure.

I think, okay I must get back to you on that because I — if that is the case it must be very new, because it?s not something they?ve ever shown me before and if they do it it?s often kind of what we call humbligated it?s often — they will give you an average but they won?t tell you exactly what your application and what your users are utilizing which is what you need to know.

So as I say with the possible exception of SAP, most cloud providers do not provide the data. So without that data, we have no way of knowing if our applications are in fact energy efficient in the cloud. Even if they are, energy efficiency is not the same as being green. Just because something is energy efficient does not mean it?s green, and this is a very common mistake that people make.

So what is green? Well I’m also going to quote from the CDC report that Nancy mentioned. And this CDC report, it?s called Cloud Computing – The IT Solution for the 21st Century and again there is a link to it there.

One of the quotes that the CDC put into that was that that a typical food and beverage firm transitioning it?s HR application from dedicated IT to public cloud can reduce CO2 emissions by 30,000 metric tons over five years. That sounds good, I buy that, that sounds quite green actually. They also went on though in their executive summary to say allowing companies to maximize performance, drive down costs, reduce inefficiency, and minimize energy use and therefore carbon emissions. So they have made the classic fundamental mistake of thinking that reducing or making something energy efficient makes it green or reduces emissions. There is nothing that says that is the case. I will tell you why?

And by the way Nancy and this is the blog post I wrote on GreenMonk where I explain in significant detail why the CDC report is completely flawed. So there is a link there you can go and have a look.

I will give it to you later, I will give you the link later. So two reasons why that report is deeply flawed. One of them is it?s based on assumptions and they say so in their model, they say their model is based on assumptions and the second is based on metric called PUE. So I?ll get the PUE in a second. PUE is Power Usage Efficiency. Anyone here familiar with the term PUE? Couple are, okay. So I?ll get to in a second. They based their model on this PUE metric, which is a widely used metric. But they have based it on a average PUE across the entire United States which is put out by the EPA, so that?s not really very indicative firstly.

But secondly, PUE the measurement itself, it?s a ratio of the total amount of power used by data center compared to the power deliver to the computer equipment. So the total power delivered to a data center is the power delivered literally to the door of the data center, which goes to power of the lighting, it goes to power the cooling, it goes to power of the UPSs, the whole thing, that?s the total power. And it?s a ratio of that to the amount of power which actually makes to the IT equipment. So the closer your PUE figure is to 1.0, the better.

Now couple of problems with PUE as a metric. The first is there hasn?t traditionally been any standard about where you measure the power. It?s measured at the meter, the power meter, the electricity company power meter but in data centers that is often been measured on the high voltage site, the medium voltage site, or the low voltage site depending on the data center, depending on where they put the meter. And of course if you are measuring out at these different place one data center measures at one place, another at another place you can?t cross compare because you are leaving out the loses that occur in the conversion from high to medium to low voltage.

So right there the lack of standardization that?s been worked on at the moment, and it is getting better, they are start to standardize but traditionally it hasn?t been standardized. So that?s one issue straightaway.

But even more important is, quick look at this graph here, if I have a data center which takes in two megawatts of power and of those two megawatts of power, one megawatt goes to powering the servers, then I have a PUE of 2.0, very simple. However if I realize that my one megawatt isn?t being used very efficiently, and I realize that some of my servers are being under utilized, may be I?ll virtualize some of them and I shut some of them down. Then my power draw from my IT equipment drops to 0.75 a megawatt. My total draw drops to 1.74 and my PUE goes up to 2.33. Remember I said PUE closer to 1.0 means you are more efficient. I?ve actually made it more efficient and my PUE has gone from 2 to 2.3, so it?s a huge problem right there with the PUE metric.

Another issue and I am sorry this is a little bit complex, but I?ll walk it though it again another issue with PUE is it takes no account of carbon. So top line is a typical data center, typical data center in a European country, a European country where the supply of power causes CO2 per kWh that?s not unusual that?s a pretty average figure. So if that typical data center has a PUE of 1.5, just quiet good, then we get 1.5 by 0.5 we get 0.75 kg CO2 per kWh is the IT carbon intensity, is how much the IT equipment is producing in terms of CO2.

So if we have a data center with the a good PUE 1.2 and that good data center is drawing mostly from coal-fired power, so it?s got a supply carbon intensity of 0.8 kilos, the you are — 0.8 by 1.2 means you are producing — even though you have got a good PUE in your data center, you are producing 0.96 kilo CO2 per kWh.

On the other hand if you have got a really bad data center with a PUE of 3, very inefficient data center, PUE of 3 but is fired mostly by renewables. So your carbon intensity on your supply is 0.2, but still it?s not 0 it?s 0.2, it?s significant, there is still carbon being produced per kWh. 0.2 by 3 gives you 0.6, which is significantly less. It?s, you know, 60% of the carbon intensity of the data center with a PUE of 1.2.

So PUE is no indicator whatsoever of how green some thing is, it?s a very bad metric. There is other metric called a CUE the Carbon Usage Efficiency but it is not widely used by the industry unfortunately.

So given that, the report that the CDC produced could just as easily have said that your typical food and beverage firm transitioning HR to a dedicated public cloud could increase CO2 emissions by 30,000, just as valid. They pick the number out of the air and they base it on a flawed metric, so it?s just as valid to say it could increase CO2 as decreased CO2.

And a good example of this in fact is Facebook, Facebook build this lovely new data center in Prineville, Oregon, they opened it early this year. Had an unbelievable PUE coming in around 1.08, highly efficient, they have open sourced it. If you go to opencompute.org you can get the blueprints for building the data center and the list of suppliers, so you can go on build that same data center yourself. They reduced their energy consumption per unit of computing by 38%, that?s fantastic, that?s really good.

Unfortunately, their energy supplier is a company called PacifiCorp. PacifiCorp produces 58% of its power from coal, this is their website, they say it themselves right there. They produce 9.6 million tons of coal from their own mines every year. They also produce another 12% of their electricity from natural gas, so that?s 70% they produce from fossil fuels, plus they also buy 22.5% of their power from other suppliers. Now they don?t say how those other suppliers generate theirs. So they get at least 70 and possibly significantly more of their energy from fossil fuels. So right there Facebook?s really impressive 1.02, sorry 1.08 PUE is blown out of the water by the fact that it?s all produced using carbon or almost all.

To contrast that this is the graph of power production on the Spanish grid. I picked Spain because I happen to live there and you can see that this was taken last Friday, the snap shot and again you can get information from the Red El?ctrica de Espa?a. The red bar here, or bar whatever it is area is coal, comes in around 20%, green one here is wind, the other is, the rest of the renewables put together except water, which is down here.

So on the Spanish grid, carbon intensity comes in around 20% at the moment based on that plus the gases and other 15% sorry. And that?s actually bad compared to the same grid two years ago. The same grid two years ago, coal was coming in single digits here on 9% and the reasons gone from the 9% two years ago to 20% today is because Zapatero, the now former President of the parliament comes from Castile and Le?n which is a coal producing part of Spain and he went to the EU and he petitioned for years to be allowed to give subsidies to the coal miners and the coal production in that part of Spain. And last February, sorry February 2010 he succeeded and they got 4.5 billion Euro in subsidies for producing coal in Spain and that?s a direct result, it?s scandalous.

Anyway that?s either here or there let?s move on. Dublin, I am originally from Cork, so I?ll talk of Ireland for little bit. Dublin has become a European, key European datacenter hub. Most of the big data center providers have significant operations in Dublin. Microsoft have their largest datacenter outside of US in Dublin. It provides the Microsoft Live and Azure services for EMEA. Similarly Amazon are there, Google are there, they all have significant centers there and they are all expanding. Google have announced new expansion as of Microsoft representatives.

Unfortunately, Ireland produces 84% of its electricity from Fossil fuels, that number is falling as it rolls out wind, it was a 87% a couple of years ago, but now its 84%. So that?s not really very green. On the other hand Apple have announced their iCloud service and their iCloud service is currently housed in this datacenter in North Carolina, it?s a photograph of it under construction. Unfortunately this datacenter gets 78% of its energy from Duke Energy who get it from, no they get all of their energy from Duke Energy, Duke Energy get their energy from 78% coal and nuclear.

Coal is obviously really bad, nuclear is also really bad, not just because of the Fukushima reasons, but you got to think as well, nuclear power plants have an enormous water footprint. And that is, it can often be devastating to the environment around them. But Apple have said in fairness to them that they have got a 121 acres site behind them that they are now clearing for scrub to install a solar facility, it will mitigate a little their emissions, a 121 acre solar facility is not going to complete power the plant and it certainly won?t power at night time but it will have at least.

Google are the really interesting player in this field, because Google have gone to extreme lengths to get their carbon footprint down to zero. They have signed power purchase agreements with Wind farms. A power purchase agreement is where you sign on the dotted line with a wind farm or any one in this case it?s wind farms in Google?s case, you sign on the dotted line and you say, for the next X years and in Google?s case its next 20 Years I will take all of your power, all of it.

For wind farms that?s a huge win because that means they can go to investors and say, we?ve got checks rolling in from Google for the next 20 years guaranteed and here is the contract, do you want to invest in us now. So obviously it will help them get investment inward investment. It?s a great win for Google on two fronts, one is they?ve got guaranteed renewable energy and the second is they?ve got guaranteed pricing for their energy for the next 20 years. How many people can say they know what the price of their electricity is going to be in 20 years?

So they have done it in a number of wind farms, this one is in Iowa, 114 megawatts, this one is in Oklahoma, another 100 megawatts. And they?ve gone to incredible lengths and this is the slide I mentioned earlier with all the bullet points and I?m really sorry this slide is more bullet points than I normally have in entire talks. So there is nine bullet points in this but it gives you an idea of the investments that Google have made in renewable energy.

The Potter Drilling one is for geothermal, Makani Power is for high altitude wind power. Solar City, the Atlantic Wind connection, that?s a — I can?t remember how long it is, it?s a massive offshore wind farm off the east coast of the US and they?ve invested in the infrastructure of that, they own a percentage of the infrastructure in that, in total Google have invested $850 million on renewables. So if anyone could be slightly green I guess in cloud it would be Google.

Having said that though, there is lot of having said that in this presentation I am sorry about that, it?s a complex area. Jevons paradox, William Stanley Jevons is an economist in the 19th century in England. And he realized that as steam engines were being made more efficient in burning coal, as they were getting more efficient at burning coal the amount of coal being burnt was actually going up not down. It was kind of counter intuitive but how it worked was as stream engines become more efficient the price dropped, more people bought them, more coal was burnt. And it?s similar with cloud computing. As cloud computing goes and starts taking off in adoption the resources that are used actually go up not down.

So cloud computing leads to an increase in consumption and this also then Parkinson?s Law and a curare of Parkinson?s Law which says data expands to fill the space available for storage, the more storage you have the quicker it fills up, you all know that. And a good example of that is when Gmail started in 2004 Hotmail had a 2 meg limit on the size of your inbox. Yahoo at 4 meg and gmail said, I am offering one gigabyte, blew them out of the water and suddenly they had catch up and go to one gigabyte, Google is now at 7.5 giga byte and they allow you to send emails of 25 megabyte, single email 25 megabytes.

So, also a nice quote I got from Infochimps? Flip Kromer and this really characterizes how cloud computing can promote consumption. And Flip said it very well when he said, EC2, which is one of Amazon?s offerings in cloud means anyone with a $10 bill can rent a 10 machine cluster with a terabyte of distributed storage for eight hours and because it costs virtually nothing to do it and because anyone can do it — it happens all the time. So that?s not very green.

You?re confused yet? So what if ultimate irony you had cloud delivered green software, Hara, Nootrol, SAP?s Carbon Impact OnDemand, these are all carbon management applications which are cloud delivered. Now, I am really confused I don?t know if they are green or not. Microsoft Iron Earth, cloud delivered using the Azure platform for managing air quality, water quality, noise pollution, that kind of thing, I think my head just exploded.

So my conclusion from all this is that cloud computing has a significant number of advantages, but being green isn?t one of them. One last thing if you are deploying stuff to the cloud, this is not really how you want to do it. Thanks very much.

post

Don’t forget – where your cloud apps are hosted helps determine their carbon footprint

Greenwash

Back in July of this year (2011), the Carbon Disclosure Project (CDP), in conjunction with Verdantix, released a report titled Cloud Computing – The IT Solution for the 21st Century [PDF warning] which erroneously claims Cloud Computing is Green. Shortly after it was released, I wrote a long post outlining exactly where the report was flawed. I also contacted the CDP directly outlining my concerns to them and pointing them to the blog post.

Then, a couple of weeks back, when preparing my slides for my Cloud Computing’s Green Potential talk for the Cepis and Hepis Green IT conference in Athens, I discovered that Verdantix and the CDP had published

a new report [PDF] on the business and environmental benefits of cloud computing in France and the UK

Unfortunately, not only does the new report make the same mistakes as the original one, but it further compounds those errors with an even more fundamental one.

Let me explain.

In the key assumptions section of the report it talks about the metric tons of CO2/kWh in both the UK and French electricity grids (0.000521 tonnes and 0.000088 tonnes respectively). It uses these figures to extrapolate the savings in both France and the UK for companies migrating their applications to cloud computing.

So? You say. Sounds reasonable to me.

Well, the issue is that they didn’t do any work to identify where applications migrated to the cloud would be hosted. The implication being that UK applications migrated to the cloud, will be hosted on UK cloud infrastructure and French IT applications will be migrated to French hosted cloud infrastructure. In fact this would be a highly unusual scenario.

A quick look at where most cloud hosting takes place shows that the vast majority of it is occurring in the US, with quite a lot happening in Singapore with a lesser amount in Europe (and that split between Ireland, Germany, UK, etc. but almost none in France – Ireland is underestimated in the list as it doesn’t include Microsoft which has a significant Cloud hosting facility in Dublin which it is now expanding or Google’s Dublin facility).

Ok, and what about the carbon intensity of electricity generation in these countries? If a cloud application is moved to somewhere with a lower carbon intensity for electricity generation, then there is a possibility of a carbon saving. However, with the vast majority of cloud hosting still being done in the US, that isn’t a likely scenario.

This table of CO2 emissions from electricity generation, by country shows that the US has one of the most carbon intensive electrical grids in the world. France, on the other hand, with its high concentration of nuclear power (78%) has one of the least carbon intensive electricity grids in the world. While the UK grid’s carbon intensiveness at 557kg CO2/mWeh sits just above the world average of 548kg CO2/mWeh.

While it is possible (though not probable) that UK IT applications outsourced to the cloud would be hosted in a country with a lower carbon intensity than the UK, the chances of a French IT application being hosted in a country with a lower carbon intensity than France are virtually nil.

Given this, the assertion by the CDP report that

large businesses in France and the UK can reduce CO2 emissions from their IT estate by 50% compared to a scenario where there was no cloud computing.

seems, at best, extremely improbable.

One problem with coming up with reports like this is the lack of transparency from cloud providers on their locations, their energy and carbon footprints. If all cloud providers reported these metrics, it would be a far simpler matter to decide whether cloud computing is green, or not. Without these data, there is absolutely no way to say whether moving to the cloud increases or decreases CO2 emissions.

If you are wondering why the Carbon Disclosure Project and Verdantix are so bullish in their assertions that Cloud Computing is Green – if you scroll to the bottom of the report, you’ll see this:

CDP & Verdantix's motivations

This study was supported by AT&T
For more information on AT&T Cloud Solutions go to …

The report was paid for by the Cloud Solutions division of AT&T. Enough said.

Photo credit fotdmike

post

Carbon Disclosure Project’s emissions reduction claims for cloud computing are flawed

data center

The Carbon Disclosure Project (CDP) is a not-for-profit organisation which takes in greenhouse gas emissions, water use and climate change strategy data from thousands of organisations globally. This data is voluntarily disclosed by these organisations and is CDP’s lifeblood.

Yesterday the CDP launched a new study Cloud Computing ? The IT Solution for the 21st Century a very interesting report which

delves into the advantages and potential barriers to cloud computing adoption and gives insights from the multi-national firms that were interviewed

The study, produced by Verdantix, looks great on the surface. They have talked to 11 global firms that have been using cloud computing for over two years and they have lots of data on the financial savings made possible by cloud computing. There is even reference to other advantages of cloud computing – reduced time to market, capex to opex, flexibility, automation, etc.

However, when the report starts to reference the carbon reductions potential of cloud computing it makes a fundamental error. One which is highlighted by CDP Executive Chair Paul Dickinson in the Foreword when he says

allowing companies to maximize performance, drive down costs, reduce inefficiency and minimize energy use ? and therefore carbon emissions

[Emphasis added]

The mistake here is presuming a direct relationship between energy and carbon emissions. While this might seem like a logical assumption, it is not necessarily valid.

If I have a company whose energy retailer is selling me power generated primarily by nuclear or renewable sources for example, and I move my applications to a cloud provider whose power comes mostly from coal, then the move to cloud computing will increase, not decrease, my carbon emissions.

The report goes on to make some very aggressive claims about the carbon reduction potential of cloud computing. In the executive summary, it claims:

US businesses with annual revenues of more than $1 billion can cut CO2 emissions by 85.7 million metric tons annually by 2020

and

A typical food & beverage firm transitioning its human resources (HR) application from dedicated IT to a public cloud can reduce CO2 emissions by 30,000 metric tons over five years

But because these are founded on an invalid premise, the report could just as easily have claimed

US businesses with annual revenues of more than $1 billion can increase CO2 emissions by 85.7 million metric tons annually by 2020

and

A typical food & beverage firm transitioning its human resources (HR) application from dedicated IT to a public cloud can increase CO2 emissions by 30,000 metric tons over five years

This wouldn’t be an issue if the cloud computing providers disclosed their energy consumption and emissions information (something that the CDP should be agitating for anyway).

In fairness to the CDP, they do refer to this issue in a sidebar on a page of graphs when they say:

Two elements to be considered in evaluating the carbon impact of the cloud computing strategies of specific firms are the source of the energy being used to power the data center and energy efficiency efforts.

However, while this could be taken to imply that the CDP have taken data centers’ energy sources into account in their calculations, they have not. Instead they rely on models extrapolating from US datacenter PUE information [PDF] published by the EPA. Unfortunately the PUE metric which the EPA used, is itself controversial.

For a data centric organisation like the CDP to come out with baseless claims of carbon reduction benefits from cloud computing may be at least partly explained by the fact that the expert interviews carried out for the report were with HP, IBM, AT&T and CloudApps – all of whom are cloud computing vendors.

The main problem though, is that cloud computing providers still don’t publish their energy and emissions data. This is an issue I have highlighted on this blog many times in the last three years and until cloud providers become fully transparent with their energy and emissions information, it won’t be possible to state definitively that cloud computing can help reduce greenhouse gas emissions.

Photo credit Tom Raftery

post

3 easy steps to see if your Cloud solution is energy efficient

Cloud

I’ve written a number of posts questioning whether Cloud Computing is Green or Energy Efficient but to be a little more helpful, here is a simple test you can do to see if your Cloud Computing delivered applications are yielding energy efficiency gains for you:

  1. Have you moved some of your applications to a Cloud provider? – if “Yes” go to step 2 (if no, then cloud is not saving you energy)
  2. Do you know what the energy consumption* of that application was before moving it to the cloud? – if “Yes”, go on to step 3 (if no, then you have no way to tell if your Cloud solution is saving you energy)
  3. Do you know the energy consumption of your application after it has moved to the Cloud? – if “Yes” subtract 3 from 2 and if the answer is positive then Cloud is saving you energy (if no, then you have no way to tell if your Cloud solution is saving you energy)

*Obviously, the units of energy consumption in steps 2 and 3 need to be the same for this to work. To make sure they are, try contacting your Cloud provider before moving your applications to the Cloud and asking them what their method for measuring energy consumption is. If they tell you (more than likely they won’t) you can match your measurement units in step 2 to theirs.

Unfortunately, as Cloud Computing providers are, as yet, not publishing energy consumption information, for now, this only works as a thought experiment. However with coming regulatory requirements around reporting of energy consumption, Cloud Providers may be forced to reveal this information.

It is only when Cloud providers detail their energy consumption information that we will be able to say whether Cloud Computing is energy-efficient, or not.

Photo credit kevindooley

post

Cloud Computing’s Green Potential – my talk at the Green Economy conference

The good people in Business and Leadership invited me to speak at their Green Economy 2011 conference on the topic of “Cloud Computing’s Green Credentials”

The event was in Dublin and was attended by around 200 people from all walks of business. Fellow speakers were Yvo de Boer from KPMG, Dick Budden from the Carbon Disclosure Project and Dr. Willfried Wienholt from Siemens who talked about Sustainable Cities.

In my own talk, I said that intuitively, you might expect Cloud Computing to be more energy efficient, and in fact some Cloud Computing providers are making claims that Cloud Computing is “potentially” Green and energy efficient. However, seeing as Cloud Computing providers are not publishing any data around Cloud Computing’s energy consumption, then it is impossible to say just how energy efficient Cloud Computing is.

An exercise I tried out was – I asked everyone in the room to put up their hands if their company had deployed apps to the cloud – a good few hands went up. Then I said, keep your hands up if you know what the energy utilisation of those apps was before they went up – you can see where I’m going with this. Unfortunately, no hands stayed up at this point. The final instruction I was going to put to them was to keep your hands up if you know the energy utilisation of your app now that it is deployed in the Cloud. If you don’t have that information (and no-one does because Cloud Providers are not supplying it) then you can’t say that Cloud Computing is energy efficient.

Sure, you can say that you deployed your CRM to the cloud for example, and you decommissioned the servers which were handling your CRM internally – so you are saving energy there. But those energy savings are simply outsourced to your Cloud CRM provider and you have no idea how much energy they are burning to provide you with your CRM solution.

As for whether or not Cloud Computing is Green, or not – this is a different question entirely. I gave the examples of FaceBook and Microsoft, for example. FaceBook have a massively energy efficient data center in Prineville Oregan. It’s PUE is 1.07 which is near the theoretical maximum (of 1.0) but it is powered by Pacific Corp 63% of whose electricity is generated by burning coal – very definitely not Green. Similarly for Microsoft’s Dublin data center – again a very respectably PUE of 1.2, but it is powered off the Irish electricity grid, 87.5% of which comes from fossil fuels – again, not Green.

On the other hand, Google have gone to extraordinary lengths, investing over $400m in renewable energy and signing 20 year power purchase agreements with renewable energy providers – so you have to suspect that their Cloud Computing platform is Green, as well as energy efficient (but again, until they start producing data to back such claims up, it remains a suspicion!).

I concluded on Flip Kromer‘s great quote:

EC2 means anyone with a $10 bill can rent a 10-machine cluster with 1TB of distributed storage for 8 hours

This is a superb example of Jevons Paradox whereby Cloud Computing leads to increased computer resource utilisation, not reduced – which is also, not very Green!

The organisers put some of my talk up on YouTube – this may help get some context around the slides above –


post

Is Cloud Computing Green yet?

Clouds

Back in 2008 I wrote a post asking how Green is Cloud Computing?

Back then I didn’t really have an answer to the question. I mean logic would lead you to think that Cloud Computing leads to more efficiently run computers, so therefore it HAS to be Green, right? However, at the time, none of the Cloud providers were publishing their energy utilisation numbers, so no conclusions based on solid data could be drawn.

Fast forward from 2008 to now. How many Cloud providers are now publishing their energy utilisation info? Oh that’s right, none of them are.

There is a move by some Amazon shareholders calling on the company to prepare a report that will assess the impact of climate change on Amazon and make it public – but there is no guarantee that even if Amazon vote to do this, that they will include detailed energy consumption data.

One thing which might force this issue is a requirement for organisations to report emissions data – until that happens though, if the last three years is anything to go by, it doesn’t look like Cloud providers will be publishing their efficiency data any time soon.

What we need to see from Cloud providers is data in the form of watts/compute cycle so we can cross-compare their efficiency, and compare it to alternative infrastructures. This is something they have been singularly reluctant to report on to-date. One has to wonder why. Could it be that, in fact, Cloud Computing is hugely inefficient?

And even if Cloud Computing is shown to be more efficient, as Simon Wardley is fond of pointing out, Jevon’s Paradox, may mean that we end up using much more of a more efficient resource, paradoxically increasing energy consumption, which is definitely NOT Green.

So what do you think? Is Cloud Computing Green Yet? And if not, will it ever be?

You should follow me on Twitter here

Photo credit supertin

post

Cloud Energy Consumption: Google, Twitter and the Systems Vendors

Yesterday Tom posed a question: just how green is cloud computing? We have been frankly disappointed by Cloud computing providers reticence to start publishing numbers on energy consumption. We know for sure that energy is a big deal when it comes to the huge data centers the likes of Facebook are building- these firms are siting data centers next to rivers to take advantage of hydro-electric power, and in Google’s case are even looking at building their own wind turbine farms.

Some of you may remember the huge fuss when Alex Wissner Gross, a researcher from Harvard University estimated how much energy the net consumed, which became a Sunday Times story about Google Searches in terms of kettles boiled. The story claimed:

performing two Google searches from a desktop computer can generate about the same amount of carbon dioxide as boiling a kettle” or about 7g of CO2 per search

Perhaps surprisingly, Google responded, to debunk the news story:

In terms of greenhouse gases, one Google search is equivalent to about 0.2 grams of CO2.

The story petered out- which is somewhat of a shame. A real, open debate, with shared figures, bringing in all of the main players, would clearly benefit us all. With that in mind I was pleased to see that one of Raffi Krikorian, tech lead of the Twitter API team, chose to talk about power/tweet at the company’s Chirp developer conference last week:

In summary, Raffi estimated that energy consumed is around 100 Joules per tweet.

Before jumping to a conclusion that Twitter is more efficient than Google its important to note that Raffi’s estimates, unlike Google’s, don’t include the power of the PC in the equation. You should also watch the video of his presentation – for the simple reason that Raffi seems to channel Jay-Z in his presenting: the guy’s body language is straight out of a hip hop video.

I discussed Twitter’s “disclosure” with my colleague Tom this morning. He questioned its value because its an estimate, rather than a measurement. He has a point. It may be however that Raffi is just the man to take this debate to the next level. He is clearly deeply technical, can think at the level of the isolated API – and is finally a Sustainability advocate of note- I first heard of him through his seminal How Valentine’s Day Causes Global Warming riff.

We need to encourage competition on the basis of power efficiency.

I’d like to close with a call to action. Surely its time for the major web players to get together with Dell, HP and IBM in order to agree standards so we can move from estimates to measurements of Cloud energy consumption, perhaps using AMEE ($client) as a back end for standard benchmarks. You can’t have sustainability through obscurity. Open data is key to working through the toughest environmental challenges.