post

IBM based mobile, crowdsourced-reporting application helps schools speed up repairs

Leaking tap

Attending IBM’s Pulse 2012 event this year I was again struck by how much IBM’s Maximo is used in maintenance management applications.

And why do we care about that you ask?

Well, keeping machinery properly maintained, and alerting if machines go out of tolerance for certain parameters (energy consumption spikes in refrigeration plant, fuel or oil consumption in engines, even the presence (or absence) or certain chemicals, etc.) is often an early sign that that machine/system is faulty. Sometimes this fault can result in extra consumption of a resource, other times it can be a safety issue. In any case the measurement and alerting can kick off a pro-active maintenance ticket which may otherwise have been missed.

Correct scheduling of servicing for a lot of machinery is a sustainability win too. If machines are not serviced according to the manufacturers schedule, consumption tends to increase, but properly maintained they are safer, and typically consume less.

I came across an interesting example of this recently with IBM’s announcement of a project to make the US’s 2nd largest school district one of its greenest and most sustainable.

The Los Angeles Unified School District (LAUSD) has 700,000 students, 14,000 buildings spread over 710 square miles in California. It receives more than 300,000 maintenance service requests per year.

How are IBM going to improve it?

They are making it more efficient by allowing students, teachers and staff to report issues like water leaks, broken aircon/heating, exposed cables and so on, by sending text messages and photos through their mobile phones. One receipt of the text, GIS is used to locate the problem which is then submitted directly to the Maintenance & Operations Service Call Desk (which runs on IBM’s Maximo Asset Management software).

?Each year we found we were spending too much time, money, and energy locating, and reporting a problem before we even had the chance to fix it,? says Danny Lu, business analyst, Los Angeles Unified School District. ?By finding a more efficient way to report and locate needed repairs, we are able to respond faster to serve our campuses. The best part is that the solution is at the fingertips of most everyone on campus.?

Text messages are great, but obviously this needs to be expanded way beyond just sms (use of which is declining globally). This kind of project needs to have an app for each of the major phone/tablet OS’s, it needs to be able to listen in on social media channels, as well as being able to receive texts. Only when all communication sources are catered for, will an initiative like this have a chance to make this school district the US’s greenest and most sustainable.

Photo Credit Tom Raftery

post

CarbonSystems EPS chosen by Microsoft for its global environmental reporting

Microsoft

In my reviews of tech companies sustainability reporting, one very obvious laggard has always been Microsoft. Hopefully that’s all about to change.

Why? Microsoft has just signed up with CarbonSystems to use CarbonSystems cloud-delivered Enterprise Sustainability Platform (ESP) to manage its energy efficiency initiatives and for reporting its environmental performance globally.

This is big news. Microsoft has 600 facilities across 110 countries worldwide. For the first time, the full energy and environmental footprints of all these sites will now be managed from within a single cloud-delivered resource, the CarbonSystems ESP system. The levels of transparency this will give Microsoft will be immense. Perhaps now, unlike many of its competitors, Microsoft will be able to join the EU’s ICT Footprint initiative.

This move should also enable Microsoft to report on the energy and emissions associated with its own cloud infrastructure – something, like all other cloud providers, Microsoft has failed to do to-date.

This move is a big deal for CarbonSystems too. CarbonSystems are an Australian company and have done quite well there but have more recently been eying the EU and US markets. Being selected by Microsoft for a global rollout has suddenly catapulted them up the credibility charts. Had you asked me previously which 3rd party platform Microsoft might have chosen I’d probably have mentioned SAP, Hara, CA, or Enablon.

Now with this win, CarbonSystems too has a seat at the big boys’ table.

Photo Credit ToddABishop

post

The Switch SuperNAP data centre – one of the most impressive I’ve been in

Switch SuperNAP data centre

If you were going to build one of the world’s largest data centre’s you wouldn’t intuitively site it in the middle of the Nevada desert but that’s where Switch sited their SuperNAPs campus. I went on a tour of the data centre recently when in Las Vegas for IBM’s Pulse 2012 event.

The data centre is impressive. And I’ve been in a lot of data centre’s (I’ve even co-founded and been part of the design team of one in Ireland).

The first thing which strikes you when visiting the SuperNAP is just how seriously they take their security. They have outlined their various security layers in some detail on their website but nothing prepares you for the reality of it. As a simple example, throughout our entire guided tour of the data centre floor space we were followed by one of Switch’s armed security officers!

The data centre itself is just over 400,000 sq ft in size with plenty of room within the campus to build out two or three more similarly sized data centres should the need arise. And although the data centre is one of the world’s largest, at 1,500 Watts per square foot it is also quite dense as well. This facilitates racks of 25kW and during the tour we were shown cages containing 40 x 25kW racks which were being handled with apparent ease by Switch’s custom cooling infrastructure.

Switch custom cooling infrastructure

Because SuperNAP wanted to build out a large scale dense data centre, they had to custom design their own cooling infrastructure. They use a hot aisle containment system with the cold air coming in from overhead and the hot air drawn out through the top of the contained aisles.

The first immediate implication of this is that there are no raised floors required in this facility. It also means that walking around the data centre, you are walking in the data centre’s cold aisle. And as part of the design of the facility, the t-scif’s (thermal seperate compartment in facility – heat containment structures) are where the contained hot aisle’s air is extracted and the external TSC600 quad process chillers systems generate the cold air externally for delivery to the data floor. This form of design means that there is no need for any water piping within the data room which is a nice feature.

Through an accident of history (involving Enron!) the SuperNAP is arguably the best connected data centre in the world, a fact they can use to the advantage of their clients when negotiating connectivity pricing. And consequently, connectivity in the SuperNAP is some of the cheapest available.

As a result of all this, the vast majority of enterprise cloud computing providers have a base in the SuperNAP. As is the 56 petabyte ebay hadoop cluster – yes, 56 petabyte!

US electricity generation

Given that I have regularly bemoaned cloud computing’s increasing energy and carbon footprint on this blog, you won’t be surprised to know that one of my first questions to Switch was about their energy provider, NV Energy.

According to NV Energy’s 2010 Sustainability Report [PDF] coal makes up 21% of the generation mix and gas accounts for another 63.3%. While 84% electricity generation from fossil fuels sounds high, the 21% figure for coal is low by US standards, as the graph on the right details.

Still, it is a long way off the 100% of electricity from renewables that Verne Global’s new data centre has.

Apart from the power generation profile, which in fairness to Switch, is outside their control (and could be considerably worse) the SuperNAP is, by far, the most impressive data centre I have ever been in.

Photo Credit Switch

post

Using Mobile Endpoint Management to prolong smartphone battery life?

Low Battery Warning

Endpoint management is a term I came across relatively recently at a Symantec event – it refers to software used to manage client computers, laptops, and servers in an organisation (the endpoints of the network). Endpoint management software does things like automating the rollout of updates, manages licensing of software and often has a role in energy management of computers (ensuring they are shut down at the end of the day, not consuming resources when not in use). Also, policies can be set to ensure the power management of the machines doesn’t interfere with the installation of any patches.

With the increasing numbers of smartphones and tablets entering the workplace, a new class of enterprise software is appearing, mobile endpoint management. I’ve had discussions with Symantec about this last year and had a demo of IBM’s beta Mobile Endpoint Manager at this year’s IBM Pulse.

The IBM software, while not yet released, is still quite interesting. It has a considerable amount of functionality for securing devices and their data, as well as what IBM are calling micro-vpn – a nifty little bit of coding which allows for the ability to VPN from within an individual app on the mobile device.

One obvious trick that’s being missed though? Energy management for mobile devices.

The one issue that all smart phone owners share is battery life. This is also an issue for organisations which provide smartphones to their staff because many of those employees will charge their phones while at work, increasing the organisations’ energy and carbon footprints. Potentially worse though, is if the battery does run out, the staff member in question is harder to contact and may be cut off from company resources.

How do you, through software, extend the life of a smartphone battery?

Well, off the top of my head, a few things come to mind – how about scanning for services not being used and shutting them down (bluetooth, wi-fi, even 3G if battery life becomes critical). Also, applications not being used could be automatically force-quit so they aren’t consuming resources in the background. Shutting off notifications (and iCloud on iPhones to avoid unnecessary uploading of data.

All of this could be configured to kick in as the amount of battery life remaining dwindles. At 30% shut off notifications and Bluetooth, at 25% iCloud and any open, but unused apps, and so on.

Another opportunity for saving comes from poorly coded applications which consume power when they are supposed to be doing nothing in the background – the iPhone Skype app had this issue for a while. An intelligent Endpoint Management app would monitor all apps energy use on the phone and report anomalous use to the user, along with an offer to close it (and potentially even offer to report the issue back to Apple and/or the app developer).

If this is reported transparently to the phone user, with an option of an opt-out, and with estimates of the amount that this will extend the battery life, most people will buy into it very quickly.

And it saves money, energy, and carbon emissions. Win, win and win.

Anyone coding Mobile Endpoint Management and not considering energy management is missing a trick.

Photo Credit Tom Raftery

post

With great power comes great responsibility – or, Cloud companies need to get on-board

Spiderman

With great power comes great responsibility

This great quote from the movie Spider-Man, is just as true for technology, as it is for superheroes.

Technology has made possible tremendous changes in our quality of life in the last couple of decades. Everything from surgery to transportation, education to construction, space exploration and most other fields of human endeavour now depend heavily on IT. However, these great advances in our knowledge and abilities comes at a cost.

Information Technology’s carbon footprint, estimated by Gartner to be 2% of global carbon emissions in 2007, is rapidly increasing and by some estimates may even double by 2020. This is obviously an unsustainable situation. ICT, which can help so many organisations to reduce their carbon footprint, should itself be an shining example of low emissions.

To this end, the EU commission’s new ICT Footprint initiative is to be lauded. The announcement of the project on EU Commissioner Neelie Kroes blog gave the following details of the initiative:

This is why the European Commission has persuaded three leading standards development organisations and a prominent greenhouse gas accounting initiative to pool their measurement efforts. Under our new initiative these organisations will examine the whole sector, the whole lifecycle and the scalability of these methods.

That means measuring everything from the supply of raw materials to their recycling. Measuring not only what it takes to make products like a laptop, but also the impact of services like hosting data in the cloud. It means that in the near future we will be able to measure the ICT environmental footprint of whole cities or countries, including the positive environmental effects that ICT enables.

Several major ICT companies and organisations from Europe, Asia and the US are now trialling such measurement solutions. And from this month onwards, nearly 30 players have joined the European Commission to broaden and speed up the effort. We call on more and more such players to get involved.

It is tremendous to see this kind of global leadership from the EU. While this only applies to the EU, it does require the development of measurement and reporting systems for whole IT ecosystems and that can only be a good thing. In time, the hope would be that these systems are used well beyond the EU and by all IT providers.

The initial participants in the organisation are some of the better known large IT companies – BT, Alcatel-Lucent, Intel, Cisco, Hitachi, Telefonica, Fujitsu, SAP, Nokia, AMD, Dell, HP, etc. However, notably absent are the major Cloud providers. Where are Amazon, Microsoft, IBM, VMWare, RackSpace, Salesforce, even Google who have gone furthest arguably in reporting and reducing their emissions, are not participants.

I have lamented many times on this blog the lack of transparency of Cloud companies and they continue to prove me correct. Unfortunately.

Transparency around energy use and emissions is coming, have no doubt. Cloud companies will eventually have to report this information. They will be dragged into it screaming and kicking, but it will happen. Then we will be able to finally decide which provider to use based not just on price, but also on their impact.

In the meantime, if you are interested in reducing the impact of your Cloud computing, you could do worse than to check out MastodonC – a company that “selects the most efficient and sustainable location for your Hadoop job” and/or Greenqloud – a company offering public compute cloud using only renewable energy to power their cloud (their data centers are based in Iceland where 100% of the electricity comes from hydro and geothermal sources).

Photo Credit Greg and Mellina

post

Colt Technology and Verne Global’s dual renewably sourced data centre in Iceland

Icelandic landscape

Iceland’s a funny place. Despite the name, it never actually gets very cold there. The average low temperature in Winter is around -5C (22F) and the summer highs average around 13C (55.5F). Iceland is also unusual in that 100% of its electricity production comes from renewable energy (about 70% from hydro and 30% from geothermal).

I have written here several times about the high carbon cost of cloud computing, so when I received an invitation from Colt Technology to view the new data centre they had built with Verne Global in Iceland, I nearly bit their hand off!

The data centre is built on an 18-hectare (approximately 45-acre) complex west of Reykjavik, just beside Keflav?k Airport. The site is geologically stable and according to Verne:

The facility is situated on the site of the former Naval Air Station Keflavik, a key strategic NATO base for over 50 years and chosen for its extremely low risk of natural disaster. Located well to the west of all of Iceland’s volcanic activity, arctic breezes and the Gulf Stream push volcanic effects away from the Verne Global site and toward Western Europe.

Cold aisle contained racks in Verne Global's Iceland facility

Cold aisle contained racks in Verne Global's Iceland facility

The data centre was built using Colt Telecom’s modular data center design. This is essentially a data centre in a box! The modular data centre is built by Colt, shipped to site, (in this case, it was literally put on a ship and shipped to site – but the modules fit on a standard wide-load 18-wheeler), where it is commissioned. In the case of the Verne Global data centre, the build of the data centre took just 4 months because of the modular nature of the Colt solution, instead of the more typical 18 months. Also, modularity means it will be relatively straightforward to add extra capacity to the site, while keeping up-front data centre development costs down.

The data center has an impressive number of configurable efficiency features built-in. In the Verne Global facility, cold aisle containment is used and it is a wise choice in this environment. The facility uses only outside air for cooling (no chillers) so it makes sense to vent the hot air from the servers into a room being cooled by outside air. In winter, if the outside air is too cold, it can be mixed with hot air from the servers before entering the underfloor space to cool the servers.

The underfloor space is kept free of plenums and obstructions to allow an unimpeded flow of air from the variable speed fans – this minimises the work needed to be done by the fans, increasing their efficiency.

From an energy perspective, though, what makes the site very unique is that it sources its electricity from dual renewable sources (hydro and geothermal). Iceland is in quite a unique situation with its excess of abundant, cheap renewable power. Energy is so cheap in Iceland that aluminium smelting plants locate themselves there to take advantage of the power. These plants require roughly 400-500MW of constant power, so adding even 10 large data centres to the grid there would hardly be noticed on the system!

Another unique aspect of the Icelandic electricity is that because it is renewably sourced, its pricing is predictable (unlike fossil fuels). In fact, the Icelandic electricity provider, Landsvirkjun, offers contracts with guaranteed pricing up to 12 years. Also, the Icelandic grid ranks 2nd in the world for reliability and has the most competitive pricing in Europe (currently offering $43/MWh for 12 years as public offering – with better private offerings potentially available).

Speaking to Verne Global’s Lisa Rhodes, while in Iceland, she told me that because Verne had guaranteed energy pricing from Landsvirkjun for the next 20 years, they would be able to pass this on to Verne’s hosting customers and, in fact, she claimed that hosting in the Verne facility would cost 50-60% of the cost of hosting in the East coast of the US.

On the connectivity front, Colt announced that they were putting a Colt POP in the Verne facility, so it is connected directly into the Colt backbone.

Also, the Emerald Express fibre-optic cable which is due to be commissioned late this year has been designed to support 100x100Gbs on each of its six fibre pairs, which should easily meet any connectivity requirements Iceland should have well into the future.

Interestingly, one of Verne’s Global’s first customers is greenqloud – a company offering green public compute cloud services (an AWS EC2 and S3 drop-in replacement). With this, can we finally say that cloud computing can be green? Unfortunately, with cloud’s propensity to promote consumption of services, no, but at least with Greenqloud, your cloud can have a vastly reduced carbon footprint.

Full disclosure – I had my travel and accommodation paid for to visit this facility. And Colt has a POP in CIX, the data centre I co-founded in Cork before joining GreenMonk.

post

Tendril courting developers for its cloud-delivered energy app platform

Green Carrot energy usage app

Last August Tendril, a US-based energy platform company, announced that they were opening their API’s and launching an energy application developer program. The idea is to allow developers to build on Tendril’s cloud platform and to deploy the developed applications on Tendril’s Tendril Connect cloud platform.

For developers this is an opportunity to develop applications addressing the energy challenge and have them deployed in a ready-made marketplace of up-to 70 million addressable households. Similar to the Apple App store, Tendril offers co-marketing opportunities for developed applications.

Tendril provides developers with, not just the API’s, but also comprehensive documentation with a “Try it Now” capability as well as a discussion forum (so far lightly used) to have questions answered.

Tendril has also been promoting this initiative to developers by participating in Hackathons in San Francisco and more recently in New York. In conjunction with the New York Hackathon, Tendril ran a contest to see who could come up with the best apps using their API’s. The winner, eMotivator, won $3,000, while 2nd placed Green Carrot (screenshot above) won $2,000 from Tendril and another $1,000 from the Hackathon organisers for ?best user experience?.

And I note that Tendril are listed as one of the Participating Organisations in the London Green Hackathon being organised by AMEE this coming weekend.

Of course, if Tendril really want to talk to developers, they should also be attending our RedMonk Monki Gras conference in London next week (Feb 1-2)! I’m not sure what the collective noun for developers is (I asked on Twitter and received the following suggestions – batch? class? scrum? repository?), but whatever it is, there’ll be a shedload of them there!

One of the interesting things about the Tendril open API initiative is that it should stimulate lots of creativity in the Smart Grid space. So far, as Tendril CTO Kent Dickson noted in a call with me the other day, no-one knows what the Smart Grid killer app will be, but crowdsourcing the ideas is far more likely to lead to compelling results.

post

Is Cloud Computing Green?

I gave the keynote address at the Digital Trends 2011 event organised by HePIS and CEPIS in Athens recently. My talk was on Cloud Computing’s Green Potential and in my presentation, I claimed that Cloud Computing is NOT Green.

I started the talk by explaining what Cloud Computing is and the many advantages it can bring to companies. However, because none of the Cloud providers are publishing energy figures around Cloud computing, we can’t say whether or not Cloud computing is energy efficient.

I went on to point out that even if Cloud is energy efficient (and we have no proof that it is), that is not the same thing as being Green.

My slides are available on my SlideShare account and a transcript of my talk is here:

Okay, so my talk this morning is on Cloud Computing and its Green Potential. So a quick couple of words about myself.

So my name is Tom Raftery, I work for an industry analyst firm called RedMonk. My area of interest within RedMonk or the area I specialize in is energy and sustainability. We have termed the practice within RedMonk that concentrates on energy and sustainability GreenMonk. So the place that I blog at is at GreenMonk.net.

And a little bit about my past. I worked in an organization called Zenith Solutions back in the 90s and early 2000s, and Zenith Solutions was a software company creating what has now become termed cloud applications. At that time we called them web applications, they were web based software with the database backend online.

Then I worked for a company called Chip Electronics in the early 2000s and Chip Electronics was again a company which created Enterprise Resource Planning, ERP applications which were cloud delivered, at the time we called it Software as a Service. No at the time we called it active service provisions, since become Software as a Service. And I am also a co-founder and Director of CIX, which is a hyper energy efficient data center based in Cork in Ireland. So I know both from the hardware side and the software side.

I mentioned my blog on GreenMonk.net, I am on Twitter and twitter.com/tomraftery. My email address is there, my mobile phone number is there, please don?t ring it now. And this site here, slideshare.net the last line there and I am sorry for the bullet points, I don?t normally use them, but I did just here and in one other slide. slideshare.net is a site where you can upload a presentations.

So, this presentation I am giving this morning, I uploaded it to SlideShare earlier this morning, so it?s already online there at that site and if you go there now you?ll see it has already been viewed over 277 times so far. So, it?s a great site for getting your talks out all available, it?s also downloadable there.

One thing you?ll notice as well about the structure of my talks is a lot of them have images like this, but they also have this bit of text at the bottom which you can?t read, don?t try right now, but what they are is those are links to the source material. So, if at any point you do download the presentation you can go and click on the links, they are clickable links you can click on them and see where I?ve got the information from.

So that?s me, who are you guys?

A couple of questions, so how many people here have deployed applications to the cloud? Not very many. How many plan to? A few more, okay. How many people here think that cloud computing is green? Okay, good few people. Right. I hope to burst that bubble, unlike Nancy who spoke just a minute ago, I am not a, I am not a believer that cloud computing is green and I hope to explain why. I am a huge fan of cloud computing, I have to say, I use it extensively, going back to the slide for a second.

The Chip application, the Zenith stuff, the GreenMonk, Twitter, SlideShare even my email are all cloud delivered. Our organization RedMonk we use Google applications for domains for our email, so my email is cloud delivered as well. So I am a big user of and believer in cloud for lots of things. But I just don?t happen to believe it?s green.

So what is cloud computing? Well at kind of first blush it?s software that?s delivered in a browser, so that?s an very easy definition of it, something we can all kind of sign up to it. It?s a lot more complex than that at various other levels and I?ll go through a couple of those other levels as well, just very briefly to kind of give you that the kind of complexity that?s involved in it, but I am not going to go into any great depth. So it?s also nothing that?s very new, this is the original sign up screen for Hotmail.

Hotmail was an email application developed and sold to Microsoft back in ?97 for $450 million if memory serves. But this was before it was sold to Microsoft, this was the original sign up screen when they launched in July ?96 and it was one of the first widely used Software as a Service or cloud application.

So cloud is nothing new, it keeps getting rebranded, so the cloud name is newish alright, but the delivery mechanism is not that new. It actually harps back to mainframe computing back in the 60s.

So there are several types of cloud computing and the first type, the first level of cloud computing is kind of Software as a Service. That?s where you kind of take your packaged software and convert it into something as I mentioned already delivered in a browser. And I mean you probably are aware of these I mentioned Hotmail and its analogs the Google applications, there is also Zoho, there is social networking the Twitter that I mentioned, SlideShare all these kind of things, they are all Software as a Service.

So they are just basic applications that you access through a browser. But you can go back one level of abstraction from that to where you get to what?s called platform as a service. And don?t worry about these acronyms basically a lot of the times you don?t need to know this stuff, the platform as a service stuff is where you, as I could say, you go back one level of abstraction and you give people a platform on which to deploy cloud applications.

And the kind of platforms that you can get are ones like the Google app engine and Amazon and Microsoft?s Azure, these are the kind of platforms that are available if you want go down that route. Most people don?t need to go there, but if you do that kind of stuff is available as well. And then you can go back one further level of abstraction where you are actually delivering Hardware as a Service and this is called Hardware as a Service or Infrastructure as a Service and both names are valid, HaaS for hardware or IaaS for infrastructure as a service and that?s where you?re delivering stuff like networking, storage, compute, CPU cycles that kind of thing as a service.

And VMware, Rackspace, OpenStack again Amazon with their EC2 and their S3 services are those kinds of types of cloud computing. If that?s a little confusing and I know it can be, this is a slide which is also confusing, but if you actually stop and study it in your own time, you could download this application and if you are interested about it, this is a good way of seeing how the different types of cloud computing stack up as it were.

So over here on the very left, you have your traditional packaged software with the entire stack from networking up through applications where you manage the entire stack on your machine. So that?s the traditional Microsoft Office whatever applications, you do the whole thing.

Over on the other side you got your Software as a Service, something like Google apps or domains or one of these things where the provider the Google or whoever are responsible for the entire stack, all you have is a browser. And then in the middle you have the two other ones, the platform as a service, where the vendor managers up to here and you manage the applications and data or infrastructure where the vendor managers is just this part and you manage the rest.

So that?s the kind of way it stacks up. As I say on the deck itself there is a link down there to where you can find that image if you are interested in checking into it. It?s quite a nice way of seeing the differences between the different types of cloud computing.

And then just to complicate things a little further, there are different deployment mechanisms. You can have private cloud, private cloud is hosted by yourself on your own infrastructure behind your own firewall. You can have public cloud which is what most people are familiar with or you can have a hybrid where you have some stuff private, some stuff public and that?s one that a lot of people are looking at, because it means you can have your data behind your firewall, but the functionality you are accessing it from public. So your stuff remains on premise.

And that?s quite important, because as Nancy alluded to, there can be a lot of issues with the data in cloud computing, because for example if you are a European company do you really want your data hosted on servers in US territories where for example the data privacy laws are a lot more lax. So I have spoken to several European companies who have said categorically they will not use cloud computing if their data is going to be hosted in US territories. It?s only if it?s in the EU and only if they know where in the EU. So you are noticing cloud providers taking that on board and starting to become aware of those issues and while they can?t change US law, they can start providing storage mechanisms that they are guaranteed to be in region.

So that?s cloud computing and the next question we get to is, is this really energy efficient because lots of people say it is and even Nancy alluded to that report from the Carbon Disclosure Project which I?ll blow apart in a minute. They aren?t the only ones Microsoft, Accenture and WSP environment brought out this story in November of last year. And this is the actual title of the story, where they say it shows significant energy in carbon emissions reduction potential from cloud computing and again the link to the report is down there at the bottom.

The difficulties I have with that are several, first is Microsoft are a cloud computing provider so they kind of skin in the game. The second is that, they don?t actually use any hard data, it?s all imputed. And the third is that after months and months of work from all these people the best they could come up with is they could say it has potential. Yeah it has potential to end world hunger and bring on world peace and fix the euro, anything kind of potential. So that?s a non-report.

Cloud computing has phenomenal advantages, don?t get me wrong, I am a big fan. So if you are into traditional IT, you know well that if you are deploying a new application or a new server it?s pain staking, you have to go through an RFP process, a tender process, PO process. You have to put, you have to go to tender and you have to get that — when you have to place the order, the order then can take several weeks from the supplier. When it comes in, it goes into the logistics area, if you got to get the guys in warehousing to tell you where the server is, you have to get the server, you have got to put the company image on the server, you got to install the applications, you got to do testing, you got to patch the server, the list goes on and on. Basically you want to deploy a new server, it?s a process that can take weeks to months.

You deploy a cloud application, there is usually no RFP and no PO process because there is — the capital cost is minimal. So typically the time to deploy for a cloud application shrinks from weeks to months to hours to minutes depending on what you are deploying, so phenomenal, cloud is fantastic for streamlining that kind of stuff.

It?s also great for what?s called dynamic provisioning. So this is the Alexa graph, the website traffic of a website for the Australian Open. The Australian Open is a big tennis competition happens in Australia every January. So you?ll notice 11 months of the year no traffic to the site, come December, January vroom, spike, that?s 2006, 2007, larger spike 2008, larger spike and the spikes keep getting bigger as you go in that direction.

So if you were the website owner for the AustralianOpen.com website you would need to have — if there were no cloud computing options you would need to have servers that could hit and deal with the traffic at this growing spike for 12 months of the year when the traffic is only there one month of the year. But with dynamic provisioning and cloud computing you can use the elasticity of the cloud to turn up the resources assigned to that site as the traffic starts to build up in December and January and then as the traffic falls off, you turn it back down again.

So in that respect cloud computing is fantastic as well, you are not using resources needlessly. You?ve also got the idea of multi-tenancy and if you can?t see what?s in this picture it?s actually a Mini Cooper with 26 people inside in her, EMC sponsored it as the world record attempt to fit people into a Mini Cooper and they fit 26 people into it. So they stuff people into it with multi-tenancy in cloud computing it means you are sharing applications across companies, lots of different companies often competitors are using the same single version of the application.

And that?s fantastic, that adds greater value. You know, you have only one instance of the application which is great as well for updates, updates of the application are instantly deployed. You know, you don?t have to download the latest update and apply it to the test server and make sure it works in the environment, the whole thing, you know, it?s just instantly on.

This is the issue of server utilization which again Nancy referred to, Nancy you stole my talk, come on. So this is a typical graph of server utilization and you can see this the memory part, but this is the server utilization and it?s at zero percent here. And well that?s a bit of a outlier, you?ll often and get in normal server, you?ll often get utilizations in single digits 7, 8% server utilization for traditional servers in data center environments. But with the advent of virtualization and cloud computing you can ramp that up significantly. So that should be quite energy efficient.

Then you have got this kind of outlier thing called chasing the moon, which you may or may not have heard off. It?s one I am kind of found of as an idea, but not many people have deployed it yet. People are kind of talking about it as out there, and what it is, is with cloud computing if you?ve got data centers in say, US, West Coast, another in Northern Europe or Southern Europe, Northern European typically because it?s cooler there and cooler I mean colder not more ?hip?. And you?ve got another data center say somewhere in Asia or Eastern Russia. Then you?ve got the time zones covered about eight hours apart. So if you have an application in those three centers, you can move the compute to where energy is cheapest at any particular point in time. So if you are doing that typically energy is cheapest when it?s in highest supply, when it?s in highest supply and it?s cheapest, its actually, this is on the wholesale markets, it?s actually greenest as well.

So when electricity is at its cheapest, it?s actually also at its greenest that?s ? it?s kind of counter intuitive but I can explain that if any one who is interested later.

So if you move your compute to where the energy and the compute is cheapest at any point in time, it?s typically night time when wind is blowing and at that time you are chasing the moon, you are putting your applications wherever the moon is out, it?s called chasing the moon.

And so it?s something you could only do — something that?s only made possible by the likes of cloud computing. Your information is ubiquitous, it?s wherever you have an internet connection, so your road warriors, your sales people on the road, can access the application while sitting up in the beach.

It also enables a lot more home working, homeshoring, teleworking whatever you want to call it. And people like ATT, IBM, lots of big companies are huge fans of this. IBM reported a couple of years back that 25% of their employees did teleworking and those 25% were saving IBM $700 million a year. That?s significant savings and a lot of that savings comes from a lower real estate footprint and a lower energy footprint because of the lower real estate footprints.

So is it energy efficient or lot of those savings coming from less commuting or from less building stock or are they from offsetting your energy? So if you are working from home you are still burning energy, it?s just not in your company?s building, your company isn?t accounting for it anymore. These are kind of questions we are not sure of, there hasn?t been any definitive studies either way, and it?s difficult anyway because it differs in every company and every geography.

One huge problem I have with cloud computing and people saying that cloud computing is energy efficient is that none of the cloud providers are publishing data around their energy utilization, not one of them. So I often do a kind of a hands up exercise at this point and I don?t know if it?ll work here, because very few people admitted that they were going to be putting stuff in the cloud, but let?s raise hands again. Hands up everyone who has or plan to deploy applications to the cloud? Okay, so keep your hands up, keep your hands up. Now keep your hands up if you know the current energy utilization of the applications you are going to deploy to the cloud or the energy applications you have already deployed to the cloud, if you know how much energy your applications burn, keep your hands up. Okay we got one, anyone else just the one? Good. Okay, keep your hand up, we are not finished. Okay keep your hand up if you know the energy utilization of that application in the cloud. You do, is it a private cloud?

And they are giving you the energy utilization of that?

Okay, I am interested in that because I do a lot of work for SAP and they can never tell me the energy utilization of any of their cloud infrastructure.

I think, okay I must get back to you on that because I — if that is the case it must be very new, because it?s not something they?ve ever shown me before and if they do it it?s often kind of what we call humbligated it?s often — they will give you an average but they won?t tell you exactly what your application and what your users are utilizing which is what you need to know.

So as I say with the possible exception of SAP, most cloud providers do not provide the data. So without that data, we have no way of knowing if our applications are in fact energy efficient in the cloud. Even if they are, energy efficiency is not the same as being green. Just because something is energy efficient does not mean it?s green, and this is a very common mistake that people make.

So what is green? Well I’m also going to quote from the CDC report that Nancy mentioned. And this CDC report, it?s called Cloud Computing – The IT Solution for the 21st Century and again there is a link to it there.

One of the quotes that the CDC put into that was that that a typical food and beverage firm transitioning it?s HR application from dedicated IT to public cloud can reduce CO2 emissions by 30,000 metric tons over five years. That sounds good, I buy that, that sounds quite green actually. They also went on though in their executive summary to say allowing companies to maximize performance, drive down costs, reduce inefficiency, and minimize energy use and therefore carbon emissions. So they have made the classic fundamental mistake of thinking that reducing or making something energy efficient makes it green or reduces emissions. There is nothing that says that is the case. I will tell you why?

And by the way Nancy and this is the blog post I wrote on GreenMonk where I explain in significant detail why the CDC report is completely flawed. So there is a link there you can go and have a look.

I will give it to you later, I will give you the link later. So two reasons why that report is deeply flawed. One of them is it?s based on assumptions and they say so in their model, they say their model is based on assumptions and the second is based on metric called PUE. So I?ll get the PUE in a second. PUE is Power Usage Efficiency. Anyone here familiar with the term PUE? Couple are, okay. So I?ll get to in a second. They based their model on this PUE metric, which is a widely used metric. But they have based it on a average PUE across the entire United States which is put out by the EPA, so that?s not really very indicative firstly.

But secondly, PUE the measurement itself, it?s a ratio of the total amount of power used by data center compared to the power deliver to the computer equipment. So the total power delivered to a data center is the power delivered literally to the door of the data center, which goes to power of the lighting, it goes to power the cooling, it goes to power of the UPSs, the whole thing, that?s the total power. And it?s a ratio of that to the amount of power which actually makes to the IT equipment. So the closer your PUE figure is to 1.0, the better.

Now couple of problems with PUE as a metric. The first is there hasn?t traditionally been any standard about where you measure the power. It?s measured at the meter, the power meter, the electricity company power meter but in data centers that is often been measured on the high voltage site, the medium voltage site, or the low voltage site depending on the data center, depending on where they put the meter. And of course if you are measuring out at these different place one data center measures at one place, another at another place you can?t cross compare because you are leaving out the loses that occur in the conversion from high to medium to low voltage.

So right there the lack of standardization that?s been worked on at the moment, and it is getting better, they are start to standardize but traditionally it hasn?t been standardized. So that?s one issue straightaway.

But even more important is, quick look at this graph here, if I have a data center which takes in two megawatts of power and of those two megawatts of power, one megawatt goes to powering the servers, then I have a PUE of 2.0, very simple. However if I realize that my one megawatt isn?t being used very efficiently, and I realize that some of my servers are being under utilized, may be I?ll virtualize some of them and I shut some of them down. Then my power draw from my IT equipment drops to 0.75 a megawatt. My total draw drops to 1.74 and my PUE goes up to 2.33. Remember I said PUE closer to 1.0 means you are more efficient. I?ve actually made it more efficient and my PUE has gone from 2 to 2.3, so it?s a huge problem right there with the PUE metric.

Another issue and I am sorry this is a little bit complex, but I?ll walk it though it again another issue with PUE is it takes no account of carbon. So top line is a typical data center, typical data center in a European country, a European country where the supply of power causes CO2 per kWh that?s not unusual that?s a pretty average figure. So if that typical data center has a PUE of 1.5, just quiet good, then we get 1.5 by 0.5 we get 0.75 kg CO2 per kWh is the IT carbon intensity, is how much the IT equipment is producing in terms of CO2.

So if we have a data center with the a good PUE 1.2 and that good data center is drawing mostly from coal-fired power, so it?s got a supply carbon intensity of 0.8 kilos, the you are — 0.8 by 1.2 means you are producing — even though you have got a good PUE in your data center, you are producing 0.96 kilo CO2 per kWh.

On the other hand if you have got a really bad data center with a PUE of 3, very inefficient data center, PUE of 3 but is fired mostly by renewables. So your carbon intensity on your supply is 0.2, but still it?s not 0 it?s 0.2, it?s significant, there is still carbon being produced per kWh. 0.2 by 3 gives you 0.6, which is significantly less. It?s, you know, 60% of the carbon intensity of the data center with a PUE of 1.2.

So PUE is no indicator whatsoever of how green some thing is, it?s a very bad metric. There is other metric called a CUE the Carbon Usage Efficiency but it is not widely used by the industry unfortunately.

So given that, the report that the CDC produced could just as easily have said that your typical food and beverage firm transitioning HR to a dedicated public cloud could increase CO2 emissions by 30,000, just as valid. They pick the number out of the air and they base it on a flawed metric, so it?s just as valid to say it could increase CO2 as decreased CO2.

And a good example of this in fact is Facebook, Facebook build this lovely new data center in Prineville, Oregon, they opened it early this year. Had an unbelievable PUE coming in around 1.08, highly efficient, they have open sourced it. If you go to opencompute.org you can get the blueprints for building the data center and the list of suppliers, so you can go on build that same data center yourself. They reduced their energy consumption per unit of computing by 38%, that?s fantastic, that?s really good.

Unfortunately, their energy supplier is a company called PacifiCorp. PacifiCorp produces 58% of its power from coal, this is their website, they say it themselves right there. They produce 9.6 million tons of coal from their own mines every year. They also produce another 12% of their electricity from natural gas, so that?s 70% they produce from fossil fuels, plus they also buy 22.5% of their power from other suppliers. Now they don?t say how those other suppliers generate theirs. So they get at least 70 and possibly significantly more of their energy from fossil fuels. So right there Facebook?s really impressive 1.02, sorry 1.08 PUE is blown out of the water by the fact that it?s all produced using carbon or almost all.

To contrast that this is the graph of power production on the Spanish grid. I picked Spain because I happen to live there and you can see that this was taken last Friday, the snap shot and again you can get information from the Red El?ctrica de Espa?a. The red bar here, or bar whatever it is area is coal, comes in around 20%, green one here is wind, the other is, the rest of the renewables put together except water, which is down here.

So on the Spanish grid, carbon intensity comes in around 20% at the moment based on that plus the gases and other 15% sorry. And that?s actually bad compared to the same grid two years ago. The same grid two years ago, coal was coming in single digits here on 9% and the reasons gone from the 9% two years ago to 20% today is because Zapatero, the now former President of the parliament comes from Castile and Le?n which is a coal producing part of Spain and he went to the EU and he petitioned for years to be allowed to give subsidies to the coal miners and the coal production in that part of Spain. And last February, sorry February 2010 he succeeded and they got 4.5 billion Euro in subsidies for producing coal in Spain and that?s a direct result, it?s scandalous.

Anyway that?s either here or there let?s move on. Dublin, I am originally from Cork, so I?ll talk of Ireland for little bit. Dublin has become a European, key European datacenter hub. Most of the big data center providers have significant operations in Dublin. Microsoft have their largest datacenter outside of US in Dublin. It provides the Microsoft Live and Azure services for EMEA. Similarly Amazon are there, Google are there, they all have significant centers there and they are all expanding. Google have announced new expansion as of Microsoft representatives.

Unfortunately, Ireland produces 84% of its electricity from Fossil fuels, that number is falling as it rolls out wind, it was a 87% a couple of years ago, but now its 84%. So that?s not really very green. On the other hand Apple have announced their iCloud service and their iCloud service is currently housed in this datacenter in North Carolina, it?s a photograph of it under construction. Unfortunately this datacenter gets 78% of its energy from Duke Energy who get it from, no they get all of their energy from Duke Energy, Duke Energy get their energy from 78% coal and nuclear.

Coal is obviously really bad, nuclear is also really bad, not just because of the Fukushima reasons, but you got to think as well, nuclear power plants have an enormous water footprint. And that is, it can often be devastating to the environment around them. But Apple have said in fairness to them that they have got a 121 acres site behind them that they are now clearing for scrub to install a solar facility, it will mitigate a little their emissions, a 121 acre solar facility is not going to complete power the plant and it certainly won?t power at night time but it will have at least.

Google are the really interesting player in this field, because Google have gone to extreme lengths to get their carbon footprint down to zero. They have signed power purchase agreements with Wind farms. A power purchase agreement is where you sign on the dotted line with a wind farm or any one in this case it?s wind farms in Google?s case, you sign on the dotted line and you say, for the next X years and in Google?s case its next 20 Years I will take all of your power, all of it.

For wind farms that?s a huge win because that means they can go to investors and say, we?ve got checks rolling in from Google for the next 20 years guaranteed and here is the contract, do you want to invest in us now. So obviously it will help them get investment inward investment. It?s a great win for Google on two fronts, one is they?ve got guaranteed renewable energy and the second is they?ve got guaranteed pricing for their energy for the next 20 years. How many people can say they know what the price of their electricity is going to be in 20 years?

So they have done it in a number of wind farms, this one is in Iowa, 114 megawatts, this one is in Oklahoma, another 100 megawatts. And they?ve gone to incredible lengths and this is the slide I mentioned earlier with all the bullet points and I?m really sorry this slide is more bullet points than I normally have in entire talks. So there is nine bullet points in this but it gives you an idea of the investments that Google have made in renewable energy.

The Potter Drilling one is for geothermal, Makani Power is for high altitude wind power. Solar City, the Atlantic Wind connection, that?s a — I can?t remember how long it is, it?s a massive offshore wind farm off the east coast of the US and they?ve invested in the infrastructure of that, they own a percentage of the infrastructure in that, in total Google have invested $850 million on renewables. So if anyone could be slightly green I guess in cloud it would be Google.

Having said that though, there is lot of having said that in this presentation I am sorry about that, it?s a complex area. Jevons paradox, William Stanley Jevons is an economist in the 19th century in England. And he realized that as steam engines were being made more efficient in burning coal, as they were getting more efficient at burning coal the amount of coal being burnt was actually going up not down. It was kind of counter intuitive but how it worked was as stream engines become more efficient the price dropped, more people bought them, more coal was burnt. And it?s similar with cloud computing. As cloud computing goes and starts taking off in adoption the resources that are used actually go up not down.

So cloud computing leads to an increase in consumption and this also then Parkinson?s Law and a curare of Parkinson?s Law which says data expands to fill the space available for storage, the more storage you have the quicker it fills up, you all know that. And a good example of that is when Gmail started in 2004 Hotmail had a 2 meg limit on the size of your inbox. Yahoo at 4 meg and gmail said, I am offering one gigabyte, blew them out of the water and suddenly they had catch up and go to one gigabyte, Google is now at 7.5 giga byte and they allow you to send emails of 25 megabyte, single email 25 megabytes.

So, also a nice quote I got from Infochimps? Flip Kromer and this really characterizes how cloud computing can promote consumption. And Flip said it very well when he said, EC2, which is one of Amazon?s offerings in cloud means anyone with a $10 bill can rent a 10 machine cluster with a terabyte of distributed storage for eight hours and because it costs virtually nothing to do it and because anyone can do it — it happens all the time. So that?s not very green.

You?re confused yet? So what if ultimate irony you had cloud delivered green software, Hara, Nootrol, SAP?s Carbon Impact OnDemand, these are all carbon management applications which are cloud delivered. Now, I am really confused I don?t know if they are green or not. Microsoft Iron Earth, cloud delivered using the Azure platform for managing air quality, water quality, noise pollution, that kind of thing, I think my head just exploded.

So my conclusion from all this is that cloud computing has a significant number of advantages, but being green isn?t one of them. One last thing if you are deploying stuff to the cloud, this is not really how you want to do it. Thanks very much.

post

Don’t forget – where your cloud apps are hosted helps determine their carbon footprint

Greenwash

Back in July of this year (2011), the Carbon Disclosure Project (CDP), in conjunction with Verdantix, released a report titled Cloud Computing – The IT Solution for the 21st Century [PDF warning] which erroneously claims Cloud Computing is Green. Shortly after it was released, I wrote a long post outlining exactly where the report was flawed. I also contacted the CDP directly outlining my concerns to them and pointing them to the blog post.

Then, a couple of weeks back, when preparing my slides for my Cloud Computing’s Green Potential talk for the Cepis and Hepis Green IT conference in Athens, I discovered that Verdantix and the CDP had published

a new report [PDF] on the business and environmental benefits of cloud computing in France and the UK

Unfortunately, not only does the new report make the same mistakes as the original one, but it further compounds those errors with an even more fundamental one.

Let me explain.

In the key assumptions section of the report it talks about the metric tons of CO2/kWh in both the UK and French electricity grids (0.000521 tonnes and 0.000088 tonnes respectively). It uses these figures to extrapolate the savings in both France and the UK for companies migrating their applications to cloud computing.

So? You say. Sounds reasonable to me.

Well, the issue is that they didn’t do any work to identify where applications migrated to the cloud would be hosted. The implication being that UK applications migrated to the cloud, will be hosted on UK cloud infrastructure and French IT applications will be migrated to French hosted cloud infrastructure. In fact this would be a highly unusual scenario.

A quick look at where most cloud hosting takes place shows that the vast majority of it is occurring in the US, with quite a lot happening in Singapore with a lesser amount in Europe (and that split between Ireland, Germany, UK, etc. but almost none in France – Ireland is underestimated in the list as it doesn’t include Microsoft which has a significant Cloud hosting facility in Dublin which it is now expanding or Google’s Dublin facility).

Ok, and what about the carbon intensity of electricity generation in these countries? If a cloud application is moved to somewhere with a lower carbon intensity for electricity generation, then there is a possibility of a carbon saving. However, with the vast majority of cloud hosting still being done in the US, that isn’t a likely scenario.

This table of CO2 emissions from electricity generation, by country shows that the US has one of the most carbon intensive electrical grids in the world. France, on the other hand, with its high concentration of nuclear power (78%) has one of the least carbon intensive electricity grids in the world. While the UK grid’s carbon intensiveness at 557kg CO2/mWeh sits just above the world average of 548kg CO2/mWeh.

While it is possible (though not probable) that UK IT applications outsourced to the cloud would be hosted in a country with a lower carbon intensity than the UK, the chances of a French IT application being hosted in a country with a lower carbon intensity than France are virtually nil.

Given this, the assertion by the CDP report that

large businesses in France and the UK can reduce CO2 emissions from their IT estate by 50% compared to a scenario where there was no cloud computing.

seems, at best, extremely improbable.

One problem with coming up with reports like this is the lack of transparency from cloud providers on their locations, their energy and carbon footprints. If all cloud providers reported these metrics, it would be a far simpler matter to decide whether cloud computing is green, or not. Without these data, there is absolutely no way to say whether moving to the cloud increases or decreases CO2 emissions.

If you are wondering why the Carbon Disclosure Project and Verdantix are so bullish in their assertions that Cloud Computing is Green – if you scroll to the bottom of the report, you’ll see this:

CDP & Verdantix's motivations

This study was supported by AT&T
For more information on AT&T Cloud Solutions go to …

The report was paid for by the Cloud Solutions division of AT&T. Enough said.

Photo credit fotdmike

post

Facebook hires Google’s former Green Energy Czar Bill Weihl, and increases its commitment to renewables

Christina Page, Yahoo & Bill Weihl, Google - Green:Net 2011

Google has had an impressive record in renewable energy. They invested over $850m dollars in renewable energy projects to do with geothermal, solar and wind energy. They entered into 20 year power purchase agreements with wind farm producers guaranteeing to buy their energy at an agreed price for twenty years giving the wind farms an income stream with which to approach investors about further investment and giving Google certainty about the price of their energy for the next twenty years – a definite win-win.

Google also set up RE < C – an ambitious research project looking at ways to make renewable energy cheaper than coal (unfortunately this project was shelved recently).

And Google set up a company called Google Energy to trade energy on the wholesale market. Google Energy buys renewable energy from renewable producers and when it has an excess over Google’s requirements, it sells this energy and gets Renewable Energy Certificates for it.

All hugely innovative stuff and all instituted under the stewardship of Google’s Green Energy Czar, Bill Weihl (on the right in the photo above).

However Bill, who left Google in November, is now set to start working for Facebook this coming January.

Facebook’s commitment to renewable energy has not been particularly inspiring to-date. They drew criticism for the placement of their Prineville data center because, although it is highly energy efficient, it sources its electricity from PacificCorp, a utility which mines 9.6 million tons of coal every year! Greenpeace mounted a highly visible campaign calling on Facebook to unfriend coal using Facebook’s own platform.

The campaign appears to have been quite successful – Facebook’s latest data center announcement has been about the opening of their latest facility in Lulea, Sweden. The data center, when it opens in 2012, will source most of its energy from renewable sources and the northerly latitudes in Lulea means it will have significant free cooling at its disposal.

Then in December of this year (2011) Facebook and Greenpeace issued a joint statement [PDF] where they say:

Facebook is committed to supporting the development of clean and renewable sources of energy, and our goal is to power all of our operations with clean and renewable energy.

In the statement Facebook commits to adopting a data center siting policy which states a preference for clean and renewable energy and crucially, they also commit to

Engaging in a dialogue with our utility providers about increasing the supply of clean energy that power Facebook data centers

So, not alone will Facebook decide where their future data centers will be located, based on the availability of renewable energy, but Facebook will encourage its existing utility providers to increase the amount of renewables in their mix. This is a seriously big deal as it increases the demand for renewable energy from utilities. As more and more people and companies demand renewable energy, utilities will need to source more renewable generation to meet this demand.

And all of this is before Google’s former Green Energy Czar officially joins Facebook this coming January.

If Bill Weihl can bring the amount of innovation and enthusiasm to Facebook that he engendered in Google, we could see some fascinating energy announcements coming from Facebook in the coming year.

Photo credit Jaymi Heimbuch