virtualization
P2C: A Funny Thing Happened on the Way to the Cloud
Digg
Reddit
Delicious
StumbleUpon
Facebook
Twitter
LinkedIn
BuzzBy Ellen Rubin
As IT organizations move forward with their virtualization initiatives, consolidating operations and shrinking provisioning times, the cloud has come along as an even more compelling option. In the cloud, companies can build capacity on-demand without having to own or manage the computing infrastructure. As companies review their application portfolios, they’ve started to realize that many of their not-yet-virtualized apps could easily be run in the cloud. In particular, applications that are characterized by spikey, cyclical, or seasonal usage could benefit the most from the cloud’s economics and scalability — but a significant percentage aren’t even getting the benefits of virtualization.
So what’s the delay in going “P2V” (physical to virtual)? As with the cloud, virtualization has typically percolated from the bottom up. In many cases it crept into organizations, led by developers and technology evangelists who recognized the efficiency and cost advantages of virtualization and simply started using it. While many enterprise customers have started expanding their virtual footprints it can be a long and complex process. Although technically it’s quite easy to virtualize an application, using a number of well-known P2V tools such as VMWare Converter from VMware or Platespin (now owned by Novell), the harder part of the process is often agreeing which applications to virtualize and understanding the inter-dependencies between these apps and other data center services.
As corporate IT has slowly adopted virtualization as a strategic imperative, the cloud has come along with paradigm-changing flexibility and elasticity. We’re now seeing enterprise customers and prospects ask what they can do with applications that aren’t yet virtualized and are still sitting on dedicated servers, recognizing that the cloud is likely to be their ultimate home. Thus we’re seeing the emergence of a new model — “P2C” (physical to cloud), with virtualization in the data center becoming a stepping stone to the ultimate destination of the cloud. As discussed in a previous blog, the cloud has become a catalyst that is prompting companies to broaden their virtualization efforts.
Customers and prospects have told us that the P2C model is far preferable to simply performing a virtualization project in a vacuum and figuring out later which applications really belong in the cloud and how to get them there. In contrast, P2C is all about planning for the cloud from the outset, starting with virtualization and moving to the cloud as a natural progression. The P2C approach can also lead enterprises to alter their virtualization strategy compared to pure P2V. In some cases, they may want to use the cloud as a temporary home for applications that need to migrate between data centers, to support satellite offices or in the case of an acquisition. In other cases, they may keep the application permanently in the cloud and be able to budget for far fewer internal resources.
Thus, we encourage customers to consider P2C as a valuable strategy, since for many applications, the cloud will deliver far greater self-service and on-demand computing power than available internally. By planning for this ultimate goal and designing their infrastructure accordingly, customers can also potentially save a great deal of time and money. Ultimately, a single integrated environment will span the virtualized data center and multiple clouds, using the same tools and providing the same simplicity of experience. CloudSwitch is working with our customers and partners to make it easy to use the cloud, regardless of the starting point.
Cloud Expo 2010: Virtualization Steals the Spotlight
By Ellen Rubin
At first glance, cloud computing can appear to be “virtualization taken to its logical conclusion.” After all, if the main benefit of virtualization is to consolidate data center resources and increase the speed of provisioning, then cloud is the ultimate pay-off: don’t own the resources at all and cut provisioning down to a few minutes with instant self-service gratification.
But upon further thought, and as was highly visible at the Cloud Computing Expo this week in NYC, cloud seems to be giving virtualization a return to the spotlight. A recent Gartner study noted that cloud computing is the number 2 priority for CIOs – trumped only by…virtualization. And most of the sessions at the Cloud Expo made some mention of the benefits of extending virtualization footprints within the data center and starting to turn these into internal clouds, or at least “cloud-like” environments.
So is virtualization what’s old but new again? Remember that most enterprises have adopted virtualization in some way, but are only about 20% virtualized so far. So there’s plenty of room left to penetrate, and there’s still lots of opportunity for optimization and better management. Virtualization has primarily been used for consolidation, not for optimizing workload management and self-service. And many companies have large investments in existing hardware and virtualization licenses that they’d like to use more efficiently. In many ways, cloud computing has emerged on the scene as a disruptive force while virtualization is still an evolution in progress.
As at other recent shows, the common wisdom at the Cloud Expo was that “hybrid” environments are key to the emerging IT infrastructure. Some resources will stay behind the firewall and others can be moved to outside cloud environments. Some applications may need to be split between the data center and external clouds, especially where the database needs to stay inside. In this hybrid world, some enterprises will want to focus on growing the internal virtualization footprint and starting to build capabilities for provisioning, charge-back, orchestration, role-based access, etc. This may require significant investment in additional hardware and software. It will also require enterprise IT to develop a new perspective on managing their virt investments, learning from the cloud providers about best practices and from companies like CloudSwitch about how to combine external cloud services with their own environments securely and transparently.
It’s also true that many of the major technology vendors (as well as some IT departments) have a bias towards focusing the cloud revolution on known and existing technologies. It’s still somewhat scary to think about moving things outside the data center and cloud technologies are in relatively early stages. And external cloud services (in particular public clouds) are pushing the envelope in terms of customer expectations and placing new, challenging demands on virtualization.
But virtualization will have to step up to these demands now that the cloud revolution has raised the bar. Many of the emerging capabilities will need to be at the management plane: a broad range of self-service functions, for sure, but also the ability to route workloads to the appropriate environments based on business and technical requirements, and to federate across multiple and diverse environments both on-prem and externally. So maybe cloud computing turns out to be not only the logical extension of virtualization, but the catalyst that helps virtualization move to the next level.
Cloud Tip: CloudSwitch Networking and ESX
By Damon Miller
As Director of Technical Field Operations for CloudSwitch, I have the pleasure of interacting with most of our customers on a regular basis. This is an integral part of my job since I’m ultimately responsible for making sure we provide a positive experience every time someone uses our product. The past month has provided a fantastic opportunity to do just this, as we opened our beta program to the public on March 1st. We’ve learned a tremendous amount from our customers so I thought I’d take a moment to share some of that information to help everyone interested in using CloudSwitch.
First, there are some basic things to remember before using CloudSwitch to move servers to the cloud:
- Applications need to be virtualized before they can be moved into the cloud, and you need a virtual environment in your datacenter for deploying the CloudSwitch Appliance.
- The virtual machines that you move to the cloud need to come from a supported version of VMware. Today, this list includes ESX 3.5 & 4.0, VirtualCenter 2.5, and vSphere 4.0. We can also access servers directly through a CIFS share.
- When running the CloudSwitch Appliance in an ESX environment, specific networking options are required for connectivity to servers running in the cloud.
The last item—ESX network configuration—has caused confusion for a few of our customers, so I thought I would also take some time to explain what specific settings we require and why they are needed. First, though, it makes sense to provide a very quick description of how the CloudSwitch solution works.
After deploying the CloudSwitch Appliance (CSA) into a VMware environment, users select internal VMs to be migrated to a target cloud. I’ll leave the full architectural overview for a later article, but suffice it to say that the selected VMs are then migrated securely into the cloud—encrypted in transit and at rest. Once the migration is completed, the CSA starts the selected servers within our Cloud Isolation Technology. This technology allows unmodified VMs to run in the cloud provider of your choice and provides secure, layer 2 connectivity to the datacenter. A layer-2 connection—or a network bridge—means that users don’t need to change any network configuration data such as IP addresses and netmasks, since this is transparent when connectivity is established at the data link layer.
After the migration, one of two things will happen: network connectivity will work exactly as it always has or the migrated VM will appear to be down (from a network perspective). As you might imagine, our goal is the former. However, in some cases VMware’s network configuration can interrupt the flow of CloudSwitch’s network traffic. Specifically, there are two Virtual Switch Policy settings which must be enabled in order for CloudSwitch to provide layer 2 connectivity. These are:
- Promiscuous Mode
- Forged Transmits
So, what do these settings actually mean?
Let’s start with Promiscuous Mode. The name Promiscuous Mode is actually a bit confusing, though if you’re familiar with the related network interface option this will kind of make sense. When Promiscuous Mode is enabled, ESX will send all traffic to nodes whose interfaces are placed into promiscuous mode. Ultimately, enabling Promiscuous Mode on a virtual switch makes that switch function kind of like a network hub. VMware has essentially provided a way to see all traffic on a given Virtual Switch or Port Group.
Ok, but why does CloudSwitch need this? The quick answer is because without this option enabled, the CSA won’t receive traffic intended for servers it has migrated into the cloud. If ESX’s virtual switch functioned just like a physical switch this would not be a problem. Physical switches build up a list of MAC addresses connected to them, effectively “learning” which network interfaces are where. Without this intelligence, a node would never be able to communicate across more than one switch. However, ESX assumes that the VMs attached to its virtual switches are always the final destination. In CloudSwitch’s case, this is not true: There are other servers “behind” the CSA—cloud-based servers launched by customers.
If enabling Promiscuous Mode was acceptable in all environments, we would be in great shape. However, some of our customers have told us that they don’t feel comfortable with this configuration for their virtual switches. We completely understand their position, because we don’t want that extra traffic either! We’re only interested in traffic for the servers we’ve migrated into the cloud. Thankfully there is a quick and simple solution. The CloudSwitch Appliance can be configured with its own Port Group and Promiscuous Mode can be enabled only for this port group. In this configuration, the CSA will never receive traffic from any other node on its switch since Promiscuous Mode applies only to itself.
There’s one more setting we need to discuss, and that’s Forged Transmits. With this option enabled, VMware allows virtual machines to generate traffic using a source address that is different from the network interface connected to the virtual switch. CloudSwitch isn’t actually “forging” anything; rather, we are delivering the traffic generated by a customer’s cloud-based virtual machines into the datacenter across the secure tunnel we establish using the CSA. All physical switches support this behavior by default because, again, without it no network consisting of more than one switch would function. To provide traffic from migrated virtual machines to customer datacenters, CloudSwitch needs the CSA’s virtual switch to function more like a physical switch and allow this traffic to flow correctly. Enabling ESX’s Forged Transmits option on the CSA’s virtual switch or port group makes this happen.
Both of these settings can be updated from the Virtual Infrastructure client. The process for enabling Promiscuous Mode and Forged Transmits is described in a knowledge base article available from VMware. Note that these settings can be applied either to an entire Virtual Switch or to a Port Group. Port Group settings override Virtual Switch settings so if you do change them on your Virtual Switch and you still don’t see the expected traffic, be sure to check the Port Group settings: They may be overriding your switch-level changes.
CloudSwitch’s goal is to provide a simple, secure way to use cloud-based resources without requiring any change to applications or operating systems. A few basic requirements such as a virtual environment are required to make this possible. Additionally, when deploying the CloudSwitch Appliance under VMware ESX, two specific network configuration options are required. Hopefully this article will help users understand what’s needed to get started, and thereby ensure a smooth, successful product experience.
Why Cloud is at the Top of the CIO's Priorities
In the most difficult economic climate in decades, CIOs are reevaluating their strategies and looking for new ways to reduce data center costs and overhead while improving responsiveness to business requirements. Cloud computing has emerged as a much more agile and efficient approach than what companies have done in the past: adding more compute, storage and networking capacity or trying to get more out of what they already own.
Cloud computing did not emerge from a vacuum, but has its origins in three technology "megatrends" that most CIOs are already familiar with. These developments were all born out of the same need -- to drive down costs, simplify data center operations and allow IT to be as agile as possible. As these megatrends have become pervasive, they've helped put the cloud in the CIO's strike zone:
The drive to consolidate: Consolidating sprawling data centers has become a top IT priority as companies struggle with out-of-control costs for hardware, power, administration and service. Many companies have seen their data centers grow beyond anything they ever anticipated, with the result that in many cases they're not only running out of space, they're increasingly running out of power and cooling as well. In response, they look for innovative ways to reduce their data center footprints - to move out anything that adds cost and complexity, and takes up extra real estate.
The growth of virtualization: Many organizations now operate in virtualized environments, where applications can be quickly deployed to available resources, rather than assigning them to a specific physical machine. Not only does this optimize utilization of equipment, it allows IT to become much more responsive to the needs of the business.
Emergence of SaaS: The Software as a Service (SaaS) model has become widely accepted, in which applications are hosted by outside service providers that can apply specialized expertise, the right hardware and economies of scale. The idea of running certain apps outside the walls of the organization is recognized as not only acceptable but often preferable, where an external provider delivers the service just as well (if not better) than companies trying to do it themselves.
Cloud computing builds on these megatrends, and goes several steps further, providing new capabilities for enterprise computing:
- Not just consolidating the data center, but creating the optimum environment both within the DC and in the external cloud, to match changing demands for computing resources
- Not just virtualizing applications across internal systems, but across whatever environment is most appropriate and cost effective
- Not just software as a service, but enterprise applications running in the cloud on the cloud provider's infrastructure
The ability to run applications in the cloud promises to radically alter the balance sheet by which IT projects are judged, where initial capital expense and ongoing operating costs are factored against value delivered and how quickly resources become available. CIOs now have the opportunity to do something much more significant than make small incremental improvements -- particularly as new cloud deployment and management tools come to market. That's why more and more IT executives are making cloud computing a top priority as they plan their strategies for 2010 and beyond.
Has Virtualization Solved the Data Center Crisis?
Over the past several years, many IT departments have committed to virtualization as an antidote to the spiraling costs and inflexibility plaguing corporate data centers everywhere. By running applications on virtual servers and consolidating underutilized hardware, data centers can get maximum value from their equipment. Virtualization also makes IT more responsive to the needs of the business: rather than spending weeks or months to provision a physical server, a virtual server can be launched in minutes.
Virtualization was meant to be the solution to today's data center woes - but is it? While it brings much-needed flexibility and efficiency to an environment where these qualities were sorely lacking, virtualization alone doesn't cure the underlying problem and in some ways adds to it. Companies still have large data center infrastructure footprints to maintain, plus virtualization licenses, plus management issues introduced by virtualization - ironically adding cost as they try to reduce cost. Many IT managers report that the technical and management challenges associated with virtualization are hindering them from realizing its full cost benefits. They're still paying huge energy bills (those consolidated servers are working much harder than previously). They're still running out of capacity and need to keep buying more servers and storage. And over half of them are still building new data centers at enormous cost.
We're Not Done Yet
But virtualization is one step toward a larger goal, not the end of the journey. IT is in the middle of a fundamental transition from the rigid, siloed world of traditional data centers toward a more elastic, responsive model where needs are met far faster and more efficiently. And we're not done yet. While virtualization helps companies reduce cost and improve agility, the full promise of the new model plays out with the addition of cloud computing, delivering infrastructure on demand as an easily-accessible, cost-effective service.
Rather than perpetuating a bloated data center, the new model will allow companies to get out of the computing infrastructure business where appropriate, retaining only the portion that is essential to the enterprise. As the cloud environment becomes increasingly agile and secure, provisioning decisions will be framed by asking: Should we be really be doing this ourselves, or can someone else do it better and at lower cost? The majority of companies surveyed that are either using or actively planning to run at least some apps in the public cloud have started asking themselves the same question.
Some companies - particularly larger enterprises with the skills and scale to do it effectively -- are building on their virtualized environments to create private, or internal, clouds that deliver several of the benefits of cloud computing within the enterprise. Private clouds provide users with an elastic computing resource on demand and help make better, more efficient use of existing capacity. But IT departments still face many of the same fundamental challenges - they still need to buy, manage and grow the data center infrastructure on which the private cloud depends. As Gartner Group's Tom Bittman points out, for most enterprises, the private cloud is not the ultimate goal, it's another stepping stone to services available in the public cloud as they become available.
It's All About the Application
The real issue is determining where each application truly belongs. Some apps are simply not suitable for any cloud, while others, at least for the foreseeable future, belong in the private cloud. Some applications are candidates for the public cloud, but the appropriate services aren't ready yet. And some data center applications could be moved to a public cloud now or in the very near future.
While virtualization is a key step toward moving beyond the rigid data center, cloud computing takes you all the way there - which is why it's getting so much attention. With new technology from CloudSwitch under development, it may work for your enterprise faster than you think. Stay tuned.
