Cloud Center of Excellence
Cloud Center of Excellence
Cloud Center
of Excellence
Contents
Building an internal team to drive success is a natural inclination. At Google, we’ve seen this team called
many different things. Cloud Services, Innovation Council, Cloud Engineering, even Cloud Platform. We
refer to a team so organized and directed as a Cloud Center of Excellence, or a Cloud COE.
A well-appointed Cloud COE begins with a small team who understands the Google Cloud Adoption
Framework and is able to use it as a guide for implementing cloud technology aligned with a business’s
goals and strategy. The Cloud COE team then becomes the conduit for transforming the way that the
other internal teams serve the business in the transition to the cloud.
A Cloud COE is not a static entity. Rather, it continually evolves to keep pace with the innovation
associated with adopting the cloud. Executive leadership should design the Cloud COE as an adaptive
structure that evolves as the needs of the organization do.
3
A successful Cloud COE is guided by the Google Cloud Adoption Framework, which builds a structure
on the rubric of people, process, and technology that produces actionable programs within the themes
of Learn, Lead, Scale, and Secure. This framework is informed by Google’s own evolution in the cloud
and many years of experience helping customers.
The Cloud COE is the team that drives the cloud maturity of the organization forward and sets the
agenda of the activities articulated in the Google Cloud Adoption Framework
4
Running a Cloud COE is a full-time job in a large organization. Its team members are aligned with the
business strategy. They collaborate with the rest of the organization in achieving their goals. And they
are fully committed to the success of this move to the cloud.
The team that makes up the Cloud COE must also be cross-functional. As they will have the authority to
make decisions regarding architecture and process, they will need expertise in all things cloud.
As it is the needs, the priorities, and the capabilities of the business that drive the structure and scope
of the Cloud COE, each Cloud COE will look a little different. And the current state of cloud maturity of
the team will drive its orientation and activities.
Across organizations, however, there are several characteristics that successful Cloud COEs will have in
common:
5
• Multidisciplinary: Members of the team reflect the diverse perspectives of the stakeholders in the
project.
• Empowered: The Cloud COE should have decision-making power without need for higher-level
sign-off.
• Visionary: The Cloud COE should consider a multi-project viewpoint to understand repeatability
and long-term benefits or goals for the organization.
• Agile: The Cloud COE should understand the necessary requirements to be able to deliver short-
term wins such as short development cycles and an iterative approach to building products.
• Technical: The Cloud COE should include experienced individuals with a history of architecting and
building past solutions within the organization.
• Engaged: The individuals within the Cloud COE should be dedicated, able to commit full-time to the
endeavor and the process.
• Cloud-centric: The Cloud COE should include members who will specialize in the cloud and cloud-
specific functions.
• Integrated: The individuals within the Cloud COE should be sourced from existing areas of the
business to allow for easy integration into existing teams and organizational constructs.
• Hands-on: Within a Cloud COE, there should be individuals who are able to do the hands-on work
needed to build and test cloud solutions.
• Small: The Cloud COE should start as small as possible, ideally 10 team members or fewer, while
still incorporating the knowledge and expertise to accomplish the other characteristics.
6
Both the cloud maturity level of the organization and its business strategy determine the focus of the
Cloud COE. Some Cloud COEs focus on best practices; others focus on standardization, improvements,
or innovation. In terms of cloud maturity level, a focus on driving transformational cloud maturity for an
organization would mean:
• Leveraging agile techniques and a fail-fast approach to research services that fit the model
appropriate to the organization and existing data center platforms
• Collecting the data that will determine the patterns of future success
Which focus to adopt depends on the most pressing needs and goals of the organization. Those needs
and goals are defined by the executive team, and the Cloud COE streamlines its services based on
them.
The Cloud COE is designed to meet the needs of individual organizations. No two Cloud Centers of
Excellence will look quite the same.
7
Individual Cloud COEs differ across organizations, and they also differ across time. The organizational
knowledge and capabilities that the Cloud COE reflects will evolve over time, as will the cloud maturity
level of the organization. The Cloud COE must evolve with it.
As the Cloud COE evolves, it will increasingly be populated with engineers who have experience and a
deep understanding of how critical functions currently operate. They will know how to translate existing
data center–based platforms into cloud-based platforms, and how to host greenfield applications on
the cloud platform using cloud-native services.
A high-level view of the evolution and alignment of a Cloud COE captures the activities and outcomes in
terms of timeframe:
8
A Cloud COE is successful to the extent that it successfully drives cloud adoption.
If employees feel that the Cloud COE is collaborative and that it helps facilitate cloud deployment
and usage, they will be more likely to use its services to work together in building better technology,
processes, and culture. If they feel coerced or that the Cloud COE has its own separate agenda, they
are less likely to embrace the COE or work with it.
The Cloud COE must strive always to inspire, to guide, and to support. It is an enabler of success
and exists to help the overall organization achieve its goals. The Cloud COE is only successful if the
various teams and organizations it supports are successful on their cloud journeys.
10
The best timing for building your Cloud COE is well before undertaking the first cloud migration.
However, there is never a bad time to introduce best practices and cloud governance. Setting up a
Cloud COE midway through your cloud journey still offers many opportunities to realize benefits and
better alignment with your strategic goals for cloud adoption.
Once the Cloud COE members are selected and the Cloud COE is evangelized across the organization,
it is important to quickly create momentum and begin the work to set the foundation for the cloud.
A successful Cloud COE empowers transformation. For a Cloud COE to be successful, it must itself be
empowered, endorsed, and supported by strong executive sponsors. Comprehensive buy-in should
expand across the C-suite and must reach across business functions, not just the Information and
Technology (IT) function. Strong executive sponsors are actively involved in cloud deployments. They
champion Cloud COE practices across the organization. And they support the Cloud COE through its
evolution.
• Co-develop objectives with the Cloud COE to make sure that activities align with the business
strategy, and communicate this to the wider business and projects team(s)
• Create a communication channel for the Cloud COE for the purpose of quickly raising issues and
risks with the committee
• Announce and promote the Cloud COE communication channel(s) within the business
• Agree on the engagement model for the committee with the Cloud COE and between Cloud COE
and businesses/functions
• Secure funding for the resources to staff the Cloud COE and for all the initiatives led by the COE
11
Organizational analysis
The Google Cloud Adoption Framework provides a Cloud Maturity Assessment to assist you with both
these tasks. Completing a Cloud Maturity Assessment then enables you to turn to questions such as
these:
• How can the organization’s culture be aligned with the technological changes?
• What policies and procedures will be impacted as part of the cloud adoption journey?
• What potential challenges can impact the training and communication required to drive cloud
adoption within the organization?
With capabilities and goals defined, you can then consider how best to shape your Cloud COE, with
questions such as these:
• Which projects can become a part of the Cloud COE as either a pilot or a proof of concept?
• Who would be the stakeholders and/or owners for the identified workstreams?
• Who can become a part of the early cloud adoption program, while driving an effective feedback
channel to the Cloud COE?
The Cloud COE is a cross-functional team of people with deep skills and expertise. At a high level, the
team undertakes to shape and support the direction of the company across five domains:
13
Encourage collaboration
Adoption
• Create and promote communication channels
• Minimize collaboration barriers across functions
• Define and monitor cross-functional collaboration activities
Increase awareness
• Give employees access to information
• Delegate authority and empower employees to take decisions
• Encourage open communication throughout the organization
Cloud advisory
• Advise on cloud methodology
• Advise on release management
Cloud optimization
• Oversee cloud utilization and address under- and overutilization
• Improve data usage and management
Governance
• Standardize processes and methodologies
• Incorporate agile methodology in cloud releases
Governance
• Tailor cloud architecture to business needs
• Develop management governance for the design, build, and release phases
• Build cloud architecture frameworks
Governance • Design cloud processes
• Develop development guidelines
Retooling
• Standardize tools across functions
• Create tools to be used in cloud initiatives
Best practices
• Work with different functions to capture best practices
• Disseminate best practices across teams
• Continuously capture and propagate best practices
• Adjust processes based on best practices
Internal expertise
• Create technical excellence within the organization
• Advise on the recruiting, training, and upskilling of cloud employees
Knowledge management
• Serve as a centralized point of knowledge management
Knowledge
• Capture and encourage best practices
• Become the centralized point for questions about the cloud
• Support the development of the training approach
Learning culture
• Encourage continuous learning
• Develop a culture of excellence and knowledge
Thought leadership
• Develop practices that are specific to the organization
• Develop points of view on the cloud and the organization
• Manage asset creation and publication
15
Cloud management
• Monitor cloud usage
• Manage cloud permissions
Cost optimization
• Monitor costs
• Manage billing
Onboarding
• Onboard new members to the Cloud COE
Security
• Incorporate security protocols into the cloud architecture
• Manage access and identity
• Manage cloud permissions
Growth
• Prioritize projects and initiatives
• Deploy the cloud strategy
• Modernize infrastructure technology
• Accelerate go-to-market products
Innovation
• Use the cloud to develop new use cases
• Spearhead technological innovations
Integration
Strategy
• Align the cloud strategy to the larger organizational strategy
• Promote cross-functional integration
Program management
• Plan sprints, releases, and upgrades
• Monitor access and identity
Strategic alignment
• Ensure business alignment
• Communicate with the executive team often to adapt a cloud strategy for
potential organizational strategy changes
16
The roles in a Cloud COE will vary based on the organization’s maturity in the cloud and its specific
needs. Small organizations might have a number of people sharing particular roles (for example,
security and networking), but large organizations are likely to separate roles out by individuals. The
intent is to create a team with the ability to move at the pace necessary to achieve the organization’s
strategic goals.
Cloud COE Oversees the Cloud COE. Responsible for working with the executive team on cross-team
Lead collaboration, next steps, sponsorship, and overall management of the Cloud COE.
Developer
Responsible for the team’s project management and execution. In addition, aligns
Operations and
developers to best practices and essential standards. Consults on edge cases and unique
Infrastructure
needs. Builds the applications and tools needed for app deployment and management.
Lead
Software Consults with the business team on how to design cloud applications for optimal scaling.
Engineer/ Represents the enterprise’s APIs to Cloud COE consumers and partners through
Cloud Architect evangelism, onboarding, documentation, and support.
Additionally, has a creative and technical mindset that empowers the organization to use
the cloud, likely using a “Train the Trainer” approach to train counterparts and achieve
scale. Keeps up to speed and promotes the latest trainings and certifications, and designs
and maintains customized programs
17
Ensures that services — both internally critical and externally visible systems — have
reliability and uptime appropriate to users’ needs and a fast rate of improvement, while
keeping an eye on capacity and performance. Responsible for availability, latency,
performance, efficiency, change management, monitoring, emergency response, and
Site Reliability capacity planning. Focuses on the health of the Google Cloud Platform (GCP)
Engineer infrastructure.
Site Reliability Engineering (SRE) is a discipline that combines software and systems
engineering to build and run large-scale, massively distributed, fault-tolerant systems.
SRE is also a mindset and a set of engineering approaches to running better production
systems.
Responsible for the team’s project management and execution. Oversees the cloud
Cloud
architecture, network engineering, security, and software engineers, cloud engineers, and
Engineering Lead
developers in the team.
Responsible for the security of applications and infrastructure in the cloud. Helps to
ensure that software and services are designed and implemented to the highest security
Security Engineer standards. Performs security audits, risk analysis, application-level vulnerability testing,
and security code reviews for a wide variety of products. Works closely with other
software engineers to enhance the overall security posture.
Guides the process of configuring and deploying the cloud infrastructure, consisting of
identity and access management, network architecture, application security, logging,
Cloud Developer monitoring, billing, and more. Consults with various teams across the organization on how
Operations and to design their cloud applications for optimal scaling, including CDN design, load balancer
Infrastructure setup, caching, compute optimizations, continuous integration and delivery pipeline, and
Engineer more.
Additionally, works closely with Product Management and Product Engineering to build
and drive excellence across products.
18
Works closely with engineering, site reliability, and deployment teams to improve the
critical tools and support process that enable cloud support engineers and internal
Technical customers to achieve success. Applies in-depth technical experience to develop a deep
Solutions understanding of, and drive enhancements for, cloud tooling architecture.
Engineer Builds and implements a global service and tooling platform to ensure stability, reusability,
testing, compliance, and overall reliability. Acts as the first line of defense, in regular
contact with cloud site reliability engineers, network engineers, and security engineers.
Leads the team of data scientists. Responsible for the team’s project management and
execution. Oversees data analytics and machine learning initiatives within an organization.
Enables data-driven decision-making by collecting, transforming, and visualizing data.
Data Designs, builds, maintains, and troubleshoots data processing systems with a particular
Scientist emphasis on the security, reliability, fault-tolerance, scalability, fidelity, and efficiency of
Lead such systems.
Additionally, analyzes data to gain insight into business outcomes, builds statistical
models to support decision-making, and creates machine learning models to automate
and simplify key business processes.
Supports initiatives related to systems, processes, and data transformation. Dives deeply
into the data and understands the business processes supported, applying statistics and
data modeling to gain actionable business insights and drive recommendations. Interacts
Data with multiple stakeholders across business, product, and engineering teams, while
Analyst working closely with the data team to support reporting and business metrics.
Responsible for maintaining the data assets developed for underlying CRM ecosystem
(such as business glossary, CDE/Reference data, and DQ dashboards) and managing the
governance process for data model changes.
Organization Assesses the impacts of cloud adoption on the organization as a whole, as well as on
Change and individual teams and lines of business. Helps align change initiatives with business value
Communication and strategic cloud goals. Develops and leads strategies to communicate key initiatives
Specialist and successes across the enterprise.
19
It is important that the skills of the Cloud COE team members be robust enough to support their roles
and activities. The following skills are recommended for Cloud COE team members:
To provide the Cloud COE individuals with the knowledge, resources, and tools to succeed in their role, it
is important to equip them with the right training. A needs analysis will help define the training plan,
which captures information on which individuals will receive training, the format and course those
individuals will receive, and the targeted timeframe for training.
For GCP customers, Google Cloud Fundamentals is recommended to give the team the basic
knowledge of Google Cloud Platform. If team members are new to agile delivery, they should also be
trained in scrum and agile fundamentals.
To fill the key roles, the following learning paths are recommended:
It is worth considering the Google Cloud Certifications, as these certifications cover the design,
development, management, and administration of application infrastructure and data solutions on
Google Cloud technology. The Google Cloud Certified designation demonstrates mastery of the job
roles and skills recommended for the Cloud COE.
Plan to staff your Cloud COE with a technically capable and highly engaged team. Ideally, you’ll be able
to staff internally, so that team members are aligned with the corporate culture and come to the role
with their corporate networks already in place. To buttress the team with additional skills not available
internally, some organizations turn to external partners or consultants.
It can be tempting to think of turning the team that delivers the first cloud project into the Cloud COE.
This repurposing works only if the project team is highly experienced in cloud offerings and if they can
be committed to the responsibilities required for the Cloud COE on a full-time basis.
Cloud COE members are the cloud champions within an organization. Their work should excite and
inspire other employees about the benefits of moving to the cloud. For better leverage, the Cloud COE
should be placed high enough within the organizational structure that the team will be able to create the
momentum necessary for conducting a successful migration.
To engage deeply with other teams and individuals across the organization, the Cloud COE team
members and the executive sponsors must work together to:
• Create a sense of urgency to help motivate employees to embrace the role of the Cloud COE in
adopting the cloud
• Involve other employees in Cloud COE initiatives and in the cloud migration
• Encourage cross-functional collaboration so that employees will feel both empowered and
represented
22
It is important for sponsors and Cloud COE team members to understand both why these goals are
important and how to achieve them:
Change can be overwhelming • Providing a vision for the future and the necessary
for employees, which can lead road to get there
to delays in adoption. To help • Highlighting market trends and competitor cloud
Creating a
counter this, the executive usage
sense of
sponsors will need to • Sharing financial information to show potential gains
urgency
communicate the pressing from cloud adoption
nature of the change and • Organizing town halls or forums where employees can
discuss the road forward. raise questions
Some employees are likely to be skeptical of the Cloud COE and its purpose. To overcome this
skepticism, Cloud COE team members need also to build credibility. They do this in large part by:
• Providing transparency to the metrics by defining, capturing, and reporting on KPIs that are
important to the business
• Being responsible for actively sharing success stories, as well as learning from failures with the
wider organization
24
A well-designed and thoughtfully implemented Cloud Center of Excellence will not only help to jump-
start a large-scale, organization-wide transformation, but it also accelerates an organization's transition
to the new operating model.
To evaluate your readiness for establishing and managing a Cloud COE, apply the following checklist:
A Cloud COE requires funding. This may take the form of FTEs or resources
dedicated to the group, budget for training, or budget to purchase products to
Secure Cloud
fuel cloud solutions. Determining the budget available will inform the size and
COE funding
scale of the Cloud COE. It can take months to set up a Cloud COE, so it is
important to account for this initiative’s recruitment and onboarding phases.
The foundation of a successful Cloud COE is its members. The level of expertise,
vision, and willingness to build the necessary tools for cloud delivery will dictate
the success of the Cloud COE and the cloud implementation. Therefore, it is
Identify/recruit important to select Cloud COE members carefully. These members can be
Cloud COE recruited internally, if they fit the qualification criteria, or can be hired externally.
members
The two main qualifying criteria for members are:
• Highly technical experience in cloud offerings
• Excitement about cloud offerings
25
Training the right resources, at the right time, with the right tools is an important aspect of establishing
a Cloud COE. Select Cloud COE members before defining a training plan, and then train them well.
A vision expresses a desired end state. To manage change successfully, you need to
Define Cloud define how the Cloud COE will support the business in achieving this end state. The
COE vision vision needs to be concrete, inspirational, attainable, focused, within scope, and
simple.
Once a vision is established, the Cloud COE and executive team need to define the
Define Cloud
best way to implement it. To better define an implementation strategy, a Cloud COE
COE strategy
can conduct an organizational analysis.
To excite employees, both the executive team and the Cloud COE need to engage,
Excite
communicate with, and encourage them. This approach will help build the necessary
employees
momentum to deploy to the cloud and build trust for the Cloud COE.
To establish trust and encourage employees to use Cloud COE offerings, the Cloud
COE will need to build credibility across the organization. To accomplish this:
• Define KPIs
Build • Run pilot projects
credibility • Communicate often and through consistent communication channels
• Be transparent with employees and address their concerns
• Hold town halls, when appropriate, to address questions and communicate
important decisions
26
Before deployment to the cloud can begin, the Cloud COE will need to develop frameworks and tools to be
used in that deployment. There are several high-level steps for establishing cloud governance.
Define the Cloud COE charter. This charter should specify goals, operating guidelines,
workstreams, key roles, and responsibilities for the group. When developing these
Establish
principles, consider the following:
operating
• Networking
principles
• CI/CD
• Programmable infrastructure
Define Setting a plan helps you define how cloud solutions will be deployed in the
deployment organization. In addition, it will help establish how the solutions will be built with
plan respect to sprint cycles, team members, release cycles, and other relevant factors.
The Cloud COE should build a process where employees are actively capturing best
Encourage practices and incorporating them into their work. The Cloud COE should have visibility
best practices into these practices so as to ensure both that these best practices are aligned with the
frameworks developed and that they are incorporated across the organization.
Defining the future of the cloud within an organization is one of the responsibilities of
Define cloud the Cloud COE. For this reason, the Cloud COE should work with the executive team
roadmap to define next steps, future offerings, and potential cloud offerings that align with the
larger organizational strategy.
To accomplish the goals of this stage, the Cloud COE should consider how they will
manage the following:
• Cost control
Cloud COE
• Data management
management
• Instrumentation
• Identity and access
• Incident management