To the cloud and beyond! Planning a multi-year data center migration

A data center migration into the cloud is often a daunting business initiative that can take years as you transition your existing hardware, software, networking, and operations into a brand new environment. In our roles with Google Cloud’s Professional Services organization, we work side by side with customers to collaboratively architect and enable data center migrations into Google Cloud. Over the years, we’ve participated in multiple migration journeys, and devised a general approach. Along the way, we’ve stumbled across a lot of complexities and learned a lot of lessons. In this blog post, we provide a high level overview of our recommended data center migration process. Then, in future blog posts, we’ll provide a more detailed view into the engineering and program management migration aspects of a migration. The migration journeyEvery data center migration has a reason behind it—something like the desire for cost savings or to become more cloud native. This results in a business objective such as “migrate n data centers to Google Cloud by this date.” Regardless of your motivation, the common challenge is how to enable a successful data center migration while effectively managing risk. To help, we’ve developed a repeatable migration approach that consists of four phases: Discovery, Planning, Execution and Optimization. For most data center migrations, leveraging this repeatable framework can help identify assets, minimize risk using a multi-phased migration approach, enable deployment and configuration, and finally, optimize the end state. Phase 1: DiscoveryThe first step of our migration approach is the Discovery phase. Here we partner with an organization’s data center team to understand and document the entire data center footprint. This includes understanding the existing hardware mapping, software applications, storage layers (databases, file shares), operating systems, networking configurations, security requirements, models of operation (release cadence, how to deploy, escalation management, system maintenance, patching, virtualization, etc.), licensing and compliance requirements, as well as other relevant assets. In this phase, our objective is to obtain a detailed view of all relevant assets and resources of the current data center footprint. These resources should also include a resource grouping classification, which will be leveraged in the following phases for dependency mapping and migration wave planning. For example, while inventorying a data center, you should identify the various operating environments (non-production vs. production), dependencies (third-party software, domain controllers, etc.) and the business impact of all applications, including third-party systems that are in the migration scope. The key milestones in the Discovery phase are:Creating a “shared” data center inventory footprint – All teams that are part of the cloud migration should be aware of the assets and resources that will go live.Completing an initial GCP foundations design – This involves identifying centralized concepts of the GCP organization such as folder structure, Identity and Access Management model, network administration model, and more.An example set of data center inventory components that should be documented during the discovery phase.Additionally, during the Discovery phase, we recommend you engage in cross-functional discussions with other internal business units, ranging from IT to Finance to Program Management, to align on changes to support future cloud processes. In migrating your physical data centers to Google Cloud, it’s important to consider whether your data center staff is trained to support managing systems and infrastructure in Google Cloud. Also, you may need to reevaluate and adjust the Service Level Agreements (SLAs) for services that you intend to use in Google Cloud. Phase 2: PlanningThe second phase is Planning. Planning leverages the assets and deliverables gathered in the Discovery phase to create migration waves—logical groupings of resources—to be sequentially deployed into production and non-production environments. As a rule of thumb, it’s best to target non-production migration waves first, identifying the sequence of waves to migrate first. Here, consider:Mapping of today’s server inventory to Google Cloud machine types – Each workload today will generally run on a machine type with similar compute power, memory and disk.Timelines – When are my targets for migrating what?Workloads in each grouping – What are my migration waves grouped by? Is it by non-production vs. production applications? Is it by function (databases vs. file shares vs. applications)?The cadence of your code releases – Factor in any upcoming code releases as this may impact the decision of whether to migrate sooner or later.Time for infrastructure deployment and testing – Factor in adequate time for testing your infrastructure before fully cutting over to Google Cloud.Number of application dependencies – The applications with the fewest dependencies are generally good candidates for migration first. In contrast, you may want to wait to migrate an application that depends on multiple databases.Migration complexity and risk – Migrations are generally more successful when you tackle the simpler aspects of the migration first.For the migration waves, we recommend you gain confidence by starting with more predictable and simple workloads. For example, here, we recommend migrating file shares first, then databases and domain controllers and finally apps.This diagram displays an example of mapping inventory content found in the Discovery phase translated into migration waves. Non-prod migration waves should occur first. Prod waves should follow a successful non-prod migration.The Planning phase is also when you begin to design a future state of your IT organization and discuss how to transform existing roles to support key workloads in Google Cloud. Customers often ask us “what’s the best way to map existing staff models to support Google Cloud after the migration?” In many cases, we discuss how to train existing staff and where we may require adjustments based on the future state of the organization after the migration. The perfect time to begin making adjustments to your operations is when you begin to deploy your migration waves. One additional area of consideration during the Planning phase is whether or not to implement DevOps and SRE practices. Many customers find cloud migrations to be the perfect time to establish Infrastructure as Code practices, integrate code build and release with continuous integration/continuous delivery (CI/CD) pipelines, and perhaps even define internal service level indicators (SLIs). Additionally, customers often update their incident management and application support processes, including processes that involve Google Cloud Support, which can help address issues and respond to incidents. Phase 3: ExecutionThe third phase is Execution: taking the plans you’ve developed and bringing them to fruition. During the Execution phase, you need to be careful about the exact set of steps you take and configurations you develop, as you’ll usually repeat them during the non-production and production migration waves. The Execution phase is when you put in place your infrastructure components—IAM, networking, firewall rules, and Service Accounts—and ensure they are configured appropriately. This is also when you test the applications on the infrastructure configurations, ensuring that they have access to their databases, file shares, web servers, load balancers, Active Directory servers and more. Execution also includes using logging and monitoring to ensure your application continues to function with the necessary performance.An overview of executing different migration waves. As an example, an organization may opt to migrate file shares first, then domain controllers; each of these processes require migrating infrastructure, then testing and verifying a successful migration.The key to a successful Execution phase is agile application debugging and testing. Additionally, be sure to have both a short and long term plan for resolving blockers that may come up during the migration. The Execution phase is iterative and the goal should be to ensure that applications are fully tested on the new infrastructure.Phase 4: OptimizeThe last stage of a large data center migration project is Optimization. Once you’ve migrated your workloads to Google Cloud, we recommend periodic review and planning to optimize them. During this time, you may want to consider a range of optimization activities:Resize your machine types and disks – Whether to save costs or improve performance, Active Assist can help you do this automatically.Leverage Terraform for more agile and predictable deploymentsImprove automation to reduce operational overhead Improve integration with logging, monitoring, and alerting toolsAdopt managed services to reduce operational overheadEnterprises have a number of common migration considerations. Topics such as cost optimization, replatforming, automation, logging and monitoring, and more should all be part of any migration plan.When you migrate from a traditional data center environment to the cloud, you obtain visibility into your resource consumption and spend. Taking Compute Engine as an example, Google Cloud provides you improved cost observability, displaying the overall cost for CPU cores vs. RAM, so that you can more easily identify the compute resources that you are paying for. You can also identify virtual machines that you no longer need or that you can rightsize them with the Recommender API to best fit the needed performance. Preemptible VMs are another option for saving on compute operations.Or with Cloud Storage, you can take advantage of storage classes (i.e., standard, nearline, coldline, and archival) based on your use cases and apply lifecycle and retention policies. Taking the first stepPerforming a full data center migration is a big but worthwhile undertaking. With this migration framework, you can break down the process into stages that will have you decommissioning your last data center in no time! Let’s wrap up with some key lessons learned that we have learned along the way. Focus on being agile – A data center migration has many moving parts. If important individuals are blocked, data center migration timelines will be put at risk. Tackle the easy parts first – Build by confidence by migrating a simple application, where it’s easier to iron out the misconfigurations or identify missing infrastructure. Trying to migrate the largest and most complex application is not recommended. Communicate early to your stakeholders – Many data centers have “external users”—these could be other users within your company, or even outside the organization. Notify them of the migration early and check for potential compliance issues, which could delay the migration.Help teams learn about Google Cloud – This involves establishing a process for learning GCP, through provisioning of sandbox spaces for testing and enrolling in training opportunities. When you’re ready to take the first step, we’re here to help with a free discovery and assessment, which will help you estimate and understand your potential migration costs and options. In addition, stay tuned for upcoming blog posts, where we’ll discuss more engineering principles to help you along an accelerated migration path, as well as how to establish a program management practice to manage a large migration program.Related ArticleCloud migration: What you need to know (and where to find it)Google Cloud offers a rich set of solutions and documentation to help guide your cloud migration. Here’s where to find what you need.Read Article
Quelle: Google Cloud Platform

New private cloud networking whitepaper for Google Cloud VMware Engine

At Google Cloud, we’re committed to helping you run your apps where you need them, with open, hybrid, and multi-cloud solutions. One way we do that is with Google Cloud VMware Engine, our managed VMware service. Among other benefits, VMware Engine is built on Google Cloud’s strong networking foundation: The service runs on top of a 100 Gbps, non-oversubscribed, fully redundant physical network, providing a 99.99% infrastructure availability SLA in a single site. To help you understand networking in VMware Engine, we’ve written Private cloud networking for Google Cloud VMware Engine. In this whitepaper, you’ll learn about the various connectivity options available in VMware Engine, with detailed explanations of traffic flows, optimization options and architectural design considerations. Building on the Google Cloud VMware Engine networking fundamentals post, the whitepaper provides additional details on how VMware Engine private cloud networking works in Google Cloud Platform (GCP), in two main sections:Google Cloud VMware Engine networking basics – Use cases, onboarding requirements, high-level system components and key networking capabilities. It also covers networks and address ranges on the VMware Engine service and private access options for services, including both, private Google access and private service access.A deep dive into network traffic flows and interactions – Here, the white paper covers all the services available to users such as customer Virtual Private Cloud (VPC), access to on-prem locations, internet egress, public IP service for VMware Engine-hosted workloads, as well as the available Google managed services (Cloud SQL, Cloud Build, etc.), with emphasis on key design considerations for a successful VMware Engine deployment.Click to enlargeGoogle Cloud VMware Engine is a first-party offering in GCP, meaning Google is your primary and sole point of contact. Whether you’re evaluating the service, or already have it in production, understanding how networking works will help ensure a successful deployment and help you deliver a better user experience.Go ahead and download the whitepaper today. For additional information about VMware Engine, please visit the VMware Engine landing page, and explore our interactive tutorials. And be on the lookout for future articles, where we’ll discuss how VMware Engine integrates with core Google Cloud services such as Cloud DNS, Cloud Load Balancing and Bring-Your-Own-IP (BYOIP).Related ArticleGoogle Cloud VMware Engine explained: Integrated networking and connectivityLearn about the networking features in Google Cloud VMware Engine to let you easily and deploy workloads across on-prem and cloud environ…Read Article
Quelle: Google Cloud Platform

New to Google Cloud? Here are a few training options to help you get started

Google Cloud has the tools you need to build apps faster and make smarter business decisions. To help you get started with Google Cloud, and get the most from the platform, we’ve put together a list of no-cost resources below. Get hands-on experience with Google Cloud fundamentalsJoin our half-day event, Cloud OnBoard: Begin with Google Cloud Fundamentals, on Feb. 23 to learn about the basics of Google Cloud from experts. Experts will start by introducing the core components of Google Cloud and provide an overview of how its tools impact the entire cloud computing landscape. The event will then cover Compute Engine and how to create VM instances from scratch and from existing templates, how to connect them together, and end with projects that can talk to each other safely and securely. You will also learn about the different storage and database options available on Google Cloud. Afterwards, you’ll have a chance to explore other Google Cloud offerings like Kubernetes Engine and App Engine, and learn more about our managed containerized environments. The Cloud OnBoard will end with experts guiding you through hands-on labs where you can practice using the Google Console, Google Cloud Shell, and more. Can’t join the event live on Feb. 23? The training will also be available on-demand after Feb. 23. Explore Google Cloud infrastructure Continue building your foundational Google Cloud knowledge with our on-demand infrastructure training, Baseline: Infrastructure. This training will provide you with practical experience through expert-guided labs which dive into Cloud Storage and other key application services like Google Cloud’s operations suite (formerly Stackdriver) and Cloud Functions. Dig deeper into Google Cloud tools Once you have a strong grasp on Google Cloud basics, we recommend you get more in-depth hands-on experience with different Google Cloud offerings. Join the skills challenge to get 30 days free access to Google Cloud labs where you can practice using BigQuery, Google Kubernetes Engine, Cloud Speech API, AI Platform, Cloud Vision API, Cloud Run, and Firebase.Ready to get started with Google Cloud? Sign uphereto attend the Feb. 23 Cloud OnBoard: Begin with Google Cloud Fundamentals event.Related Article2021 resolutions: Kick off the new year with free Google Cloud trainingTackle your New Year’s resolutions with our new skills challenges which will provide you with no cost training to build cloud knowledge i…Read Article
Quelle: Google Cloud Platform

New Docker Desktop Preview for Apple M1 Released

This is just a quick update to let you know that we’ve released another preview of Docker Desktop for Apple M1 chips, which you can download from our Docker Apple M1 Tech Preview page. The most exciting change in this version is that Kubernetes now works.

First, a big thank you to everyone who tried out the previous preview and gave us feedback. We’re really excited to see how much enthusiasm there is for this, and also really grateful to you for reporting what doesn’t yet work and what your highest priorities are for quick fixes. In this post, we want to update you on what we’ve done and what we’re still working on.

Some of the biggest things we’ve been doing since the New Year are not immediately visible but are an essential part of eventually turning this into a supported product. The previous preview was built on a developer’s laptop from a private branch. Now all of the code is fully integrated into our main development branch. We’ve extended our CI suite to add several M1 machines, and we’ve extended our CI code to build and test Docker Desktop itself and all our dependencies for both architectures in parallel. With the whole pipeline now automated, from now on we will be able to issue new previews on a more regular basis and have more confidence that our changes have not broken anything.

As for feature changes and bug fixes since the last preview, here are some of the highlights:

Kubernetes now works (although you might need to reset the cluster in our Troubleshoot menu one time to regenerate the certificates).The host.docker.internal and vm.docker.internal DNS entries now resolve.We removed hard-coded IP addresses: it now dynamically discovers the IP allocated by macOS.osxfs file sharing now works.We made a configuration change that should improve disk performance.The Restart option in the Docker menu works.

The last major thing that we’re still working on is:

HTTP proxy support. At the moment the HTTP proxy configured on the host is ignored.

Finally, we are aware of the following items which are unfortunately out of our control. Here are our best recommendations for now:

Some corporate security or VPN software blocks the connection between the host and the VM, or the VM and the outside world. This can happen even if it doesn’t happen on Intel Macs because we had to switch to a new connection method with Apple’s new virtualization framework. There are some possible workarounds posted by users on our github issue, https://github.com/docker/for-mac/issues/5208.If you are trying to run Intel-based containers on an M1 machine, they can sometimes crash. We are using a piece of software called qemu to emulate Intel chips on M1 but it occasionally fails to run the container. Where possible we recommend sticking to arm64 containers on M1 machines; they will also be faster.

If you have an M1 Mac, then we invite you to download this new build and try it out. (Just bear in mind that it’s still a preview, so expect some rough edges.) If you encounter any bugs, please let us know on our GitHub repo. If you filed a bug against the previous preview, now would be a good time to retest it and let us know either that it’s now fixed or that it isn’t. You can chat with other users on the #docker-desktop-mac channel on our community Slack. And finally, if you’re the sort of user who wants to be the first to try out early versions of our software (not just M1) we invite you to join our Developer Preview Program.
The post New Docker Desktop Preview for Apple M1 Released appeared first on Docker Blog.
Quelle: https://blog.docker.com/feed/

AWS WAF bietet Support für JSON-Parsing und -Inspektion

AWS WAF kann jetzt nativ den JSON-Inhalt des Anfragekörpers parsen, so dass Sie bestimmte Schlüssel oder Werte des JSON-Inhalts mit AWS WAF-Regeln untersuchen können. Diese Funktion hilft Ihnen, Ihre APIs zu schützen, indem sie auf eine gültige JSON-Struktur prüft, den JSON-Inhalt auf gängige Bedrohungen für Ihre Anwendung untersucht und False Positives reduziert, indem nur die Schlüssel oder Werte im JSON-Inhalt untersucht werden.
Quelle: aws.amazon.com

Amazon EKS-Cluster unterstützen jetzt die Benutzerauthentifizierung mit OIDC-kompatiblen Identitätsanbietern

Amazon Elastic Kubernetes Service (Amazon EKS) unterstützt jetzt die Verwendung von OpenID Connect (OIDC)-kompatiblen Identitätsanbietern als Benutzerauthentifizierungsoption für Kubernetes-Cluster. Mit der OIDC-Authentifizierung können Sie den Benutzerzugriff auf EKS-Cluster verwalten, indem Sie die Standardverfahren in Ihrer Organisation zum Erstellen, Aktivieren und Deaktivieren von Mitarbeiterkonten verwenden. 
Quelle: aws.amazon.com

Ankündigung der allgemeinen Verfügbarkeit von Amplify Flutter, mit neuem Daten- und Authentifizierungssupport

Der Flutter-Support in AWS Amplify ist jetzt allgemein verfügbar (GA). Amplify ist eine Reihe von Tools und Diensten, die Frontend-Web- und Mobile-Entwicklern helfen, sichere, skalierbare Full-Stack-Anwendungen zu erstellen. Flutter ist ein Open-Source-UI-Softwareentwicklungskit, das von Google für die Entwicklung von Anwendungen für Android und iOS aus einer einzigen Codebasis erstellt wurde. Amplify Flutter bringt Amplify und Flutter zusammen. Es ist für Entwickler gedacht, die in das Flutter-Ökosystem investiert haben und nun die Leistung von AWS nutzen möchten. Sie können die Amplify Flutter-Bibliotheken sowohl mit von Amplify erstellten Backends als auch mit bestehenden AWS-Backends verwenden.
Quelle: aws.amazon.com