Do more with less: Introducing Cloud SQL Cost optimization recommendations with Active Assist

With Cloud SQL, teams spend less time on database operations and maintenance and more time on innovation and digital transformation efforts. This increased bandwidth for strategic work can sometimes lead to significant growth in database fleet size, which in turn can introduce operational complexity when it comes to managing cost. If your financial operations team flags that database instances are exceeding their budget, it can take a substantial amount of toil, expertise and time to identify waste across a large number of projects. And given the mission critical nature of your databases, it can be difficult to make changes with confidence while optimizing costs.We are, therefore, excited to introduce Cloud SQL cost insights and recommendations powered by Active Assist to address these challenges, while minimizing the effort required to keep costs optimized. These new recommenders will help you detect and right-size over-provisioned Cloud SQL instances, detect idle instances, and optimize your Cloud SQL billing. Cloud SQL recommendations use advanced analytics and machine learning to identify, with a high degree of confidence, the over-provisioned and idle instances in your fleet, as well as the ones that may be able to take advantage of committed use discounts. This feature is available for Cloud SQL for MySQL, PostgreSQL and SQL Server via the Recommender API and Recommendation Hub today, which makes it easy for you to integrate this feature with your company’s existing workflow management and communication tools, or to export results to a BigQuery table for custom analysis.Renault Group, a French multinational automobile manufacturer and one of our early customers for Cloud SQL recommendations, is already a fan:When we first ran Google’s early prototype, we were really impressed with its accuracy, given that we know how challenging it can be to analyze and interpret activity on database instances. After thoroughly testing this feature on 140 pilot projects, we ended up realizing that almost 20% of our Cloud SQL instances were idle and took appropriate actions. Not only did these recommendations help us reduce waste, but they also saved us significant effort in the writing and maintaining of custom scripts. We are looking to bring this in as part of our organization-wide optimization dashboard. Stéphane Gamondes Cloud Office Product Leader, Renault GroupWhat are the main sources of waste in cloud databases?Based on our Cloud SQL analysis and customer feedback, we identified the three most common reasons for exceeding budget:Over-provisioned resources. When developers err on the safe side and provision unnecessarily large instances, it can lead to unnecessary spending. It’s also common for database administrators who are used to provisioning larger instances on-premises, where it can be non-trivial to quickly increase instance size, to carry this practice over into the cloud environment, where it’s not as critical due to its elasticity. Idle resources. Cloud SQL makes it extremely easy for developers to create new instances to build a prototype, or run a dev/test environment. As a result, it’s not uncommon to see idle instances left running in non-production environments.Discounts not leveraged. While workloads with predictable resource needs can benefit from the committed use discounts, we see that many customers don’t always utilize those discounts, partially due to the complexity associated with figuring them out at scale.Let’s take a peek at these new Cloud SQL cost recommendations.Recommendation Hub example summary cardRightsize overallocated instancesOne of the key challenges associated with detection and remediation of overallocated instances is the definition of what it means for a database instance to be too large for a given workload. Active Assist uses machine learning and Google’s fleet-level Cloud SQL telemetry data to identify instances that have low peak utilization for CPU and/or memory, to ensure that they can be rightsized with minimal risk and have enough capacity to still handle their peak workloads after they are right-sized.To make it easier for you to act on each of these right sizing recommendations, this feature also provides an at-a-glance view of your instance usage over the past 30 days:example rightsize overallocated instances recommenderStop idle InstancesIdle or abandoned resources are known to be one of the largest contributors to waste in cloud spending, ranging from entire projects to individual Cloud SQL instances that tend to be forgotten about. One of the challenges associated with detecting and remediating such instances is learning to distinguish between Cloud SQL instances that have low level of activity by design, from the ones that are truly idle but that still show some activity due to health monitoring and maintenance, for example. This feature uses machine learning to estimate activity across all the Cloud SQL instances managed by Google and identify, with a high degree of precision, the instances that are likely to be idle.Leverage long term commitments discounts Cloud SQL committed use discounts give you a 25% discount off of on-demand pricing for a one-year commitment and a 52% discount for a three-year commitment. Figuring out the most optimal committed use discounts can be easier said than done, as it requires a thorough analysis of each workload’s usage patterns to establish the stable usage baseline and estimate the impact of the billing model changes. Active Assist detects Cloud SQL workloads with predictable resource needs and recommends to purchase committed use discounts.Unlike the sizing and idle instance recommendations, committed usage discount recommendations for Cloud SQL are only available in private preview today (please use this form if you are interested in early access). The committed usage recommendations offer you an alternative choice between optimizing to cover your stable usage or maximize savings.Getting started with Cloud SQL cost optimization recommendationsHead over to Recommendation Hub to see if there are already some Cloud SQL cost optimization recommendations available on your project. You can also automatically export all recommendations from your Organization to BigQuery and then investigate the recommendations with DataStudio or Looker, or use Connected Sheets that let you use Google Workspace Sheets to interact with the data stored in BigQuery without having to write queries.As with any other Recommender, you can choose to opt out of data processing at any time by disabling the appropriate data groups in the Transparency & control tab under Privacy & Security settings.We hope that you can leverage Cloud SQL cost recommendations to optimize your database fleet and reduce cost, and can’t wait to hear your feedback and thoughts about this feature! Please feel free to reach us at active-assist-feedback@google.com and we also invite you to sign up for our Active Assist Trusted Tester Group if you would like to get early access to the newest features as they are developed.Related ArticleDatabase observability for developers: introducing Cloud SQL InsightsNew Insights tool helps developers quickly understand and resolve database performance issues on Cloud SQL.Read Article
Quelle: Google Cloud Platform

What is Cloud Load Balancing?

Let’s say your new application has been a hit. Usage is growing across the world and you now need to figure out how to scale, optimize, and secure the app while keeping your costs down and your users happy. That’s where Cloud Load Balancing comes in. What is Cloud Load Balancing?Cloud Load Balancing is a fully distributed load balancing solution that balances user traffic (HTTP(s), HTTPS/2 with gRPC, TCP/SSL, UDP, and QUIC) to multiple backends to avoid congestion, reduce latency, increase security, and reduce costs. It is built on the same frontend-serving infrastructure that powers Google, supporting 1 million+ queries per second with consistent high performance and low latency. Software-defined network(SDN) Cloud Load Balancing is not an instance- or device-based solution, which means you won’t be locked into physical infrastructure or face HA, scale, and management challenges. Single global anycast IP and autoscaling:Cloud Load Balancing front-ends all your backend instances in regions around the world. It provides cross-region load balancing, including automatic multi-region failover, which gradually moves traffic in fractions if backends become unhealthy or scales automatically if more resources are needed.Click to enlargeHow does Cloud Load Balancing work?External load balancingConsider the following scenario. You have a user, Shen, in California. You deploy your frontend instances in that region and configure a load-balancing Virtual IP (VIP). When your user base expands to another region, all you need to do is to create instances in additional regions. There is no change in the VIP or the DNS server settings. As your app goes global, the same patterns follow: Maya from India is routed to the instance closer to her in India. If the instances in India are overloaded and are autoscaling to handle the load, Maya will seamlessly be redirected to the other instances in the meantime and route back to India when instances have scaled sufficiently to handle the load. This is an example of external load balancing at Layer 7.Internal load balancingIn any three-tier app, after the frontend you have the middleware and the data sources to interact with, in order to fulfill a user request. That’s where you need Layer 4 internal load balancing between the frontend and the other internal tiers. Layer 4 internal load balancing is for TCP/UDP traffic behind RFC 1918 VIP, where the client IP is preserved.You get automatic heath checks and there is no middle proxy; it uses the SDN control and data plane for load balancing. How to use global HTTP(S) load balancingFor global HTTP(s) load balancing the Global Anycast VIP (IPv4 or IPv6) is associated with a forwarding rule, which directs traffic to a target proxy. The target proxy terminates the client session, and for HTTPs you deploy your certificates at this stage, define the backend host, and define the path rules. The URL map provides Layer 7 routing and directs the client request to the appropriate backend service. The backend services can be managed instance groups (MIGs) for compute instances, or network endpoint groups (NEGs) for your containerized workloads. This is also where service instance capacity and health is determined. Cloud CDN is enabled to cache content for improved performance. You can set up firewall rules to control traffic to and from your backend. The internal load balancing setup works the same way; you still have a forwarding rule but it points directly to a backend service. The forwarding rule has the Virtual IP address, Protocol, and up to five ports. How to secure your application with Cloud Load BalancingAs a best practice,run SSL everywhere. With HTTPS and SSL proxy load balancing you can use managed certs, for which Google takes care of the provisioning and managing the SSL certificate lifecycle. Cloud Load Balancing supports multiple SSL certificates, enabling you to serve multiple domains using the same load balancer IP address and port. It absorbs and dissipates layer 3 and layer 4 volumetric attacks across Google’s global load balancing infrastructureAdditionally, with Cloud Armor, you can protect against Layer 3 to Layer 7 application level attacksBy using Identity Aware Proxy and firewalls you can authenticate and authorize access to backend services. How to choose the right load balancing optionWhen deciding which load balancing option is right for your use case, consider factors such as: Internal vs external, global vs regional and type of traffic (HTTPs, TLS, or UDP)If you are looking to reduce latency, improve performance, enhance security, and lower costs for your backend systems then check out Cloud Load Balancing. It is easy to deploy in just a few clicks; simply set up the frontend and backends associated with global VIP and you are good to go!  For a more in-depth look into the service check out the documentation.For more #GCPSketchnote, follow the GitHub repo. For similar cloud content follow me on Twitter @pvergadia and keep an eye out on thecloudgirl.dev Related ArticleGlobal HTTP(S) Load Balancing and CDN now support serverless computeNow, our App Engine, Cloud Run and Cloud Functions serverless compute offerings can take advantage of global load balancing and Cloud CDN.Read Article
Quelle: Google Cloud Platform

Der Sofortmodus der Amazon-EC2-Flotte unterstützt jetzt gezielte Amazon-EC2-On-Demand-Kapazitätsreservierungen

Ab heute können Sie die EC2-Flotte mit gezielten On-Demand-Kapazitätsreservierungen nutzen. Mit On-Demand-Kapazitätsreservierungen können Sie Rechenkapazität für Ihre Amazon-EC2-Instances in einer bestimmten Availability Zone für einen beliebigen Zeitraum reservieren. Für gezielte Kapazitätsreservierungen müssen Instances speziell auf die Kapazitätsreservierung abzielen, um in der reservierten Kapazität ausgeführt zu werden. Bisher gab es beim Start einer EC2-Flotte keine Möglichkeit, gezielte Kapazitätsreservierungen zu verwenden.
Quelle: aws.amazon.com

Amazon Lex gibt Äußerungsstatistiken für Bots bekannt, die mit der Lex-V2-Konsole und API erstellt wurden

Amazon Lex ist ein Service zur Erstellung von Konversations-Schnittstellen für Sprache und Text in jeder Anwendung. Ab heute stellt Amazon Lex Äußerungsstatistiken über die Amazon-Lex-V2-Konsole und API zur Verfügung. Sie können jetzt Äußerungsstatistiken verwenden, um Bots zu optimieren, die auf der Lex-V2-Konsole und APIs basieren, um die Unterhaltungserfahrung für Ihre Benutzer weiter zu verbessern. Mit diesem Start können Sie vom Bot verarbeitete Äußerungsinformationen anzeigen und analysieren. Diese Informationen können verwendet werden, um die Leistung Ihres Bots zu verbessern, indem neue Äußerungen zu vorhandenen Absichten hinzugefügt werden und Sie dabei helfen, neue Absichten zu entdecken, die vom Bot bedient werden können. Mithilfe von Äußerungsstatistiken können Sie auch die Leistung mehrerer Versionen eines Bots vergleichen. 
Quelle: aws.amazon.com

Amazon Lex ist jetzt in den Regionen Asien-Pazifik (Seoul) und Afrika (Kapstadt) verfügbar

Ab heute ist Amazon Lex in den Regionen Asien-Pazifik (Seoul) und Afrika (Kapstadt) verfügbar. Amazon Lex ist ein Service zur Erstellung von Konversations-Schnittstellen für Sprache und Text in jeder Anwendung. Amazon Lex kombiniert fortgeschrittene Deep-Learning-Funktionen der automatischen Spracherkennung (Automatic Speech Recognition, ASR) für die Umwandlung von Sprache in Text und das Verstehen natürlicher Sprache (Natural Language Understanding, NLU), um die Absicht des Textes zu erkennen. So können Sie Anwendungen mit fesselnden Benutzererlebnissen und lebensechten Interaktionen erstellen. Mit Amazon Lex können Sie einfach anspruchsvolle, Konversation-Bots („Chatbots“), virtuelle Agenten und IVR-Systeme in natürlicher Sprache erstellen.
Quelle: aws.amazon.com

Amazon DynamoDB bietet Ihnen jetzt eine genauere Kontrolle der Prüfungs-Protokollierung, indem Sie die API-Aktivität auf der Datenebene von Streams in AWS CloudTrail filtern können

Sie können jetzt AWS CloudTrail verwenden, um die API-Aktivität auf der Datenebene von Amazon DynamoDB Streams zu filtern und abzurufen, was Ihnen eine detailliertere Kontrolle darüber gibt, welche DynamoDB-API-Aufrufe Sie selektiv in CloudTrail protokollieren und bezahlen möchten und um Compliance- und Prüfungs-Anforderungen zu erfüllen.
Quelle: aws.amazon.com