Adrian Cockcroft

FEBRUARY 13, 2023

Sustainability at AWS re:Invent 2022 -All the talks and videos I could find… Las Vegas MSG Sphere under construction next door to the Venetian Sands Expo Center — Photo by Adrian This blog post is long overdue — I spent too long trying to find time to watch all the videos, and finally gave up and listed a few below that I haven’t seen.

AWS 64

AWS Energy Architecture Programming 64

Dynatrace

APRIL 30, 2019

You can read my blog supporting my session titled “ Performance as Code: Lets make it a Standard ” on the Neotys PAC blog. At its heart it uses Istio (for traffic control) and Knative (for event driven tool orchestration) and stores all configuration in Git – following the GitOps approach. Bamboo, Azure DevOps, AWS CodePipeline ….

Architecture 125

Architecture Open Source Azure Metrics 125

Dynatrace

JUNE 20, 2023

Data is proliferating in separate silos from containers and Kubernetes to open source APIs and software to serverless compute services, such as AWS and Azure. Additionally, due to performance impact, Apigee’s distributed tracing only configures a probabilistic sampling rate, with a maximum rate of 50%.

Open Source 199

Open Source Google Serverless Azure 199

Dynatrace

NOVEMBER 22, 2022

For retail organizations, peak traffic can be a mixed blessing. While high-volume traffic often boosts sales, it can also compromise uptimes. In its pursuit, IT teams hover over system performance dashboards hoping their preparations will deliver five nines—or even four nines—availability. What is always-on infrastructure?

Infrastructure 188

Infrastructure Availability Systems Retail 188

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Smashing Magazine

AUGUST 3, 2023

How We Optimized Performance To Serve A Global Audience How We Optimized Performance To Serve A Global Audience Liran Cohen 2023-08-03T10:00:00+00:00 2023-08-03T13:06:00+00:00 I work for Bookaway , a digital travel brand. It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC. 43416 5001 52.213.180.42

Network 150

Network Tuning AWS Big Data 150

Dynatrace

JANUARY 28, 2021

Organizations that want a high-performance language with a great ecosystem for their applications often use Golang , an open-source programming language. With Dynatrace OneAgent you also benefit from support for traffic routing and traffic control. Dynatrace news. An observability framework alone is not enough.

Traffic 170

Traffic Open Source Servers Cloud 170

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. In case of a spike in traffic, you can automatically spin up more resources, often in a matter of seconds. Inconsistent performance.

Cloud 169

Cloud Traffic Best Practices Strategy 169

Adrian Cockcroft

FEBRUARY 9, 2023

The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. The virtualization and networking platform could be datacenter based, with something like VMware, or cloud based using one of the cloud providers such as AWS EC2.

Engineering 137

Engineering Serverless Lambda AWS 137

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. Thus making it an ideal choice for businesses seeking a successful implementation of their multi-cloud strategy.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

DECEMBER 21, 2023

The backend is a single one where the “passive” PMM instance (the one that is a pure “read replica”) is marked as “backup” so that traffic is only routed there in case the primary fails the health check. For simplicity, the PMM instances are configured to listen to the 80 port (http) on the private IPs.

Availability 97

Availability Monitoring Open Source Traffic 97

KeyCDN

FEBRUARY 22, 2023

With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades. There are several popular cloud-based platforms for web development and deployment, such as AWS , Azure , and Google Cloud Platform.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

The Netflix TechBlog

OCTOBER 18, 2022

We started seeing signs of scale issues, like: Slowness during peak traffic moments like 12 AM UTC, leading to increased operational burden. Meson was based on a single leader architecture with high availability. As the usage increased, we had to vertically scale the system to keep up and were approaching AWS instance type limits.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a With traffic growth, a single leader node handling all request volume started becoming overloaded. queries/sec.

Cache 224

Cache Latency Traffic Systems 224

Scalegrid

JANUARY 8, 2024

AI algorithms embedded in cloud architecture automate repetitive processes, streamlining workloads and reducing the chance of human error. AI-driven resource allocation not only enhances the overall performance of cloud services but also contributes to substantial cost savings.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

SEPTEMBER 23, 2019

In order to achieve this level of availability, we leverage an N+1 architecture where we treat Amazon Web Services (AWS) regions as fault domains, allowing us to withstand single region failures. can be abstracted by our key performance indicator, stream starts per second (SPS). evacuation traffic/nominal traffic ).

Traffic 190

Traffic Metrics Mobile Government 190

The Netflix TechBlog

MARCH 10, 2023

These applications are built on a microservices architecture, and the Asset Management Platform provides asset management to those dozens of services for various asset types. Although this indexing strategy worked smoothly for a while, interesting challenges started coming up and we started to notice performance issues over time.

Strategy 258

Strategy Cache Analytics Storage 258

Dynatrace

JULY 8, 2019

I’ve been speaking to customers over the last few months about our new cloud architecture for Synthetic testing locations and their confusion is clear. or “How will performance be accurate if the machine is not physical?” Hearing things like “Will you have more than one geographic location?” Some customers do but most do not.

Cloud 202

Cloud Hardware Testing Logistics 202

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. Amazon Aurora has become the fastest-growing service in the history of AWS and frequently is the target of migration from on-premise proprietary databases.

Database 117

Database Design Cloud Storage 117

Dynatrace

MAY 1, 2020

The investment continues—we’re anticipating an upcoming release of the AWS Graviton2 processor , which has already been announced to be significantly more powerful than its predecessor. Host performance measures. For details on available metrics, see host performance monitoring. Automatic updates of all monitoring modules.

Java 133

Java Hardware Tuning Metrics 133

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. As a micro-service owner, a Netflix engineer is responsible for its innovation as well as its operation, which includes making sure the service is reliable, secure, efficient and performant.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Abhishek Tiwari

JULY 8, 2023

Testing was primarily performed during the development lifecycle to identify and fix bugs, errors, and other issues before releasing the software to users. Monitoring, on the other hand, was conducted post-release to continuously observe and measure system performance, identify bottlenecks, and ensure availability.

Monitoring 52

Monitoring Testing Artificial Intelligence Traffic 52

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

The Netflix TechBlog

OCTOBER 15, 2019

Existing Solutions Dual Writes In order to keep two datastores in sync, one could perform a dual write, which is executing a write to one datastore following a second write to the other. In Netflix the microservice architecture is widely adopted and each microservice typically handles only one type of data.

Transportation 192

Transportation Architecture Processing Storage 192

Smashing Magazine

JANUARY 11, 2021

Front-End Performance Checklist 2021. Front-End Performance Checklist 2021. This guide has been kindly supported by our friends at LogRocket , a service that combines frontend performance monitoring , session replay, and product analytics to help you build better customer experiences. Web performance is a tricky beast, isn’t it?

Performance 145

Performance Cache Media Metrics 145

High Scalability

JULY 20, 2018

That’s mapping applications to the specific architectural choices. The third wing of the architecture piece is the “domain specific system-on-chip.” This is where your performance goes. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction.

Internet 121

Internet Internet Scalability Automotive 121

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. In serverless architecture, when applications are developed, they are typically composed of many different services. Other benefits to serverless architecture include the following: Cost. Response Times.

Serverless 57

Serverless Monitoring Lambda Latency 57

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost. APIs are forever.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. As a native offering from AWS, QuickSight comes deeply integrated with AWS data sources such as Amazon Redshift, RDS, and S3.

Analytics 152

Analytics Availability Media Social Media 152

Adrian Cockcroft

APRIL 5, 2023

This would open up opportunities to leverage existing performance monitoring tools and dashboards, extend optimization tools like autoscalers and schedulers, and to build new kinds of carbon analysis and optimization tools and services. At the instance level, many CPU and system architectures have direct access to power consumption metrics.

Energy 52

Energy Metrics Cloud Operating System 52

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership and the Return on Agility. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

The Netflix TechBlog

FEBRUARY 9, 2021

We can leverage high performance VMs in AWS to generate the assets. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires. Even with high performance VMs, generating 1000s of assets can take a long time.

Engineering 165

Engineering Storage Latency Entertainment 165

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started

Open Source 52

Open Source DevOps AWS Azure 52

Enprowess

JANUARY 12, 2022

Serverless Architecture. According to Ericsson’s analysis, international mobile data traffic is projected to become 4.5 Supports multitasking : voice search technology can simultaneously perform multiple tasks from navigation to setting up meetings and reminders. Serverless Architecture. Single Page Applications (SPAs).

Blockchain 59

Blockchain IoT Development Serverless 59

The Netflix TechBlog

JULY 30, 2019

Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra While we’re not (yet) actively measuring the nth percentiles, our production workloads speak for Conductor’s performance. Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. This post is a high level overview of the design and architecture of Gutenberg. A publisher publishes to a topic and consumers consume from a topic.

Cache 187

Cache Architecture Metrics Java 187