Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Casey Rosenthal (traffic and chaos) Models of Availability.

Tuning 61

Tuning AWS Best Practices Network 61

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience. This is where large-scale system migrations come into play.

Traffic 279

Traffic Metrics Systems Strategy 279

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Casey Rosenthal (traffic and chaos) Models of Availability.

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

APRIL 26, 2022

Digital experience monitoring enables companies to respond to issues more efficiently in real time, and, through enrichment with the right business data, understand how end-user experience of their digital products significantly affects business key performance indicators (KPIs).

Monitoring 202

Monitoring Social Media IoT Metrics 202

Percona

DECEMBER 13, 2023

MySQL 8 introduces Error Log Filtering as a mechanism to fine-tune the error log, allowing administrators to focus on the most critical issues. This is particularly beneficial in high-traffic environments where minimizing log noise is crucial for efficient log analysis.

Database 95

Database Open Source Tuning Traffic 95

Smashing Magazine

NOVEMBER 8, 2021

Surveying the existing landscape of available developer tools and runtimes, we felt that there is a gap. Stay tuned for more in 2022! On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around. Commerce At Shopify Scale: Hydrogen Powered By Oxygen.

Cache 136

Cache Best Practices Strategy Servers 136

Dynatrace

OCTOBER 25, 2022

To ensure continuous availability, it‘s essential to proactively analyze potential problems and optimize the environment in advance to minimize the negative impact on users and improve user experience. The proper focus and best optimization level must be chosen wisely to get the most out of the available time.

Efficiency 235

Efficiency Best Practices DevOps Open Source 235

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Just because everything works perfectly during production testing doesn’t mean that will be the case when your website is flooded with traffic.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

KeyCDN

SEPTEMBER 20, 2018

Error monitoring can get increasingly complicated as you deal with bugs reported by users and your production team, which is why having an efficient error tracking workflow from the beginning is so important. Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app.

Strategy 67

Strategy Monitoring Website Google 67

Dynatrace

SEPTEMBER 29, 2021

This opens the door to auto-scalable applications, which effortlessly matches the demands of rapidly growing and varying user traffic. For a deeper look into how to gain end-to-end observability into Kubernetes environments, tune into the on-demand webinar Harness the Power of Kubernetes Observability. What is Docker? Networking.

Open Source 301

Open Source Traffic DevOps Cloud 301

Dynatrace

FEBRUARY 16, 2023

Now, that same full-spectrum value is available at the massive scale of the Dynatrace Grail data lakehouse. For example, these include verifying app deployments, isolating faults coming from a single IP address, identifying root causes of traffic spikes, or investigating malicious user activity.

Analytics 185

Analytics Innovation Metrics Database 185

IO River

NOVEMBER 2, 2023

With the ever-growing demands of the internet, websites and web applications face the challenge of delivering content swiftly and efficiently to users worldwide. ‍ Think of a CDN Load Balancer (or LB, if you like to keep things short and sweet) as the internet’s traffic police. ‍But how does it decide where to send this traffic?

Traffic 52

Traffic Cache Servers Latency 52

The Netflix TechBlog

JULY 26, 2021

From the moment a Netflix film or series is pitched and long before it becomes available on Netflix, it goes through many phases. Data connectivity across Netflix Studio and availability of Operational Reporting tools also incentivizes studio users to avoid forming data silos. The audits check for equality (i.e.

Big Data 253

Big Data Government Analytics Processing 253

Percona

OCTOBER 18, 2023

Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. This is where you will fine-tune authentication mechanisms, storage paths, security policies, and memory allocation settings to optimize them for your specific use case(s).

Open Source 94

Open Source Database Hardware Strategy 94

The Netflix TechBlog

OCTOBER 18, 2022

We started seeing signs of scale issues, like: Slowness during peak traffic moments like 12 AM UTC, leading to increased operational burden. Meson was based on a single leader architecture with high availability. At Netflix, the peak traffic load can be a few orders of magnitude higher than the average load.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Designed with High Availability in mind. Writing events to any output.

Database 212

Database Traffic Transportation Open Source 212

IO River

NOVEMBER 2, 2023

With the ever-growing demands of the internet, websites and web applications face the challenge of delivering content swiftly and efficiently to users worldwide. Think of a CDN Load Balancer (or LB, if you like to keep things short and sweet) as the internet’s traffic police. But how does it decide where to send this traffic?

Traffic 40

Traffic Cache Network Servers 40

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Designed with High Availability in mind. Writing events to any output.

Database 197

Database Traffic Transportation Open Source 197

Percona

AUGUST 27, 2018

Resource groups permit assigning threads running within MySQL to particular groups so that threads execute according to the resources available to this group. MySQL determines, at startup, how many virtual CPUs are available. Then we need to see IF implementing the tuning will work or not. I am talking about resource groups.

Tuning 45

Tuning Virtualization Testing Servers 45

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

Dynatrace

DECEMBER 9, 2020

The flip side of speeding up delivery, however, is that each software release comes with the risk of impacting your goals of availability, performance, or any business KPIs. Typical Dynatrace use cases cover SLOs for service availability, web application performance, mobile application availability, and synthetic availability.

Metrics 151

Metrics Engineering Google Monitoring 151

The Netflix TechBlog

NOVEMBER 2, 2021

Here, based on the video length, the throughput and latency requirements, available scale etc., The figure does not show the chunk start times separately, however, each chunked quality computation starts and completes (annotated as 3a and 3b) independently based on resource availability. The workflow is initiated. 4c & 5.

Media 171

Media Innovation Metrics Latency 171

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

DECEMBER 8, 2020

One single platform drives efficient DevSecOps collaboration and automated vulnerability management. Stay tuned – this is only the start. Vulnerabilities are prioritized by real exposure: is a library actually used in production, is the vulnerability exposed to the public internet, is sensitive data affected?

Cloud 289

Cloud Open Source Internet Internet 289

Official Blog - World Web Technology

MAY 12, 2023

Stay tuned. Moreover, developers can also make prototypes, test the app, and develop the application efficiently with the Headless CMS. High-performing Websites With Good Traffic One of the reasons why visitors keep coming to your website is the speed. This post answers all your queries in detail. What is Headless CMS?

Website 52

Website Development Scalability Architecture 52

All Things Distributed

MARCH 7, 2013

As I sat down with the DynamoDB team to review our progress over the last year, I realized that DynamoDB had surpassed even my own expectations for how easily applications could achieve massive scale and high availability with DynamoDB. How are we able to do this? This was the genesis of NoSQL databases like Dynamo at Amazon.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

KeyCDN

OCTOBER 31, 2018

Consequently, there are so many free and premium PHP tools available online that it’s difficult for developers to determine which ones are worthwhile. This enterprise IDE is available to students and teachers at no cost, so take advantage of the discount if you can. Below is a run down of a few useful PHP tools for developers.

Development 57

Development Open Source Java AWS 57

Smashing Magazine

SEPTEMBER 6, 2021

For example, you could reduce compression efficiency , because that works better with more data. As such, a micro-optimization is, again, how you probably need to fine-tune things on a low level to really benefit from it. Note that there is an Apache Traffic Server implementation, though.). What Does It All Mean?

Network 105

Network Servers Cache Traffic 105

Particular Software

APRIL 9, 2018

Luckily, there are tools in place that let us keep track of electricity and water usage, how much parking we have available, and how much trash the park generates. To understand if our theme park is running efficiently or not, we'll need monitoring tools that understand how theme parks really work. So how do theme parks work?

Systems 40

Systems Infrastructure Monitoring Tuning 40

Smashing Magazine

AUGUST 9, 2021

QUIC is needed because TCP, which has been around since the early days of the Internet, was not really built with maximum efficiency in mind. For example, if the device is a firewall, it might be configured to block all traffic containing (unknown) extensions. For example, TCP requires a “ handshake ” to set up a new connection.

Transportation 145

Transportation Internet Internet Network 145

Smashing Magazine

AUGUST 22, 2021

One aspect of performance is about how efficiently a transport protocol can use a network’s full (physical) bandwidth (i.e. Additionally, even if we knew the available physical bandwidth, that wouldn’t mean we could use all of it ourselves. More in-depth information is available. Congestion Control. What Does It All Mean?

Performance 106

Performance Network Latency Servers 106

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76