The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. In both bands, performance characteristics remain consistent for the entire uptime of the JVM on the node, i.e. nodes never jumped the bands. We also see much higher L1 cache activity combined with 4x higher count of MACHINE_CLEARS.

Hardware 363

Hardware Cache Performance Latency 363

John McCalpin

SEPTEMBER 17, 2018

Most Intel microprocessors support “HyperThreading” (Intel’s trademark for their implementation of “simultaneous multithreading”) — which allows the hardware to support (typically) two “Logical Processors” for each physical core. leaving half of the Logical Processors idle).

Hardware 40

Hardware Performance Cache Programming 40

Percona

JANUARY 3, 2024

ProxySQL is a high-performance SQL proxy that runs as a daemon watched by a monitoring process. Below are backup methods to perform a backup restore of the ProxySQL server. and above Physical snapshot: A ProxySQL backup can be performed using the physical snapshot method. sec) File /var/lib/proxysql/proxybkp.cnf is saved.

Traffic 105

Traffic Hardware Cache Servers 105

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. CXL-based disaggregated memory provides a new opportunity with two orders of magnitude better performance than RDMA (as illustrated in Figure 2).

Latency 52

Latency Hardware Cache Architecture 52

Testsigma

JUNE 3, 2021

These software errors are usually uncovered during functionality testing, mostly can be present as: Difficult/ confusing functionality: If the user is unable to understand or perform a function on the application, then it should change. Hardware error. We focus on software so much that we forget about the hardware failures.

Software 82

Software Software Testing Hardware 82

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). This becomes really important for cache solutions like Redis™. Reserved Instances.

Cloud 242

Cloud Azure AWS Database 242

CSS Wizardry

AUGUST 7, 2019

only to find that the resource they’re requesting isn’t in that PoP ’s cache. DDoS or heavy load: In a similar vein to the previous point, increased load with no way of auto-scaling your application will lead to degraded performance where you begin to probe the limits of your infrastructure. View full size/quality (533KB).

Latency 269

Latency Ecommerce Servers Mobile 269

SQL Performance

MAY 22, 2019

It’s one of the things we look at during a health audit, and Kimberly has a great query from her Plan cache and optimizing for adhoc workloads post that’s part of our toolkit. About 1GB of the plan cache is for prepared and procedure plans, and they only take up about 300MB worth of space. DBCC FREEPROCCACHE ; GO. EXEC dbo. [

Cache 54

Cache Performance Hardware Servers 54

Scalegrid

JANUARY 5, 2024

The DBMS is key to maintaining these aspects by offering a storage system that allows users to perform operations such as data insertion, deletion, and selection, thereby promoting enhanced data integration across diverse applications and platforms. Practical Applications of DBMS DBMS finds practical applications in various fields.

Efficiency 147

Efficiency Storage Database Scalability 147

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., Here the first finding was that the current strategy for determining when to hand-off has a 25% probability of worsening your link performance after handover. Application performance. SIGCOMM’20.

Energy 130

Energy Latency Performance Network 130

Percona

MAY 2, 2023

ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. Since your dataset is 100 GB and you have 500 GB of RAM, you can allocate a significant portion of the available memory to the InnoDB buffer pool. 16) and monitoring the server’s performance.

Social Media 120

Social Media Database Servers Cache 120

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. of the persistent data on average.

Storage 112

Storage Engineering Cache Serverless 112

Dotcom-Montior

JUNE 15, 2020

The limited number access points, compounded with the fact that traffic is controlled by the Ministry of Industry and Information Technology, creates performance bottlenecks for all users in China when trying to access websites from inside and outside of the country. Final Thoughts: Monitoring Performance from the Great Firewall of China.

Monitoring 52

Monitoring Performance Artificial Intelligence Internet 52

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Smashing Magazine

JANUARY 15, 2019

How Improving Website Performance Can Help Save The Planet. How Improving Website Performance Can Help Save The Planet. Perhaps the biggest win when it comes to making websites more sustainable is that performance, user experience and sustainability are all neatly intertwined. Jack Lenox. 2019-01-15T13:30:32+01:00.

Website Performance 73

Website Performance Website Energy Performance 73

KeyCDN

JANUARY 23, 2020

These acronyms, which stand for real user monitoring and application performance monitoring, are software monitoring processes essential to measuring and evaluating applications in many different areas. RUM gathers data from real life users to analyze application performance. What is application performance monitoring (APM)?

Strategy 72

Strategy Metrics Monitoring Servers 72

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. Linux already has many performance tools, but these are often counter-based and have limited visibility. This example instrumented one of many thousands of available events. bashreadline.bt biolatency.bt

Latency 68

Latency C++ Cache Programming 68

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 124

Performance Hardware Tuning Storage 124

ACM Sigarch

FEBRUARY 23, 2018

In industry, engineers (me included) sometimes attack a problem with the tools they have readily available rather than taking a step back and examining the issue at large. Hardware engineers design and implement solutions in RTL, while software engineers attempt to solve the problem either at the OS or application level.

Architecture 47

Architecture Cache Hardware Virtualization 47

Brendan Gregg

MARCH 16, 2024

This technique saves two instructions in the prologue and epilogue and makes one additional general-purpose register (%rbp) available." I'm sure this delivered large performance improvements and I wouldn't try arguing against it. And for leaf routines (which never establish a frame), this is a non-issue.

Java 145

Java Cache Google Hardware 145

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it. How does high availability work?

Availability 104

Availability Database Open Source Hardware 104

John McCalpin

DECEMBER 6, 2016

The modes that are important are: “Flat” vs “Cache” In “Flat” mode, MCDRAM memory is used as directly accessible memory, occupying the upper 16 GiB of physical address space. In “Cache” mode, MCDRAM memory is used as an L3 cache for the main DDR4 memory. numactl).

Latency 40

Latency Cache Testing Systems 40

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. A widely used technology called distributed caching meets this need by storing frequently accessed data in memory on a server farm instead of within a database. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. A widely used technology called distributed caching meets this need by storing frequently accessed data in memory on a server farm instead of within a database. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

Smashing Magazine

JUNE 18, 2020

There are plenty of reasons not to do that, and it’s not the point of this piece to convince you to use frameworks like Flutter instead that keep your app native, with all the performance and user experience advantages that come with it, while allowing you to write code that is going to be the same for all platforms most of the time.

Storage 94

Storage Mobile Website Java 94

Dynatrace

AUGUST 30, 2019

Digital Performance: 99% reduction in Response Time, from 18.2s Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. Dynatrace Real User Monitoring (RUM) captures very detailed user behavior, as well as experience and performance information, about every user on your applications.

Cache 193

Cache Architecture Database Government 193

Percona

MARCH 28, 2023

It’s to ensure that our data is durable after each write operation and to make it persistent and consistent without compromising the performance. The same data, in the form of pages inside the Wiredtiger cache, are also marked dirty. Starting with the basics, why is WAL needed in the first place? wt and index-*.wt).

Hardware 85

Hardware C++ Storage Cache 85

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation. This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

The Netflix TechBlog

NOVEMBER 15, 2022

Rendering is the final step in the VFX creation process, and processing on a render farm often can take several hours to complete just a single frame of a show, even when this process runs on the latest high-end hardware. via direct plug-ins, and is available on multi-cloud platform services.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

SQL Server According to Bob

DECEMBER 18, 2018

Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “. Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. Performance points of reference: The following charts highlight the increase in performance. The Back Story.

Servers 90

Servers Media Cache Storage 90

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Serverless architecture offers several benefits for enterprises. Simplicity. The first benefit is simplicity. Data Store.

Serverless 273

Serverless AWS Lambda Storage 273

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Cached vs Scaled Workloads. What is HammerDB?

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. Classics of the genre include: Apple's just focused on performance! The Performance Argument. Spurious reports of "10x worse" performance merit intense scepticism. Steve & Tim's Close-up Magic.

Media 145

Media Games Education Engineering 145

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124