The Netflix TechBlog

NOVEMBER 9, 2022

In both bands, performance characteristics remain consistent for the entire uptime of the JVM on the node, i.e. nodes never jumped the bands. Luckily, the m5.12xl instance type exposes a set of core PMCs (Performance Monitoring Counters, a.k.a. We also see much higher L1 cache activity combined with 4x higher count of MACHINE_CLEARS.

Hardware 363

Hardware Cache Performance Latency 363

HammerDB

APRIL 19, 2023

Predicting application performance is a difficult art, but an important one when choosing the target deployment environment. In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. We will not concern ourselves with the raw throughput of workload.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JANUARY 3, 2024

ProxySQL is a high-performance SQL proxy that runs as a daemon watched by a monitoring process. The proxy is designed to run continuously without needing to be restarted. Below are backup methods to perform a backup restore of the ProxySQL server. These include runtime parameters, server grouping, and traffic-related settings.

Traffic 114

Traffic Hardware Cache Servers 114

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. CXL-based disaggregated memory provides a new opportunity with two orders of magnitude better performance than RDMA (as illustrated in Figure 2).

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

JANUARY 5, 2024

It was initially designed to mitigate the limitations of file management systems, including slow operations, inadequate security, and substantial data redundancy. It optimizes performance through monitoring tools and expert support, offers scalable solutions, and ensures high data security with end-to-end encryption and compliance adherence.

Efficiency 147

Efficiency Storage Database Scalability 147

Testsigma

JUNE 3, 2021

A few of the errors which can be faced due to a poorly designed UI are: i. These software errors are usually uncovered during functionality testing, mostly can be present as: Difficult/ confusing functionality: If the user is unable to understand or perform a function on the application, then it should change. Hardware error.

Software 82

Software Software Testing Hardware 82

Percona

MAY 2, 2023

ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. Keep in mind that setting the buffer pool size too high may result in other processes on your server competing for memory, which can impact performance. 16) and monitoring the server’s performance.

Social Media 124

Social Media Database Servers Cache 124

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Dotcom-Montior

JUNE 15, 2020

The limited number access points, compounded with the fact that traffic is controlled by the Ministry of Industry and Information Technology, creates performance bottlenecks for all users in China when trying to access websites from inside and outside of the country. Final Thoughts: Monitoring Performance from the Great Firewall of China.

Monitoring 52

Monitoring Performance Artificial Intelligence Internet 52

The Morning Paper

NOVEMBER 5, 2019

Breaking that assumption allowed Ceph to introduce a new storage backend called BlueStore with much better performance and predictability, and the ability to support the changing storage hardware landscape. But let’s take a quick look at the changing hardware landscape before we go on… The changing hardware landscape.

Storage 64

Storage Systems Hardware Efficiency 64

Smashing Magazine

JANUARY 15, 2019

How Improving Website Performance Can Help Save The Planet. How Improving Website Performance Can Help Save The Planet. In 2013, A List Apart published Sustainable Web Design by James Christie. Sustainable Web Design. In 2016, O’Reilly published “ Designing For Sustainability ” by Tim Frick. Jack Lenox.

Website Performance 73

Website Performance Website Energy Performance 73

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. Linux already has many performance tools, but these are often counter-based and have limited visibility. hardware Hardware counter-based instrumentation. usdt User-level statically defined tracing.

Latency 68

Latency C++ Cache Programming 68

ACM Sigarch

FEBRUARY 23, 2018

In industry, generally due to time-to-market restrictions, we tend to think extremely short term with evolutionary design changes rather than riskier revolutionary ideas that have a longer timeline for returns. I recall heated discussions 20+ years ago on whether speculative data in caches improves or degrades cache performance.

Architecture 47

Architecture Cache Hardware Virtualization 47

Brendan Gregg

MARCH 16, 2024

I'm sure this delivered large performance improvements and I wouldn't try arguing against it. Only in extreme circumstances does the cost (in processor time and I-cache footprint) translate to a tangible benefit - circumstances which usually resort to hand-coded assembly anyway. The actual overhead depends on your workload.

Java 145

Java Cache Google Hardware 145

SQL Server According to Bob

JUNE 3, 2016

Internally DBCC CHECK* uses a page scanning coordinator design (MultiObjectScanner.) SQL Server 2016 changes the internal design to (CheckScanner), applying no lock semantics and a design similar to those used with In-Memory Optimized (Hekaton) objects, allowing DBCC operations to scale far better than previous releases.

Hardware 40

Hardware Cache Servers Software Engineering 40

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. More importantly, if this works out well, this could lead to a radical improvement in performance by leveraging hardware trends such as GPUs and TPUs. Learned indexes.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Smashing Magazine

JUNE 18, 2020

That’s because they are meant for user preferences, as mentioned here in the case of iOS and here in the Android documentation when talking about the Security library which is designed to provide wrappers to the SharedPreferences specifically to encrypt the data before storing it. Secure Storage On Mobile. Large preview ). In React Native.

Storage 93

Storage Mobile Website Java 93

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation.

Hardware 18

Hardware Architecture Programming Innovation 18

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. Processor caches can help to hide local accesses too, but not remote accesses.

Design 80

Design Cache Hardware Scalability 80

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. For bare metals, any algorithm among deadline or noop (the performance difference between them is imperceptible) will be better than CFQ.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

NOVEMBER 15, 2022

Rendering is the final step in the VFX creation process, and processing on a render farm often can take several hours to complete just a single frame of a show, even when this process runs on the latest high-end hardware. Rendering on AWS provides the flexibility to control how quickly a project is completed.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Serverless architecture offers several benefits for enterprises. Simplicity. The first benefit is simplicity. Let’s explore each in more detail.

Serverless 280

Serverless AWS Lambda Storage 280

Percona

MARCH 28, 2023

It’s to ensure that our data is durable after each write operation and to make it persistent and consistent without compromising the performance. The same data, in the form of pages inside the Wiredtiger cache, are also marked dirty. So, what happens when there’s an unexpected crash or hardware failure?

Hardware 93

Hardware C++ Storage Cache 93

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The design of the in-stream processing engine itself was driven by the following requirements: SQL-like functionality. High performance and mobility.

Big Data 154

Big Data Processing Lambda Database 154

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. Cached vs Scaled Workloads. Why HammerDB was developed. Derived Workloads.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124

Randon ASCII

SEPTEMBER 30, 2022

RuntimeBroker was CPU bound and was spending most of its time in a single thread that was busy performing queries on the results of a crawl over some directory: The next step was to look at the File I/O graph to see what directory was being scanned. Is there some RuntimeBroker caching? Is that a WinRT flaw, or a Voice Recorder flaw?

Software 130

Software Software Cache Hardware 130

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Alex Russell

APRIL 29, 2021

Classics of the genre include: Apple's just focused on performance! The Performance Argument. As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. Web Performance APIs.

Media 145

Media Games Education Engineering 145

ACM Sigarch

OCTOBER 12, 2020

The focus of most published research in architecture is on applications implemented in high-performance, “ close-to-the-metal” languages essentially developed before computers got fast. To be clear, these languages were not designed to be fast or space-efficient, but for ease of use. As Leiserson et al.

C++ 108

C++ Benchmarking Hardware Architecture 108

ACM Sigarch

JULY 17, 2023

We then discuss defects observed, the role of test and design to address this problem, and identify research opportunities. An example of a specification is the correct operation of the hardware of a microprocessor. While testing is important, exhaustive testing is challenging given the sheer size of modern processor designs.

Energy 52

Energy Hardware Best Practices Architecture 52

John McCalpin

AUGUST 1, 2018

Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? If I am analyzing (apparent) performance shortfalls, how can I distinguish between cause and effect ? The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. How does high availability work? Redundancy is also critical for disaster recovery.

Availability 112

Availability Database Open Source Hardware 112

Smashing Magazine

AUGUST 22, 2021

HTTP/3: Performance Improvements (Part 2). HTTP/3: Performance Improvements (Part 2). In this second part, we will zoom in on the performance improvements that QUIC and HTTP/3 bring to the table for web-page loading. HTTP/3 performance features ( current article ). Robin Marx. 2021-08-23T06:20:00+00:00.

Performance 105

Performance Network Latency Servers 105