The Netflix TechBlog

JULY 12, 2019

Gatekeeper is the system at Netflix responsible for evaluating the “liveness” of videos and assets on the site. Gatekeeper accomplishes its prescribed task by aggregating data from multiple upstream systems, applying some business logic, then producing an output detailing the status of each video in each country.

Cache 183

Cache Architecture Latency Engineering 183

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index.

Performance 102

Performance Monitoring Traffic Database 102

Percona

APRIL 7, 2023

Here’s how the same test performed when running Percona Distribution for PostgreSQL 14 on these same servers: Queries: reads Queries: writes Queries: other Queries: total Transactions Latency (95th) MySQL (A) 1584986 1645000 245322 3475308 122277 20137.61 MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 134

Tuning Cache Servers Benchmarking 134

Percona

JULY 17, 2023

5 among all database management systems and No. 1 among non-relational/document-based systems ( DB-Engines, July 2023 ). Taking a deeper dive, MongoDB is a system for analyzing data because documents are easily shared across multiple nodes and because of its indexing, query-on-demand, and real-time aggregation capabilities.

Open Source 74

Open Source Database Scalability Software 74

The Morning Paper

OCTOBER 26, 2020

As a production system within Microsoft capturing around a quadrillion events and indexing 16 trillion search keys per day it would be interesting in its own right, but there’s a lot more to it than that. These two narratives of reference architecture and ingestion/indexing system are interwoven throughout the paper.

Cloud 104

Cloud Big Data Latency Architecture 104

Abhishek Tiwari

NOVEMBER 3, 2018

Recently I was asked about content management systems (CMS) of the future - more specifically how they are evolving in the era of microservices, APIs, and serverless computing. In addition, open source CMS solutions also struggle with blotted plugin ecosystem. can generate an HTML-only website without involving a CMS.

Systems 63

Systems Cache Website Network 63

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. A distributed file system provides a unified view over aggregated storage from multiple physical machines.

Storage 64

Storage Systems Hardware Efficiency 64

Brendan Gregg

JULY 2, 2021

This is also applicable for people adding it to their own in-house monitoring systems. You likely already have agents running on all your customer systems. There are so many options it's really your own preference based on your existing system and customer environments. opensnoop Files opened table.

Latency 145

Latency Cache Energy Systems 145

Smashing Magazine

AUGUST 3, 2023

For Performance Monitoring Many of you reading this may already be familiar with Next.js, but it is a popular open-source JavaScript framework that allows us to monitor our website’s performance in real-time. It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further.

Performance 74

Performance Cache Traffic Metrics 74

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. Operating system Linux is the most common operating system for high-performance MySQL servers. CPU From a CPU standpoint, faster processors with many cores provide better throughput.

Performance 123

Performance Hardware Tuning Storage 123

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. TB of in-memory capacity in a single cluster. Atomic slot migration.

Games 112

Games Retail Latency Education 112

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. system(".") BCC is great for canned complex tools and agents.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

FEBRUARY 23, 2020

There are five different types of member in an AnyLog system, and any network node can join without restriction as any type of member. Caching of query results on the other hand, looks like a good business model, at large enough scale these might amount to pretty much the same thing). Market participants.

Blockchain 94

Blockchain Internet Internet IoT 94

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption.

Database 197

Database Traffic Transportation Open Source 197

Enprowess

SEPTEMBER 7, 2021

is a server-side, open-source, JavaScript runtime environment that allows developers to write JavaScript on the client and the server-side. Real-time software system – Collaboration tools used for video/audio conferencing, document writing, Chat applications, etc. Open-source: Large ecosystem for the open-source library.

Open Source 52

Open Source Virtualization Programming Servers 52

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption.

Database 212

Database Traffic Transportation Open Source 212

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MARCH 10, 2020

So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads. This benchmark can synthetically generate more precise key-value queries that represent the reads and writes of key-value stores to the underlying storage system.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. There are many tools allowing you to achieve that: SiteSpeed.io Large preview ).

Performance 145

Performance Cache Media Metrics 145

CSS - Tricks

JULY 25, 2019

Cache-Headers missing? Lighthouse is an open source project run by a dedicated team from Google Chrome. Estimated Input Latency. Estimated Input Latency. Service workers that will cache the bytecode result of a parsed and compiled script. After that, it’ll be mitigated by cache. Speed Index.

Google 71

Google Engineering Speed Mobile 71

Smashing Magazine

AUGUST 20, 2021

During the 90s, we saw two content management systems for static sites — Microsoft FrontPage in 1996 and Macromedia Dreamweaver in 1997. These desktop applications incremented the tooling an inch closer to the modern Jamstack content management systems of today. Maintaining layouts became a particular pain point for static sites.

Ecommerce 139

Ecommerce Website Government Internet 139

Brendan Gregg

JULY 2, 2021

This is also applicable for people adding it to their own in-house monitoring systems. If you're using an open source monitoring platform, first check if it already has a BPF agent. You likely already have agents running on all your customer systems. opensnoop Files opened table 3.

Open Source 40

Open Source Latency Cache Energy 40

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks. Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 106

Performance Network Latency Servers 106

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. In the MySQL open source ecosystem, we have only two consolidated ways to perform sharding — Vitess and ProxySQL.

Traffic 121

Traffic Scalability Database Servers 121

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. There are many tools allowing you to achieve that: SiteSpeed.io But this consideration needs to be deliberate.

Performance 104

Performance Cache Network Metrics 104

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. So is speedy resolution and agreement. Media Session API. Offscreen Canvas.

Media 145

Media Games Education Engineering 145

Smashing Magazine

SEPTEMBER 6, 2021

This approach was touted to be better for fine-grained caching because each subresource could be cached individually and the full bundle didn’t need to be redownloaded if one of them changed. Finally, not inlining resources has an added latency cost because the file needs to be requested.

Network 105

Network Servers Cache Traffic 105