The Netflix TechBlog

MARCH 7, 2024

In this article, we cover a few key integrations that we provide for various layers of the Metaflow stack at Netflix, as illustrated above. In addition to Spark, we want to support last-mile data processing in Python, addressing use cases such as feature transformations, batch inference, and training.

Systems 226

Systems Media Cache Open Source 226

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance. Interoperability with Hadoop.

Big Data 154

Big Data Processing Lambda Database 154

Percona

MAY 10, 2023

There is a good article that goes into more detail on the subject, but basically, “IOWait” is kind of idle CPU time. ” If, however, it got idle because a process is waiting on disk, I/O time is counted towards “IOWait.” Because of this accounting, other interesting behaviors are possible.

Cache 143

Cache Monitoring Open Source Processing 143

Speed Curve

FEBRUARY 5, 2024

desc="Time to process request at origin" NOTE: This is not a new API. Caching the base page/HTML is common, and it should have a positive impact on backend times. Key things to understand from your CDN Cache Hit/Cache Miss – Was the resource served from the edge, or did the request have to go to origin?

Servers 57

Servers Cache Retail Benchmarking 57

Smashing Magazine

SEPTEMBER 28, 2022

Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching Schemes. Large preview ).

Cache 126

Cache Performance Servers Social Media 126

Smashing Magazine

OCTOBER 2, 2023

In this second article, I’ll go over some key technical highlights from the project. In the first article, I briefly discussed the technical stack that includes a React-based front-end framework, Next.js Definitely read up on the strategy and reasoning behind this stack in the first article if you missed it.

Cache 72

Cache Strategy Best Practices Design 72

Smashing Magazine

MAY 16, 2022

For this article, that’s all we’ll need to start exposing the value and leave other more specific articles to go deeper. There are a handful of different entry subtypes but, for the scope of this article, we will be concerned with the PerformanceResourceTiming and PerformanceNavigationTiming subtypes. More after jump!

Servers 93

Servers Monitoring Cache Network 93

Brendan Gregg

AUGUST 29, 2021

Problem Statement The microservice managed and processed large files, including encrypting them and then storing them on S3. Reads usually have apps waiting on them; writes may not (write-back caching). total used free shared buff/cache available Mem: 64414 15421 349 5 48643 48409 Swap: 0 0 0. Counting cache functions.

Cache 105

Cache C++ AWS Latency 105

CSS - Tricks

APRIL 1, 2021

In that spirit, what we’re looking at in this article is focused more on the incremental wins and less on providing an exhaustive list or checklist of performance strategies. I’m going to audit the performance of my slow site before and after the things we tackle in this article. Compressing, minifying and caching assets.

Cache 92

Cache Social Media Media Network 92

Smashing Magazine

MAY 25, 2022

When the JavaScript engine runs a garbage-collection process, the man object will be removed from memory and from the WeakMap that we assigned it to. The process of clearing memory when objects are no longer being used is referred to as garbage collection. With caching, a copy of the result from a request is saved locally.

Cache 117

Cache Programming Storage Code 117

Scalegrid

JANUARY 5, 2024

This article cuts through the complexity to showcase the tangible benefits of DBMS, equipping you with the knowledge to make informed decisions about your data management strategies. It comprises a collection of interrelated data and a set of software tools that aid in the access, processing, and management of data.

Efficiency 147

Efficiency Storage Database Scalability 147

Smashing Magazine

AUGUST 3, 2023

However, achieving a good LCP score is often a multi-faceted process that involves optimizing several stages of loading and rendering. HTML Processing Once a web page’s HTML file has been downloaded, the browser begins to process the contents line by line, translating code into the visual website that users interact with.

Performance 74

Performance Cache Traffic Metrics 74

Smashing Magazine

NOVEMBER 26, 2021

In this article, we will discuss a few of those techniques as well as some of the things I wish I had known earlier to help manage large Next.js Note : While this article is specific to Next.js, some of the points will also work for a wide variety of front-end applications. This can be reduced by a proper code-review process.

Cache 143

Cache Code Testing Design 143

CSS - Tricks

FEBRUARY 16, 2021

Set far-out expires headers on images and have a cache-busting strategy (like changing the file name). You need to make sure your AVIF version is both better and smaller, which feels like a manual process right now. Direct Link to Article — Permalink. Use content-visibility: auto; Send AVIF when you can.

Cache 119

Cache Strategy Processing Performance 119

Brendan Gregg

FEBRUARY 28, 2023

As I was determined to become great at my new occupation regardless of my location, I read every sysadmin book, article, and magazine I could find on the shelf. I didn't end up getting published in SysAdmin directly, but my performance work did make it as a feature article (thanks Matty). Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

KeyCDN

DECEMBER 8, 2022

Unfortunately, it is a bit difficult to point out the problem directly– there are many possibilities that we will explore in this article. But this article won't just help you figure out why your WordPress website is not fast enough. So let's discuss the process one step at a time. Why is WordPress slow?

Cache 52

Cache Website Speed Website Performance 52

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. ecosystem was chosen for this new service deserves an article in and of itself. video titles, descriptions) could be aggressively cached and reused across multiple requests.

Latency 233

Latency Cache Java Traffic 233

Smashing Magazine

DECEMBER 23, 2020

The service workers enable the offline usage of the PWA by fetching cached data or informing the user about the absence of an Internet connection. When developing a PWA, you can cache the application shell’s resources and assets in the browser. Cached content with IndexedDB. Cache first, then network. Service Workers.

Cache 124

Cache Internet Internet Google 124

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. In fact, choosing the right metric is a process without obvious winners.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

NOVEMBER 17, 2022

This article is sponsored by Storyblok. As you may already know, image optimization is the process that a high-quality image has to go through to be delivered in ideal conditions, sometimes with the help of an Image Transformation API and a global Content Delivery Network (CDN) to make the process simpler and scalable.

Media 106

Media Cache Website Mobile 106

Smashing Magazine

JANUARY 21, 2021

We were designing and building things, setting up new products, refactoring the components, and publishing articles. The entire site is built with progressive enhancement in mind, meaning that you, dear reader, can read every Smashing article in its entirety without the need to boot the application at all. We had to fix that.

Performance 145

Performance Cache Mobile Network 145

Percona

SEPTEMBER 28, 2023

Whenever you install your favorite MySQL server on a freshly created Ubuntu instance, you start by updating the configuration for MySQL, such as configuring buffer pool, changing the default datadir director, and disabling one of the most outstanding features – query cache. It’s a nice thing to do, but first things first.

Servers 113

Servers Best Practices Database Open Source 113

Dynatrace

MAY 17, 2023

To demonstrate how that can work, we’ve chosen a pristine web application without any observability and are going to make it observable step-by-step during the next few chapters of this article. These two bits are particularly important for context propagation , but more on that in just a second.

Metrics 189

Metrics Open Source Traffic Cache 189

Percona

SEPTEMBER 1, 2023

A finely tuned database processes queries more efficiently, leading to swifter results. Inefficient query design, such as utilizing SELECT * instead of specifying necessary columns, can escalate data transfer and processing overhead. Another highly beneficial caching method is key-value caching.

Tuning 52

Tuning Database Performance Hardware 52

KeyCDN

FEBRUARY 4, 2021

Oddly enough we encountered this error to a third party website while writing this article. ISPs do cache DNS however which means if your first provider goes down it will still try to query the first DNS server for a period of time before querying for the second one. So DNS services definitely go down! They do quite well actually.

Cache 134

Cache Website Internet Internet 134

CSS Wizardry

NOVEMBER 9, 2018

While this strategy is effective, it’s not simple: highly dynamic sites can be difficult to extract styles from, the process needs to be automated, we have to make assumptions about what above the fold even is, it’s hard to capture edge cases, and tooling still in its relative infancy. There is a lot to digest in this article.

Network 278

Network Performance Media Cache 278

SQL Performance

MARCH 29, 2022

Simple parameterization has a number of quirks in this area, which can result in more parameterized plans being cached than expected, or finding different results compared with the unparameterized version. Reputation = 252552 ; These statements result in six cached plans, three Adhoc and three Prepared : Different guessed types.

Cache 90

Cache Servers Database Testing 90

CSS - Tricks

FEBRUARY 3, 2021

Back/forward cache — I always assumed browsers just do fancy stuff with the back/forward buttons and us developers had very little control. Philip Walton tells us it’s critical that we understand “what makes pages eligible (and ineligible) for bfcache to maximize their cache-hit rates.” GIF never wins.

Performance 91

Performance Cache Testing Code 91

Percona

MAY 1, 2023

Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies. PostgreSQL performance optimization is an ongoing process involving monitoring, benchmarking, and adjustments to maintain high-performing PostgreSQL databases.

Tuning 52

Tuning Efficiency Database Performance 52

DZone

FEBRUARY 21, 2021

In this article, let's study ‘nice CPU time’. multiple processes contend for CPU cycles), the process with higher priority are given more chances to run. In Unix/Linux operating systems, processes are launched with a priority 0 (default). What Is ‘nice’ CPU Time? When there is a CPU contention (i.e.,

Operating System 133

Operating System Hardware Metrics Systems 133

SQL Performance

NOVEMBER 10, 2021

This process enables simplifications that can result in more optimal query plans. If you need a refresher on parameter embedding optimization, go over last month’s article as well as Paul White ’s excellent article Parameter Sniffing, Embedding, and the RECOMPILE Options. Constant Folding. Dynamic Filtering/Ordering.

Cache 121

Cache Servers Code Database 121

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 104

Performance Cache Network Metrics 104

Tim Kadlec

MARCH 19, 2018

How well does AMP perform when the library is served using the AMP cache? How well does AMP perform compared to the canonical article? As Ferdy pointed out, when you click through to an AMP article from Google Search, it loads instantly—AMP’s little lightning bolt icon seems more than appropriate.

Cache 79

Cache Google Speed Metrics 79

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. If you’re on the latter end of this scale, you probably need more specialized advice than this article is prepared to give. Option 1: Default Django.

Media 69

Media Cache Storage AWS 69

SQL Performance

SEPTEMBER 25, 2019

An example plan shape showing a lazy table performance spool is below: The questions I set out to answer in this article are why, how, and when the query optimizer introduces each type of performance spool. For more details, please see my linked article. When a spool is able to replay cached results, this is known as a rewind.

Performance 104

Performance Cache Servers Education 104

Dotcom-Montior

MARCH 6, 2022

It assists in identifying where important events happened during the loading process. Waterfall charts within the Dotcom-Monitor platform can help users identify where important events happened during the page load process. Moreover, caching utility may decrease the waiting time. Queued request. What’s the Difference?

Performance 52

Performance Cache Website Speed 52