The Morning Paper

MARCH 10, 2020

The paper examines three different uses of RocksDB at Facebook: UDB , the underlying storage engine for the MySQL databases storing the social graph data. All cache read misses and all writes go through UDB servers, with SQL queries being converted into RocksDB queries. block reads, block cache hits, read-bytes, write-bytes).

Benchmarking 59

Benchmarking Storage Cache Open Source 59

The Netflix TechBlog

OCTOBER 18, 2019

He started by laying out some of the challenges around inefficiencies of engineering time when manually optimizing for weights/parameters in their business objective functions. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

The Netflix TechBlog

OCTOBER 18, 2019

He started by laying out some of the challenges around inefficiencies of engineering time when manually optimizing for weights/parameters in their business objective functions. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

The Netflix TechBlog

JUNE 14, 2023

By the summer of 2020, many UI engineers were ready to move to GraphQL. The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations.

Traffic 353

Traffic Latency Cache Metrics 353

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better.

Tuning 135

Tuning Cache Servers Benchmarking 135

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. innodb_thread_concurrency (Dynamic) – With improvements to the InnoDB engine, it is recommended to allow the engine to control the concurrency by keeping it to the default value (which is zero).

Performance 124

Performance Hardware Tuning Storage 124

The Netflix TechBlog

JULY 21, 2022

Since memory management is not something one usually associates with classification problems, this blog focuses on formulating the problem as an ML problem and the data engineering that goes along with it. Some nuances while creating this dataset come from the on-field domain knowledge of our engineers. of the time (False Positives).

Big Data 179

Big Data Cache Engineering Data Engineering 179

The Netflix TechBlog

SEPTEMBER 24, 2021

Doing so has the added advantage of being able to design and tune the enhancement to suit the requirements of packager and our other encoding applications. It downloads the part(s) that contain the referenced, uploaded bytes and keeps them in an LRU active cache. For write operations, those challenges do not apply. We’re hiring!

Cloud 237

Cloud Media Storage Cache 237

The Netflix TechBlog

JULY 1, 2019

As UI engineers we are excited about delivering creative and engaging experiences that help members choose the content they will love so we are always trying to push the limits of our UI. Our UI runs on top of a custom rendering engine which uses what we call a “surface cache” to optimize our use of graphics memory.

Cache 166

Cache Design Testing Development 166

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

FEBRUARY 9, 2018

Many thanks to the engineers working hard to develop workarounds to these processor bugs. In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 and 4.14.12 1024 nopti: 922336 1024 6.59

Performance 75

Performance Benchmarking Cache Tuning 75

Brendan Gregg

FEBRUARY 8, 2018

Many thanks to the engineers working hard to develop workarounds to these processor bugs. In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 and 4.14.12 1024 nopti: 922336 1024 6.59

Performance 40

Performance Benchmarking Cache Tuning 40

Rigor

SEPTEMBER 3, 2019

Stock level issues [E-commerce engine]. Ensure you have a Web Application Firewall (or other security device) in place and that its rules engine is up to date. STEP 7: Tune Your CDN Performance. Ultimately, the key to surviving a peak event is to have very good CDN cache designs. Slow CDN times [Synthetic or RUM].

Website 74

Website Cache Ecommerce Traffic 74

Brendan Gregg

JUNE 30, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. Don't do it. Do it less.

Benchmarking 54

Benchmarking Latency Cache Network 54

Enprowess

MARCH 4, 2018

Enable cluster link for cache replication. 3) Search Clustering: Search engine should be separate from Liferay server. Liferay portal default ships with Elasticsearch engine. Once the Liferay portal servers and Search engine have been configured as a cluster, change Liferay Portal from embedded mode to remote mode.

Cache 52

Cache Transportation Media Traffic 52

Brendan Gregg

JUNE 29, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. Don't do it. Do it less.

Benchmarking 40

Benchmarking Latency Cache Network 40

SQL Performance

JUNE 21, 2019

During service startup, if the Database Engine detects more than 8 physical cores per NUMA node or socket, soft-NUMA nodes are created automatically. The engine takes care of placing logical processors from the same physical core into different soft-NUMA nodes. Greater than 8, keep MAXDOP at 8.

Servers 49

Servers Azure Hardware Database 49

The Netflix TechBlog

DECEMBER 17, 2019

We found that some solutions use advanced database features that are not transferable to other systems, such as: using MySQL’s blackhole engine or getting a consistent snapshot for dumps from the creation of a PostgreSQL replication slot. Using proprietary database features. This prevents code reuse across databases. Schema store integration.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

We found that some solutions use advanced database features that are typically not available in other systems, such as: using MySQL’s blackhole engine or getting a consistent snapshot for dumps from the creation of a PostgreSQL replication slot. Using database specific features. Preventing code reuse across databases.

Database 212

Database Traffic Transportation Open Source 212

HammerDB

NOVEMBER 5, 2018

To illustrate the data reads on Oracle we can flush the buffer cache. Consequently we now need to increase the buffer cache in size if we are to see more CPU activity. A good example of how tuning is an iterative process. SQL> alter system flush buffer_cache; System altered. so what are your options? PostgreSQL.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JANUARY 17, 2019

Aurora Parallel Query response time (for queries which can not use indexes) can be 5x-10x better compared to the non-parallel fully cached operations. The second and third run used the cached data. It does not use any cache (ie: innodb buffer pool) either. This query is 100% cached. Test data and versions.

Cache 46

Cache C++ AWS Airlines 46

Smashing Magazine

SEPTEMBER 6, 2021

This approach was touted to be better for fine-grained caching because each subresource could be cached individually and the full bundle didn’t need to be redownloaded if one of them changed. As such, a micro-optimization is, again, how you probably need to fine-tune things on a low level to really benefit from it.

Network 107

Network Servers Cache Traffic 107

All Things Distributed

OCTOBER 2, 2017

In addition, DynamoDB Accelerator (DAX) a fully managed, highly available, in-memory cache further speeds up DynamoDB response times from milliseconds to microseconds and can continue to do so at millions of requests per second.

Internet 128

Internet Internet AWS Performance 128

SQL Server According to Bob

JANUARY 11, 2020

Time of Last Access The time of last access is a caching ​​ algorithm ​​ that enables ​​ cache ​​ entries to be ordered by their ​​ access times.

Servers 40

Servers Cache Database Media 40

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. Total elapsed time is 933ms with 6,673ms of CPU time with a warm cache. Given limited engineering resources, and a long list of desired product improvements, compromises like this often have to be made. The second problem.

Servers 95

Servers Tuning Architecture Performance 95

Smashing Magazine

AUGUST 22, 2021

As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. Some examples of the latter are heavily cached websites, as well as single-page apps that periodically fetch small updates via APIs and other protocols such as DNS-over-QUIC. also needs to execute. What does it all mean?

Performance 107

Performance Network Latency Servers 107

DZone

AUGUST 16, 2019

When you build a great product or application, sooner or later, it will be drawing attention more and more users who will expect a flawless, perfect application as the demand grows in the time it handles more and more requests per minute.

Scalability 145

Scalability Efficiency Hardware Software 145

Smashing Magazine

AUGUST 9, 2021

However, many other devices are sitting between the client and the server that also have their own TCP code on board (examples include firewalls, load balancers, routers, caching servers, proxies, etc.). Stay tuned! (vf, These middleboxes are often more difficult to update and sometimes more strict in what they accept. vf, il, al).

Transportation 145

Transportation Internet Internet Network 145

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

High Scalability

NOVEMBER 25, 2019

This is a guest post by Kalpesh Patel , an Engineer, who for Egnyte from home. Edge caching. In general, Egnyte connect architecture shards and caches data at different levels based on: Amount of data. Nginx for disk based caching. We use different types of caching techniques depending on the problem statements.

Architecture 52

Architecture Cache Azure Storage 52