Percona

MAY 1, 2023

PostgreSQL performance optimization aims to improve the efficiency of a PostgreSQL database system by adjusting configurations and implementing best practices to identify and resolve bottlenecks, improve query speed, and maximize database throughput and responsiveness. What is PostgreSQL performance tuning?

Tuning 52

Tuning Efficiency Database Performance 52

The Netflix TechBlog

MARCH 7, 2024

Since its inception , Metaflow has been designed to provide a human-friendly API for building data and ML (and today AI) applications and deploying them in our production infrastructure frictionlessly. Deployment: Cache To produce business value, all our Metaflow projects are deployed to work with other production systems.

Systems 226

Systems Media Cache Open Source 226

The Netflix TechBlog

SEPTEMBER 24, 2021

Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances. Since not all projects are terabytes projects, allocating the largest cloud storage to all packager instances is not an efficient use of cloud resources.

Cloud 237

Cloud Media Storage Cache 237

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 243

AWS Efficiency Azure Cloud 243

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. Processor caches can help to hide local accesses too, but not remote accesses.

Design 80

Design Cache Hardware Scalability 80

Percona

APRIL 17, 2023

Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache. MongoDB security: Monitor MongoDB performance regularly As with any database, it’s essential to monitor MongoDB performance to ensure it’s running with optimal efficiency and effectiveness.

Best Practices 52

Best Practices Design Tuning Database 52

IO River

NOVEMBER 2, 2023

A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. The Four Pillars of CDN Design‍CDN architecture can be broken down into several building blocks, known as the Four Pillars of CDN Design.

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs). Dynatrace news.

Storage 184

Storage Database Network Metrics 184

Percona

SEPTEMBER 1, 2023

Additionally, they enable the implementation of sophisticated business logic within the database, streamlining repetitive tasks and enhancing overall efficiency. However, they can also introduce performance bottlenecks, especially if poorly designed. Well-designed indexes can significantly improve query performance within triggers.

Cache 62

Cache Database Games Healthcare 62

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. One of the important attributes of their design was easy and rapid deployment across an existing fleet. If we compress objects instead of cache lines though, we can get to a 56% compression ratio (c).

Cache 61

Cache Benchmarking Hardware Java 61

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies. Old design (until Percona XtraBackup 8.0.33-27): New design (from Percona XtraBackup 8.0.33-28)

Cache 87

Cache Benchmarking Servers Design 87

Dynatrace

JULY 16, 2020

To do that, we need an easy and efficient API access to all of our Dynatrace Environments, without having to create and maintain API access tokens of individual tenants. I wanted a rather lightweight design that is yet versatile. In fact, go’s concurrency was so efficient that I ran into a few pitfalls I didn’t think of first: ?

Cache 234

Cache Serverless Efficiency Tuning 234

The Netflix TechBlog

MARCH 10, 2023

One of the first decisions when integrating with Elasticsearch is designing the indices, their settings and mappings. To avoid the ES query for the list of indices for every indexing request, we keep the list of indices in a distributed cache. Net, Ruby, Perl etc.).

Strategy 258

Strategy Cache Analytics Storage 258

IO River

NOVEMBER 2, 2023

‍A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. A data lakehouse, therefore, enables organizations to get the best of both worlds.

Artificial Intelligence 205

Artificial Intelligence Analytics Storage Government 205

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. The first benefit is simplicity. AWS serverless offerings. Amazon divides its serverless solutions into three broad categories with 12 specific services.

Serverless 276

Serverless AWS Lambda Storage 276

Smashing Magazine

SEPTEMBER 28, 2022

On design systems, UX, web performance and CSS/JS. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching partially stores your data and is not used as permanent storage. Caching Schemes.

Cache 125

Cache Performance Servers Social Media 125

Smashing Magazine

NOVEMBER 8, 2021

On top of this foundation, we add layers of caching, prerendering and edge delivery optimizations — not the other way around. Hydrogen fuels dynamic commerce by uniting React Server Components, streaming server-side rendering, and smart caching controls. Large preview ). This is not a debate about dynamic vs. static.

Cache 135

Cache Best Practices Strategy Servers 135

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Percona

MARCH 20, 2023

When designing an architecture, many components need to be considered before deciding on the best solution. In this scenario, it is also crucial to be efficient in resource utilization and scaling with frugality. This is due to the multiplexing and the very efficient way ProxySQL uses to deal with high load.

Games 123

Games Latency Traffic Cache 123

Percona

SEPTEMBER 1, 2023

Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. Let’s explore these benefits in more detail.

Tuning 52

Tuning Database Performance Hardware 52

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. Jason Lowe-Power (UC Davis) discussed smart memory management and the need for an efficient interface for it.

Latency 52

Latency Hardware Cache Architecture 52

IO River

NOVEMBER 2, 2023

CDN’s Effectiveness: Static Vs Dynamic ContentBack in the day, a CDN’s primary function revolved around caching static content and delivering it efficiently to end-users. It’s a static file, and CDN can cache it, enabling quick delivery to various locations. The same movie file is served to millions of users worldwide.

Cache 52

Cache Traffic Games Network 52

Dynatrace

APRIL 21, 2022

The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time. Performance efficiency. Performance Efficiency. Design efficient use of your computing resources as demand changes and technologies evolves. Reliability.

Azure 184

Azure Monitoring Virtualization Metrics 184

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. Latencies The old api service was running on the same “machine” that also cached a lot of video metadata (by design). This meant that data that was static (e.g.

Latency 233

Latency Cache Java Traffic 233

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40

The Netflix TechBlog

MARCH 6, 2019

Video encoding is what MezzFS was originally designed for and remains one of its canonical use cases, so we’ll focus on video encoding to describe the problem that MezzFS solves. Disk Caching? — ? MezzFS can be configured to cache objects on the local disk. Regional caching? —?Netflix What problem are we solving?

Media 214

Media Storage Processing Cache 214

The Morning Paper

FEBRUARY 6, 2020

.’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

Randon ASCII

SEPTEMBER 30, 2022

A twenty-second delay for recording a forty-second clip is a pretty bad efficiency ratio. In my case the directory structure of my documents directory was entirely cached in memory so there was zero disk activity required to do the scan, but some users are not so lucky. Is there some RuntimeBroker caching?

Software 130

Software Software Cache Hardware 130

Smashing Magazine

JULY 18, 2022

However, it’s not energy-efficient to render the article for each and every request. The “stale-while-revalidate” cache control strategy can reduce the TTFB issue by serving a cached version of the page until it’s updated. It may sound weird at first that you need a web server to achieve efficient static rendering.

Cache 114

Cache Website Energy Servers 114

IO River

NOVEMBER 2, 2023

CDN’s Effectiveness: Static Vs Dynamic ContentBack in the day, a CDN’s primary function revolved around caching static content and delivering it efficiently to end-users. It’s a static file, and CDN can cache it, enabling quick delivery to various locations. The same movie file is served to millions of users worldwide.

Cache 40

Cache Traffic Games Network 40

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

Smashing Magazine

JUNE 8, 2021

To be effective, all these images need to be carefully orchestrated to appear on the screen fast — but as it turns out, loading images efficiently at scale isn’t a project for a quiet afternoon. Keeping this efficient helps ensure a good user experience. Using responsive images is a key part of delivering fully responsive web design.

Media 105

Media Cache Google Best Practices 105

The Morning Paper

OCTOBER 18, 2020

Radix Sort is carefully designed to make effective use of the L2 cache and sequential memory accesses, whereas Learned Sort is making random accesses all over the destination array. How can learned sort be adapted to make it cache-efficient? Sympathy for the machine. Linear splines result in 2.7x Evaluation.

Cache 137

Cache C++ Java Tuning 137

Smashing Magazine

AUGUST 3, 2023

These pages serve as a pivotal tool in our digital marketing strategy, not only providing valuable information about our services but also designed to be easily discoverable through search engines. This is why the async and deferred attributes are crucial, as they ensure an efficient, seamless web browsing experience.

Performance 74

Performance Cache Traffic Metrics 74