The Netflix TechBlog

MARCH 5, 2024

Reduced tail latencies In both our GRPC and DGS Framework services, GC pauses are a significant source of tail latencies. In fact, we’ve found for our services and architecture that there is no such trade off. Reference processing is also only performed in major collections with ZGC. There is no best garbage collector.

Latency 228

Latency Java Tuning Efficiency 228

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

The Netflix TechBlog

MAY 4, 2023

When undertaking system migrations, one of the main challenges is establishing confidence and seamlessly transitioning the traffic to the upgraded architecture without adversely impacting the customer experience. It provides a good read on the availability and latency ranges under different production conditions.

Traffic 339

Traffic Latency Tuning Systems 339

InfoQ

JULY 14, 2023

Mei-Chin Tsai, Vinod discuss the internal architecture of Azure Cosmos DB and how it achieves high availability, low latency, and scalability. By Mei-Chin Tsai, Vinod Sridharan

Latency 52

Latency Azure Availability Scalability 52

The Netflix TechBlog

JANUARY 25, 2023

The service should be able to serve real-time, aka UI, applications so CRUD and search operations should be achieved with low latency. Our service will be used by a lot of internal UI applications hence the latency for CRUD and search operations must be low. Teams should be able to define their data model for annotation.

Scalability 283

Scalability Latency Media Architecture 283

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. HLS ensures users get the optimal video quality based on their internet performance.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. HLS ensures users get the optimal video quality based on their internet performance.

Architecture 52

Architecture Performance Internet Internet 52

Alex Russell

FEBRUARY 28, 2022

It's being reposted here for completeness, but if you care about web performance, make sure to check out the whole series and get subscribed to the RSS feed to avoid missing any of next year's posts. The predominant answer: a unified theory of web performance. What, in particular, is "web performance"? How do we do it?

Performance 104

Performance Latency Architecture Network 104

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

NOVEMBER 28, 2022

The new Amazon capability enables customers to improve the startup latency of their functions from several seconds to as low as sub-second (up to 10 times faster) at P99 (the 99th latency percentile). This can cause latency outliers and may lead to a poor end-user experience for latency-sensitive applications.

Lambda 227

Lambda AWS Serverless Latency 227

Dynatrace

MARCH 29, 2024

During a breakout session at Dynatrace Perform 2024 , Alois Mayr, principal product manager at Dynatrace, and Stefano Doni, CTO at Akamas, broke down how Dynatrace and Akamas can help organizations enhance Kubernetes cluster management. Consider a sudden drop in performance. “Additionally, we are full-stack and goal-oriented.

Engineering 228

Engineering DevOps Operating System Open Source 228

Dynatrace

NOVEMBER 10, 2022

As companies accelerate digital transformation, cloud services such as AWS Lambda help companies to modernize their application architectures to quickly adapt to the needs of their customers while offloading the operational complexity to their cloud vendor.

Lambda 235

Lambda Serverless AWS Latency 235

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Managed DBaaS solutions like ScaleGrid.io

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

DECEMBER 27, 2022

As more organizations embrace microservices-based architecture to deliver goods and services digitally, maintaining customer satisfaction has become exponentially more challenging. When organizations implement SLOs, they can improve software development processes and application performance. SLOs improve software quality. Reliability.

Software 266

Software Software Benchmarking Latency 266

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. Figure 1: Sample RAG architecture While this approach significantly improves the response quality of GenAI applications, it also introduces new challenges.

Cache 206

Cache Azure Infrastructure Monitoring 206

DZone

MAY 1, 2023

It is a transversal component that applies to all the tech areas and architecture layers such as operating systems, data platforms, backend, frontend, and other components. It is a transparent layer for the data consumer in terms of user usability except to improve performance.

Cache 141

Cache Strategy Latency Operating System 141

Dynatrace

APRIL 7, 2023

Dynatrace is a launch partner in support of AWS Lambda Response Streaming , a new capability enabling customers to improve the efficiency and performance of their Lambda functions. Customers can use AWS Lambda Response Streaming to improve performance for latency-sensitive applications and return larger payload sizes.

Lambda 218

Lambda AWS Serverless Latency 218

Dynatrace

JANUARY 14, 2022

That is because Kubernetes provides several benefits from a performance perspective. However, setting the right parameters for Kubernetes clusters to ensure application availability, performance, and resilience while avoiding overspending isn’t a walk in the park. Dynatrace news. below 500ms) and error rates (e.g. lower than 2%.).

Latency 206

Latency Tuning Efficiency AWS 206

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., What is the end-to-end throughput and latency, and where are the bottlenecks? Future 5G Standalone Architecture (SA) deployments with a native 5G control plane will not have this problem. SIGCOMM’20.

Energy 130

Energy Latency Performance Network 130

Dynatrace

MAY 13, 2022

This extension provides fully app-centric Cassandra performance monitoring for Azure Managed Instance for Apache Cassandra. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance.

Azure 238

Azure Latency Metrics Infrastructure 238

The Morning Paper

SEPTEMBER 3, 2019

SLOG: serializable, low-latency, geo-replicated transactions Ren et al., The challenge with strict serializability (or even just serializability on a regular DBMS) is that it requires coordination, and as we know, coordination kills performance. That’s where SLOG (Serializable LOw-latency, Geo-replicated transactions) comes in.

Latency 70

Latency Processing Benchmarking Systems 70

Alex Russell

DECEMBER 18, 2022

2023 Content Targets Desktop Devices Networks Mobile Devices Networks Developing Your Own Targets The Performance Inequality Gap is Growing. Last month, I had the honour of joining what seemed like the entire web performance community at performance.now() in Amsterdam. This is an ethical crisis for the frontend. 2023 Content Targets #.

Performance 113

Performance Network Mobile Latency 113

Dynatrace

MAY 31, 2023

With so many of their transactions occurring online, customers are becoming more demanding, expecting websites and applications to always perform perfectly. Microservices-based architectures and software containers enable organizations to deploy and modify applications with unprecedented speed.

Best Practices 225

Best Practices DevOps Latency Metrics 225

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

APRIL 8, 2024

Optimize the IT infrastructure supporting risk management processes and controls for maximum performance and resilience. The IT infrastructure, services, and applications that enable processes for risk management must perform optimally. Once teams solidify infrastructure and application performance, security is the subsequent priority.

Analytics 203

Analytics Infrastructure Efficiency Technology 203

Alex Russell

JANUARY 30, 2024

The usual caveats also apply: Performance is a deep and nuanced domain, and much can go wrong beyond content size and composition. How sites manage resources after-load can have a big impact on perceived performance. Until and unless teams have better data about their performance, the global baseline budget should be enforced.

Performance 90

Performance Network Mobile Speed 90

Dynatrace

MAY 19, 2022

Example 1: Architecture boundaries. This multinational information technology service and consulting company was asked to help a global automotive manufacturer with the management goal of measuring service flow performance. First, they took a big step back and looked at their end-to-end architecture (Figure 2).

Automotive 272

Automotive Latency Architecture Azure 272

Dynatrace

OCTOBER 10, 2022

Reduced latency. Serverless architecture makes it possible to host code anywhere, rather than relying on an origin server. By using cloud providers with multiple server sites, organizations can reduce function latency for end users. Architectural complexity. Optimizes resources. No infrastructure to maintain.

Serverless 167

Serverless Infrastructure Lambda Latency 167

Scalegrid

MARCH 14, 2024

The architecture usually integrates several private, public, and on-premises infrastructures. Key Components of Hybrid Cloud Infrastructure A hybrid cloud architecture usually merges a public Infrastructure-as-a-Service (IaaS) platform with private computing assets and incorporates tools to manage these combined environments.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

NOVEMBER 17, 2022

While conventional video codecs remain prevalent, NN-based video encoding tools are flourishing and closing the performance gap in terms of compression efficiency. Architecture of the deep downscaler model, consisting of a preprocessing block followed by a resizing block. On a CPU, we leveraged oneDnn to further reduce latency.

Network 292

Network Media Innovation Efficiency 292

Alex Russell

MAY 9, 2022

Despite advances in browser tooling , automated evaluation , lab tools , guidance , and runtimes , however, teams struggle to deliver even decent performance with today's popular frameworks. What is Performance? It may seem a silly question, but what is performance, exactly?

Performance 86

Performance Latency Metrics Engineering 86

Dynatrace

JANUARY 26, 2021

Within this paradigm, it is possible to run entire architectures without touching a traditional virtual server, either locally or in the cloud. In a serverless architecture, applications are distributed to meet demand and scale requirements efficiently. When an application is triggered, it can cause latency as the application starts.

Serverless 244

Serverless Efficiency Lambda Azure 244

Dynatrace

SEPTEMBER 13, 2023

The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 249

AWS Efficiency Azure Cloud 249

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” Note that the class size is limited to about 100, so that I’ll be able to interact with most attendees directly.

Latency 51

Latency C++ Hardware Performance 51

Dynatrace

SEPTEMBER 18, 2020

Sure, cloud infrastructure requires comprehensive performance visibility, as Dynatrace provides , but the services that leverage cloud infrastructures also require close attention. Cloud-based application architectures commonly leverage microservices. High latency or lack of responses. Soaring number of active connections.

Infrastructure 192

Infrastructure Latency Metrics Analytics 192

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Common Websocket Architecture. Event Sourcing Architecture. Agustinus Theodorus.

Cache 125

Cache Performance Servers Social Media 125