The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We formulate the problem as a Mixed Integer Program (MIP).

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

MARCH 8, 2020

When I think about cloud-native architectures, I think about disaggregation (enabling each resource type to scale independently), fine-grained units of resource allocation (enabling rapid response to changing workload demands, i.e. elasticity), and isolation (keeping tenants apart). From shared-nothing to disaggregation. The scorecard.

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This strategy reduces the volume needed during retrieval operations.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. When available, it can use hardware level performance counters.

Big Data 45

Big Data Cloud Performance Hardware 45

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

All Things Distributed

AUGUST 16, 2012

An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. Total Cost of Ownership and the Return on Agility. By Werner Vogels on 16 August 2012 10:00 AM. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 20, 2017

The benefit for customers: Authorized users can view this data and therefore manage their inventories across different sites, making the maintenance processes much more efficient. We need mechanisms that enable the mass production of data using software and hardware capabilities. This pattern should be broken.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Percona

NOVEMBER 9, 2023

Kubernetes can be complex, which is why we offer comprehensive training that equips you and your team with the expertise and skills to manage database configurations, implement industry best practices, and carry out efficient backup and recovery procedures.

Efficiency 105

Efficiency Cloud Healthcare Open Source 105

Dynatrace

MAY 1, 2023

This operational data could be gathered from live running infrastructures using software agents, hypervisors, or network logs, for example. In addition to improved IT operational efficiency at a lower cost, ITOA also enhances digital experience monitoring for increased customer engagement and satisfaction.

Analytics 184

Analytics Artificial Intelligence Big Data Open Source 184

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 90

Database Hardware Open Source Strategy 90

ACM Sigarch

NOVEMBER 4, 2019

The technical program, put together by program chairs Tor Aamodt and Reetuparna Das , showcased key innovations across a wide range of computer architecture topics, from domain-specific accelerators to in/near-memory computing and from security to quantum computing. . This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. This can be efficient at the beginning but counter-productive in a long run. In some cases, this can be enhanced by combining data virtualization techniques with microservices architecture.

Latency 63

Latency Analytics Scalability Engineering 63

Highly Scalable

AUGUST 20, 2013

The engine should be compact and efficient, so one can deploy it in multiple datacenters on small clusters. In the previous section, we noted that many distributed query processing algorithms resemble message passing networks. Efficient lineage tracking is not a trivial problem. High performance and mobility. Pipelining.

Big Data 154

Big Data Processing Lambda Database 154

Dynatrace

FEBRUARY 23, 2022

IaC, or software intelligence as code , codifies and manages IT infrastructure in software, rather than in hardware. According to a Gartner report, “By 2023, 60% of organizations will use infrastructure automation tools as part of their DevOps toolchains, improving application deployment efficiency by 25%.”. and 2.14.1.

Serverless 261

Serverless Infrastructure Innovation DevOps 261

The Morning Paper

NOVEMBER 10, 2019

Snap: a microkernel approach to host networking Marty et al., This paper describes the networking stack, Snap , that has been running in production at Google for the last three years+. The desire for CPU efficiency and lower latencies is easy to understand. SOSP’19. Emphasis mine). It reminds me of ZeroMQ.

Network 92

Network Transportation Latency Entertainment 92

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. What is Hybrid Cloud?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

JULY 8, 2019

I’ve been speaking to customers over the last few months about our new cloud architecture for Synthetic testing locations and their confusion is clear. When we wanted to add a location, we had to ship hardware and get someone to install that hardware in a rack with power and network. Hardware was outdated.

Cloud 201

Cloud Hardware Testing Logistics 201

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device.

Analytics 205

Analytics Monitoring Artificial Intelligence DevOps 205

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. This ensures each Redis® instance optimally uses the in-memory data store and aligns with the operating system’s efficiency.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

AUGUST 30, 2019

Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. Reducing performance and architectural issues in their backend system gave them a 99% performance improvement! A highly distributed architecture like this has a lot of potential for performance and architectural hotspots.

Cache 195

Cache Architecture Database Government 195

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Network effects are not the same as monopoly control. You can even go old school and use non cloud-native architectures. Cloud providers incur huge fixed costs for creating and maintaining a network of datacenters spread throughout the word.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 110

Availability Database Open Source Hardware 110

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

DECEMBER 23, 2020

This abstraction allows the compute team to influence the reliability, efficiency, and operability of the fleet via the scheduler. Titus internally employs a cellular bulkhead architecture for scalability, so the fleet is composed of multiple cells. We do this for reliability, scalability, and efficiency reasons.

Media 286

Media Metrics Systems Processing 286

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. Gone are the days of monolithic architecture. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network.

Systems 74

Systems Monitoring Hardware Network 74

All Things Distributed

MARCH 11, 2016

The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. The importance of the network.

AWS 144

AWS Hardware Retail Virtualization 144

Percona

AUGUST 15, 2023

Network Connectivity: Establish a reliable network connection between the primary and replica servers. Below is an example architecture for Group Replication. Failover ensures that if the primary MySQL server becomes unavailable due to hardware failure or another issue, the system seamlessly switches to a standby replica.

Servers 52

Servers Database Availability Traffic 52

The Morning Paper

MAY 19, 2019

The net result of rapid advancements in the networking world is that inter-tier communications latency will approach the fundamental lower bound of speed-of-light propagation in the foreseeable future. At one extreme we have a ‘16 x 1’ architecture with 16 queues each with one associated processing unit.

Latency 80

Latency Hardware Network Architecture 80

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

All Things Distributed

JULY 20, 2015

Today, I want to explore the Amazon ECS architecture and what this architecture enables. The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). Let’s talk about what Amazon ECS is actually doing.

Latency 166

Latency Architecture AWS Open Source 166

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 40

Virtualization AWS Hardware Storage 40

Testsigma

MAY 19, 2021

Thinking back on how SDLC started and what it is today, the only reasons for its success can be accounted to efficiency, speed and most importantly automation – DevOps and cloud-based solutions can be considered major contributors here (after all DevOps is 41% less time-consuming than traditional ops ). . Software as a Service (SaaS).

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59