The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Cloud 213

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda? The Amazon Web Services ecosystem.

Lambda 180

Lambda AWS Serverless Hardware 180

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Adrian Cockcroft

FEBRUARY 9, 2023

We used this model effectively at Netflix when I was their cloud architect from 2010 through 2013. The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. Netflix made many contributions to open source projects by it’s cloud platform team.

Engineering 137

Engineering Serverless Lambda AWS 137

The Morning Paper

OCTOBER 4, 2020

The first 5G networks are now deployed and operational. The study is based on one of the world’s first commercial 5G network deployments (launched in April 2019), a 0.5 The 5G network is operating at 3.5GHz). Future 5G Standalone Architecture (SA) deployments with a native 5G control plane will not have this problem.

Energy 130

Energy Latency Performance Network 130

All Things Distributed

SEPTEMBER 6, 2013

Given that I am originally from the Netherlands I have, of course, a special interest in how Dutch companies are using our cloud services. . But it is not just Dutch entrepreneurs who build their business in the cloud, also traditional Dutch enterprises are moving to the cloud to improve their agility and cost-effectiveness.

Cloud 129

Cloud Energy AWS Healthcare 129

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Scalegrid

JANUARY 8, 2024

Confused about multi-cloud vs hybrid cloud and which is the right strategy for your organization? Multicloud harnesses diverse cloud services to boost flexibility, while hybrid cloud merges public and private clouds for enhanced control. What is Multi-Cloud? But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

Scalegrid

JANUARY 5, 2024

Types of DBMS DBMS can be classified into hierarchical, network, relational, and object-oriented types. Additionally, it modernizes data architecture, moves data management to the cloud, and automates processes, collectively decreasing data management costs and enhancing the productivity of database administration teams.

Efficiency 147

Efficiency Storage Database Scalability 147

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Without cloud-based rendering, this ambitious project would not have met its targeted delivery date!

Cloud 282

Cloud Entertainment AWS Infrastructure 282

The Netflix TechBlog

JUNE 4, 2019

When you’re running in the cloud your containers are in a shared space; in particular they share the CPU’s memory hierarchy of the host instance. The idea CFS operates by very frequently (every few microseconds) applying a set of heuristics which encapsulate a general concept of best practices around CPU hardware use.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

High Scalability

NOVEMBER 14, 2018

New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime.

Design 54

Design Education Google Internet 54

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This strategy reduces the volume needed during retrieval operations.

Storage 130

Storage Systems Big Data Azure 130

High Scalability

OCTOBER 24, 2022

There's a move to regulate cloud providers by vertically separating the services they offer. Like railroads of yore, who were not allowed to provide freight services on top of their base services, cloud providers would not be allowed to provide services on top of their base platform services. The job of a cloud is to run workloads.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

AUGUST 16, 2012

Both of these are important as they help customer accurately gauge the economic benefits of running their applications in the cloud. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud.

AWS 118

AWS Hardware Traffic Best Practices 118

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

Dynatrace

JULY 8, 2019

While not a new concept, the term “cloud” creates a lot of confusion because it means different things to different audiences. I’ve been speaking to customers over the last few months about our new cloud architecture for Synthetic testing locations and their confusion is clear. Hardware was outdated. Dynatrace news.

Cloud 202

Cloud Hardware Testing Logistics 202

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

Dynatrace

DECEMBER 8, 2021

As cloud environments become increasingly complex, legacy solutions can’t keep up with modern demands. As a result, companies run into the cloud complexity wall – also known as the cloud observability wall – as they struggle to manage modern applications and gain multicloud observability with outdated tools.

Cloud 227

Cloud Serverless Hardware Operating System 227

Dynatrace

JUNE 29, 2022

More than 90% of enterprises now rely on a hybrid cloud infrastructure to deliver innovative digital services and capture new markets. That’s because cloud platforms offer flexibility and extensibility for an organization’s existing infrastructure. What is hybrid cloud architecture?

Infrastructure 182

Infrastructure Cloud Azure AWS 182

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors. Teachers can interact with their colleagues in professional learning networks.

Innovation 146

Innovation AWS Education Network 146

All Things Distributed

DECEMBER 20, 2017

Developments like cloud computing, the internet of things, artificial intelligence, and machine learning are proving that IT has (again) become a strategic business driver. Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Dynatrace

MAY 1, 2023

With 99% of organizations using multicloud environments , effectively monitoring cloud operations with AI-driven analytics and automation is critical. IT operations analytics (ITOA) with artificial intelligence (AI) capabilities supports faster cloud deployment of digital products and services and trusted business insights.

Analytics 188

Analytics Artificial Intelligence Big Data Open Source 188

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 84

Database Hardware Open Source Strategy 84

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Cloud providers then manage physical hardware, virtual machines, and web server software management.

Development 251

Development Serverless Best Practices Lambda 251

Dynatrace

FEBRUARY 23, 2022

In order for software development teams to balance speed with quality during the software development cycle (SDLC), development, security, and operations teams (or DevSecOps teams) need to ensure that their practices align with modern cloud environments. Serverless architecture expands. and 2.14.1.

Serverless 265

Serverless Infrastructure Innovation DevOps 265

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Abhishek Tiwari

DECEMBER 27, 2017

portability between cloud and on-premises. optimised container networking and security. For instance, scatter/gather pattern can be used to implement a MapReduce like batch processing architecture on top of Kubernetes. better cluster resource utilization. frictionless multi-tenancy with versioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes.

Analytics 209

Analytics Monitoring Artificial Intelligence DevOps 209

Percona

NOVEMBER 9, 2023

You may already be using it daily and find it makes running applications in the cloud much more manageable. It simplifies infrastructure management and is the driving force behind many cloud-native applications and services. It has become the industry standard for cloud-native container orchestration.

Efficiency 98

Efficiency Cloud Healthcare Open Source 98