The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. As a micro-service owner, a Netflix engineer is responsible for its innovation as well as its operation, which includes making sure the service is reliable, secure, efficient and performant.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

High Scalability

MARCH 22, 2019

Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading). They'll learn a lot and love you even more.5 At some point, the e-mail I send over WiFi will hit a wire, of course".

Internet 134

Internet Internet Scalability Wireless 134

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. The next challenge was to stream large amounts of traces via a scalable data processing platform.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. A disruption spanning hardware, networks, and cloud infrastructure can require input and participation from network and infrastructure architects, risk experts, security teams, and even procurement officers.

Engineering 225

Engineering Entertainment Cloud Infrastructure 225

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. to drive new efficiencies and higher reliability.

AWS 110

AWS Innovation Scalability Cache 110

The Netflix TechBlog

MAY 21, 2019

There are several problems efficient test scheduling could help us solve: Quickly detect a regression in the integration of the Netflix SDK on a consumer electronic or MVPD (multichannel video programming distributor) device. We wanted the to tool be available as a standalone library as well as scalable API service.

Testing 163

Testing AWS Lambda Network 163

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. This can fundamentally transform how they work, make processes more efficient, and improve the overall customer experience. Reduced cost.

Cloud 165

Cloud Traffic Best Practices Strategy 165

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. All Things Distributed. The Back-to-Basics Readings of 2012.

Operating System 144

Operating System Cache AWS Scalability 144

Scalegrid

JANUARY 8, 2024

Key Takeaways Multi-cloud involves using services from multiple cloud providers to gain flexibility and reduce vendor lock-in, while hybrid cloud combines private and public cloud resources to balance control and scalability. Thus making it an ideal choice for businesses seeking a successful implementation of their multi-cloud strategy.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Scalegrid

MARCH 14, 2024

This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential. The public cloud’s ability to scale efficiently enables ‘cloudbursting’ when demand spikes without requiring businesses to overprovision their own infrastructures.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dotcom-Montior

OCTOBER 6, 2021

Site reliability engineers are focused with creating scalable and reliable software systems, so this also includes ensuring that development work is efficient and reliable, so when the finished product is ready for production, there are no surprises. that are required to keep the software deployments live are running efficiently.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. All Things Distributed. Comments (). Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

NOVEMBER 22, 2016

Some examples of popular deep learning frameworks that we support on AWS include Caffe, CNTK, MXNet, TensorFlow, Theano, and Torch. Among all these popular frameworks, we have concluded that MXNet is the most scalable framework. AWS will contribute code and improved documentation as well as invest in the ecosystem around MXNet.

AWS 167

AWS Open Source Scalability Programming 167

High Scalability

JUNE 29, 2018

kellabyte : LOL at racking up an AWS bill of $140,000 in 4 hours of compute time. kellabyte : Recently I got to work on a project that really stressed Amazon AWS scalability. We spun up a cluster of 100,000 AWS instances multiple times. They'll love you even more. potential immigrants can actually attend! Don't stop here.

Scalability 131

Scalability Internet Internet Wireless 131

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. The public cloud provides flexibility and cost efficiency through utilizing a provider’s resources. These include on-premises data centers which offer specific business benefits.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

DECEMBER 13, 2016

In November 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in the United Kingdom. Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Acceleration and distribution.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. Microservices architecture helps teams become more flexible and bring highly scalable apps to market faster. Simple network calls. Dynatrace news. Focused on delivering business value.

Architecture 246

Architecture Software Software Development 246

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. Microservices architecture helps teams become more flexible and bring highly scalable apps to market faster. Simple network calls. Dynatrace news. Focused on delivering business value.

Architecture 244

Architecture Software Software Development 244

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

Dynatrace

NOVEMBER 3, 2022

The containerization craze has continued for enterprises, with benefits such as portability, efficiency, and scalability. Serverless container offerings such as AWS Fargate enable companies to manage and modify containers while abstracting server layers to offer customization without increased complexity. Easy scalability.

Serverless 218

Serverless Azure Hardware Transportation 218

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 118

Cloud Serverless AWS Storage 118

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. ElastiCache for Redis Multi-AZ capability is built to handle any failover case for Redis Cluster with robustness and efficiency. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

Scalegrid

MAY 13, 2020

Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum interconnect is the networking layer of the architecture, and manages communication between the Greenplum segments and master host network infrastructure. At a glance – TLDR. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Network effects are not the same as monopoly control. Cloud providers incur huge fixed costs for creating and maintaining a network of datacenters spread throughout the word. For example, AWS created Nitro. And even that list is not invulnerable.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. We use Keystone as it is easy to use, reliable, scalable, and provides aggregation of facts from different cloud regions into a single AWS region.

Storage 187

Storage Design Scalability Latency 187

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. . Who manage s the networking aspects? How do you make it scalable? .

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. . Who manage s the networking aspects? How do you make it scalable? .

Google 130

Google Ecommerce DevOps Cloud 130

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started Hold that thought. Migrating isn't as simple as 'copy-paste'.‍Even

Open Source 52

Open Source DevOps AWS Azure 52

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost.

AWS 144

AWS Hardware Retail Virtualization 144

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times.

Performance 74

Performance Cache Traffic Metrics 74

High Scalability

SEPTEMBER 8, 2018

Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! This increases the cores and network bandwidth available to serve common requests.

Storage 199

Storage Performance AWS Efficiency 199