The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

MAY 26, 2021

The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. AWS aims to support the streamlining of observability.

AWS 208

AWS Strategy Storage Metrics 208

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Examples of continuous sensing are found in the managed cloud platform built by Rachio on AWS IoT to enable the secure interaction of its connected devices with cloud applications/other devices.

AWS 90

AWS Cloud Healthcare Blockchain 90

Dynatrace

DECEMBER 15, 2022

While many organizations have embraced cloud observability to better manage their cloud environments, they may still struggle with the volume of entities that observability platforms monitor. 3: Ingest AWS Fargate logs with Fluent Bit. Let’s take this example of AWS Fargate. Ingest AWS Fargate logs with Fluent Bit.

Strategy 177

Strategy AWS Open Source Transportation 177

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. Amazon Aurora has become the fastest-growing service in the history of AWS and frequently is the target of migration from on-premise proprietary databases.

Database 117

Database Design Cloud Storage 117

Dynatrace

MAY 26, 2021

The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. AWS aims to support the streamlining of observability.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

NOVEMBER 20, 2023

At the AWS re:Invent 2023 conference, generative AI is a centerpiece. The first goal is to demonstrate how generative AI can bring key business value and efficiency for organizations. AWS re:Invent 2023: IT automation in AWS environments through a multipronged AI approach In almost every industry, generative AI has become a key topic.

AWS 206

AWS Artificial Intelligence Analytics Cloud 206

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. We earned the trust of our engineers by developing empathy for their operational burden and by focusing on providing efficient tracer library integrations in runtime environments.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. Although MyRocks is very efficient for writes, I chose a more generic workload that will provide a different MyRocks use case. RocksDB is a very efficient key-value store based on LSM trees.

Storage 56

Storage Cache C++ Virtualization 56

Scalegrid

JANUARY 8, 2024

Confused about multi-cloud vs hybrid cloud and which is the right strategy for your organization? Multicloud harnesses diverse cloud services to boost flexibility, while hybrid cloud merges public and private clouds for enhanced control. What is Multi-Cloud? But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

All Things Distributed

MARCH 11, 2015

Cloud computing is enabling amazing new innovations both in consumer and enterprise products, as it became the new normal for organizations of all sizes. So many exciting new areas are being empowered by cloud that it is fascinating to watch. Cloud analytics are everywhere. Cloud enables self-service analytics.

Analytics 135

Analytics Cloud Healthcare Retail 135

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Scalegrid

MARCH 14, 2024

Mastering Hybrid Cloud Strategy Are you looking to leverage the best private and public cloud worlds to propel your business forward? A hybrid cloud strategy could be your answer. This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix. File System. Networking. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem

Tuning 61

Tuning AWS Best Practices Network 61

All Things Distributed

JUNE 29, 2011

Driving Bandwidth Cost Down for AWS Customers. Any work we can do to improve over these dimensions generates long term benefits for AWS customers. Our account managers periodically call customers to work with them to see if there are opportunities to create better efficiencies and lower bills. Countdown to What is Next in AWS.

AWS 104

AWS Retail Innovation Strategy 104

Dynatrace

OCTOBER 7, 2021

For many companies, the journey to modern cloud applications starts with serverless. Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases.

Serverless 276

Serverless AWS Lambda Storage 276

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix. File System. Networking. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem

Tuning 52

Tuning AWS Best Practices Network 52

Abhishek Tiwari

JULY 22, 2023

In the fast-paced world of software development, the ability to deploy applications quickly and efficiently is crucial for organizations. For instance, Sentinel policies can enforce rules such as "All AWS S3 buckets must have server-side encryption enabled" or "Only specific IAM roles can access certain resources."

AWS 52

AWS Best Practices Infrastructure Traffic 52

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

DECEMBER 5, 2023

ARM architecture, based on a processor type optimized for cloud and hyperscale computing, has become the most prevalent on the planet, with billions of ARM devices currently in use. Energy efficiency and carbon footprint outshine x86 architectures The first clear benefit of ARM in the enterprise IT landscape is energy efficiency.

Efficiency 262

Efficiency Architecture Energy Monitoring 262

Scalegrid

JANUARY 12, 2024

What is workload in cloud computing? Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms.

Cloud 130

Cloud Virtualization Storage Efficiency 130

ScaleOut Software

JANUARY 9, 2020

To keep operations efficient and cost-effective, it’s important to be able to quickly respond to issues as they occur and efficiently verify their resolution. In addition, the platform provides fast, in-memory data storage so that the application can easily and quickly record both telemetry and analytics results for each store.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

To keep operations efficient and cost-effective, it’s important to be able to quickly respond to issues as they occur and efficiently verify their resolution. In addition, the platform provides fast, in-memory data storage so that the application can easily and quickly record both telemetry and analytics results for each store.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

To keep operations efficient and cost-effective, it’s important to be able to quickly respond to issues as they occur and efficiently verify their resolution. In addition, the platform provides fast, in-memory data storage so that the application easily can keep track of both telemetry and analytics results for each store.

Logistics 52

Logistics Retail Analytics Azure 52

All Things Distributed

AUGUST 18, 2011

The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. Many of our Big-Data customers already saw a big drop in their AWS bill last month when the cost of incoming bandwidth was dropped to $0.00.

Big Data 111

Big Data Analytics AWS Cloud 111

All Things Distributed

AUGUST 16, 2012

Both of these are important as they help customer accurately gauge the economic benefits of running their applications in the cloud. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud.

AWS 118

AWS Hardware Traffic Best Practices 118

Percona

FEBRUARY 24, 2023

If you’re using PostgreSQL in the cloud, there’s a good chance you’re spending more than you need in order to get the results you need for your business. Usage reduction: What to look for to reduce PostgreSQL cloud costs The first step in cost reduction is to use what you need and not more. Don’t pay for capacity you don’t use or need.

Cloud 121

Cloud Serverless AWS Storage 121

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. Who can benefit from DLV? and later v13 versions, 14.7

AWS 99

AWS Benchmarking Performance Traffic 99

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 13, 2009

Expanding the Cloud - Amazon EC2 Spot Instances. Spot Instances are an innovation that is made possible by the unparalleled economies of scale created by the tremendous growth of the AWS Infrastructure Services. Consistently we have lowered compute, storage and bandwidth prices based on such cost savings. All Things Distributed.

Cloud 63

Cloud AWS Storage Innovation 63

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. It is worth pointing out that cloud processing is always subject to variable network conditions.

Cloud 237

Cloud Media Storage Cache 237

High Scalability

OCTOBER 24, 2022

There's a move to regulate cloud providers by vertically separating the services they offer. Like railroads of yore, who were not allowed to provide freight services on top of their base services, cloud providers would not be allowed to provide services on top of their base platform services. The job of a cloud is to run workloads.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

The Morning Paper

JUNE 16, 2019

The challenging thing of course, is efficiently maintaining all of these parallel universes. In the prototype implementation, policies are expressed in a language similar to Google Cloud Firestore security rules. These ideas make an efficient multiverse database possible. Expressing privacy policies.

Database 90

Database Cache Benchmarking Efficiency 90

All Things Distributed

DECEMBER 13, 2016

In November 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in the United Kingdom. Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

Adrian Cockcroft

APRIL 18, 2018

This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads. In addition, for cloud native applications, a feedback loop is used to auto-scale the application resources based on metrics that report the utilization of current capacity.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124