The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

All Things Distributed

NOVEMBER 12, 2018

Today, I'm happy to announce that the AWS GovCloud (US-East) Region, our 19th global infrastructure Region, is now available for use by customers in the US. With this launch, AWS now provides 57 Availability Zones, with another 12 zones and four Regions in Bahrain, Cape Town, Hong Kong SAR, and Stockholm expected to come online by 2020.

AWS 117

AWS Healthcare Cloud Government 117

Dynatrace

SEPTEMBER 17, 2019

AWS EKS for Integration and Production. When focusing on the LanguageController service we learn that it’s currently deployed in three pods across three EKS nodes across two AWS Availability Zones (AZ). 4 AWS EFS monitoring. Their technology stack looks like this: Spring Boot-based Microservices. NGINX as an API Gateway.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Adrian Cockcroft

FEBRUARY 13, 2023

Sustainability at AWS re:Invent 2022 -All the talks and videos I could find… Las Vegas MSG Sphere under construction next door to the Venetian Sands Expo Center — Photo by Adrian This blog post is long overdue — I spent too long trying to find time to watch all the videos, and finally gave up and listed a few below that I haven’t seen.

AWS 64

AWS Energy Architecture Programming 64

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Dynatrace

JUNE 20, 2023

Data is proliferating in separate silos from containers and Kubernetes to open source APIs and software to serverless compute services, such as AWS and Azure. In this case, the bank group could not rely solely on Google Cloud Trace because they needed to collect traces and monitor the applications across all their systems.

Open Source 192

Open Source Google Serverless Azure 192

Dynatrace

MAY 6, 2021

To improve management of node capabilities , we added Enable/disable Web UI traffic operation for cluster node in Cluster Mission Control UI. Operating systems support. Future Dynatrace Managed operating systems support changes. Future Dynatrace Managed operating systems support changes. Linux: Amazon Linux AMI 2017.x.

Operating System 229

Operating System AWS Metrics Storage 229

Adrian Cockcroft

FEBRUARY 9, 2023

The next layer is operating system platforms, what flavor of Linux, what version of Windows etc. The virtualization and networking platform could be datacenter based, with something like VMware, or cloud based using one of the cloud providers such as AWS EC2. Above that there’s a deployment platform such as Kubernetes or AWS Lambda.

Engineering 137

Engineering Serverless Lambda AWS 137

Dynatrace

AUGUST 9, 2023

Install Falco in AWS EKS to gather security-relevant events from all the happenings in Unguard. To keep it real, we have a load generator that creates benign traffic. For the demonstration in this blog post, we want to deploy Unguard in AWS EKS and hunt for attacks within that environment.

Analytics 194

Analytics AWS Strategy Infrastructure 194

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. In case of a spike in traffic, you can automatically spin up more resources, often in a matter of seconds. Inconsistent performance.

Cloud 164

Cloud Traffic Best Practices Strategy 164

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

Abhishek Tiwari

JULY 22, 2023

For instance, Sentinel policies can enforce rules such as "All AWS S3 buckets must have server-side encryption enabled" or "Only specific IAM roles can access certain resources." OPA can be integrated with a wide range of tools and systems, making it highly versatile. Checkov: Checkov is a static code analysis tool.

AWS 52

AWS Best Practices Infrastructure Traffic 52

Scalegrid

JANUARY 8, 2024

Artificial intelligence can automate tasks ranging from: data analysis resource provisioning system maintenance decision-making natural language processing This not only improves accuracy and reliability but also frees up valuable time for IT teams to focus on strategic tasks, such as resource management on platforms like Google Cloud.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. Can we adjust our auto-scaling policies to be more efficiency without risking our availability during traffic spikes? A majority of the Netflix product features are either partially or completely dependent on one of our many micro-services (e.g.,

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

All Things Distributed

APRIL 11, 2018

Last year at re:Invent, we launched AWS Fargate , and today, I want to explore how Fargate fundamentally changes the landscape of container technology. This is the vision behind AWS Fargate. With AWS Fargate, you can provision resources to run your containers at a much finer grain than with an EC2 instance. Getting Started.

Cloud 148

Cloud AWS Innovation Traffic 148

Adrian Cockcroft

APRIL 18, 2018

In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. What if your monitoring systems fail? How do you even know when a monitoring system has failed?

Monitoring 40

Monitoring Systems Virtualization Metrics 40

High Scalability

APRIL 16, 2019

Thus, whenever a master MySQL goes down (whether due to a MySQL crash, OS crash, system reboot, etc.), This ensures that the system continues to be available to the applications. Application traffic will be redirected to this new master MySQL node and the slave S2 will start replicating from the new master.

Availability 149

Availability Network Azure AWS 149

High Scalability

SEPTEMBER 21, 2018

Aria Bracci : Using a previously established, peer-reviewed technique, the team conducted more than half a million data traffic tests across 161 countries. Too often, those who already hold power, those who are least able to recognize the flaws in our current systems, are the ones who decide our technological future. More quotes.

Internet 126

Internet Internet Scalability Traffic 126

DZone

SEPTEMBER 14, 2023

With the advent of cloud computing, managing network traffic and ensuring optimal performance have become critical aspects of system architecture. Amazon Web Services (AWS), a leading cloud service provider, offers a suite of load balancers to manage network traffic effectively for applications running on its platform.

AWS 258

AWS Traffic Network Architecture 258

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

Abhishek Tiwari

JULY 8, 2023

In today's digital landscape, where user experience is paramount, organizations must ensure their applications and systems are functioning optimally at all times. The Evolution of Testing and Monitoring Historically, software testing and system monitoring have been separate processes, each serving distinct purposes.

Monitoring 52

Monitoring Testing Artificial Intelligence Traffic 52

The Netflix TechBlog

OCTOBER 15, 2019

Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2]. By their nature, they can only rely on the lowest common denominator of participating systems. That system quickly grew very complex and became difficult to maintain.

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

JULY 30, 2019

Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra External Payload Storage External payload storage was implemented to prevent the usage of Conductor as a data persistence system and to reduce the pressure on its backend datastore. As such, Conductor 2.x

Lambda 189

Lambda Media Open Source Metrics 189

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. In this blog post, we will give an overview of the Rapid Event Notification System at Netflix and share some of the learnings we gained along the way.

Systems 334

Systems Traffic Architecture Mobile 334

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 117

Database Design Cloud Storage 117

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 135

Analytics Cloud Healthcare Retail 135

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. This segregation facilitates optimized I/O operations, preventing potential bottlenecks and enhancing overall system performance. Amazon RDS extends support for DLVs across various database engines: MariaDB: 10.6.7

AWS 100

AWS Benchmarking Performance Traffic 100

All Things Distributed

NOVEMBER 12, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. Many young businesses as well as established enterprises are already using AWS, many of them targeting customers globally. Comments ().

Cloud 117

Cloud AWS Ecommerce Latency 117

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. All Things Distributed. Comments (). Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

MARCH 11, 2013

Werner Vogels weblog on building scalable and robust distributed systems. I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js Today, AWS Elastic Beanstalk just added support for Node.js All Things Distributed. Elastic Beanstalk a la Node.

AWS 102

AWS Mobile Games Java 102

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Developers don’t have to put in additional time to fine-tuning the system, or rely on other teams for support, as it’s done automatically with the cloud provider. Focus on Application Development.

Serverless 57

Serverless Monitoring Lambda Latency 57