The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! We’ve compiled our speaking events below so you know what we’ve been working on. Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! We’ve compiled our speaking events below so you know what we’ve been working on. Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

Dynatrace

AUGUST 9, 2023

Not only that, teams struggle to correlate events and alerts from a wide range of security tools, need to put them into context, and infer their risk for the business. Falco is an open-source, cloud-native security tool that utilizes the Linux kernel technology  eBPF , to generate fine-grained networking, security, and observability events.

Analytics 195

Analytics AWS Strategy Infrastructure 195

Dynatrace

JUNE 20, 2023

Data is proliferating in separate silos from containers and Kubernetes to open source APIs and software to serverless compute services, such as AWS and Azure. The organization needed to ensure the correlation of all events in a complete end-to-end trace. However, they had numerous custom applications with separate APIs.

Open Source 193

Open Source Google Serverless Azure 193

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Dynatrace

JANUARY 28, 2021

For today’s highly dynamic and exceedingly complex production environments, performance problems that are evident at the service level (for example, slow response times or failed requests) are often the result of underlying (cloud) infrastructure issues. Enrich OpenTelemetry instrumentation with high-fidelity data provided by OneAgent.

Traffic 166

Traffic Open Source Servers Cloud 166

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! We’ve compiled our speaking events below so you know what we’ve been working on. Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers. Wednesday?—?December

AWS 37

AWS Entertainment Open Source Benchmarking 37

The Netflix TechBlog

OCTOBER 15, 2019

Delta is an eventual consistent, event driven, data synchronization and enrichment platform. Another thread or process is constantly polling events from the log table and writes them to one or multiple datastores, optionally removing events from the log table after acknowledged by all datastores.

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

JULY 30, 2019

Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Instead, we use a wrapper that pulls in the latest version of Conductor and adds Netflix infrastructure components and libraries before deployment. Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

Abhishek Tiwari

JULY 8, 2023

The term "synthetic" is used because it does not rely on traffic generated by real clients and end-users. This approach offers the advantage of promptly identifying and addressing unavailability or performance degradation events before they impact any end-users.

Monitoring 52

Monitoring Testing Artificial Intelligence Traffic 52

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

The Netflix TechBlog

OCTOBER 18, 2019

Faisal Siddiqi Infrastructure for Contextual Bandits and Reinforcement Learning?—? As with other traditional machine learning and deep learning paths, a lot of what the core algorithms can do depends upon the support they get from the surrounding infrastructure and the tooling that the ML platform provides.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

High Scalability

APRIL 16, 2019

Application traffic will be redirected to this new master MySQL node and the slave S2 will start replicating from the new master. Thus, we see that the MySQL HA framework handles split-brain scenarios effectively, ensuring both data consistency and availability in the event the network connectivity breaks between master and slave nodes.

Availability 149

Availability Network Azure AWS 149

The Netflix TechBlog

OCTOBER 18, 2019

Faisal Siddiqi Infrastructure for Contextual Bandits and Reinforcement Learning?—? As with other traditional machine learning and deep learning paths, a lot of what the core algorithms can do depends upon the support they get from the surrounding infrastructure and the tooling that the ML platform provides.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

Dynatrace

NOVEMBER 22, 2022

For retail organizations, peak traffic can be a mixed blessing. While high-volume traffic often boosts sales, it can also compromise uptimes. For organizations running their own on-premises infrastructure, these costs can be prohibitive. What is always-on infrastructure?

Infrastructure 182

Infrastructure Availability Systems Retail 182

Dynatrace

NOVEMBER 24, 2020

As organizations plan, migrate, transform, and operate their workloads on AWS, it’s vital that they follow a consistent approach to evaluating both the on-premises architecture and the upcoming design for cloud-based architecture. AWS 5-pillars. Dynatrace and AWS. through our AWS integrations and monitoring support.

AWS 144

AWS Artificial Intelligence Best Practices Lambda 144

All Things Distributed

APRIL 5, 2012

Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. Troy: We moved our service from internal servers to AWS.

Innovation 146

Innovation AWS Education Network 146

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. Another adtech infrastructure problem is capacity. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. The simple answer is to just spin up more servers.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. Another adtech infrastructure problem is capacity. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. The simple answer is to just spin up more servers.

Performance 40

Performance Hardware Latency Infrastructure 40

Dynatrace

SEPTEMBER 7, 2022

VPC Flow Logs is an Amazon service that enables IT pros to capture information about the IP traffic that traverses network interfaces in a virtual private cloud, or VPC. By default, each record captures a network internet protocol (IP), a destination, and the source of the traffic flow that occurs within your environment.

Traffic 215

Traffic AWS Network Cloud 215

The Netflix TechBlog

JUNE 14, 2023

The control group’s traffic utilized the legacy Falcor stack, while the experiment population leveraged the new GraphQL client and was directed to the GraphQL Shim. This helped us successfully migrate 100% of the traffic on the mobile homepage canvas to GraphQL in 6 months.

Traffic 353

Traffic Latency Cache Metrics 353

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. Cloud Network Insight is a suite of solutions that provides both operational and analytical insight into the Cloud Network Infrastructure to address the identified problems.

Network 150

Network Tuning AWS Big Data 150

O'Reilly

DECEMBER 2, 2019

5G enthusiasts frequently say it’s an enabling technology for autonomous vehicles (AV), which will need high bandwidth to download maps and images, and perhaps even to communicate with each other: AV heaven is a world in which all vehicles are autonomous and can therefore collaboratively plan traffic. Upcoming events.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Dynatrace

JUNE 26, 2020

Dynatrace Synthetic Monitoring helps you quickly verify if your application is delivering the expected end user experience by offering an outside-in view of all your applications and services, independent of real traffic. Virginia (AWS) ?, California (AWS), San Jose (Azure), Texas (Azure), Ohio (AWS), Toronto (Azure) ?,

Monitoring 256

Monitoring Azure AWS Traffic 256

The Netflix TechBlog

APRIL 29, 2019

An easy, though imprecise, way of thinking about Netflix infrastructure is that everything that happens before you press Play on your remote control (e.g., takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e., are you logged in? what plan do you have? what do you want to watch?)

Open Source 279

Open Source Network Infrastructure Big Data 279

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. Heading over to `Infrastructure` / `Hosts` in your dashboard, you should now have an entry for the host where you installed OneAgent.

Metrics 171

Metrics Monitoring Database Network 171

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. No locks on tables are ever acquired, which prevent impacting write traffic on the source database.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. No locks on tables are ever acquired, which prevent impacting write traffic on the source database.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

AUGUST 13, 2020

We also highlight interesting broader events such as regional traffic evacuations and nearby deployments , information that is vital to understanding health holistically. It usually has dependencies, talks to other services, and lives in different AWS regions. Regional traffic evacuations. Infrastructure change events.

Monitoring 210

Monitoring Tuning Traffic Metrics 210

IO River

NOVEMBER 2, 2023

The code is declarative, which means you specify what you want the final configuration to look like, and Terraform ensures the infrastructure matches that desired state.‍So, ‍Terraform is a revolution in the way we handle infrastructure. Background‍The idea of managing infrastructure through code wasn't initiated by HashiCorp.

Open Source 52

Open Source DevOps AWS Azure 52

Smashing Magazine

AUGUST 3, 2023

It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site. While paid marketing strategies like Google Ads play a part in our approach as well, enhancing our organic traffic remains a major priority. The higher our organic traffic, the more profitable we become as a company.

Performance 74

Performance Cache Traffic Metrics 74

IO River

NOVEMBER 2, 2023

The code is declarative, which means you specify what you want the final configuration to look like, and Terraform ensures the infrastructure matches that desired state.‍So, What Exactly is Terraform?‍Terraform Terraform is a revolution in the way we handle infrastructure.

Open Source 40

Open Source DevOps AWS Azure 40

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Especially if going into or out of storage types that may throttle bandwidth/network traffic. It also supports storing the backups on filesystem and AWS S3 buckets. mongodump --host=mongodb1.example.net

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

OCTOBER 2, 2017

Our straining database infrastructure on Oracle led us to evaluate if we could develop a purpose-built database that would support our business needs for the long term. As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com.

Internet 128

Internet Internet AWS Performance 128

The Netflix TechBlog

OCTOBER 16, 2019

Without infrastructure-level support, every team ends up building their own point solution to varying degrees of success. An important point to note is that Gutenberg is not designed as an eventing system?—?it Datasets themselves are of varying size, from a few bytes to multiple gigabytes.

Cache 187

Cache Architecture Metrics Java 187

All Things Distributed

JUNE 21, 2012

Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. By Werner Vogels on 21 June 2012 09:00 AM. Comments (). David Eisenman, Principal, Madwell. DynamoDBâ??s

Games 142

Games Scalability AWS Database 142

All Things Distributed

NOVEMBER 21, 2017

Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. Our retail customers have shared similar challenges about managing workload surges and declines driven by big sale events.

Games 112

Games Retail Latency Education 112