The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

All Things Distributed

NOVEMBER 12, 2018

Today, I'm happy to announce that the AWS GovCloud (US-East) Region, our 19th global infrastructure Region, is now available for use by customers in the US. With this launch, AWS now provides 57 Availability Zones, with another 12 zones and four Regions in Bahrain, Cape Town, Hong Kong SAR, and Stockholm expected to come online by 2020.

AWS 117

AWS Healthcare Cloud Government 117

Dynatrace

SEPTEMBER 17, 2019

Some vendors have just bolted on individual capabilities which often leads to six data silos. PostgreSQL & Elastic for data storage. AWS EKS for Integration and Production. MaaSS for Business: Data per SaaS-Tenant. The Business teams therefore built a set of dashboards that contain the data they want to see.

AWS 127

AWS Monitoring Ecommerce Lambda 127

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

Adrian Cockcroft

FEBRUARY 13, 2023

Sustainability at AWS re:Invent 2022 -All the talks and videos I could find… Las Vegas MSG Sphere under construction next door to the Venetian Sands Expo Center — Photo by Adrian This blog post is long overdue — I spent too long trying to find time to watch all the videos, and finally gave up and listed a few below that I haven’t seen.

AWS 64

AWS Energy Architecture Programming 64

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. While our engineering teams have and continue to build solutions to lighten this cognitive load (better guardrails, improved tooling, …), data and its derived products are critical elements to understanding, optimizing and abstracting our infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

The Netflix TechBlog

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226

Systems Media Cache Open Source 226

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Dynatrace

MAY 17, 2023

While the first guardian validates the traffic, the second guardian checks the business transactions generated during the observation period. More precisely, this team uses AWS Fault Injection Simulator (FIS) to run fault injection to improve the application’s performance and resiliency.

DevOps 187

DevOps Traffic Latency Best Practices 187

Percona

APRIL 20, 2023

Data-at-rest encryption is essential for compliance with regulations that require the protection of sensitive data. It is also critical for securing sensitive data and avoiding data breaches. PostgreSQL does not natively support Transparent Data Encryption (TDE). apiVersion: storage.k8s.io/v1

Storage 119

Storage AWS Cloud Database 119

Dynatrace

JANUARY 28, 2021

OpenTelemetry for Go provides developers with an observability framework for cloud-native software, allowing them to instrument, generate, collect, and export telemetry data for relevant services. Such additional telemetry data includes user-behavior analytics, code-level visibility, and metadata (including open-source data).

Traffic 166

Traffic Open Source Servers Cloud 166

Dynatrace

MAY 6, 2021

To improve management of node capabilities , we added Enable/disable Web UI traffic operation for cluster node in Cluster Mission Control UI. Metric data points are no longer erroneously billed (DDUs) after the dimension limit is exceeded. Improved filter field edit behavior in ‘Data explorer’ (APM-291342).

Operating System 230

Operating System AWS Metrics Storage 230

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. With an on-prem data center, the organization bears the burden of securing the physical infrastructure and its digital assets.

Cloud 165

Cloud Traffic Best Practices Strategy 165

Dynatrace

AUGUST 9, 2023

However, our customers often want to augment the data Dynatrace provides with data from third-party tools. Dynatrace Grail  is a data lakehouse that provides context-rich analytics capabilities for observability, security, and business data. To keep it real, we have a load generator that creates benign traffic.

Analytics 195

Analytics AWS Strategy Infrastructure 195

Adrian Cockcroft

FEBRUARY 9, 2023

The virtualization and networking platform could be datacenter based, with something like VMware, or cloud based using one of the cloud providers such as AWS EC2. Above that there’s a deployment platform such as Kubernetes or AWS Lambda. The introduction of containers brought everyone a similar but lighter weight mechanism.

Engineering 137

Engineering Serverless Lambda AWS 137

The Netflix TechBlog

OCTOBER 19, 2020

Traces collected from various microservices are ingested in a stream processing manner into the data store. Edgar uses this infrastructure tagging schema to query and join traces with log data for troubleshooting streaming sessions. Stream Processing: to sample or not to sample trace data?

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Abhishek Tiwari

JULY 22, 2023

These policies encompass a wide range of concerns, including security best practices, data protection measures, industry regulations, privacy laws, accessibility requirements, and internal organizational policies. Restricting access to specific AWS services based on defined IAM roles. Checkov: Checkov is a static code analysis tool.

AWS 52

AWS Best Practices Infrastructure Traffic 52

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Scalegrid

JANUARY 8, 2024

By analyzing real-time data, AI-based models can: Adjust the allocation of resources in response to demand Boost business performance Reduce unnecessary expenditures Lead to significant cost savings Improve scalability Operational Efficiency through Automation Automation is a significant way AI enhances cloud operations.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

JANUARY 11, 2011

DROAM - Dreaming about Cheap Data Roaming. The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. After many investigations I settled for T-Mobile which has an international Blackberry supplement that is $20/month for all BB mail traffic. Comments (). Contact Info.

Wireless 107

Wireless AWS Internet Internet 107

High Scalability

SEPTEMBER 21, 2018

Aria Bracci : Using a previously established, peer-reviewed technique, the team conducted more than half a million data traffic tests across 161 countries. They'll love you even more. They'll love you even more. ” @mjpt777 : "Patterson indicated that rewriting Python into C gets you a 50 times speedup in performance".

Internet 126

Internet Internet Scalability Traffic 126

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

APRIL 11, 2018

Last year at re:Invent, we launched AWS Fargate , and today, I want to explore how Fargate fundamentally changes the landscape of container technology. This is the vision behind AWS Fargate. With AWS Fargate, you can provision resources to run your containers at a much finer grain than with an EC2 instance. Getting Started.

Cloud 148

Cloud AWS Innovation Traffic 148

Dynatrace

OCTOBER 28, 2022

Data indicates that increasingly C-level executives recognize the importance of joining AIOps and digital transformation. But BT’s move to the cloud has also generated complexity and a profusion of data. The amount of data that is being observed is really big,” Deane said. Observability reduces MTTR and incidents themselves.

Cloud 201

Cloud Strategy Technology Technology 201

High Scalability

APRIL 16, 2019

This scenario is more commonly known as split-brain scenario, and if not handled properly, can lead to more than one node claiming to be a master MySQL which in turn leads to data inconsistencies and corruption. Application traffic will be redirected to this new master MySQL node and the slave S2 will start replicating from the new master.

Availability 149

Availability Network Azure AWS 149

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 117

Database Design Cloud Storage 117

High Scalability

JUNE 22, 2018

. $40 million : Netflix monthly spend on cloud services; 5% : retention increase can increase profits 25%; 50+% : Facebook's IPv6 traffic from the U.S, 40 million : Netflix monthly spend on cloud services; 5% : retention increase can increase profits 25%; 50+% : Facebook's IPv6 traffic from the U.S, I am a hit at parties.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 135

Analytics Cloud Healthcare Retail 135

Dynatrace

SEPTEMBER 7, 2022

Dynatrace and the Dynatrace Intelligent Observability Platform have added support for the newly introduced Amazon VPC Flow Logs to Amazon Kinesis Data Firehose. This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. What is VPC Flow Logs? Why Dynatrace?

Traffic 215

Traffic AWS Network Cloud 215

Abhishek Tiwari

JULY 8, 2023

The term "synthetic" is used because it does not rely on traffic generated by real clients and end-users. It is also known as active monitoring or active probing since the agents make active attempts to connect with the target system and collect performance data, regardless of whether real end-users are accessing it or not.

Monitoring 52

Monitoring Testing Artificial Intelligence Traffic 52

CSS - Tricks

APRIL 28, 2022

We’ll walk through how to host the entire web app on CloudFront and have CloudFront forward — or “proxy” — non-cacheable requests for data, auth, etc., We’ll use AWS Route 53 for this. We told AWS we want it to manage this domain for us, and AWS gave us the name servers it’ll route our traffic through.

Cache 79

Cache AWS Servers Traffic 79

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. It becomes more manageable and efficient by isolating logs and data to a dedicated mount. Benchmarking AWS RDS DLV setup Setup 2 RDS Single DB instances 1 EC2 Instance Regular DLV Enabled Sysbench db.m6i.2xlarge

AWS 96

AWS Benchmarking Performance Traffic 96

Speed Curve

FEBRUARY 5, 2024

Server Timing is a specification that allows communication of data from the server to the client through the use of a server-timing header. SpeedCurve's RUM collection library – lux.js – accesses this interface to collect custom data from the user agent.

Servers 57

Servers Cache Retail Benchmarking 57