The Netflix TechBlog

OCTOBER 19, 2020

An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. The next challenge was to stream large amounts of traces via a scalable data processing platform. Mantis is our go-to platform for processing operational data at Netflix.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

All Things Distributed

MAY 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Using the AWS Toolkit for Visual Studio , you can now deploy your.NET applications to AWS Elastic Beanstalk directly from your Visual Studio environment without changing any code. Expanding the Cloud for Windows Developers. Comments ().

Cloud 115

Cloud Development AWS Servers 115

All Things Distributed

MARCH 11, 2013

Werner Vogels weblog on building scalable and robust distributed systems. I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js Today, AWS Elastic Beanstalk just added support for Node.js All Things Distributed. Elastic Beanstalk a la Node.

AWS 102

AWS Mobile Games Java 102

High Scalability

APRIL 16, 2019

Application traffic will be redirected to this new master MySQL node and the slave S2 will start replicating from the new master. At ScaleGrid, we offer highly available hosting for MySQL on AWS and MySQL on Azure that is implemented based on the concepts explained in this blog series.

Availability 149

Availability Network Azure AWS 149

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. After many investigations I settled for T-Mobile which has an international Blackberry supplement that is $20/month for all BB mail traffic. This includes 50MB data traffic per day. Theyre not even an AWS customer :-). All Things Distributed.

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners.

Innovation 146

Innovation AWS Education Network 146

Percona

OCTOBER 19, 2023

Welcome to the first installment of our series: Scalable Solutions with Percona Distribution for PostgreSQL. In this guide, we will demonstrate how to establish a Citus database spanning multiple nodes by using Percona Distribution for PostgreSQL. This tutorial will use Ubuntu 20.04 and Percona Distribution for PostgreSQL 15.

Scalability 88

Scalability Database Open Source Traffic 88

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them.

Internet 114

Internet Internet AWS Scalability 114

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? What we should really compare is the MySQL and Aurora database engines provided by Amazon RDS.

AWS 52

AWS Database Serverless Storage 52

Scalegrid

JANUARY 8, 2024

Key Takeaways Multi-cloud involves using services from multiple cloud providers to gain flexibility and reduce vendor lock-in, while hybrid cloud combines private and public cloud resources to balance control and scalability. The reason lies in the unique advantages that come from utilizing a hybrid cloud.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

MAY 2, 2023

That’s why it’s essential to implement the best practices and strategies for MongoDB database backups. Why are MongoDB database backups important? Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks.

Best Practices 52

Best Practices Database Storage Servers 52

Percona

FEBRUARY 24, 2023

In the Home Dashboard of PMM, a low CPU utilization on any of the database services that are being monitored could mean that the server is inactive or over-provisioned. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2.

Cloud 122

Cloud Serverless AWS Storage 122

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications.

Scalability 167

Scalability Database Ecommerce Latency 167

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Database monitoring Once more, under Applications & Microservices, we’ll also find Databases.

Metrics 170

Metrics Monitoring Database Network 170

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Strategic allocation of these resources plays a crucial role in achieving scalability, cost savings, improved performance, and staying ahead of advancements in the field.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters.

Systems 334

Systems Traffic Architecture Mobile 334

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 202

Java Scalability Traffic Architecture 202

KeyCDN

FEBRUARY 22, 2023

Cloud-based development and deployment One of the main advantages of cloud-based development and deployment is scalability. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Smashing Magazine

AUGUST 3, 2023

It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site. While paid marketing strategies like Google Ads play a part in our approach as well, enhancing our organic traffic remains a major priority. The higher our organic traffic, the more profitable we become as a company.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

OCTOBER 2, 2017

Today marks the 10 year anniversary of Amazon's Dynamo whitepaper , a milestone that made me reflect on how much innovation has occurred in the area of databases over the last decade and a good reminder on why taking a customer obsessed approach to solving hard problems can have lasting impact beyond your original expectations.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

JUNE 21, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. Comments ().

Games 142

Games Scalability AWS Database 142

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform is a revolution in the way we handle infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform is a revolution in the way we handle infrastructure.

Open Source 40

Open Source DevOps AWS Azure 40

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. Part 3 : Models, Admin, And Harnessing The Relational Database. Imagine a professional networking site with a database of users. Part 2 : Templating Saves Lines.

Media 69

Media Cache Storage AWS 69

KeyCDN

OCTOBER 31, 2018

PHPStorm PHPStorm streamlines application development by offering integration with relational databases and other PHP tools. AWS Cloud 9 AWS Cloud 9 is ideal for developing PHP applications completely in the cloud. PHPUnit is particularly useful for consistency and scalability testing.

Development 57

Development Open Source Java AWS 57

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Resource consumption & traffic analysis. Database & functional migration. How much traffic is sent between two processes hosting a certain service?

Cloud 31

Cloud Traffic Database Network 31

All Things Distributed

NOVEMBER 21, 2017

Amazon ElastiCache embodies much of what makes fast data a reality for customers looking to process high volume data at incredible rates, faster than traditional databases can manage. Since then, we have added support for Redis clusters, enabling customers to run faster and more scalable workloads.

Games 112

Games Retail Latency Education 112

Enprowess

JANUARY 12, 2022

According to Ericsson’s analysis, international mobile data traffic is projected to become 4.5 Use in traffic systems: Using IoT technology, delivery, traffic or transportation tracking, asset tracking, inventory control, customer management, and individual order tracking can be more cost-effective with the right tracking system.

Blockchain 59

Blockchain IoT Development Serverless 59

Tech News Gather

JUNE 16, 2023

Ensure scalability and performance optimization: As your clone app gains popularity and attracts more users, scalability and performance optimization become crucial. Choose a robust technology stack that can handle high traffic and accommodate future growth. Evaluate your resources and timeline to make an informed decision.

Social Media 52

Social Media Tuning Strategy Media 52

All Things Distributed

APRIL 11, 2012

Werner Vogels weblog on building scalable and robust distributed systems. And like most AWS services, Amazon CloudSearch scales automatically as your data and traffic grow, making it an easy choice for applications small to large. Amazon CloudSearch is itself built on AWS, which enables it to handle scale. Comments ().

Cloud 149

Cloud AWS Technology Technology 149

Smashing Magazine

JANUARY 7, 2019

For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Representational State Transfer ( REST ) is a well-established, logical choice: it defines a set of constraints that developers follow to make content accessible in a performant, reliable and scalable fashion.

Performance 104

Performance Cache Metrics Network 104