The Netflix TechBlog

AUGUST 30, 2021

The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Hardware 213

Dynatrace

NOVEMBER 10, 2022

To take full advantage of the scalability, flexibility, and resilience of cloud platforms, organizations need to build or rearchitect applications around a cloud-native architecture. So, what is cloud-native architecture, exactly? What is cloud-native architecture? The principles of cloud-native architecture.

Cloud 162

Cloud Architecture Serverless Infrastructure 162

High Scalability

JULY 20, 2018

That’s mapping applications to the specific architectural choices. The third wing of the architecture piece is the “domain specific system-on-chip.” And you already see that in machine learning, where there’s a really hot field in terms of deep neural nets and other implementations. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

SQL Performance

JULY 8, 2021

Searching is everywhere on the internet. That kind of feedback is necessary to help build maintainable, scalable solutions. Michael J Swart is a passionate database professional and blogger who focuses on database development and software architecture. Searching Text For Substring. About the Author.

Design 92

Design Software Architecture Database Servers 92

High Scalability

AUGUST 3, 2018

Use Multi-AZ deployments for High Availability and Read Replica for read scalability. Stacey Higginbotham : a startup in France called GreenWaves Technologies has built a dedicated chip for the Internet of Things. You can further set up a cross-region read replica for disaster recovery. million (US $3.6

Internet 113

Internet Internet Scalability Blockchain 113

High Scalability

JUNE 15, 2018

JoeEmison : Another thing that serverless architectures change: how do you software development. The end of Dennard Scaling and Moore's Law means architecture is where we have to innovate to improve performance, cost, and energy. Domain Specific Architectures are getting 20x and 40x improvements, not just 5-10%. Hungry for more?

Internet 113

Internet Internet Scalability Blockchain 113

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. DNS is an absolutely critical piece of the internet infrastructure. All Things Distributed. Comments ().

Cloud 117

Cloud Internet Internet AWS 117

Alex Podelko

OCTOBER 28, 2016

– New Architectures. With quick internet growth and the popularity of browser-based clients, most products support only HTTP or a few select web-related protocols. I decided to publish a few parts here to see if anything triggers a discussion. It would be published as separate posts: – Introduction (a short teaser).

Performance Testing 100

Performance Testing Technology Technology Testing 100

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Jul 20 - Disco: Running Commodity Operating Systems on Scalable Multiprocessors by Edouard Bugnion, Scott Devine, Kinshuk Govil, Mendel Rosenblum in the Proceedings of the 16th ACM Symposium on Operating Systems Principles, October 5-8, 1997, St. Comments ().

Operating System 144

Operating System Cache AWS Scalability 144

High Scalability

NOVEMBER 14, 2018

It discusses how these new systems treat the datacenter itself as one massive computer designed at warehouse scale, with hardware and software working in concert to deliver good levels of internet service performance. At 189 pages it's not exactly light reading, but it's packed with information you can't find anywhere else.

Design 54

Design Education Google Internet 54

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. Field personnel with mobile devices can send these messages over the Internet to the cloud service.

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. Field personnel with mobile devices can send these messages over the Internet to the cloud service.

Logistics 52

Logistics Analytics Scalability Cloud 52

All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. This team is constantly rethinking the assumptions behind how traditional databases were built and constantly working on building the right database architectures suited for the Cloud environment. All Things Distributed. Comments (). All postings. Recent Entries.

AWS 75

AWS Database Storage Scalability 75

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. All Things Distributed. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Visiting future customers is equally exiting as you get a change to understand their current architecture, if it is a migration, and how they plan to exploit cloud services in their new setup. All Things Distributed. Around the World in 28 Days. Comments ().

AWS 75

AWS Storage Cloud Best Practices 75

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. I’d helped eBay recover from capacity related outages in 1999 and had setup their capacity planning processes.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Highly Scalable

AUGUST 20, 2013

The whole point of this section is that all the algorithms above can be naturally implemented using a message passing architectural style i.e. the query execution engine can be considered as a distributed network of nodes connected by the messaging queues. For example, consider a system that counts unique visitors on some internet site.

Big Data 154

Big Data Processing Lambda Database 154

VoltDB

JUNE 1, 2017

Bear in mind that the internet currently takes 4ms from New York to Philadelphia. Instead of having a private cloud architecture that’s cookie-cuttered to multiple locations, we’ll need centralized management of herds of up to 1,000 private clouds. Some of these will serve large urban areas and will be sensitive to efficiency.

Hardware 56

Hardware Latency Virtualization Cloud 56

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use.

Systems 334

Systems Traffic Architecture Mobile 334

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications.

Scalability 167

Scalability Database Ecommerce Latency 167

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It can receive telemetry from retail stores over the Internet using event delivery systems such as Azure IoT Event Hub, AWS, Kafka, and REST, and it can respond back to the retail stores in milliseconds.

Logistics 52

Logistics Retail Analytics Azure 52

The Netflix TechBlog

SEPTEMBER 13, 2021

Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers. Our second observation centered on strong authentication as our highest-leverage control.

Internet 220

Internet Internet Cloud Traffic 220

Dynatrace

JUNE 9, 2021

Especially as software development continually evolves using microservices, containerized architecture, distributed multicloud platforms, and open-source code. Whether the process is exposed to the Internet. The Dynatrace OneAgent has been proven to be scalable and high-performing in the largest enterprises in the world.

Open Source 178

Open Source Entertainment Tuning Internet 178

VoltDB

JUNE 1, 2017

Bear in mind that the internet currently takes 4ms from New York to Philadelphia. Instead of having a private cloud architecture that’s cookie-cuttered to multiple locations, we’ll need centralized management of herds of up to 1,000 private clouds. Some of these will serve large urban areas and will be sensitive to efficiency.

Hardware 40

Hardware Latency Virtualization Cloud 40

High Scalability

NOVEMBER 16, 2018

The idea of running a complex, distributed architecture like a private cloud at the same or higher stability and comparable or even lower cost than public clouds eventually proved futile. Doubleslash : Back in 2014 OpenStack may have been a thing but nowadays, 4 years later, people learned a lesson. How many quotes are there do you think?

Internet 28

Internet Internet Scalability Energy 28

Dynatrace

DECEMBER 8, 2020

It inherits the automation, AI, scalability, and enterprise-grade robustness of the Dynatrace platform. With new RASP capabilities of the Dynatrace OneAgent, the same trusted approach extends the Dynatrace platform to application security: automatic, intelligent, highly scalable. Is it exposed to the public Internet?

Cloud 284

Cloud Open Source Internet Internet 284

High Scalability

SEPTEMBER 28, 2018

Martin Sústrik : Philosophers, by and large, tend to be architecture astronauts. Programmers' insight is that architecture astronauts fail. And the sense that you have to be here or you can’t play is going to start diminishing. There more.

Internet 35

Internet Internet Scalability Blockchain 35

Percona

JULY 17, 2023

DBAs and developers appreciate its combination of flexibility, scalability, and performance. A survey of 90,240 companies using MongoDB listed the leading uses as Technology and Services (23%), Computer Software (16%), and Internet (6%). It’s an open source distributed NoSQL database that offers high scalability and availability.

Open Source 77

Open Source Database Scalability Software 77

Percona

JULY 30, 2018

Please join Percona’s CEO, Peter Zaitsev as he presents Using MySQL for Distributed Database Architectures on Tuesday, July 31st, 2018 at 7:00 AM PDT (UTC-7) / 10:00 AM EDT (UTC-4). Such architectures bring many benefits (such as scalability and resiliency), but can also bring a lot of pain if incorrectly designed and executed.

Architecture 41

Architecture Database Open Source Internet 41

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database.

Database 167

Database Lambda AWS IoT 167

Percona

MAY 15, 2023

Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition. As said, the last one is probably the most powerful, scalable, and difficult to design, and unfortunately, it represents probably less than 5% of the solution currently deployed.

Traffic 125

Traffic Scalability Database Servers 125

ScaleOut Software

JANUARY 28, 2021

Given the unique and highly dynamic nature of this challenge, we need software solutions that are agile enough to adapt to evolving needs and scalable enough to quickly handle a daunting amount of fast-changing data. Conventional, enterprise data architectures take months to develop and are complex to change.

Logistics 84

Logistics Airlines Analytics Ecommerce 84

Percona

JUNE 22, 2023

Database downtime can hurt or doom any company with anything to do with the internet. It also supports the flexibility and scalability of the database infrastructure. When planning your database HA architecture, the size of your company is a great place to start to assess your needs.

Availability 109

Availability Database Open Source Hardware 109