The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind.

Database 197

Database Traffic Transportation Open Source 197

O'Reilly

APRIL 23, 2024

As the internet grew, the amount of information available to consumers became so vast that it outran traditional human means of curation and selection. By the end of 2012, it was up to 82%. Without app developers, there would be no App Stores; without users creating content as well as consuming it, no social media.

Social Media 108

Social Media Google Internet Internet 108

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. These are the apps that have motivated us to develop DAX.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. A deep dive on how we were using our existing databases revealed that they were frequently not used for their relational capabilities.

Internet 128

Internet Internet AWS Performance 128

Alex Russell

JULY 14, 2021

Developers also suffer higher costs and reduced opportunities to escape Google, Facebook, and Apple's walled gardens. Web engineers frequently refer to browsers as "User Agents", a nod to their unique role as interpreters of developer intent that give users the final say over how the web is experienced.

Google 121

Google Mobile Engineering Internet 121

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

The Agile Manager

JANUARY 31, 2014

The growth in demand for software has consistently outpaced the growth in the supply of software developers. Each major expansion in software development - automation (60s), productivity (80s), internet (90s), mobile (00s) - has been additive to the total stock of software in the world. It's worth looking at why.

Software 73

Software Software Development Government 73

All Things Distributed

FEBRUARY 15, 2013

Werner Vogels weblog on building scalable and robust distributed systems. s now available for all customers in the US East (N. This combination of in-cluster replication and continuous backup to Amazon S3 ensures you have a highly durable system. This is all entirely transparent to the running system. Comments ().

Design 110

Design AWS Storage Systems 110

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

SQL Performance

FEBRUARY 22, 2021

On the contrary, it is almost always because they have developed better and more modern ways to solve those same problems. The system table sys.sysprocesses was replaced way back in SQL Server 2005 by a set of dynamic management views (DMVs), most notably sys.dm_exec_requests , sys.dm_exec_sessions , and sys.dm_exec_connections.

Latency 57

Latency Servers Monitoring Systems 57

All Things Distributed

NOVEMBER 12, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 12 November 2012 05:00 AM. The Region launches with two Availability Zones to help customers build highly available applications. All Things Distributed. Expanding the Cloud â?? introducing the Asia Pacific (Sydney) Region.

Cloud 117

Cloud AWS Ecommerce Latency 117

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. We already have 44 Availability Zones across 16 geographic Regions that customers can use today. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 152

Cloud Education Energy Government 152

All Things Distributed

JUNE 21, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 21 June 2012 09:00 AM. ve already passed our 2012 targets. With DynamoDB, we were able to develop and test a new, high scale consumer application in just a few weeks. All Things Distributed. Comments (). In their own words: â??With

Games 142

Games Scalability AWS Database 142

ACM Sigarch

APRIL 26, 2018

The new DGX-2, which achieves 2 petaFLOPS in the system, combines 16 fully interconnected GPUS with 10x the deep learning performance. To my best knowledge, even though the term NPU was first mentioned in a MICRO 2012 paper by Hadi Esmaeilzadeh et al. , the first commercial product named after NPU in industry is from Vimicro in 2016.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

All Things Distributed

FEBRUARY 18, 2013

Werner Vogels weblog on building scalable and robust distributed systems. OpsWorks is designed for IT administrators and ops-minded developers who want an easy way to manage applications of nearly any scale and complexity without sacrificing control. All Things Distributed. By Werner Vogels on 18 February 2013 11:30 PM. Comments ().

AWS 157

AWS Cloud Architecture Infrastructure 157

All Things Distributed

FEBRUARY 22, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 22 February 2012 12:01 AM. Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. Application developers must coordinate multiple distributed components to get the desired results.

Cloud 130

Cloud AWS Java Scalability 130

All Things Distributed

NOVEMBER 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 November 2012 03:00 PM. Customers tell us they poll SQS quickly because they want to retrieve messages as soon as they become available. Shazam , developers of the mobile discovery app, report using SQS as a buffer for DynamoDB.

Efficiency 104

Efficiency Cloud Games Scalability 104

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. For example, find all books that are available in braille. Managing High Availability in PostgreSQL.

Storage 321

Storage Database Efficiency Processing 321

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 21 August 2012 12:01 AM. It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s provides highly available and highly durable (â??designed

Storage 122

Storage Cloud AWS Media 122

Alex Russell

MARCH 6, 2021

The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. Meanwhile, developer behaviour offers little hope: Median mobile JavaScript payloads have only grown since 2016, now hovering above 400KiB of script transferred, or nearly 2.5MiB of uncompressed JS. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 18 January 2012 07:00 AM. s Dynamo technology , which was one of the first non-relational databases developed at Amazon. All Things Distributed. Amazon DynamoDB â?? Comments (). History of NoSQL at Amazon â?? The growth of Amazonâ??s

Scalability 167

Scalability Database Ecommerce Latency 167

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. It's an exciting development in cloud computing: hardware virtualization is now fast. I've summarized hypervisor developments in EC2 with the above diagram.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

MARCH 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 20 March 2012 09:00 PM. Flexibility is in the choice of software and languages running on AWS, in the tools and interfaces available to manipulate resources and applications, and in the ability to leverage services from other providers.

AWS 104

AWS Scalability Java Storage 104

Smashing Magazine

JUNE 30, 2021

The web is streaming, meaning it has none of the resources locally available when you open an app for the first time. iOS empowers developers to easily parallelize code using Grand Central Dispatch , Android does this via their new, unified task scheduler WorkManager and game engines like Unity have job systems. Web Workers.

Games 145

Games Architecture Code C++ 145

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. By the way, for mission critical OLTP workloads, you should also consider adding the Amazon RDS Multi-AZ option to improve availability. All Things Distributed. Expanding the Cloud â?? Comments ().

Cloud 117

Cloud AWS Storage Database 117

Smashing Magazine

APRIL 1, 2020

In the end, youll have built a shopping cart using GraphCMS (a (backend-only content management system). A scalable, cross-platform content management system is crucial to ensuring a product’s growth velocity. A headless CMS gives developers the ability to harness creativity quickly. What Does This Look Like In Practice?

Open Source 103

Open Source Website Mobile Code 103

All Things Distributed

MAY 13, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 14 May 2012 12:01 AM. These performance optimizations are available for all types of content (static and dynamic) delivered via CloudFront. For more details, see the CloudFront detail page and the posting on the AWS developer blog.

Cache 117

Cache Latency AWS Website 117

Alex Russell

FEBRUARY 21, 2023

If you're a web developer not living under a rock, you undoubtedly got word of last week's big Safari 16.4 By mandating proof of developer enthusiasm for features, extensive test suites, and accurate specifications, the catch-up process has been put on rails for Apple. What choice do developers have, but to sit and stew?

Energy 79

Energy Games Engineering Design 79

Sutter's Mill

NOVEMBER 30, 2012

I said something similar to the above, but with two important differences: I said hardware “threads,” not only hardware “cores” – it was about the amount of hardware parallelism available on a mainstream system. Longer answer follows: Here’s the main part from article, “Design for Manycore Systems” (August 11, 2009).

Hardware 40

Hardware Programming Scalability Software 40

O'Reilly Software

OCTOBER 23, 2018

A look at the roles of architect and strategist, and how they help develop successful technology strategies for business. Technology systems are difficult to wrangle. Our systems grow in accidental complexity and complication over time. By 2012, Harvard Business Review published an article by Thomas Davenport and D.J.

Strategy 100

Strategy Architecture Technology Technology 100

Highly Scalable

MARCH 10, 2015

Most of this article represents an overview of the results published by retailers and researchers who built practical decision making and optimization systems combining abstract economic models with data mining methods. The most typical use cases for this problem are recommender systems, personalized search results ranking, and targeted ads.

Retail 152

Retail C++ Analytics Metrics 152

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 06 April 2012 06:00 AM. Recently I had great conversations with Troy Otillio, Senior Development Manager at Intuit and Jack Murgia, Senior DevOps Engineer at Edmodo. and took near zero development effort. All Things Distributed.

Innovation 146

Innovation AWS Education Network 146

Randon ASCII

MARCH 30, 2020

This is a good set of options for developing Chromium as it gives full debuggability together with a fast turnaround on incremental builds (when just a few source files are modified between builds). The colorful graphs of compile times ( live versions available here ) are interactive. enable_nacl = false # Disable NACL.

C++ 87

C++ Code Open Source Programming 87

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. It's an exciting development in cloud computing: hardware virtualization is now fast. I've summarized hypervisor developments in EC2 with the above diagram.

Virtualization 40

Virtualization AWS Hardware Storage 40

Smashing Magazine

APRIL 9, 2019

In those early days, libraries like script.aculo.us, Prototype and eventually jQuery began to gain adoption amongst developers looking to add more interactivity into their pages. Let’s imagine that it’s 2012 and everyone is using the brand new jQuery 1.8. What Could Go Wrong? That’s a big problem. Enter Subresource Integrity.

Website 57

Website Servers Code Best Practices 57

Alex Russell

AUGUST 20, 2015

In the heat of the ‘11–12 debate (“prefixpocalypse”) I tried to outline a hierarchy of the web platform needs: Meeting developer & user experience needs with new features. combined with an aversion to proprietary gunk by web developers?—? Not for web developers or browser makers (to say nothing of amorous teens).

Programming 54

Programming Google Infrastructure Engineering 54