The Netflix TechBlog

OCTOBER 15, 2019

Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2]. By their nature, they can only rely on the lowest common denominator of participating systems. That system quickly grew very complex and became difficult to maintain.

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

SEPTEMBER 5, 2013

Over the past few years, two important trends that have been disrupting the database industry are mobile applications and big data. The explosive growth in mobile devices and mobile apps is generating a huge amount of data, which has fueled the demand for big data services and for high scale databases.

Big Data 98

Big Data Mobile Latency Database 98

Testsigma

MAY 7, 2020

IBM Big Data and Analytics Hub website cited a case study, where a US insurance company was estimating 15% of their testing efforts to be just test data collection for the backend system and the frontend system. The test data management for the company had become a big problem and had to be solved.

Testing 60

Testing Storage Database Processing 60

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. There are many success stories about the effectiveness of caching in many different scenarios; next to helping applications achieving fast and predictable performance, it often protects databases from requests bursts and brownouts under overload conditions.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. There are sessions in many different categories: Architecture, Big Data, HPC, Computer & Networking, Storage, Databases, Security, Tools & Languages, Media Sharing & Content Delivery, Managing AWS Resources, Enterprise IT, Mobile, Start-up, and more.

AWS 83

AWS Big Data Media Storage 83

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements.

AWS 115

AWS Cloud Java Operating System 115

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Comments ().

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon S3 is much more than just storage; the network and distributed systems infrastructure to ensure that content can be served fast and at high rates without customers impacting each other, is amazing. All Things Distributed. Comments (). at 30,000 feet).

Servers 126

Servers Social Media AWS Website 126

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. AWS GovCloud (US) will be used by several of these agencies to help them with their Bigger-than-Big-Data needs.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Please also visit the AWS developer blog for more great stories from our South American customers. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving down the cost of Big-Data analytics.

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s Data is retrieved by scheduling a job, which typically completes within 3 to 5 hours. All Things Distributed.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

SEPTEMBER 29, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Like many folks who started down the path of using real-time micro-blogging services (read: twitter ) the convenience of those platforms has made that sharing happens there instead of on the blogs we (used to) keep. blog comments powered by Disqus.

AWS 69

AWS Storage Big Data Scalability 69

All Things Distributed

FEBRUARY 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. While cleaning out the digital attic I ran into this drawing that Hugh MacLeod (aka "gapingvoid") made for me in reponse to a storm-in-a-teacup about blogging Amazon. blog comments powered by Disqus. Driving down the cost of Big-Data analytics.

AWS 60

AWS Storage Big Data Scalability 60

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. For more details see the announcement , the details pages of the services at [link] , and the posting on the AWS developer blog. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Comments ().

AWS 104

AWS Retail Innovation Strategy 104

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services.

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

AWS 93

AWS Internet Internet Storage 93

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. DROAM - Dreaming about Cheap Data Roaming. The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. blog comments powered by Disqus. Job Openings in AWS - Senior Leader in Database Services.

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. More information can found on the Elastic Load Balancing and the Route 53 detail pages and on the two blog posts on the AWS developer blog. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Not just for HPC but for mission critical enterprise systems such as OLTP. Dedicated High Performance Compute clusters require significant capital investments and their procurement often has longer lead times than many enterprise class server systems.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Job Openings in AWS - Senior Leader in Database Services.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

JULY 3, 2011

Werner Vogels weblog on building scalable and robust distributed systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services.

AWS 67

AWS Storage Big Data Cloud 67

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services.

AWS 60

AWS Storage Cloud Big Data 60

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services.

AWS 75

AWS Storage Cloud Best Practices 75

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are four main reasons to do so: Performance - For many applications and services, data access latency to end users is important. You need to be able to place your systems in locations where you can minimize the distance to your most important customers.

AWS 61

AWS Cloud Latency Storage 61

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. End-to-End Schema Evolution Schema is a key component of Data Mesh.

Big Data 253

Big Data Government Analytics Processing 253

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. A wide variety of operating systems and software configurations is available for use. with more memory or CPU), a different operating system (e.g., with new security patches installed), or add new user data. blog comments powered by Disqus.

AWS 60

AWS Storage Operating System Cloud 60

The Netflix TechBlog

MARCH 25, 2019

Finally, imagine yourself in the role of a data platform reliability engineer tasked with providing advanced lead time to data pipeline (ETL) owners by proactively identifying issues upstream to their ETL jobs. Let’s review a few of these principles: Ensure data integrity ?—?Accurately Enable seamless integration?—?

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

All Things Distributed

DECEMBER 13, 2009

Werner Vogels weblog on building scalable and robust distributed systems. For more details and background information visit the Amazon EC2 Spot Instance detail page, the AWS developer blog and the good folks at RightScale. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

Cloud 63

Cloud AWS Storage Innovation 63

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Due to its popularity, the number of workflows managed by the system has grown exponentially.

Java 202

Java Scalability Traffic Architecture 202

Dynatrace

MARCH 11, 2021

It’s been a while since my last blog article on managing Dynatrace Managed at scale. In the fourth part of the series, I’ll show you how I used Dynatrace’s raw problem and event data to find the best fit for optimized anomaly detection settings. I took a big-data-analysis approach, which started with another problem visualization.

Tuning 262

Tuning Architecture Monitoring Big Data 262

The Netflix TechBlog

DECEMBER 21, 2020

Use cases We found several use cases where a system like AutoOptimize can bring tons of value. Some of the optimizations are prerequisites for a high-performance data warehouse. Sometimes Data Engineers write downstream ETLs on ingested data to optimize the data/metadata layouts to make other ETL processes cheaper and faster.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. appeared first on Dynatrace blog. From APM to full-stack monitoring. Download Magic Quadrant. The post What is APM?

Artificial Intelligence 181

Artificial Intelligence Social Media Monitoring IoT 181

Dynatrace

JUNE 29, 2022

A hybrid cloud, however, combines public infrastructure and services with on-premises resources or a private data center to create a flexible, interconnected IT environment. Hybrid environments provide more options for storing and analyzing ever-growing volumes of big data and for deploying digital services.

Infrastructure 179

Infrastructure Cloud Azure AWS 179

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. appeared first on Dynatrace blog. From APM to full-stack monitoring. You can download the report here.

Monitoring 132

Monitoring Performance Social Media Artificial Intelligence 132