All Things Distributed

MAY 19, 2017

It gave us the opportunity to invent a new database architecture that would address to needs of modern cloud-scale applications, departing from the traditional approaches that had their roots in the databases of nineties. That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL.

Database 120

Database Design Cloud Storage 120

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda?

Lambda 181

Lambda AWS Serverless Hardware 181

The Netflix TechBlog

APRIL 17, 2019

Netflix headquarters circa 2014. It’s a nice building with good architecture! Since that time, Intel’s and Netflix’s teams closely collaborated on SVT-AV1 development, discussing architectural decisions, implementing new tools, and improving the compression efficiency.

Open Source 166

Open Source Scalability Speed Efficiency 166

Brendan Gregg

JULY 2, 2021

The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed. For a more recent example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2 at the time.

Latency 145

Latency Cache Energy Systems 145

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Adrian Cockcroft

MARCH 24, 2020

My 2014 re:Invent talk provides a structured basis for covering all the aspects of cost optimization, although some of the examples are now out of date. link] My old friend Constantin Gonzales (we worked together over 20yrs ago at Sun) has a regular presentation at re:Invent on running Lean Architectures, with a customer appearance by HERE.

Cloud 52

Cloud Social Media Healthcare Entertainment 52

Uber Engineering

FEBRUARY 22, 2018

In 2014, Uber Engineering built Schemaless , our fault-tolerant and scalable datastore, to facilitate the rapid growth of our company. For context, we deployed more than 40 Schemaless instances and many thousands of storage nodes in 2016 alone.

Code 94

Code Storage Scalability Engineering 94

Uber Engineering

JUNE 23, 2016

In 2014, Uber began expanding ever rapidly. Our platform grew from about 60 cities to 100 in the spring, and then to 200 in the fall. Meanwhile, our fastest growing cities were among our oldest.

Engineering 102

Engineering Architecture 102

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

SEPTEMBER 26, 2014

Be sure to bring your questions about AWS architecture, cost optimization, services and features, and anything else AWS-related. Topics include Introduction to AWS, Big Data, Compute & Networking, Architecture, Mobile & Gaming, Databases, Operations, Security, and more. When: October 1, 2014 at 6:30 -8:00 PM.

AWS 113

AWS Games Education Innovation 113

Uber Engineering

JANUARY 12, 2016

The making of Schemaless, Uber Engineering’s custom designed datastore using MySQL, which has allowed us to scale from 2014 to beyond. By Jakob Holdgaard Thomsen. This is part one of a three-part series on Schemaless.

Scalability 102

Scalability Design Engineering Database 102

Dynatrace

MAY 7, 2019

It was around 2011 that PaaS software projects started as open instead of closed – think of OpenShift (2011), Cloud Foundry (2011), or Kubernetes (2014). The complexities of today’s world are too big for just one company.

Open Source 113

Open Source DevOps Innovation Infrastructure 113

Adrian Cockcroft

MARCH 24, 2020

My 2014 re:Invent talk provides a structured basis for covering all the aspects of cost optimization, although some of the examples are now out of date. link] My old friend Constantin Gonzales (we worked together over 20yrs ago at Sun) has a regular presentation at re:Invent on running Lean Architectures, with a customer appearance by HERE.

Cloud 40

Cloud Social Media Healthcare Entertainment 40

Adrian Cockcroft

JANUARY 31, 2023

I had also turned down a job offer at that time, and when I called back in 2004 they took me on as a Distinguished Engineer in their Operations Architecture team. In fact, for the rest of my career, I’ve been telling stories about how we did things at Netflix between 2007 and when I left in 2014.

Google 52

Google Transportation Programming Innovation 52

Uber Engineering

JANUARY 19, 2016

The details and examples of Schemaless triggers, a key feature of the datastore that’s kept Uber Engineering scaling since October 2014.

Engineering 89

Engineering Design Database Architecture 89

O'Reilly

APRIL 23, 2024

But in 2013 and 2014, it remained stuck at 83% , and while in the ten years since, it has reached 95% , it had become clear that the easy money that came from acquiring more users was ending. Google, for example, invented the Large Language model architecture that underlies today’s disruptive AI startups. The market was maturing.

Social Media 108

Social Media Google Internet Internet 108

ACM Sigarch

MARCH 18, 2019

He is a fellow of IEEE and the ACM, serves as Chair of the Computer Community Consortium (2018-20) and served as Wisconsin Computer Sciences Department Chair 2014-17. Disclaimer: These posts are written by individual contributors to share their thoughts on the Computer Architecture Today blog for the benefit of the community.

Systems 60

Systems Latency Performance Analytics 60

ACM Sigarch

MARCH 25, 2019

He is a fellow of IEEE and the ACM, serves as Chair of the Computer Community Consortium (2018-20) and served as Wisconsin Computer Sciences Department Chair 2014-17. Disclaimer: These posts are written by individual contributors to share their thoughts on the Computer Architecture Today blog for the benefit of the community.

Systems 53

Systems Latency Performance C++ 53

Brendan Gregg

JULY 2, 2021

The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed. As an extreme example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2 It depends on the tool. at the time.

Open Source 40

Open Source Latency Cache Energy 40

Dynatrace

AUGUST 11, 2022

The FaaS model of cloud computing debuted in 2014 with startups like hook.io. FaaS vs. monolithic architectures. Monolithic architectures were commonplace with legacy, on-premises software solutions. Because a third party manages part of the infrastructure, IT teams give up a measure of control over system architecture.

Development 252

Development Serverless Best Practices Lambda 252

SQL Performance

FEBRUARY 1, 2022

Everything else I’ll cover in the series requires knowing some of the architecture of the transaction log, so that’s what I’m going to discuss this time. Prior to SQL Server 2014, when the log file auto grows, the number of new VLFs added to the end of the log file is determined by the algorithm above, based on the auto-grow size.

Architecture 53

Architecture Servers Virtualization Database 53

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. From Reloaded to Cosmos Reloaded Starting in 2014, we developed and operated the video processing pipeline on our third-generation platform Reloaded. The microservice architecture provides strong decoupling between services.

Processing 229

Processing Media Latency Innovation 229

Dynatrace

JULY 13, 2020

The bold ones were building distributed architectures using SOA, trying to implement ESBs and this all looked good on paper but ended up being difficult to implement. . ? Containers and Microservices: R evolution in the architecture of distributed systems . ? But a perfect storm was brewing on the horizon. Cloud-native?

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

The bold ones were building distributed architectures using SOA, trying to implement ESBs and this all looked good on paper but ended up being difficult to implement. . ? Containers and Microservices: R evolution in the architecture of distributed systems . ? But a perfect storm was brewing on the horizon. Cloud-native?

Google 130

Google Ecommerce DevOps Cloud 130

Percona

JULY 30, 2018

Please join Percona’s CEO, Peter Zaitsev as he presents Using MySQL for Distributed Database Architectures on Tuesday, July 31st, 2018 at 7:00 AM PDT (UTC-7) / 10:00 AM EDT (UTC-4). Such architectures bring many benefits (such as scalability and resiliency), but can also bring a lot of pain if incorrectly designed and executed.

Architecture 41

Architecture Database Open Source Internet 41

Dynatrace

MAY 31, 2021

Since Kubernetes emerged in 2014, it has become a popular solution for scaling, managing, and automating the deployments of containerized applications in distributed environments. Containers and microservices: A revolution in the architecture of distributed systems. Distributed.

Virtualization 133

Virtualization DevOps Infrastructure Cloud 133

Brendan Gregg

MAY 16, 2017

When I joined Netflix in April 2014, we had over 40 million subscribers in 41 countries. You might imagine that at some point we had a major scaling crises, where it looked like we'd fail due to an architectural bottleneck, and engineers worked long nights and weekends to save Netflix from certain disaster.

Java 75

Java Entertainment Engineering Scalability 75

Brendan Gregg

NOVEMBER 29, 2017

It's all a bit confusing, and I wrote about this in 2014: [Xen Modes]. When I joined Netflix in 2014, we had begun transitioning from PV to HVM (PVHVM). I previously posted [The PMCs of EC2: Measuring IPC], covering the architectural set of PMCs that were recently exposed to certain instance types in EC2.

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

FEBRUARY 20, 2019

For more information on the background and architecture of Vector and PCP, you can see our earlier tech blog post “ Introducing Vector ”. Having the right metrics available on demand and at a high resolution is key to understanding how a system behaves and helps to quickly troubleshoot performance issues.

Performance 211

Performance Latency Open Source Metrics 211

All Things Distributed

JULY 20, 2015

Today, I want to explore the Amazon ECS architecture and what this architecture enables. This architecture affords Amazon ECS high availability, low latency, and high throughput because the data store is never pessimistically locked. Below is a diagram of the basic components of Amazon ECS: How we coordinate the cluster.

Latency 166

Latency Architecture AWS Open Source 166

Dynatrace

FEBRUARY 25, 2021

Since its introduction by AWS in 2014, AWS Lambda has revolutionized the compute space and boosted the entire serverless movement. Distributing accounts across the infrastructure is an architectural decision, as a given account often has similar usage patterns, languages, and sizes for their Lambda functions. Dynatrace news.

Lambda 220

Lambda AWS Monitoring Serverless 220

Alex Podelko

NOVEMBER 21, 2018

In 2014, I was preparing a presentation about load testing tools and criteria for their selection. Even stellar performance in production and a highly scalable architecture don’t guarantee that it won’t crash under a slightly higher load. It appears that Apache JMeter became the most popular load testing tool.

DevOps 113

DevOps Testing Testing Tools Performance Testing 113

Brendan Gregg

NOVEMBER 28, 2017

It's all a bit confusing, and I wrote about this in 2014: [Xen Modes]. When I joined Netflix in 2014, we had begun transitioning from PV to HVM (PVHVM). I previously posted [The PMCs of EC2: Measuring IPC], covering the architectural set of PMCs that were recently exposed to certain instance types in EC2.

Virtualization 40

Virtualization AWS Hardware Storage 40

Abhishek Tiwari

NOVEMBER 3, 2018

When it comes to innovation, most of CMS solutions are constrained by their legacy architecture (read strong coupling between content management and content presentation) which makes it difficult to serve content to new types of emerging channels such as apps and devices.

Systems 63

Systems Cache Website Network 63

SQL Server According to Bob

SEPTEMBER 26, 2016

As we moved towards SQL Server 2014, the pace of hardware accelerated. Our design for SQL Server 2012 and SQL Server 2014 is still proven and meets the demands for many of our customers. First, we looked at the overall architecture of the replica design. The X axis is the number of concurrent users as we pushed the workload.

Availability 40

Availability Servers Hardware Benchmarking 40

Enprowess

JANUARY 11, 2022

React is too unopinionated i.e. it is concerned with only view layer in MVC architecture. From MVC architecture to routers and data layers to testing tools, all is built into the application by default. Framework doesn’t provide a clear structure hence architecture is unclear sometimes. Material-UI.

Virtualization 64

Virtualization Website Speed Mobile 64