InfoQ

APRIL 15, 2024

At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. He specifically delved into Venice DB, the NoSQL data store used for feature persistence. The presenter shared the lessons learned from evolving and operating the platform, including cluster management and library versioning.

Artificial Intelligence 105

Artificial Intelligence Big Data Data Engineering Latency 105

InfoQ

APRIL 25, 2024

Jenna Zeigen discusses front-end performance issues encountered by Slack as they continue to grow and evolve the desktop app. By Jenna Zeigen

Performance 90

Performance Design Scalability Architecture 90

InfoQ

MARCH 7, 2024

Uber replaced a legacy architecture built using the WAMP protocol with a new solution that takes advantage of GraphQL subscriptions. The main drivers for creating a new architecture were challenges around reliability, scalability, observability/debugibility, as well as technical debt impeding the team’s ability to maintain the existing solution.

Scalability 125

Scalability Architecture Design Development 125

InfoQ

APRIL 12, 2024

Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering. By Yao Yue

Engineering 99

Engineering Performance Design Scalability 99

InfoQ

DECEMBER 29, 2023

Zendesk reduced its data storage costs by over 80% by migrating from DynamoDB to a tiered storage solution using MySQL and S3. The company considered different storage technologies and decided to combine the relational database and the object store to strike a balance between querybility and scalability while keeping the costs down.

Storage 133

Storage Scalability Database Technology 133

InfoQ

FEBRUARY 6, 2024

Uber created a new load-shedding library for its microservice platform, serving over 130 million customers and handling aggregated peaks of millions of requests per second (RPSs).

Latency 111

Latency Availability Design Scalability 111

InfoQ

APRIL 26, 2024

Lily Mara, Hunter Laine walk through the design of a system, its performance characteristics, and how they scaled it. By Lily Mara, Hunter Laine

Design 62

Design Systems Performance Scalability 62

InfoQ

MARCH 20, 2024

Expedia made flight search faster by up to 52% (page usable time) by applying a range of optimizations to web and mobile applications. To support these improvements, the company improved the observability of its applications.

Speed 84

Speed Mobile Architecture Tuning 84

InfoQ

JANUARY 29, 2024

RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 billion daily API requests. The team at RevenueCat created an open-source memcache client that provides several advanced features.

Cache 104

Cache Open Source Availability Performance 104

InfoQ

APRIL 10, 2024

As part of the Super Bowl marketing campaign, Duolingo sent out 4 million mobile push notifications when the company’s five-second ad aired during the commercial break. At QCon London, Doulingo’s engineers presented the asynchronous AWS architecture responsible for broadcasting messages to millions of users across seven US cities.

AWS 70

AWS Architecture Mobile Engineering 70

InfoQ

FEBRUARY 11, 2024

Pinterest open-sourced its generic PubSub client library, PSC, which has been heavily used in production for a year and a half. The library helped the engineering teams by increasing developer velocity, and the scalability and stability of services using it. Over 90% of Java applications have migrated to PSC with minimal changes. By Rafal Gancarz

Open Source 98

Open Source Java Scalability Engineering 98

InfoQ

APRIL 17, 2024

During the recent QCon London conference, Trainline’s CTO spoke about the evolution of the company’s system architecture and organizational structure over the last five years. The company had to adapt to market changes and growing customer expectations by improving the performance and reliability of its technology platform. By Rafal Gancarz

Architecture 62

Architecture Technology Technology Systems 62

InfoQ

MARCH 16, 2024

Alex Dubrouski, Gaojie Liu discuss some of the tricks used in their pursuit to lower read latency and to reach 1M operations per second per node. By Alex Dubrouski, Gaojie Liu

Latency 83

Latency Design Scalability Architecture 83

InfoQ

NOVEMBER 8, 2023

AWS published a new set of updates to its Well-Architected Framework, with changes across all six pillars of the framework. The performance efficiency and operational excellence pillars have been restructured and consolidated to reduce the number of best practices.

AWS 121

AWS Best Practices Architecture Efficiency 121

InfoQ

JANUARY 12, 2024

The team at lastminute.com rearchitected the search result aggregation process by breaking up the single service into multiple ones and introducing asynchronous integration. Developers used RabbitMQ for messaging and Redis for storing results from data suppliers.

Scalability 102

Scalability Architecture Processing Development 102

InfoQ

NOVEMBER 15, 2023

Microsoft recently announced a comprehensive refresh of the Well-Architected Framework (WAF) for designing and running optimized workloads on Azure. By Steef-Jan Wiggers

Azure 116

Azure Design Best Practices Architecture 116

InfoQ

NOVEMBER 30, 2023

John Spray describes an experience of building high performance systems with C++20 in an asynchronous runtime, and explores the challenges & tradeoffs in adopting a thread-per-core architecture. By John Spray

Performance 109

Performance C++ Architecture Systems 109

InfoQ

JANUARY 26, 2024

Discord optimized its platform to serve over one million online users in a single server while maintaining a responsive user experience.

Servers 102

Servers Tuning Scalability Performance 102

InfoQ

OCTOBER 28, 2023

DoorDash rearchitected the heterogeneous caching system they were using across all of their microservices and created a common, multi-layered cache providing a generic mechanism and solving a number of issues coming from the adoption of a fragmented cache. By Sergio De Simone

Cache 108

Cache Scalability Performance Systems 108

InfoQ

DECEMBER 8, 2023

AWS recently announced the preview of Amazon Aurora Limitless Database, a new capability supporting automated horizontal scaling to process millions of write transactions per second and manage petabytes of data in a single Aurora database. By Steef-Jan Wiggers

Database 99

Database AWS Processing Availability 99

InfoQ

MARCH 15, 2024

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing. By Rafal Gancarz

Scalability 70

Scalability AWS Architecture Lambda 70

InfoQ

DECEMBER 4, 2023

LinkedIn was able to dramatically improve the scalability and performance of its Espresso database by migrating it from HTTP1.1 to HTTP2, resulting in a reduction in the number of connections, latency, and garbage collection times. To achieve these gains, the team had to optimize the Netty’s default HTTP2 stack to make it fit their needs.

Latency 98

Latency Scalability Database Performance 98

InfoQ

OCTOBER 20, 2023

Contentsquare needed notification functionality for many use cases within its platform. The company created a generic solution spanning multiple services as part of its microservice architecture. During the implementation, the developers had to improve observability and overcome some scalability challenges. By Rafal Gancarz

Scalability 104

Scalability Architecture Development Design 104

InfoQ

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator. By Rogerio Robetti

Design 144

Design Systems Storage Data Engineering 144

InfoQ

OCTOBER 14, 2023

Google recently announced various improvements to Cloud Spanner, its distributed, decoupled relational database service with a “50% increase in throughput and 2.5 times the storage per node than before” without a price change. By Steef-Jan Wiggers

Google 99

Google Storage Cloud Database 99

InfoQ

OCTOBER 4, 2023

During the second day of QCon San Francisco 2023, Yao Yue, a Founder of IOP Systems, presented on performance engineering. Yue discussed in her session the evolving performance engineering in the modern era.

Engineering 100

Engineering Performance Hardware Systems 100

InfoQ

FEBRUARY 29, 2024

Billy Lynch, Zack Newman discuss the architecture and internals of Sigstore and keyless signing, along with the security considerations that drove the design. By Billy Lynch, Zack Newman

Infrastructure 67

Infrastructure Scalability Software Software 67

InfoQ

MARCH 26, 2024

Lesley Cordero focuses on how Platform Engineering can drive sustainability for growing organizations through DevOps principles, centralization, and scalable technical practices. By Lesley Cordero

Engineering 57

Engineering DevOps Scalability Performance 57

InfoQ

OCTOBER 7, 2023

To improve how they ship software in a scalable and effective way, GitHub has adopted GitHub Actions for a part of their continuous integration system. In particular, they leveraged the new Actions larger runners to get to run 15,000 CI jobs across 150,000 cores. In the process they also extended larger runners capabilities for all their users.

Scalability 91

Scalability Software Software Systems 91

InfoQ

SEPTEMBER 25, 2023

When it comes to deploying Large Language Models (LLMs) in production, the two major challenges originate from the huge amount of parameters they require and the necessity of handling very long input sequences to represent contextual information.

Data Engineering 93

Data Engineering Scalability Engineering Development 93

InfoQ

SEPTEMBER 11, 2023

LinkedIn developed a new open-source service called "iris-message-processor" to enhance the performance and reliability of its existing Iris escalation management system. iris-message-processor" significantly improves processing speeds, being ~4.6x faster under average loads and ~86.6x faster under high loads than its predecessor.

Open Source 95

Open Source Speed Systems Processing 95

InfoQ

MAY 15, 2023

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 110

Storage Systems Scalability Cloud 110

InfoQ

FEBRUARY 5, 2024

Surabhi Diwan discusses how the Netflix’ membership team outgrew many of its technology and architectural choices as memberships went from a few hundred thousand to 200 million. By Surabhi Diwan

Architecture 65

Architecture Technology Technology Design 65

InfoQ

FEBRUARY 1, 2024

Peter Lawrey discusses achieving vertical scalability by minimizing accidental complexity and using an event-driven architecture. By Peter Lawrey

Scalability 73

Scalability Efficiency Systems Architecture 73

InfoQ

NOVEMBER 29, 2023

HubSpot adopted routing messages over multiple Kafka topics (called swimlanes) for the same producer to avoid the build-up in the consumer group lag and prioritize the processing of real-time traffic.

Processing 77

Processing Traffic Data Engineering Scalability 77

InfoQ

AUGUST 7, 2023

Uber released a major version of its workflow orchestration platform named Cadence after six years in development. Uber and other companies use Cadence to build stateful services at scale using native programming languages. By Rafal Gancarz

Scalability 88

Scalability Programming Development Design 88

InfoQ

APRIL 18, 2023

Slack recently described how it sends millions of messages daily in real-time across the globe. The company provides a comprehensive insight into its architecture, designed to manage real-time messages at scale.

Architecture 101

Architecture Design Infrastructure Engineering 101