InfoQ

APRIL 18, 2023

The company provides a comprehensive insight into its architecture, designed to manage real-time messages at scale. It highlights the unique challenges posed by delivering real-time messages across different time zones and regions and how Slack's engineers designed the infrastructure to handle them. By Eran Stiller

Architecture 101

Architecture Design Infrastructure Engineering 101

Strategic Tech

JULY 21, 2020

Most organisations go through an architecture modernisation effort at some point as their systems drift into a state of intolerable maintenance costs and they diverge too far from modern technological advances. Before jumping into either of those scenarios, have a look at what Strategic Domain-Driven Design can offer you.

Architecture 98

Architecture Design Software Architecture Strategy 98

Dynatrace

JUNE 2, 2022

Site reliability engineering (SRE) continues to gain popularity as organizations embrace hybrid cloud strategies and IT automation at scale. By applying software engineering principles to operations and infrastructure practices, SRE enables organizations to streamline and automate IT processes. Dynatrace news.

DevOps 147

DevOps Innovation Engineering Benchmarking 147

The Netflix TechBlog

JUNE 15, 2022

By Alex Hutter , Falguni Jhaveri , and Senthil Sayeebaba In a previous post , we described the indexing architecture of Studio Search and how we scaled the architecture by building a config-driven self-service platform that allowed teams in Content Engineering to spin up search indices easily.

Engineering 183

Engineering Architecture Availability Tuning 183

ACM Sigarch

OCTOBER 10, 2022

Although, only recently the security attacks on quantum computers have begun to be demonstrated, this brings to the forefront the need to consider security of quantum computer architectures as a first-class design objective. Why Research Security of Quantum Computers?

Architecture 72

Architecture Hardware Programming Cloud 72

InfoQ

APRIL 12, 2024

Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering. By Yao Yue

Engineering 99

Engineering Performance Design Scalability 99

The Netflix TechBlog

JUNE 1, 2021

Data Engineers of Netflix?—?Interview Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. What drew you to Netflix?

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

Uber Engineering

AUGUST 14, 2019

Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog. In our experience, optimizing for operational efficiency requires answering one key question: for which tables does the maintenance cost supersede utility?

Efficiency 110

Efficiency Engineering Design Storage 110

DZone

FEBRUARY 9, 2024

In the paradigm of zero trust architecture , Privileged Access Management (PAM) is emerging as a key component in a cybersecurity strategy, designed to control and monitor privileged access within an organization.

Strategy 183

Strategy Architecture Network Database 183

Testsigma

NOVEMBER 18, 2021

George Ukkuru is a seasoned technocrat and AVP of quality engineering, DevOps, and SRE @Marlabs Inc. He has also authored a number of books on quality engineering and test automation. API Tests are faster to design, execute and maintain. In this QnA, Ukkuru lays out the scope and depth of his experience without even trying.

Engineering 104

Engineering Social Media DevOps Azure 104

Uber Engineering

AUGUST 18, 2020

In October 2014, Uber had started its journey of scale in what … The post Designing Edge Gateway, Uber’s API Lifecycle Management Platform appeared first on Uber Engineering Blog. Evolution of Uber’s API gateway.

Design 144

Design Scalability Engineering Monitoring 144

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Options at each level offer significant potential benefits, especially when complemented by practices that influence the design and purchase decisions made by IT leaders and individual contributors.

Cloud 214

Cloud Energy Best Practices Cache 214

Dynatrace

MARCH 18, 2024

Following FinOps practices, engineering, finance, and business teams take responsibility for their cloud usage, making data-driven spending decisions in a scalable and sustainable manner. Suboptimal architecture design. Poorly designed cloud solutions can become costly over time.

Best Practices 237

Best Practices Strategy Cloud AWS 237

DZone

OCTOBER 11, 2022

Simpler UI Testing with CasperJS ( Architects Zone – Architectural Design Patterns & Best Practices). Using MongoDB as a cache store ( Architects Zone – Architectural Design Patterns & Best Practices). Why haven’t cash-strapped American schools embraced open source? Hacker News).

Java 244

Java Best Practices Google Analytics 244

The Netflix TechBlog

NOVEMBER 17, 2022

Our approach to NN-based video downscaling The deep downscaler is a neural network architecture designed to improve the end-to-end video quality by learning a higher-quality video downscaler. We employed an adaptive network design that is applicable to the wide variety of resolutions we use for encoding.

Network 292

Network Media Innovation Efficiency 292

Dynatrace

OCTOBER 9, 2020

Now you can: Understand the actual architecture of your applications in Kubernetes in real-time. Understand the architecture of your applications in Kubernetes in real-time. Online Boutique has been launched into a Kubernetes cluster that runs in Google Kubernetes Engine (GKE). Have ideas for further improvements?

Design 102

Design Google Architecture Traffic 102

Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications.

Cache 209

Cache Azure Infrastructure Monitoring 209

Dynatrace

JANUARY 23, 2024

What will the new architecture be? Session attendees will learn first-hand how Dynatrace natively integrates into the AWS Migration Hub to provide a full topology of on-prem workloads and dependencies in order to generate the ideal cloud-based architecture in the AWS cloud. What can we move?

Cloud 217

Cloud Artificial Intelligence Performance AWS 217

Dynatrace

NOVEMBER 2, 2023

Spiraling cloud architecture and application costs have driven the need for new approaches to cloud spend. The result is smarter, data-driven solutions designed to manage cloud spend. FinOps helps engineering, development, finance, and business teams meet critical key performance indicators (KPIs) and fulfill service-level agreements.

Cloud 201

Cloud Strategy Retail Energy 201

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 120

Database Design Cloud Storage 120

DZone

JULY 13, 2021

Experienced engineers used Perl scripts, vi, grep and awk to make log searches more efficient. These historical approaches worked for a different era of software applications: ones more monolithic in design, changing relatively infrequently (once every few weeks or months) and with only a handful of log types to monitor.

Google 255

Google Architecture Efficiency Cloud 255

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

MAY 24, 2023

Microsoft initially designed the OS for internal use to develop and manage Azure services. The core operating system has a lightweight footprint of only a few hundred MBs when uncompressed, yet it is powerful enough to support various profiles, including x64 or Arm64-based architectures. Why monitor Azure Linux container host for AKS?

Azure 231

Azure Monitoring Operating System Virtualization 231

DZone

DECEMBER 28, 2020

Performance testing is mainly a subset of Performance engineering and is also referred to as ' Perf Tests.' It is almost a part of the wider performance engineering portrait, concentrating on performance glitches in the architecture and design of any software.

Performance Testing 220

Performance Testing Testing Tools Testing Performance 220

Dynatrace

NOVEMBER 6, 2023

“Dynatrace provides improved visibility into the code running the OneStream platform on Microsoft Azure, enabling our engineering teams to constantly improve the user experiences our customers have grown to trust,” said Ryan Berry, SVP of Architecture at OneStream.

Azure 184

Azure Analytics Artificial Intelligence Innovation 184

Uber Engineering

FEBRUARY 2, 2023

In this blog post, discover how a team of Uber app engineers streamlined development with a new native mobile architecture, resulting in far fewer lines of code and allowing us to deliver more features faster than we ever thought possible.

Development 52

Development Design Mobile Architecture 52

Dynatrace

NOVEMBER 17, 2023

In the first blog post of this series , we explored how the Dynatrace ® observability and security platform boosts the reliability of Site Reliability Engineers (SRE) CI/CD pipelines and enhances their ability to focus on innovation. The below screenshot shows the code initiating the Jenkins job.

Innovation 228

Innovation Architecture Code Processing 228

O'Reilly Software

OCTOBER 23, 2018

I should start by saying this section does not offer a treatise on how to do architecture. Vitruvius and the principles of architecture. Architecture begins when someone has a nontrivial problem to be solved. Everyone who goes to architecture school learns his work. It must be useful, have utility.

Strategy 100

Strategy Architecture Technology Technology 100

InfoQ

APRIL 10, 2024

At QCon London, Doulingo’s engineers presented the asynchronous AWS architecture responsible for broadcasting messages to millions of users across seven US cities. As part of the Super Bowl marketing campaign, Duolingo sent out 4 million mobile push notifications when the company’s five-second ad aired during the commercial break.

AWS 70

AWS Architecture Mobile Engineering 70

ACM Sigarch

FEBRUARY 23, 2018

Engineers, like economists, deal with large amounts of data and pride ourselves on our clinical ability to analyze and solve complex problems. One of the premises expounded upon ( link ) is that engineering/computer science does not appeal to young women and they choose other careers. Hence the lack of women in our field.

Architecture 47

Architecture Cache Hardware Virtualization 47

Dynatrace

JULY 7, 2022

But as IT teams increasingly design and manage cloud-native technologies, the tasks IT pros need to accomplish are equally variable and complex. The framework forms the basis of the SAE (Society of Automotive Engineers) automation levels 1 through 5 for cars. Dynatrace news. Think’ with artificial intelligence. Act’ with AIOps.

Artificial Intelligence 185

Artificial Intelligence Automotive DevOps Infrastructure 185

Dynatrace

JANUARY 23, 2024

Composite’ AI, platform engineering, AI data analysis through custom apps This focus on data reliability and data quality also highlights the need for organizations to bring a “ composite AI ” approach to IT operations, security, and DevOps. To learn more about platform engineering, explore the following resources.

Performance 191

Performance DevOps Innovation Artificial Intelligence 191

Uber Engineering

JANUARY 15, 2016

How Uber’s infrastructure works with Schemaless, the datastore using MySQL that’s kept Uber Engineering scaling since October 2014. This is part two of a three- part series on Schemaless; part one is on designing Schemaless.

Architecture 81

Architecture Infrastructure Engineering Design 81

DZone

OCTOBER 11, 2021

This article is more focused on overall system design and architecture than any other written by me till today — so consider yourself warned. Additionally, I want to show you laws and their mathematical equations that can help you calculate the impact of these 3 mechanics on your application.

Software 246

Software Software Architecture Design 246

Dynatrace

DECEMBER 21, 2022

Cloud modernization is the ongoing process of taking legacy applications and updating their features, architecture, or infrastructure to ensure they’re optimized for operating in cloud environments. . These include developers, site reliability engineers (SREs), and cloud architects. . But what is cloud modernization? .

Cloud 147

Cloud Architecture Strategy Scalability 147

The Netflix TechBlog

MARCH 4, 2024

The rule-based classifier classifies job errors based on a set of predefined rules and provides insights for schedulers to decide whether to retry the job and for engineers to diagnose and remediate the job failure. Rule Execution Engine is responsible for matching the collected logs against a set of predefined rules.

Tuning 210

Tuning Efficiency Big Data Engineering 210

The Netflix TechBlog

JANUARY 25, 2023

Marken architecture Above picture represents the block diagram of the architecture for our service. Our architecture makes it possible to easily onboard and ingest data from Media algorithms. Different types of search queries are supported using the Elasticsearch as a backend search engine.

Scalability 283

Scalability Latency Media Architecture 283