InfoQ

JULY 7, 2023

Facundo Agriel dives into the architecture of Magic Pocket, some early key design patterns, and the challenges of operating such a system at this scale. By Facundo Agriel

Systems 52

Systems Storage Architecture Design 52

Dynatrace

JUNE 9, 2023

When extended to include application security practices, DevOps becomes DevSecOps and includes security-focused criteria, such as security by design and making security a critical release criterion. Research has found that 99% of organizations have embraced a multicloud architecture.

DevOps 183

DevOps Analytics Storage Metrics 183

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. In a paper published this week at SIGMOD'17 , the Amazon Aurora team presents the design considerations for the new database engine and how they addressed them.

Database 117

Database Design Cloud Storage 117

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. The design space. InS does now offer an NVMe variant too, and the authors perform limited testing on that as well.

Architecture 76

Architecture Cloud Storage Serverless 76

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Caching partially stores your data and is not used as permanent storage.

Performance 125

Performance Cache Servers Social Media 125

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Scalegrid

JANUARY 5, 2024

It was initially designed to mitigate the limitations of file management systems, including slow operations, inadequate security, and substantial data redundancy. It optimizes performance through monitoring tools and expert support, offers scalable solutions, and ensures high data security with end-to-end encryption and compliance adherence.

Efficiency 147

Efficiency Storage Database Scalability 147

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

InfoQ

JUNE 26, 2023

Microsoft has recently unveiled several new features for Azure Cosmos DB to enhance cost efficiency, boost performance, and increase elasticity. These features are burst capacity, hierarchical partition keys, serverless container storage of 1 TB, and priority-based execution. By Steef-Jan Wiggers

Azure 87

Azure Serverless Performance Storage 87

Scalegrid

JANUARY 8, 2024

AI algorithms embedded in cloud architecture automate repetitive processes, streamlining workloads and reducing the chance of human error. AI-driven resource allocation not only enhances the overall performance of cloud services but also contributes to substantial cost savings.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

DZone

JUNE 12, 2019

A system that has the ability to easily scale resources to meet the increasing workload without affecting the performance is known as a scalable system. The workload could refer to anything from an increase in users, storage, or a number of transactions.

Scalability 100

Scalability Software Architecture Storage Architecture 100

Dynatrace

DECEMBER 15, 2022

ITOps refers to the process of acquiring, designing, deploying, configuring, and maintaining equipment and services that support an organization’s desired business outcomes. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 202

Artificial Intelligence DevOps Hardware Virtualization 202

Dynatrace

JUNE 7, 2023

Kubernetes also gives developers freedom of choice when selecting operating systems, container runtimes, storage engines, and other key elements for their Kubernetes environments. Without having to worry about underlying infrastructure concerns, such as storage, security, and lifecycle management, developers can focus on writing code.

Open Source 206

Open Source Social Media Infrastructure Operating System 206

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 246

AWS Efficiency Azure Cloud 246

Dynatrace

MAY 26, 2021

In the keynote by Christina Yakomin and Steve Prazenica from Vanguard, the presenters recounted their journey from a monolith with alert-based incident reporting and no positive health signals to an observable microservice architecture. Trace-based sampling can help you save storage costs. So, the design of OTel allows for flexibility.

AWS 212

AWS Strategy Storage Metrics 212

VoltDB

JULY 10, 2018

This goal has been attempted to be addressed from the beginning of time: think of Object Oriented Programming, Service Oriented Architecture, Enterprise Service Bus and now Microservices. There are further requirements for high performance in the following: Telecom: vEPC or 5G Core. Real-World Example Problem. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

VoltDB

JULY 10, 2018

This goal has been attempted to be addressed from the beginning of time: think of Object Oriented Programming, Service Oriented Architecture, Enterprise Service Bus and now Microservices. There are further requirements for high performance in the following: Telecom: vEPC or 5G Core. Real-World Example Problem. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

InfoQ

DECEMBER 29, 2023

Zendesk reduced its data storage costs by over 80% by migrating from DynamoDB to a tiered storage solution using MySQL and S3. The company considered different storage technologies and decided to combine the relational database and the object store to strike a balance between querybility and scalability while keeping the costs down.

Storage 135

Storage Scalability Database Technology 135

High Scalability

NOVEMBER 14, 2018

Five years ago when Google published The Datacenter as a Computer: Designing Warehouse-Scale Machines it was a manifesto declaring the world of computing had changed forever. The world is still changing, so Google published a new edition: The Datacenter as a Computer: Designing Warehouse-Scale Machines, Third Edition.

Design 54

Design Education Google Internet 54

Dynatrace

MAY 26, 2021

In the keynote by Christina Yakomin and Steve Prazenica from Vanguard, the presenters recounted their journey from a monolith with alert-based incident reporting and no positive health signals to an observable microservice architecture. Trace-based sampling can help you save storage costs. So, the design of OTel allows for flexibility.

AWS 147

AWS Strategy Storage Metrics 147

ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. These priorities tend to push the architecture to the back burner.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. These priorities tend to push the architecture to the back burner.

Software Architecture 40

Software Architecture Architecture Software Software 40

Percona

DECEMBER 4, 2023

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. Release highlights include: Docker images are now available for x86_64 architectures.

Open Source 83

Open Source Azure Servers Programming 83

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration. Why perform exclusion at two points?

Design 191

Design Storage Programming Analytics 191

Percona

JANUARY 19, 2023

While the technologies have evolved and matured enough, there are still some people thinking that MySQL is only for small projects or that it can’t perform well with large tables. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 91

Open Source Storage Database Big Data 91

Percona

AUGUST 17, 2023

PostgreSQL has powerful and advanced features, including asynchronous replication, full-text searches of the database, and native support for JSON-style storage, key-value storage, and XML. It’s reliable, robust, feature-rich, and performant. It all helps ensure the cluster’s peak performance.

Open Source 80

Open Source Healthcare Social Media Database 80

The Netflix TechBlog

MAY 21, 2019

The device ecosystem is rich with partners ranging from Silicon-on-Chip (SoC) manufacturers, Original Design Manufacturer (ODM) and Original Equipment Manufacturer (OEM) vendors. Solving the above problems could help Netflix and our Partners save time and money during the entire lifecycle of device design, build, test, and certification.

Testing 163

Testing AWS Lambda Network 163

ACM Sigarch

OCTOBER 4, 2018

This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. On the other hand, one can implement this system with encryption/decryption units between the compute and the storage. His website is [link].

Systems 47

Systems Hardware Storage Healthcare 47

Smashing Magazine

NOVEMBER 2, 2021

Application leaders for digital commerce technologies must plan for PWAs when designing digital commerce experiences”. Meet Adam Silver’s Form Design Patterns , a practical guide to designing and building forms for the web. The Design Gives Ground For Utmost Usability. Jump to table of contents ?. Large preview ).

Code 74

Code Cache Retail Mobile 74

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Managed DBaaS solutions like ScaleGrid.io

Cache 130

Cache Storage Scalability Architecture 130

The Netflix TechBlog

MARCH 10, 2020

This decision was not geared by performance issues?—?but Leveraging Hexagonal Architecture We needed to support the ability to swap data sources without impacting business logic , so we knew we needed to keep them decoupled. The idea of Hexagonal Architecture is to put inputs and outputs at the edges of our design.

Architecture 345

Architecture Transportation Java Strategy 345

Dynatrace

OCTOBER 4, 2022

Grail architectural basics. The aforementioned principles have, of course, a major impact on the overall architecture. A data lakehouse addresses these limitations and introduces an entirely new architectural design. This decoupling ensures the openness of data and storage formats, while also preserving data in context.

Artificial Intelligence 267

Artificial Intelligence Analytics Storage Architecture 267

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 280

Serverless AWS Lambda Storage 280