VoltDB

JULY 10, 2018

As the complexity of applications and systems increases, the size of the teams that work on these also increase. In these scenarios, having the system as a monolithic one inhibits the development team from being able to move forward at speed. The post Scalable MicroService Architecture appeared first on VoltDB.

Architecture 40

Architecture Scalability Ecommerce Latency 40

VoltDB

JULY 10, 2018

As the complexity of applications and systems increases, the size of the teams that work on these also increase. In these scenarios, having the system as a monolithic one inhibits the development team from being able to move forward at speed. The post Scalable MicroService Architecture appeared first on VoltDB.

Architecture 40

Architecture Scalability Ecommerce Latency 40

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts. Dynatrace news.

AWS 205

AWS Strategy Storage Metrics 205

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

ScaleOut Software

JULY 19, 2021

How are we managing the torrent of telemetry that flows into analytics systems from these devices? Today’s streaming analytics architectures are not equipped to make sense of this rapidly changing information and react to it as it arrives. The list goes on. The Limitations of Today’s Streaming Analytics.

IoT 78

IoT Analytics Big Data Architecture 78

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts. Dynatrace news.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

JANUARY 23, 2024

Enter AI observability, which uses AI to understand the performance and cost-effectiveness details of various systems in an IT environment. Join us at Dynatrace Perform 2024 , either on-site or virtuall y, to explore these themes further. As organizations adopt more AI technologies, the associated costs are skyrocketing.

Performance 179

Performance DevOps Innovation Artificial Intelligence 179

The Morning Paper

APRIL 4, 2019

Ginseng: keeping secrets in registers when you distrust the operating system Yun & Zhong et al., Suppose you did go to the extreme length of establishing an unconditional root of trust for your system, even then, unless every subsequent piece of code you load is also fully trusted (e.g., NDSS’19.

Operating System 43

Operating System Systems Wireless Transportation 43

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). And this all has to work for whole-system executions, not just the C-language portion of user processes. ASPLOS’19. code is not given access to excessive capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. in the directory storage/innobase/ut the following section has UT_RELAX_CPU defined to call the PAUSE instruction on x86.

Testing 48

Testing Tuning Latency Storage 48

The Morning Paper

FEBRUARY 18, 2020

ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Compared to web-scale platform use of ML, enterprise applications tend to be built by smaller teams with deeper domain expertise, but less deep algorithmic or systems expertise. Three big bets.

Government 95

Government Software Engineering Storage Database 95

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. I am pretty sure some if not all of these papers deserved to be elected to the hall of fame of best papers in distributed systems. Feb 11 - A Survey of Rollback-Recovery Protocols in Message-Passing Systems , E. All Things Distributed. Comments ().

Operating System 144

Operating System Cache AWS Scalability 144

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. The architecture usually integrates several private, public, and on-premises infrastructures. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Abhishek Tiwari

DECEMBER 27, 2017

Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. faster access to external storage and data locality (I/O, bandwidth). Storage provisioning. But Kubernetes storage is evolving quite quickly.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Netflix TechBlog

SEPTEMBER 24, 2021

Table 1: Movie and File Size Examples Initial Architecture A simplified view of our initial cloud video processing pipeline is illustrated in the following diagram. Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients.

Cloud 237

Cloud Media Storage Cache 237

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. It's an exciting development in cloud computing: hardware virtualization is now fast. Virtualized in Hardware**: Hardware support for virtualization, and near bare-metal speeds.

Virtualization 111

Virtualization AWS Hardware Storage 111

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else. as a result there were product and messaging changes.

Tuning 52

Tuning Benchmarking Engineering C++ 52

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. But that’s also a problem that 5G vendors could solve; virtual LANs ( VLANs ) are hardly a new concept. I do regular backups, but I know I’m the exception.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Dynatrace

NOVEMBER 11, 2022

More organizations are adopting a hybrid IT environment, with data center and virtualized components. Therefore, they need an environment that offers scalable computing, storage, and networking. Instead of treating storage, server, compute, and network functions as separate entities, HCI virtualizes these resources.

Infrastructure 195

Infrastructure Storage Virtualization Network 195

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. FaaS vs. monolithic architectures. Monolithic architectures were commonplace with legacy, on-premises software solutions. Infrastructure as a service (IaaS) handles compute, storage, and network resources.

Development 244

Development Serverless Best Practices Lambda 244

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. In a nutshell, a data pipeline is a distributed system. Testing Hell Testing and quality assurance with data pipeline is a nightmare.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

MAY 8, 2023

In addition, monitoring DevOps processes provide the following benefits: Improve system performance. Monitoring provides a clearer, more consistent picture of DevOps system performance and overall health. Help systems meet SLAs. Increase system uptime. DevOps monitoring also helps teams meet their SLAs for system uptime.

DevOps 213

DevOps Efficiency Monitoring Infrastructure 213

The Netflix TechBlog

MAY 5, 2021

In the future posts, we will do an architectural deep dive into the several components of Netflix Drive. Netflix Drive relies on a data store that will be the persistent storage layer for assets, and a metadata store which will provide a relevant mapping from the file system hierarchy to the data store entities.

Media 174

Media Storage Architecture Cloud 174

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. It's an exciting development in cloud computing: hardware virtualization is now fast. Virtualized in Hardware**: Hardware support for virtualization, and near bare-metal speeds.

Virtualization 40

Virtualization AWS Hardware Storage 40

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Login & Authentication: Systems that verify user credentials and maintain session-specific data.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Login & Authentication: Systems that verify user credentials and maintain session-specific data.Â

Architecture 52

Architecture Performance Internet Internet 52

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 83

Availability Open Source Architecture Database 83

Percona

AUGUST 22, 2023

We’ll also look at the differences, as it’s important to know what architecture(s) will help you best meet your unique requirements for maximizing data assets and achieving continuous uptime. High availability does not guarantee 100% uptime, but an HA system enables you to minimize downtime to the point you’re almost there.

Availability 78

Availability Hardware Open Source Database 78

Dynatrace

AUGUST 21, 2023

“Traditional monitoring approaches worked fine when an operator was tasked with tracking a simple, static system,” wrote Ali Siddiqui in “ How to harness the power of observability, AIOps and automation.” ” But, he continues, ” Today’s environments present a completely different picture.

Analytics 143

Analytics Innovation Infrastructure Scalability 143

Dynatrace

JULY 6, 2022

Virtualization has revolutionized system administration by making it possible for software to manage systems, storage, and networks. This can reduce labor costs and enhance reliability by enabling systems to self-heal. By removing physical dependencies, automation can help perform SRE at scale.

Best Practices 181

Best Practices Open Source Tuning Infrastructure 181

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. The main benefits of serverless architecture are cost savings and scalability.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 105

Availability Database Open Source Hardware 105

O'Reilly

MAY 19, 2020

Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). It encompasses private clouds, the IaaS cloud—also host to virtual private clouds (VPC)—and the PaaS and SaaS clouds. First, our survey didn’t ask respondents if they (or their organizations) have adopted microservices architecture.

Cloud 141

Cloud Serverless AWS Architecture 141

Percona

MAY 15, 2023

In both cases, when using virtually-synchronous replication, the process will require certification from each node and local (by node) write; as such, the number of writes is NOT distributed across multiple nodes but duplicated. As well, very few cases are in need to have a full system/solution to provide scalability with sharding.

Traffic 122

Traffic Scalability Database Servers 122

All Things Distributed

MARCH 11, 2016

Build evolvable systems. The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. Automation is key.

AWS 144

AWS Hardware Retail Virtualization 144

Testsigma

OCTOBER 16, 2020

A lot of trustworthy SaaS companies or cloud service providers such as Testsigma having a strong history of client satisfaction have very strict data security policies which make them immune to breaches in their systems. Checking the current security protocols and the steps to be followed in case of a system breach.

Best Practices 81

Best Practices Cloud Virtualization Architecture 81