ACM Sigarch

AUGUST 3, 2023

(Editor’s Note: This post was submitted as a rebuttal to Andrew Chien’s July 24 SIGARCH Blog Post ) The recent post “ Why Embodied Carbon is a poor Architecture Design metric, and Operational Carbon remains an important Problem ” by Prof. Andrew Chien rightfully raises awareness of the challenges of reducing operational carbon.

Energy 98

Energy Architecture Hardware Metrics 98

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 104

Availability Database Open Source Hardware 104

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. Logs can include data about user inputs, system processes, and hardware states. For example: Lack of end-to-end observability. Dynatrace news.

Analytics 198

Analytics Monitoring Artificial Intelligence DevOps 198

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Downtime due to SPOFs can also be attributed to bottlenecks from architectures designed for applications instead of databases. Despite all its upside, PostgreSQL software presents such challenges.

Availability 82

Availability Open Source Architecture Database 82

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Examples of traditional natural monopolies are dams, railroads, power plants, water supply, and sewer services. You can even go old school and use non cloud-native architectures. For example, AWS created Nitro. So, the cloud is not a monopoly.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

The Netflix TechBlog

FEBRUARY 9, 2021

This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires. We call these adaptive fields.

Engineering 165

Engineering Storage Latency Entertainment 165

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. Examples include slow command execution time which leads to poor latency and increased memory usage. Redis®, a powerful in-memory data store, is no exception.

Strategy 130

Strategy Monitoring Latency DevOps 130

ACM Sigarch

OCTOBER 4, 2018

This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. For example, consider a database system that is distributed across a data center, or even across data centers. Transmission: A number of encryption schemes (e.g.,

Systems 47

Systems Hardware Storage Architecture 47

All Things Distributed

MARCH 11, 2016

The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

Percona

SEPTEMBER 1, 2023

Vertical scaling is also often discussed, which involves increasing the resources of a single server, which can have limitations in hardware capabilities and become costly as demands grow. The sharding architecture consists of several components: Shard Servers : Shard servers are individual nodes within the sharded cluster.

Best Practices 71

Best Practices Traffic Database Servers 71

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. It also supports auto-scaling of compute and storage resources, dynamically adjusting capacity based on chosen utilization thresholds to optimize performance and costs.

AWS 52

AWS Database Serverless Storage 52

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture 52

Architecture Cache Azure Storage 52

The Netflix TechBlog

FEBRUARY 13, 2020

Shown below are screenshots of the Netflix app on iOS as an example. As seen above, image assets typically have gradients, text and graphics , for example the Netflix symbol or other title-specific symbols such as “The Witcher” insignia, composited on the image. Let us take color subsampling as an example.

Code 212

Code Metrics Efficiency Open Source 212

Percona

JANUARY 19, 2023

Example (using the employee sample DB ): Suppose we have the following schema: db1 employees> show create table employeesG 1. Example: Creating four simple tables to store strings but using different data types: db1 test> CREATE TABLE tb1 (id int auto_increment primary key, test_text char(200)); Query OK, 0 rows affected (0.11

Open Source 85

Open Source Storage Database Big Data 85

The Morning Paper

OCTOBER 4, 2020

There are high hopes for 5G , for example unlocking new applications in UHD streaming and VR, and machine-to-machine communication in IoT. Three different 5G phones are used, including a ZTE Axon10 Pro with powerful communication (SDX 50 5G modem) and compute (Qualcomm Snapdragon TM855) capabilities together with 256GB of storage.

Energy 130

Energy Latency Performance Network 130

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. Unified data management architecture. Databricks Delta is a perfect example of this class. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Percona

DECEMBER 27, 2022

Disk-level encryption is a security measure that encrypts all data stored on a disk or storage device. Disk-level encryption is a security measure that encrypts all data stored on a disk or storage device. Cluster-level encryption is a security measure that encrypts data stored in a cluster of servers or storage devices. .

Database 92

Database Storage Servers Strategy 92

All Things Distributed

MARCH 7, 2013

s use of DynamoDB, which is an extreme example of how DynamoDBâ??s Shazam needed to handle an enormous increase in traffic for the duration of the Super Bowl and used DynamoDB as part of their architecture. This rapid adoption has allowed us to benefit from the scale economies inherent in our architecture. s prices by 70%.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. For example, a value of ‘2’ can be represented by a signal that is low until time 2 and then high from then on. One efficient way of doing that in analog hardware is the use of current-starved inverters.

Energy 52

Energy Hardware Efficiency Architecture 52

High Scalability

NOVEMBER 14, 2018

New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime.

Design 54

Design Education Google Internet 54

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. For example, MongoDB 5.0 To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set.

Database 79

Database Servers Storage Strategy 79

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). For instance, scatter/gather pattern can be used to implement a MapReduce like batch processing architecture on top of Kubernetes. Twitter Heron is another good example of this approach. Storage provisioning. optimised container networking and security.

Big Data 63

Big Data Storage Benchmarking Hardware 63

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 145

Availability Performance Scalability AWS 145

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. For example, on a 128GB memory host, this can allow up to 38.4GB of dirty pages. There is an issue with this, which causes the OS to swap even with memory available. The background ratio won’t kick in until 12.8GB.

Best Practices 52

Best Practices Design Tuning Database 52

ACM Sigarch

AUGUST 20, 2018

same instruction set architecture, same operating system, etc.). Looking at current hardware and software security research, however, we are seeing a number of technologies that are being developed that limit this type of broad interoperability. The cloud system can perform processing steps (e.g.,

Hardware 47

Hardware Operating System Architecture Software 47

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Highly Scalable

APRIL 2, 2012

From the business logic point of view, this was a pretty typical eCommerce service for hierarchical and faceted navigation, although not without peculiarities, but high performance requirements led us to the quite advanced architecture and technical design. Deployment Schema and High-Level Architecture.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. an example is shown of the shortest of these: . hardware limits: 1000 MHz - 3.80

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

SQL Performance

AUGUST 27, 2019

This is the second generation EPYC server processor that uses the same Zen 2 architecture as the AMD Ryzen 3000 Series desktop processors. It will also use less power than a two-socket Intel server, with a lower hardware cost, and potentially lower licensing costs (for things like VMware). This idea is not unique to AMD.

Servers 52

Servers Benchmarking Virtualization Architecture 52

All Things Distributed

NOVEMBER 15, 2010

Building general purpose architectures has always been hard; there are often so many conflicting requirements that you cannot derive an architecture that will serve all, so we have often ended up focusing on one side of the requirements that allow you to serve that area really well. From CPU to GPU. General Purpose GPU programming.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

SEPTEMBER 6, 2013

Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. Here are some great examples from different industries each with unique use cases. In addition, its robust architecture supports ten times as many scientists, all working simultaneously.

Cloud 129

Cloud Energy AWS Healthcare 129