ACM Sigarch

FEBRUARY 23, 2018

In industry, generally due to time-to-market restrictions, we tend to think extremely short term with evolutionary design changes rather than riskier revolutionary ideas that have a longer timeline for returns. I had a professor in grad school who used to joke that all architecture is reinvented every 5 years.

Architecture 47

Architecture Cache Hardware Virtualization 47

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. Chaos testing enriches the organization’s intelligence about how software performs under stress and how to make it more resilient.

Engineering 225

Engineering Entertainment Cloud Infrastructure 225

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Testlodge

APRIL 14, 2021

A software tester’s work life includes making sure that systems that have been designed to achieve specific results behave exactly as they should. These systems are a combination of different hardware and software which have been configured to perform the desired task. What is Configuration Testing? An Example.

Testing 89

Testing Hardware Virtualization Operating System 89

ACM Sigarch

OCTOBER 25, 2019

When it comes to hardware support to mitigate software security issues, there is a significant gap between what is available in products today and known solutions. A History of Architecture Support for Security. The figure above provides a timeline of architectural support for practical defenses, as found in commercial products.

Hardware 98

Hardware Virtualization Architecture Games 98

Dynatrace

APRIL 5, 2021

Real-time stream processing to perform live activity tracking, data cleansing, metrics generation, and more. The function itself performs a small unit of work and Lambda charges subscribers by the millisecond. For such functions, organizations will be better off using an EC2 instance or their own hardware to interact with data.

Lambda 180

Lambda AWS Serverless Hardware 180

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Hardware 213

High Scalability

NOVEMBER 14, 2018

Five years ago when Google published The Datacenter as a Computer: Designing Warehouse-Scale Machines it was a manifesto declaring the world of computing had changed forever. The world is still changing, so Google published a new edition: The Datacenter as a Computer: Designing Warehouse-Scale Machines, Third Edition.

Design 54

Design Education Google Internet 54

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 165

Cloud Traffic Best Practices Strategy 165

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

JANUARY 5, 2024

It was initially designed to mitigate the limitations of file management systems, including slow operations, inadequate security, and substantial data redundancy. It optimizes performance through monitoring tools and expert support, offers scalable solutions, and ensures high data security with end-to-end encryption and compliance adherence.

Efficiency 147

Efficiency Storage Database Scalability 147

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. As it turns out, for the large majority of Netflix use cases, its performance is far from optimal.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

ACM Sigarch

OCTOBER 4, 2018

This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. Naively securing this system would require a large amount of trust; “guns and guards”, trusted personnel, and trusted software and hardware. His website is [link].

Systems 47

Systems Hardware Storage Healthcare 47

The Netflix TechBlog

FEBRUARY 25, 2021

However, high level operations performed on client devices, such as seeking, do not need to be aware of the elementary syntax and benefit from a codec-agnostic format. Simplified architecture of a streaming preparation pipeline A key feature that our members rightfully deserve when playing audio, video, and timed text is synchronization.

Technology 181

Technology Technology Open Source Media 181

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

Percona

JANUARY 19, 2023

While the technologies have evolved and matured enough, there are still some people thinking that MySQL is only for small projects or that it can’t perform well with large tables. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 93

Open Source Storage Database Big Data 93

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

Dynatrace

OCTOBER 2, 2023

Transforming an application from monolith to microservices-based architecture can be daunting, and knowing where to start can be difficult. Unsurprisingly, organizations are breaking away from monolithic architectures and moving toward event-driven microservices. Migration is time-consuming and involved.

Architecture 231

Architecture Artificial Intelligence Cloud Open Source 231

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Dynatrace

JULY 11, 2023

We’re delighted to share that IBM and Dynatrace have joined forces to bring the Dynatrace Operator, along with the comprehensive capabilities of the Dynatrace platform, to Red Hat OpenShift on the IBM Power architecture (ppc64le).

Architecture 170

Architecture Availability Infrastructure Metrics 170

Percona

JUNE 12, 2023

So why not use a proven architecture instead of starting from scratch on your own? This blog provides links to such architectures — for MySQL and PostgreSQL software. You can use these Percona architectures to build highly available PostgreSQL or MySQL environments or have our experts do the heavy lifting for you.

Architecture 101

Architecture Availability Open Source Healthcare 101

ACM Sigarch

NOVEMBER 4, 2019

The technical program, put together by program chairs Tor Aamodt and Reetuparna Das , showcased key innovations across a wide range of computer architecture topics, from domain-specific accelerators to in/near-memory computing and from security to quantum computing. . This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. In those days, my main goal was to take the advances in building the highly dedicated High Performance Cluster environments and turn them into commodity technologies for the enterprise to use.

Cloud 118

Cloud AWS Automotive Latency 118

Testsigma

JULY 25, 2020

These different stages could be stages of tests: unit tests, integration tests, acceptance tests and performance tests as well as stages of environments such as Dev, QA, Staging and Production. If integration tests pass, automated acceptance tests can be run followed by performance tests.

Testing 55

Testing DevOps Performance Testing Infrastructure 55

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. Pipeline reliability and performance go hand in hand. If tuned for performance, there is a good change reliability is compromised - and vice versa. Generally speaking, data pipelines are leaky by nature.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 280

Serverless AWS Lambda Storage 280

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The design of the in-stream processing engine itself was driven by the following requirements: SQL-like functionality. High performance and mobility.

Big Data 154

Big Data Processing Lambda Database 154

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

AUGUST 22, 2023

We’ll also look at the differences, as it’s important to know what architecture(s) will help you best meet your unique requirements for maximizing data assets and achieving continuous uptime. Redundancy provides backups and safeguards against data loss in case of hardware failures. What does high availability mean?

Availability 82

Availability Hardware Open Source Database 82

Testsigma

FEBRUARY 12, 2021

Just a manual testing approach would not suffice for today’s wired devices and dynamic architectural applications of Industry 4.0. The tester can find a bug in the specifications, design, or development phase. Automated testing provides the production team with more outstanding performance. Total coverage of the test.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

The Netflix TechBlog

NOVEMBER 15, 2022

Rendering is the final step in the VFX creation process, and processing on a render farm often can take several hours to complete just a single frame of a show, even when this process runs on the latest high-end hardware. via direct plug-ins, and is available on multi-cloud platform services.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 92

Database Hardware Open Source Strategy 92