Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design. What Exactly is Greenplum?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

NOVEMBER 9, 2021

by Liwei Guo , Ashwin Kumar Gopi Valliammal , Raymond Tam , Chris Pham , Agata Opalach , Weibo Ni AV1 is the first high-efficiency video codec format with a royalty-free license from Alliance of Open Media (AOMedia), made possible by wide-ranging industry commitment of expertise and resources.

Media 246

Media Open Source Efficiency Software Engineering 246

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. These essential data points heavily influence both stability and efficiency within the system. offers the Software Watchdog specifically designed for this purpose.

Metrics 130

Metrics Monitoring Latency Cache 130

High Scalability

DECEMBER 16, 2022

Cloud computing is a model of computing that delivers computing services over the internet, including storage, data processing, and networking. This model of computing has become increasingly popular in recent years, as it offers a number of benefits, including cost savings, flexibility, scalability, and increased efficiency.

Cloud 201

Cloud Serverless Internet Internet 201

The Morning Paper

NOVEMBER 15, 2020

Improving the efficiency with which we can coordinate work across a collection of units (see the Universal Scalability Law ). With more nodes and more coordination comes more complexity, both in design and operation. FPGAs are chosen because they are both energy efficient and available on SmartNICs). IDS/IPS requirements.

Servers 128

Servers Hardware Latency Design 128

Dynatrace

OCTOBER 28, 2021

To test the hypothesis, chaos engineers orchestrate simulated uncertainty combined with load testing and watch for signs of upheaval in the services, infrastructure, networks, and devices that deliver the application. Any failures in the stack break the hypothesis. Blast radius. That’s a good thing. Accelerates innovation.

Engineering 221

Engineering Entertainment Cloud Infrastructure 221

The Morning Paper

JUNE 11, 2019

Beyond data and model parallelism for deep neural networks Jia et al., The goal here is to reduce the training times of DNNs by finding efficient parallel execution strategies, and even including its search time, FlexFlow is able to increase training throughput by up to 3.3x SysML’2019. compared to state-of-the-art approaches.

Network 81

Network Strategy Hardware Benchmarking 81

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., There’s another emerging option that we didn’t talk about there: the use of far-memory , memory attached to the network that can be remotely accessed without mediation by a local processor. HotOS’19. The last word.

Design 80

Design Cache Hardware Scalability 80

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. With performance optimization at its core along with mitigating risks associated with relying solely on one cloud provider or taking advantage of cost efficiencies. What is Hybrid Cloud?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. In addition to the disaster recovery site, this design includes an external layer of nodes.

Availability 110

Availability Database Open Source Hardware 110

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 90

Database Hardware Open Source Strategy 90

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda? Customizing and connecting these services requires code.

Lambda 178

Lambda AWS Serverless Hardware 178

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Note that most of the changes we’ve introduced so far and those that are detailed below are all designed to be invisible to you, taking place entirely automatically in the background.

Best Practices 193

Best Practices Storage Java Benchmarking 193

Testlodge

NOVEMBER 12, 2021

Software testers explore the effectiveness of processes that should lead to quality software products to make sure they perform the purpose for which they have been designed. If executed efficiently with maximum coverage, can confirm the stability and workability of the application. Types of Compatibility Testing.

Testing 78

Testing Hardware Operating System Mobile 78

ACM Sigarch

APRIL 26, 2018

BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. With its modular architecture, DLA is scalable, highly configurable, and designed to simplify integration and portability. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

SEPTEMBER 30, 2021

Like any move, a cloud migration requires a lot of planning and preparation, but it also has the potential to transform the scope, scale, and efficiency of how you deliver value to your customers. This can fundamentally transform how they work, make processes more efficient, and improve the overall customer experience. Here are three.

Cloud 163

Cloud Traffic Best Practices Strategy 163

Sutter's Mill

NOVEMBER 11, 2023

If you want to do efficient linear algebra, you don’t want to write your own code by hand; that would be slow. Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. Seeing only the end result of T.[0] This is that library.

C++ 107

C++ Lambda Network Programming 107

The Morning Paper

MARCH 1, 2020

Firekube exists because none of the existing alternatives (virtualisation, containers or language-specific vms) met the combined needs of multi-tenant efficiency and strong isolation in the AWS environment. The design of Firecracker. These simplifying assumptions are reflected in Firecracker’s design and implementation.

Serverless 101

Serverless Virtualization Lambda AWS 101

Percona

OCTOBER 18, 2023

Compatibility Open source databases are designed with interoperability at their core, adhering to industry standards and offering support for a wide range of data import and export formats. Evaluating your hardware requirements is another vital aspect of resource allocation. Should I be bringing in external experts to help out?

Open Source 94

Open Source Database Hardware Strategy 94

The Morning Paper

MAY 19, 2019

The net result of rapid advancements in the networking world is that inter-tier communications latency will approach the fundamental lower bound of speed-of-light propagation in the foreseeable future. It’s designed for “ emerging architectures featuring fully integrated NIs and hardware-terminated transport protocols.”

Latency 80

Latency Hardware Network Architecture 80

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 121

Cloud Serverless AWS Storage 121

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We formulate the problem as a Mixed Integer Program (MIP).

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

JANUARY 28, 2020

From an operator perspective it makes it harder to follow the classic cloud-native design in which a global storage layer is separate to compute. Entry/exit in/out of V8 contexts is less expensive than hardware-based isolation mechanisms, keeping request processing latency low and throughput high. Shredder in action.

Serverless 99

Serverless Storage Latency Cloud 99

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

Testlodge

JUNE 16, 2021

To secure consumer data, organizations need to make sure that their networks are updated and protected against any malicious activity. Penetration testing is comprehensively performed over a fully-functional system’s software and hardware. Why do we perform Penetration Testing?

Testing 67

Testing Hardware Open Source Internet 67

The Morning Paper

JANUARY 30, 2020

The design of the HTML5 Web Worker interface turns out to be a great match for migration – Workers are already designed to work on a separate thread communicating via message passing, and are typically used to offload expensive computation that you don’t want to do in the main thread with the user waiting.

Mobile 104

Mobile Cloud Latency Games 104

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. What's changed since last year? and 75KiB of JavaScript.

Performance 90

Performance Network Mobile Speed 90

The Morning Paper

SEPTEMBER 19, 2019

Could it be Analyzing efficient stream processing on modern hardware ? I don’t think so in this case, but this paper will take you down into the nitty-gritty of getting the best out of modern processors and networks, with up to two orders of magnitude single node throughput gains to be had. What’s their secret???

Blockchain 46

Blockchain Hardware Google Analytics 46

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Race logic has four primary operations that are easy to implement in hardware: MAX, MIN, ADD-CONSTANT, and INHIBIT. One efficient way of doing that in analog hardware is the use of current-starved inverters.

Energy 52

Energy Hardware Efficiency Architecture 52

Alex Russell

APRIL 29, 2021

Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Modern, asynchronous network APIs that dramatically improve performance in some situations. These TransformStream types help applications efficiently deal with large amounts of binary data. Delayed five years.

Media 145

Media Games Education Engineering 145

The Morning Paper

MAY 14, 2019

Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. There are multiple sources of queueing in both hardware and software, and Seer works best when using deep instrumentation to capture these.

Big Data 45

Big Data Cloud Performance Hardware 45

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

ACM Sigarch

OCTOBER 25, 2018

The phenomenon of plateauing ST performance is a consequence of design constraints – primarily power. The Thermal Design Power (TDP) of a SOC in a current Ultrabook design is constrained to 15W. In view of this it is perhaps worth pondering why ST performance growth has stalled and some options to revive the growth.

Architecture 67

Architecture Technology Technology Innovation 67