The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. This is very efficient, as confirmed by the elapsed time of 13ms (all of which is CPU time). Test Environment. The cost threshold for parallelism is set to 50. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. In a serverless architecture, applications are distributed to meet demand and scale requirements efficiently.

Serverless 241

Serverless Efficiency Lambda Azure 241

Percona

JANUARY 19, 2023

In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. Redundant indexes: It is known that accessing rows by fetching an index is more efficient than through a table scan in most cases. It is available under a paid subscription.

Open Source 85

Open Source Storage Database Big Data 85

KeyCDN

SEPTEMBER 20, 2018

Error monitoring can get increasingly complicated as you deal with bugs reported by users and your production team, which is why having an efficient error tracking workflow from the beginning is so important. Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app.

Strategy 67

Strategy Monitoring Website Google 67

Dynatrace

APRIL 21, 2023

State and local agencies must spend taxpayer dollars efficiently while building a culture that supports innovation and productivity. APM helps ensure that citizens experience strong application reliability and performance efficiency. Many agencies are forced to hire contractors to manage all the tools, including upgrades.

Government 157

Government Infrastructure Innovation Monitoring 157

Percona

OCTOBER 18, 2023

Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. Evaluating your hardware requirements is another vital aspect of resource allocation. Look closely at your current infrastructure (hardware, storage, networks, etc.)

Open Source 89

Open Source Database Hardware Strategy 89

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Its tailored to enterprise applications that have thousands of users, but limited free edition is available. What is Performance Testing? Consider optimizing before investing.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 295

Open Source Traffic DevOps Cloud 295

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. Key features Multi-table storage : Unlike file-per-table tablespaces, which store each table in a separate file, general tablespaces can house numerous tables, enhancing storage efficiency.

Storage 84

Storage Engineering Database Hardware 84

O'Reilly

NOVEMBER 28, 2023

A year after the first web servers became available, how many companies had websites or were experimenting with building them? That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. Certainly not two-thirds of them. We’ll say more about this later.) AI will be the same.

Open Source 111

Open Source Artificial Intelligence Google Infrastructure 111

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log analytics also help identify ways to make infrastructure environments more predictable, efficient, and resilient. Log analysis can reveal potential bottlenecks and inefficient configurations so teams can fine-tune system performance.

Analytics 202

Analytics Monitoring Artificial Intelligence DevOps 202

Percona

AUGUST 27, 2018

Resource groups permit assigning threads running within MySQL to particular groups so that threads execute according to the resources available to this group. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth.

Tuning 44

Tuning Virtualization Testing Servers 44

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

All Things Distributed

MARCH 19, 2018

Amazon SageMaker training supports powerful container management mechanisms that include spinning up large numbers of containers on different hardware with fast networking and access to the underlying hardware, such as GPUs. Post-training model tuning and rich states. This can all be done without touching a single line of code.

Scalability 159

Scalability Hardware AWS Tuning 159

The Morning Paper

NOVEMBER 10, 2019

Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. Rather than reimplement TCP/IP or refactor an existing transport, we started Pony Express from scratch to innovate on more efficient interfaces, architecture, and protocol.

Network 92

Network Transportation Latency Entertainment 92

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

The Morning Paper

JUNE 27, 2019

The thrust of the argument is that there’s a chain of inter-linked assumptions / dependencies from the hardware all the way to the programming model, and any time you step outside of the mainstream it’s sufficiently hard to get acceptable performance that researchers are discouraged from doing so. Challenges compiling non-standard kernels.

Systems 87

Systems Tuning Programming Innovation 87

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 5, 2023

Various partition types, like RANGE, LIST, HASH, and KEY, are used for specific needs, from range-based data to custom criteria, to ensure efficient data handling and the optimization of queries. ensures that only relevant partitions are accessed, further enhancing query efficiency. Partition pruning, a feature in MySQL 5.7,

Strategy 40

Strategy Storage Database Best Practices 40

All Things Distributed

MARCH 7, 2013

As I sat down with the DynamoDB team to review our progress over the last year, I realized that DynamoDB had surpassed even my own expectations for how easily applications could achieve massive scale and high availability with DynamoDB. How are we able to do this? This was the genesis of NoSQL databases like Dynamo at Amazon.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

The Morning Paper

MAY 21, 2019

Zswap is readily available and runs as a swap device in the Linux kernel. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. ML-based auto-tuning. Evaluation.

Software 78

Software Software Google Hardware 78

HammerDB

FEBRUARY 25, 2021

However, having the application logic in the client is even worse because you are sacrificing key database efficiencies of prepared statements. Of course, you can prepare individual statements, however you can see major efficiency gains by using natively compiled stored procedures. Glue language.

Programming 67

Programming Benchmarking Virtualization C++ 67

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). One thing they all had in common is an evaluation using some kind of simulation of the expected behaviour of NVDIMMs, because the real thing wasn’t yet available. The Optane DIMM is the first scalable, commercially available NVDIMM. But now it is!

Scalability 59

Scalability Latency Cache Media 59

O'Reilly

OCTOBER 11, 2022

Andrew Ng , Christopher Ré , and others have pointed out that in the past decade, we’ve made a lot of progress with algorithms and hardware for running AI. Our current set of AI algorithms are good enough, as is our hardware; the hard problems are all about data. The data available to our retail business is much more limited.

Games 119

Games Healthcare Processing Retail 119

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. For specific information on I/O tuning and balancing, you will find more details in the following document.

Servers 40

Servers Cache Media Hardware 40

Smashing Magazine

AUGUST 22, 2021

One aspect of performance is about how efficiently a transport protocol can use a network’s full (physical) bandwidth (i.e. Additionally, even if we knew the available physical bandwidth, that wouldn’t mean we could use all of it ourselves. More in-depth information is available. Congestion Control. What Does It All Mean?

Performance 106

Performance Network Latency Servers 106

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

O'Reilly Software

APRIL 4, 2018

The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80

John McCalpin

JANUARY 22, 2018

Since “peak performance” for the processor is two (512-bit SIMD) FMA instructions per cycle, any instructions that are not FMA instructions subtract directly from the available peak performance. of the “adjusted peak performance”, there is no longer a significant upside to performance tuning.

Latency 40

Latency Hardware Code Testing 40

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. We can do the correct offset calculation manually using the data available in the plan.

Servers 95

Servers Tuning Architecture Performance 95

SQL Server According to Bob

JANUARY 11, 2020

​​ Various defragmentation ​​ utilities ​​ are ​​ available ​​ on the market today. KB ​​ boundaries efficiently. ​​ Application design ​​ can become ​​ critical to efficient log space usage.

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

Version7 (Future): Move all compute to the public cloud, carve out more services for impact isolation, dynamic resource pooling to manage pets and cattle efficiently. Always be available: Have a service level circuit breaker and a circuit breaker by customer. This is the current architecture.

Architecture 52

Architecture Cache Azure Storage 52