Percona

DECEMBER 27, 2023

Consequently, they might miss out on the benefits of integrating security into the SDLC, such as enhanced efficiency, speed, and quality in software delivery. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 77

Cloud Open Source Strategy Best Practices 77

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

Sutter's Mill

NOVEMBER 11, 2023

If you want to do efficient linear algebra, you don’t want to write your own code by hand; that would be slow. Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. Seeing only the end result of T.[0] This is that library.

C++ 115

C++ Lambda Network Programming 115

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. You need to identify the source (like TCP/IP if it is fixed, username) and design which settings you want for your resource groups. Will this work?

Tuning 44

Tuning Virtualization Testing Servers 44

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

Percona

AUGUST 5, 2023

If you don’t have well-designed and small columns for this composite primary key, it could enlarge all of your secondary indexes. Various partition types, like RANGE, LIST, HASH, and KEY, are used for specific needs, from range-based data to custom criteria, to ensure efficient data handling and the optimization of queries.

Strategy 40

Strategy Storage Database Best Practices 40

The Morning Paper

JUNE 27, 2019

The thrust of the argument is that there’s a chain of inter-linked assumptions / dependencies from the hardware all the way to the programming model, and any time you step outside of the mainstream it’s sufficiently hard to get acceptable performance that researchers are discouraged from doing so. Challenges compiling non-standard kernels.

Systems 87

Systems Tuning Programming Innovation 87

Percona

JANUARY 19, 2023

In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. Redundant indexes: It is known that accessing rows by fetching an index is more efficient than through a table scan in most cases. It can help us to save costs on storage and backup times.

Open Source 85

Open Source Storage Database Big Data 85

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. The key to an efficient system is the identification of cold pages: the cold age threshold determines how many seconds we can go without a page being accessed before it is declared cold. ML-based auto-tuning. Evaluation.

Software 78

Software Software Google Hardware 78

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Using this data, we designed targeted experiments to investigate anomalies and verify or disprove our hypotheses about the undelying causes… About ten thousand data points were collected altogether, see [link]. FAST’20. Making the most of your memory.

Scalability 59

Scalability Latency Cache Media 59

HammerDB

FEBRUARY 25, 2021

As we have seen databases are designed to handle multiple database sessions at the same time. However, having the application logic in the client is even worse because you are sacrificing key database efficiencies of prepared statements. Basic Benchmarking Concepts. To benchmark a database we introduce the concept of a Virtual User.

Programming 67

Programming Benchmarking Virtualization C++ 67

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. For specific information on I/O tuning and balancing, you will find more details in the following document.

Servers 40

Servers Cache Media Hardware 40

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. This can be efficient at the beginning but counter-productive in a long run.

Latency 63

Latency Analytics Scalability Engineering 63

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. Alternate designs. The clock keeps running at the same rate even during sleep.

Servers 95

Servers Tuning Architecture Performance 95

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e., addl $1, %eax vfmadd213pd %zmm16, %zmm17, %zmm29.

Latency 40

Latency Hardware Code Testing 40

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. Such policies would be designed to mitigate legal problems and require regulatory compliance. of users and 3.9%

Open Source 112

Open Source Artificial Intelligence Google Infrastructure 112

All Things Distributed

MARCH 19, 2018

So, when designing Amazon SageMaker we took on a challenge: to build machine learning algorithms that can handle an infinite amount of data. This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. Post-training model tuning and rich states. Streaming algorithms.

Scalability 159

Scalability Hardware AWS Tuning 159

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 102

Hardware Storage Big Data Blockchain 102

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites.

Open Source 279

Open Source Network Infrastructure Big Data 279

SQL Server According to Bob

JANUARY 11, 2020

​​ With new ​​ innovations ​​ come ​​ new terms, designs, ​​ and ​​ algorithms. This is different from ​​ the reference count design ​​ that was ​​ used in SQL Server 7.0 and ​​ 2000.

Servers 40

Servers Cache Database Media 40

All Things Distributed

MARCH 7, 2013

After working with DynamoDB for only three days, they had already managed to go from the design phase to a fully production-ready deployment that could handle the biggest advertising event of the year. DynamoDB runs on a fleet of SSD-backed storage servers that are specifically designed to support DynamoDB. As Amazonâ??s

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

O'Reilly

OCTOBER 11, 2022

Andrew Ng , Christopher Ré , and others have pointed out that in the past decade, we’ve made a lot of progress with algorithms and hardware for running AI. Our current set of AI algorithms are good enough, as is our hardware; the hard problems are all about data. Designing the loop needs to be part of the automation plan.

Games 120

Games Healthcare Processing Retail 120

Smashing Magazine

AUGUST 22, 2021

One aspect of performance is about how efficiently a transport protocol can use a network’s full (physical) bandwidth (i.e. As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. Many network interface controllers (NICs) even have built-in hardware-offload features for TCP.

Performance 107

Performance Network Latency Servers 107

High Scalability

NOVEMBER 25, 2019

To help our customers manage ongoing data explosion, we have designed many of the core components over the last few years. Version7 (Future): Move all compute to the public cloud, carve out more services for impact isolation, dynamic resource pooling to manage pets and cattle efficiently. How much upfront design should you do?

Architecture 52

Architecture Cache Azure Storage 52