Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. Using default scheduler's node affinity feature you can ensure that certain pods only schedule on nodes with specialized hardware like GPU, memory-optimised, I/O optimised etc. Kubernetes has a massive community support and momentum behind it.

Big Data 63

Big Data Storage Benchmarking Hardware 63

HammerDB

DECEMBER 5, 2020

From an engineering perspective this may be all that you need to know. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. more transactions than system B in the fully audited benchmark then the HammerDB result was also 1.5X I.e. if system A generated 1.5X

C++ 40

C++ Benchmarking Virtualization Open Source 40

Abhishek Tiwari

DECEMBER 13, 2017

More importantly, if this works out well, this could lead to a radical improvement in performance by leveraging hardware trends such as GPUs and TPUs. Their result is particularly promising for specialized index structures termed as learned indexes which has potential to replace B-Trees without major re-engineering. Learned indexes.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Alex Russell

MARCH 9, 2024

Learning to tell the difference is helpful for browser project managers and engineers, but also working web developers who struggle to develop theories of change for affecting browser teams. In industrial-scale engineering projects like browsers headcount is destiny , but it isn't the whole story.

Benchmarking 59

Benchmarking Strategy Internet Internet 59

Brendan Gregg

MARCH 16, 2024

It was also a virtual machine that lacked low-level hardware profiling capabilities, so I wasn't able to do cycle analysis to confirm that the 10% was entirely frame pointer-based. and we may have been flying close to the edge of hardware cache warmth, where adding a bit more instructions caused a big drop.

Java 145

Java Cache Google Hardware 145

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. Supported Databases.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Benchmark before you decide. have been released since then with some major changes. Transparent huge pages (THP) disabled. I hope this helps!

Performance 123

Performance Hardware Tuning Storage 123

Daniel Lemire

FEBRUARY 8, 2019

The division by a power of two ( / (2 N )) can be implemented as a right shift if we are working with unsigned integers, which compiles to single instruction: that is possible because the underlying hardware uses a base 2. However, engineering matters because computer registers have finite number of bits, and multiplications can overflow.

C++ 279

C++ Benchmarking Hardware Testing 279

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

All Things Distributed

NOVEMBER 21, 2018

The Amazon Redshift team has delivered remarkable gains using a few simple engineering techniques: Leveraging fleet telemetry. Verifying benchmark claims. Clearly, they're updating their systems far more frequently than they did on-premises, which changes the nature of engineering problems the team needs to prioritize.

Cloud 135

Cloud Benchmarking Performance AWS 135

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. With each team, benchmarks lost are understood as bugs.

Media 145

Media Games Education Engineering 145

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. One, by researching on the Internet; Two, by developing small programs and benchmarking.

Java 207

Java C++ Benchmarking Programming 207

Dynatrace

NOVEMBER 22, 2022

Five-nines availability has long been the goal of site reliability engineers (SREs) to provide system availability that is “always on.” Five-nines availability: The ultimate benchmark of system availability. Site reliability engineering teams often measure system availability in percentages in the pursuit of 100% uptime.

Infrastructure 182

Infrastructure Availability Systems Retail 182

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 104

Availability Database Open Source Hardware 104

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. I love short benchmarks like this as I can disassemble the resulting binary and ensure that the compiled instructions match my expectations, and the compiler hasen't messed with it. ## 6.

Speed 126

Speed Java AWS Virtualization 126

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. What we should really compare is the MySQL and Aurora database engines provided by Amazon RDS. Considering a Fully Managed DBaaS Offering For Your Business? RDS MySQL is 5.5,

AWS 52

AWS Database Serverless Storage 52

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. As the data is distributed into smaller partitions, the database engine only needs to scan relevant partitions, leading to faster query responses. Streamlined Maintenance : Partitioning simplifies maintenance operations.

Strategy 40

Strategy Storage Database Best Practices 40

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. I love short benchmarks like this as I can disassemble the resulting binary and ensure that the compiled instructions match my expectations, and the compiler hasen't messed with it.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. I love short benchmarks like this as I can disassemble the resulting binary and ensure that the compiled instructions match my expectations, and the compiler hasen't messed with it. ## 7.

Speed 40

Speed Java AWS Virtualization 40

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . driver: intel_pstate CPUs which run at the same hardware frequency: 0 .

Best Practices 40

Best Practices Scalability Performance C++ 40

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. We get a strong sense for how bad site performance is going to be based on the percentage of engineering leads, PMs, and decision makers carrying high-end phones which they primarily use in urban areas. Deciding what benchmark to use for a performance budget is crucial.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MARCH 6, 2021

3] As we'll see below, CPUs are not improving fast enough to cope with frontend engineers' rosy resource assumptions. Hardware Past As Performance Prologue. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Engineering is the discipline of designing solutions under specific constraints. What's mysterious is that anybody pays them to do it.

Performance 90

Performance Network Mobile Speed 90

ACM Sigarch

OCTOBER 25, 2018

and Transistor Options Beyond 3nm examine ways to deliver performance by re-engineering traditional CMOS transistors. She is currently a Principal Hardware Engineer at Microsoft in the Quantum Architecture Group. Other research examines modifying existing technology to extract performance.

Architecture 67

Architecture Technology Technology Innovation 67

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e., addl $1, %eax vfmadd213pd %zmm16, %zmm17, %zmm29.

Latency 40

Latency Hardware Code Testing 40

SQL Server According to Bob

JANUARY 11, 2020

ReadFile WriteFile ReadFileScatter WriteFileGather GetOverlappedResult ​​ For extended details on the 823 error, see ​​ Error message 823 may indicate hardware problems or system problems ​​ ( [link] i crosoft.com/default.aspx?scid=kb scid=kb ; en-us;828339 ) on the Microsoft Web site.

Servers 40

Servers Cache Database Media 40

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. Oracle support for hardware and software packages is typically available at 22% of their licensing fees. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

High Scalability

NOVEMBER 25, 2019

This is a guest post by Kalpesh Patel , an Engineer, who for Egnyte from home. Keep it simple: New engineers join every month so the goal is to have them productive from week one - a simple architecture ensures easy induction. A fairly distributed engineering team at the start but now gravitating mostly in Mountain View, Poland, India.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Geekbench CPU performance benchmarks for the highest selling smartphones globally in 2019.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Geekbench CPU performance benchmarks for the highest selling smartphones globally in 2019.

Performance 145

Performance Cache Media Metrics 145