The Morning Paper

DECEMBER 5, 2019

Benchmarking spreadsheet systems Rahman et al., When spreadsheets were originally conceived, data and formula were input by hand and so everything operated at human scale. Increasingly we’re dealing with larger and larger datasets — for example, data imported via csv files — and spreadsheets are creaking. Rahman et al.

Benchmarking 56

Benchmarking Systems Google Scalability 56

Scalegrid

NOVEMBER 25, 2019

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 Google Cloud.

Big Data 187

Big Data Database Open Source Azure 187

Dynatrace

OCTOBER 19, 2023

With the increasing frequency of cyberattacks, it is imperative to institute a set of cybersecurity best practices that safeguard your organization’s data and privacy. Vulnerability management Vulnerability management is the process of identifying, prioritizing, rectifying, and reporting software vulnerabilities.

Best Practices 214

Best Practices Benchmarking Speed Infrastructure 214

Dynatrace

JUNE 26, 2023

This, in turn, accelerates the need for businesses to implement the practice of software automation to improve and streamline processes. This involves big data analytics and applying advanced AI and machine learning techniques, such as causal AI. Software is behind most of our human and business interactions.

Software 193

Software Software Analytics Big Data 193

Dynatrace

NOVEMBER 30, 2023

Social media was relatively quiet, and as always, the Dynatrace Insights team was benchmarking key retailer home pages from mobile and desktop perspectives. In the past, I tried to understand where in the page-loading process was the majority of time spent. There is a wealth of data tied up in logs that can be used by retailers.

Retail 226

Retail Social Media Performance Benchmarking 226

Percona

DECEMBER 26, 2023

Configuring Grafana For our purposes, the Grafana datasource used in this PoC is also the Postgres data cluster that is generating the data to be monitored. It collects various statistics data such as query statistics, query plan, SQL comments, and other performance insights. And yes, it even works in PostgreSQL.

Benchmarking 120

Benchmarking Metrics C++ Database 120

Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out. The following invocation generates almost 4GB of data.

Database 102

Database Benchmarking Latency C++ 102

Scalegrid

JUNE 4, 2020

We measure PostgreSQL throughput in terms of transactions processed. Throughput in general is the rate at which something is processed, and in terms of PostgreSQL, this is the number of transactions per second (TPS) your application can handle. Latency is the average transaction execution time of your PostgreSQL data.

Database 230

Database Latency Benchmarking Performance 230

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. All these contribute significantly towards ensuring smooth functioning.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

MAY 5, 2021

As more organizations respond to the pressure to release better software faster, there is an increasing need to build quality gates into every stage of BizDevOps processes , from early development to deployment. Automating quality gates creates reliable checks and balances and speeds up the process by avoiding manual intervention.

Benchmarking 188

Benchmarking Latency Speed Software 188

Scalegrid

JULY 29, 2020

It uses only one process which makes it very lightweight. If we require N parallel connections, this forks N child processes. By default, there are 32 child processes that are forked. Pgpool-II defines one process per child process. We cannot control which child process a client connects to. Not supported.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. It is important to note how much data the client needs to download. Large preview ).

Cache 126

Cache Performance Servers Social Media 126

Dynatrace

SEPTEMBER 21, 2023

A single data center can consume the equivalent electricity of 50,000 homes.” The app’s advanced algorithms and real-time data analytics translate utilization metrics into their CO2 equivalent (CO2e). Because Carbon Impact is integrated with Dynatrace Smartscape ® topology modeling, it’s easy to drill into host and process details.

Energy 239

Energy Cloud Airlines Strategy 239

The Netflix TechBlog

NOVEMBER 13, 2023

In this blog post, we will introduce speech and music detection as an enabling technology for a variety of audio applications in Film & TV, as well as introduce our speech and music activity detection (SMAD) system which we recently published as a journal article in EURASIP Journal on Audio, Speech, and Music Processing.

Architecture 224

Architecture Energy Benchmarking Processing 224

John McCalpin

APRIL 25, 2023

This metric is interesting because we don’t always have the luxury of parallelizing every application we run, and our operating systems almost always process each call (e.g., GHz, 1530 GB/s peak BW from 6 HBM stacks), I see single-thread sustained memory bandwidth of 304 GB/s on the ReadOnly benchmark used here. Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Dynatrace

AUGUST 29, 2022

Developers use release validation as an internal consistency mechanism to validate individual releases before collecting data for the next release. It is also a vital data collection mechanism for regression testing against subsequent releases. Look for automation tools to help with release validation data and reports.

DevOps 214

DevOps Benchmarking Cloud Monitoring 214

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Dynatrace

OCTOBER 2, 2023

It is better to consider refactoring as part of the application transformation process before migrating, if possible. Teams can gain this understanding through topology mapping , with telemetry data from request traces, and understanding how the frontend ties to backend functions.

Architecture 237

Architecture Artificial Intelligence Cloud Open Source 237

The Netflix TechBlog

MARCH 14, 2023

Earlier we shared the details of one of these algorithms , introduced how our platform team is evolving the media-specific machine learning ecosystem , and discussed how data from these algorithms gets stored in our annotation service. Processing took several hours to complete. Some ML algorithms are computationally intensive.

Media 291

Media Innovation Energy Architecture 291

The Morning Paper

NOVEMBER 26, 2019

Mergeable replicated data types – part II Kaki et al., Last time out we saw how Mergeable Replicated Data Types (MRDTs) use a bijection between the natural domain of a data type and relational sets to define merge semantics between two concurrently modified versions given their lowest common ancestor (LCA).

C++ 98

C++ Storage Benchmarking Efficiency 98

Dynatrace

NOVEMBER 2, 2023

The result is smarter, data-driven solutions designed to manage cloud spend. Additionally, include benchmarks for stakeholders and best practices that support the anticipated growth of the organization as a whole. What is FinOps? This helps to prevent overprovisioning, underutilization of reserved instances, and hidden costs.

Cloud 201

Cloud Strategy Retail Energy 201

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 57

Servers Cache Retail Benchmarking 57

Dynatrace

NOVEMBER 22, 2022

Five-nines availability: The ultimate benchmark of system availability. Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Gather observability data from all digital touchpoints.

Infrastructure 188

Infrastructure Availability Systems Retail 188

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

SEPTEMBER 23, 2021

Container security is the practice of applying security tools, processes, and policies to protect container-based workloads. If containers are run with privileged flags, or if they receive details about host processes, they can easily become points of compromise for corporate networks. What is container security?

Open Source 255

Open Source Benchmarking Best Practices Network 255

Dynatrace

JUNE 27, 2022

Real user monitoring (RUM) is a performance monitoring process that collects detailed data about users’ interactions with an application. RUM collects data on each user action within a session, including the time required to complete the action, so IT pros can identify patterns and where to make improvements in experience.

Best Practices 180

Best Practices Monitoring Wireless Traffic 180

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. Key challenges. Performance.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Scalegrid

JANUARY 12, 2024

Key Takeaways A cloud workload encompasses any application or service running on a cloud infrastructure, facilitating tasks ranging from basic functions to advanced data analysis with the help of resources like databases, collaboration tools, and disaster recovery systems. This applies to both virtual machines and container-based deployments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

MARCH 22, 2024

Crafting Your Multi-Cloud Blueprint Formulating a comprehensive multi-cloud framework is an intricate process that requires a business’s specific requirements, choosing suitable cloud services, and optimizing for performance and affordability. Each private cloud setup has perks and benefits, especially for handling specific tasks.

Strategy 130

Strategy Cloud Government Innovation 130

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Dynatrace

MARCH 25, 2022

Indeed, according to recent Uptime Institute data, outages have become far more expensive over the past several years. With an observability platform powered by contextual software intelligence, organizations can gather data on incidents in real-time and proactively. In a breakout session at Dynatrace Perform 2022, they explained how.

Benchmarking 176

Benchmarking Efficiency DevOps Tuning 176

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. The process started with manual pull of member account information that was part of the session.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Percona

DECEMBER 20, 2023

Unfortunately, the performance in benchmarks is almost the same as for 4KB pages. Please check out the Why Linux HugePages are Super Important for Database Servers: A Case with PostgreSQL blog post for more information. Setup I recommend starting with 2MB huge pages because it’s trivial to set up.

C++ 95

C++ Virtualization Benchmarking Database 95

Speed Curve

OCTOBER 25, 2023

You can even go one step further and integrate your performance budgets with your CI/CD process, so that you not only get alerts but even break the build if a new deploy would violate any of your budgets. Integrating your budgets with your CI process is like having your security cameras trigger your guards to rush in and stop the bad guys.

Benchmarking 62

Benchmarking Metrics Website Monitoring 62

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. We’re now allowing for even easier OneAgent rollout by freeing up the /opt mount point from any runtime data that’s produced by OneAgents. Dynatrace news.

Best Practices 202

Best Practices Storage Java Benchmarking 202