Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success.

Best Practices 87

Best Practices Hardware Tuning Scalability 87

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. PostgreSQL.

Open Source 244

Open Source Tuning C++ Database 244

Percona

OCTOBER 18, 2023

It’s a complex process involving various factors and meticulous planning. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier. In this section, we’ll outline the essential steps involved in migrating to open source databases.

Open Source 92

Open Source Database Hardware Strategy 92

Percona

AUGUST 29, 2018

For optimum performance, a PostgreSQL database depends on the operating system parameters being defined correctly. In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. PostgreSQL uses System V (SysV) that requires SHMMAX setting.

Tuning 56

Tuning Database Servers Processing 56

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. However, the process of log analysis can become complicated without the proper tools.

Analytics 218

Analytics Monitoring Artificial Intelligence DevOps 218

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. All these contribute significantly towards ensuring smooth functioning.

Metrics 130

Metrics Monitoring Latency Cache 130

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post.

Latency 213

Latency Traffic Transportation Hardware 213

Dynatrace

MAY 1, 2020

This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint. Network measurements with per-interface and per-process resolution. Network metrics are also collected for detected processes.

Java 134

Java Hardware Tuning Metrics 134

All Things Distributed

MARCH 19, 2018

Bill Simmons, CTO of Dataxu, states, "We process 3 million ad requests a second - 100,000 features per request. " To make things even more challenging, a system that can handle a single large training job is not nearly good enough if training jobs are slow or expensive. Clearly, no customer has an infinite amount of data.

Scalability 159

Scalability Hardware AWS Tuning 159

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 105

Database Benchmarking Latency C++ 105

Dynatrace

OCTOBER 28, 2021

The science has spawned specialized chaos engineers who dedicate themselves to disrupting cloud software and the on-prem systems they interact with to make them resilient. The discoveries form inputs into the software development and delivery process, so new software and microservices will better stand up to unforeseeable events.

Engineering 234

Engineering Entertainment Cloud Infrastructure 234

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. A micro-benchmark suite, LEBench was then built around tee system calls responsible for most of the time spent in the kernel.

Performance 108

Performance Benchmarking Tuning Hardware 108

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 97

Hardware Storage Big Data Blockchain 97

Percona

DECEMBER 27, 2023

Another significant issue within security concerns is the escalating complexity of modern systems, especially in platforms like Kubernetes, which highlights the need for unified threat models and scanning tools to address vulnerabilities. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 80

Cloud Open Source Strategy Best Practices 80

DZone

AUGUST 16, 2019

It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system.

Scalability 145

Scalability Efficiency Hardware Software 145

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., What is the possible usage?

Tuning 45

Tuning Virtualization Testing Servers 45

Percona

JANUARY 4, 2024

In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning.

Storage 88

Storage Engineering Database Hardware 88

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. sysbench is a widely used open-source benchmarking tool that is designed to evaluate the performance of CPU, memory, disk I/O, and database systems. Operating System: Ubuntu 22.04 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

OCTOBER 22, 2019

If your system is under high load, it can run into thread-locking issues that prevent upward linear scaling of your application. Many systems don’t scale in a linear fashion because they need to coordinate work across many threads. Dynatrace news. Threads enable your application to execute multiple tasks at the same time.

Java 103

Java Scalability Hardware Architecture 103

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

NOVEMBER 28, 2023

Users and Nonusers AI adoption is in the process of becoming widespread, but it’s still not universal. Until AI reaches 100%, it’s still in the process of adoption. Automating the process of building complex prompts has become common, with patterns like retrieval-augmented generation (RAG) and tools like LangChain.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

The Morning Paper

MAY 21, 2019

” This paper describes a “far memory” system that has been in production deployment at Google since 2016. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. The system also collects per-job cold-page histograms for a given set of predefined cold age thresholds.

Software 78

Software Software Google Hardware 78

O'Reilly

OCTOBER 11, 2022

There seems to be broad agreement that hyperautomation is the combination of Robotic Process Automation with AI. We’ll see it in the processing of the thousands of documents businesses handle every day. We can certainly apply the slogan to many, if not all, clerical tasks–and even to the automation process itself.

Games 114

Games Healthcare Processing Retail 114

Alex Podelko

OCTOBER 20, 2016

Cloud seriously impacts system architectures that has a lot of performance-related consequences. First, we have a shift to centrally managed systems. Software as a Service’ (SaaS) basically are centrally managed systems with multiple tenants/instances. -New Architectures (this post). – New Technologies.

Performance Testing 100

Performance Testing Architecture Testing Performance 100

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. But wow, I didn’t think we’d be at the point yet where we’d be abandoning TCP/IP!

Network 92

Network Transportation Latency Entertainment 92

Adrian Cockcroft

JUNE 2, 2023

FSD has a sense of purpose, a planning capability, has real time agency and responds to its environment via an ego model, predicting the behavior of pedestrians and other road users, and is being tuned to drive in a very human way, so that other road users interact with it as a predicable normal driver. Tristan Zajonc, CEO of Continual.ai

Social Media 98

Social Media Innovation Open Source Entertainment 98

HammerDB

OCTOBER 18, 2019

So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests. So by default, the system boots into powersave. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00 uname -a Linux ubuntu19 5.3.0-rc3-custom

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

NOVEMBER 30, 2016

There are many more application areas where we use ML extensively: search, autonomous drones, robotics in fulfillment centers, text processing and speech recognition (such as in Alexa) etc. Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

SQL Performance

JUNE 21, 2019

I always check backups first when looking at a new system. Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Memory settings. Statistics.

Servers 49

Servers Azure Hardware Database 49

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The Sort only has 19 rows to process, so it consumes only 1ms or so. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. Test Environment.

Servers 86

Servers Tuning Database Efficiency 86

Dotcom-Montior

NOVEMBER 11, 2020

Serverless computing can be a huge benefit to organizations that don’t have the necessary resources or teams to manage physical resources, like servers/hardware, and all the maintenance and licensing that goes along with that, allowing them to focus on developing their code and applications. Benefits of a Serverless Model.

Serverless 57

Serverless Monitoring Lambda Latency 57

O'Reilly

JANUARY 16, 2024

I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance. software” rather than “hardware” in our brains). Whenever I paused for too long, ChatGPT would interpret what I said so far as my request and start processing it.

Entertainment 72

Entertainment Internet Internet Design 72

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

Dynatrace

NOVEMBER 20, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements.

Availability 32

Availability Hardware Java Tuning 32