Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. If you see concurrency issues, you can tune this variable. have been released since then with some major changes.

Performance 123

Performance Hardware Tuning Storage 123

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. Performing updates, installing software, and resolving hardware issues requires up to 17 hours of developer time every week.

Serverless 245

Serverless Efficiency Lambda Azure 245

Percona

NOVEMBER 2, 2023

Powerful change streams and support for data definition language operations. x: Flexible modification of time-series data. New operators and variables for advanced data transformations. Improved performance : MongoDB continually fine-tunes its database engine, resulting in faster query execution and reduced latency.

Best Practices 84

Best Practices Hardware Tuning Scalability 84

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 29, 2023

Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables. Data redundancy, a database version of a RAID Pondering the case of high availability and redundancy, one replicates data by creating a replica via streaming replication.

C++ 77

C++ Database Storage Testing 77

Dynatrace

APRIL 21, 2023

The agencies resisted adopting the tool because it required significant time to configure and tune collected metrics into valuable information. Saving budget expenditures with tool rationalization Issues arise when there are multiple, disparate tools collecting data. More tools will lead to more voices saying, “Not my problem.”

Government 164

Government Infrastructure Innovation Monitoring 164

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. Oracle requires more complex ongoing administration, as all database configurations must evolve in conjunction with the data schemas and custom code. CitusDB – distributes data and queries horizontally across nodes.

Open Source 244

Open Source Tuning C++ Database 244

The Netflix TechBlog

NOVEMBER 9, 2021

AV1 playback on TV platforms relies on hardware solutions, which generally take longer to be deployed. Throughout 2020 the industry made impressive progress on AV1 hardware solutions. The Encoding Technologies team took a first stab at this problem by fine-tuning the encoding recipe. Stay tuned! Some titles (e.g.,

Media 246

Media Open Source Efficiency Software Engineering 246

Percona

AUGUST 29, 2018

In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. Ensure that $PGDATA environment variable is set to PostgreSQL’s data directory. #!/bin/bash Let’s now try to add some data into the database. SHMMAX / SHMALL. Until version 9.2,

Tuning 54

Tuning Database Servers Processing 54

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. However, the move to microservices comes with its own challenges and complexities.

Architecture 237

Architecture Artificial Intelligence Cloud Open Source 237

Percona

OCTOBER 18, 2023

Advantages of migrating to open source For many reasons mentioned earlier, organizations are increasingly shifting towards open source databases for their data management needs. This compatibility simplifies the migration of data from other environments, whether they are proprietary or another open source option.

Open Source 89

Open Source Database Hardware Strategy 89

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. A reduced throughput could generally indicate that the server gets fewer queries.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

MAY 1, 2020

The Linux ARM platform —the Linux kernel ported to ARM processor–based machines—is becoming a tempting, cost-effective solution for building microservice-oriented data centers. We understand the dependencies between the mainframe, data center, and cloud, including all application components and even end-user experience. Dynatrace news.

Java 133

Java Hardware Tuning Metrics 133

Dynatrace

OCTOBER 26, 2020

Dynatrace has recently enhanced its Metrics APIs, allowing everyone to send any type of metric with any set of data dimension to Davis, Dynatrace’s AI engine. Up until then, he had pushed JMeter data in other tools which made it harder to correlate it with the rest of the performance data captured by Dynatrace OneAgent.

Innovation 157

Innovation Metrics Hardware Games 157

All Things Distributed

MARCH 19, 2018

For example, training on more data means more accurate models. Machine learning is one such transformational technology that is top of mind not only for CIOs and CEOs, but also developers and data scientists. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Whether your data source is the API or OneAgent, you get the same visibility into the most critical performance metrics. So stay tuned!

Serverless 239

Serverless Azure Monitoring Lambda 239

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 307

Open Source Traffic DevOps Cloud 307

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log files contain much of the data that makes a system observable: for example, records of all events that occur throughout the operating system, network devices, pieces of software, or even communication between users and application systems.

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214

Percona

MARCH 27, 2023

The percentage in degradation will vary depending on many factors {hardware, workload, number of tables, configuration, etc.}. If you rely heavily on queries against information_schema, then your workload will benefit from upgrading to MySQL/Percona Server for MySQL 8 because of the new data dictionary format. While you are on 5.7,

Cache 98

Cache Hardware Servers Benchmarking 98

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. On the exact same hardware, the benchmark suite is then used to test 36 Linux release versions from 3.0 Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

O'Reilly

NOVEMBER 28, 2023

AI users say that AI programming (66%) and data analysis (59%) are the most needed skills. Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., Will this work?

Tuning 44

Tuning Virtualization Testing Servers 44

O'Reilly Software

APRIL 4, 2018

Considerations for setting the architectural foundations for a fast data platform. Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. Back in the days of Web 1.0,

Architecture 80

Architecture Scalability Google Operating System 80

Abhishek Tiwari

JULY 12, 2018

Building data pipelines can offer strategic advantages to the business. Often companies underestimate the necessary effort and cost involved to build and maintain data pipelines. Data pipeline initiatives are generally unfinished projects. In this post, we will discuss why you should avoid building data pipelines in first place.

Latency 63

Latency Analytics Scalability Engineering 63

The Netflix TechBlog

APRIL 29, 2019

Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites. Device interaction for the collection of health and other operational data is yet another Python application. We also use Python to detect sensitive data using Lanius.

Open Source 279

Open Source Network Infrastructure Big Data 279

Percona

DECEMBER 27, 2023

In our conversations with developers and engineers during the conference, we confirmed the CNCF GItOps Microsurvey data – 91% are already using GitOps. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 77

Cloud Open Source Strategy Best Practices 77

Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out. The following invocation generates almost 4GB of data.

Database 102

Database Benchmarking Latency C++ 102

Dynatrace

OCTOBER 28, 2021

The crisis could be technical, natural, or malicious events, for example an earthquake affecting data center availability, or a cyberattack infecting applications and websites. It created more uncertainty than the load balancing issues the entertainment firm saw in its data centers.

Engineering 231

Engineering Entertainment Cloud Infrastructure 231

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Whether your data source is the API or OneAgent, you get the same visibility into the most critical performance metrics. So stay tuned!

Serverless 143

Serverless Azure Monitoring Lambda 143

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 213

Latency Traffic Transportation Hardware 213

HammerDB

APRIL 19, 2023

Please refer to this tuning guide to tune the system for HammerDB: Open Source Database Tuning Guide on 3rd Generation Intel® Xeon® Scalable Processors Based Platform. For the experiments in this blog, we did not tune the system. on identical hardware, with identical settings, but at different load levels.

Performance 54

Performance Benchmarking Cache Storage 54

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

SQL Performance

APRIL 27, 2020

Many of the newer features we have in SQL Server were initially launched in Azure SQL Database, including (but not limited to) Always Encrypted, Dynamic Data Masking, Row Level Security, and Query Store. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. DTU Pricing Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. Data plane operations are handled by pluggable engines (Pony Express is an engine).

Network 92

Network Transportation Latency Entertainment 92

Dynatrace

OCTOBER 22, 2019

Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. On this page, the difference from a typical thread dump becomes obvious: the data is continuously available, with historical context, and doesn’t need to be triggered if a problem occurs.

Java 103

Java Scalability Hardware Architecture 103

The Morning Paper

MAY 21, 2019

Google’s “far” memory it turns out is exactly the same memory, but with compressed data stored in it! Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters.

Software 78

Software Software Google Hardware 78