Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Improved performance : MongoDB continually fine-tunes its database engine, resulting in faster query execution and reduced latency. Ready to supercharge your MongoDB experience?

Best Practices 90

Best Practices Hardware Tuning Scalability 90

The Morning Paper

JUNE 27, 2019

Machine learning systems are stuck in a rut Barham & Isard, HotOS’19. In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. Convolutional Capsule primitives can be implemented reasonably efficiently on CPU but problems arise on accelerators (e.g.

Systems 87

Systems Tuning Programming Innovation 87

Percona

OCTOBER 18, 2023

Parallel run : Operating both the existing and new database system simultaneously during the transition, allowing for a seamless fallback in case of any issues. Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you.

Open Source 95

Open Source Database Hardware Strategy 95

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Log monitoring vs log analytics.

Analytics 209

Analytics Monitoring Artificial Intelligence DevOps 209

Dynatrace

OCTOBER 28, 2021

The science has spawned specialized chaos engineers who dedicate themselves to disrupting cloud software and the on-prem systems they interact with to make them resilient. Because it can touch many systems, chaos engineering can have broad implications, affecting groups and stakeholders across the organization. Lack of observability.

Engineering 226

Engineering Entertainment Cloud Infrastructure 226

Percona

DECEMBER 27, 2023

Another significant issue within security concerns is the escalating complexity of modern systems, especially in platforms like Kubernetes, which highlights the need for unified threat models and scanning tools to address vulnerabilities. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 82

Cloud Open Source Strategy Best Practices 82

Dynatrace

SEPTEMBER 29, 2021

Think of containers as the packaging for microservices that separate the content from its environment – the underlying operating system and infrastructure. For a deeper look into how to gain end-to-end observability into Kubernetes environments, tune into the on-demand webinar Harness the Power of Kubernetes Observability. Networking.

Open Source 302

Open Source Traffic DevOps Cloud 302

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 91

Storage Engineering Database Hardware 91

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waiting queries mean waiting applications and users, and no one likes to wait!

Tuning 115

Tuning Servers Monitoring Hardware 115

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. MySQL package installers for Linux systems should set this capability. Then we need to see IF implementing the tuning will work or not.

Tuning 46

Tuning Virtualization Testing Servers 46

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand. Emphasis mine).

Network 92

Network Transportation Latency Entertainment 92

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Managed here means that the system automates resource provisioning for models to match a set of SLO constraints (cf. autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

MAY 21, 2019

” This paper describes a “far memory” system that has been in production deployment at Google since 2016. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. The system also collects per-job cold-page histograms for a given set of predefined cold age thresholds.

Software 78

Software Software Google Hardware 78

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. This is very efficient, as confirmed by the elapsed time of 13ms (all of which is CPU time).

Servers 86

Servers Tuning Database Efficiency 86

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Applications and files systems access App Direct memory using CPU instructions offering a variety of options for controlling the ordering of store operations: cache-line flush, cache-line write back, and non-temporal stores (bypassing the cache hierarchy). FAST’20.

Scalability 59

Scalability Latency Cache Media 59

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. However, having the application logic in the client is even worse because you are sacrificing key database efficiencies of prepared statements. Glue language. Tcl Multithreading in parallel.

Programming 67

Programming Benchmarking Virtualization C++ 67

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once? Exactly once?

Architecture 80

Architecture Scalability Google Operating System 80

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

Abhishek Tiwari

JULY 12, 2018

In a nutshell, a data pipeline is a distributed system. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. Pipeline reliability and performance go hand in hand.

Latency 63

Latency Analytics Scalability Engineering 63

KeyCDN

SEPTEMBER 20, 2018

Error monitoring can get increasingly complicated as you deal with bugs reported by users and your production team, which is why having an efficient error tracking workflow from the beginning is so important. Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app.

Strategy 67

Strategy Monitoring Website Google 67

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04

Virtualization 76

Virtualization AWS Engineering Hardware 76

John McCalpin

JANUARY 22, 2018

The double-precision matrix multiplication routine “DGEMM” is typically the computational kernel that achieves the highest fraction of peak performance on high performance computing systems. of the “adjusted peak performance”, there is no longer a significant upside to performance tuning. cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Java used to power core file system code. What is the name of your system and where can we find out more about it?

Architecture 52

Architecture Cache Azure Storage 52

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 99

Hardware Storage Big Data Blockchain 99

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites.

Open Source 279

Open Source Network Infrastructure Big Data 279

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

All Things Distributed

MARCH 19, 2018

" To make things even more challenging, a system that can handle a single large training job is not nearly good enough if training jobs are slow or expensive. This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. Post-training model tuning and rich states.

Scalability 159

Scalability Hardware AWS Tuning 159

O'Reilly

OCTOBER 11, 2022

meme originated in IT’s transformation from manual system administration to automated configuration management and software deployment. We could see it as an example of 1980s-style “ expert systems ,” based on deterministic business rules. Developers who are automating business systems have to determine where humans belong in the loop.

Games 116

Games Healthcare Processing Retail 116

All Things Distributed

MARCH 7, 2013

Werner Vogels weblog on building scalable and robust distributed systems. This allows us to tune both our hardware and our software to ensure that the end-to-end service is both cost-efficient and highly performant. All Things Distributed. DynamoDB One Year Later: Bigger, Better, and 85% Cheaperâ?¦. Comments ().

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

Smashing Magazine

AUGUST 22, 2021

One aspect of performance is about how efficiently a transport protocol can use a network’s full (physical) bandwidth (i.e. However, TCP is typically implemented in the operating system’s (OS’) kernel, a secure and more restricted environment, which for most OSes isn’t even open source. Congestion Control. UDP and TLS Performance.

Performance 105

Performance Network Latency Servers 105