All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. While building Amazon SageMaker and applying it for large-scale machine learning problems, we realized that scalability is one of the key aspects that we need to focus on. Streaming algorithms.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

SEPTEMBER 29, 2021

Think of containers as the packaging for microservices that separate the content from its environment – the underlying operating system and infrastructure. This opens the door to auto-scalable applications, which effortlessly matches the demands of rapidly growing and varying user traffic. What is Docker? What is Kubernetes?

Open Source 307

Open Source Traffic DevOps Cloud 307

Percona

MARCH 23, 2023

PostgreSQL is a free and open source object-relational database management system (ORDBMS) that has existed since the mid-1990s. Over the years, it has evolved into a robust and feature-rich database that offers several advantages over other database management systems.

Database 113

Database Open Source Traffic Small Business 113

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 202

Java Scalability Traffic Architecture 202

Dynatrace

JUNE 9, 2021

The Marriott data breach, in which one of its reservation systems had been compromised and hundreds of millions of customer records, including credit card and passport numbers, were stolen. Snyk also reports that open-source software is a common entry point for vulnerabilities. million Americans, 15.2

Open Source 183

Open Source Entertainment Tuning Internet 183

Dynatrace

OCTOBER 2, 2023

Because they’re separate, they allow for faster release cycles, greater scalability, and the flexibility to test new methodologies and technologies. However, the distributed system of a microservices architecture comes with its own cost: increased application complexity and convoluted testing. Migration is time-consuming and involved.

Architecture 237

Architecture Artificial Intelligence Cloud Open Source 237

Dynatrace

AUGUST 16, 2021

Providing standardized self-service pipeline templates, best practices, and scalable automation for monitoring, testing, and SLO validation. Microsoft’s GitHub is the largest open-source software community in the world with millions of open-source projects. GitHub and GitHub Actions. Try it yourself.

Software 246

Software Software Open Source Azure 246

Dynatrace

JUNE 16, 2022

At the same time, open source software (OSS) libraries now account for more than 70% of most applications’ code base, increasing the risk of application vulnerabilities. An ideal RASP technology does not need training or fine-tuning to learn what bad application behavior looks like. Not scalable in cloud-native environments.

Tuning 228

Tuning Cloud Open Source Network 228

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. Another source reported a 43% overall increase in Prometheus adoption for the last six months of 2021.

Metrics 183

Metrics Engineering Energy Tuning 183

Scalegrid

MARCH 22, 2024

This process thoroughly assesses factors like cost-effectiveness, security measures, control levels, scalability options, customization possibilities, performance standards, and availability expectations. Register now for free and experience the seamless operation of your databases across multi-cloud and hybrid-cloud systems.

Strategy 130

Strategy Cloud Government Innovation 130

Percona

DECEMBER 27, 2023

We want adopters of our technology to be able to deploy their critical open source databases and applications across any public or private cloud environment. Creating repositories for memory-safe patterns in cloud systems to improve overall security. It’s worry-free and doesn’t require human intervention.

Cloud 77

Cloud Open Source Strategy Best Practices 77

Dynatrace

DECEMBER 8, 2020

Open source has also become a fundamental building block of the entire cloud-native stack. While leveraging cloud-native platforms, open-source and third-party libraries accelerate time to value significantly, it also creates new challenges for application security.

Cloud 294

Cloud Open Source Internet Internet 294

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Mantis is our go-to platform for processing operational data at Netflix.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

NOVEMBER 3, 2023

Sure, database migration is complex, particularly when you’re looking to migrate from a proprietary database to an open source one. Have you tuned your environment? This is particularly true when you’re migrating to an open source database that those on your staff may or may not be intimately familiar with.

Database 81

Database Open Source Benchmarking Strategy 81

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Percona Monitoring and Management (PMM) – A fully open source monitoring tool to help you run your databases (not limited to MongoDB).

Availability 96

Availability Servers Database Open Source 96

Percona

MARCH 23, 2023

Operating system Linux is the most common operating system for high-performance MySQL servers. Some cloud providers also offer specialized instances for database workloads, which may provide additional features and optimizations for performance and scalability. If you see concurrency issues, you can tune this variable.

Performance 123

Performance Hardware Tuning Storage 123

Percona

DECEMBER 13, 2023

Error logging is a critical aspect of database administration, providing insights into issues, warnings, and errors that may affect the system’s stability and performance. MySQL 8 introduces Error Log Filtering as a mechanism to fine-tune the error log, allowing administrators to focus on the most critical issues.

Database 91

Database Open Source Tuning Traffic 91

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). It has evolved steadily, however, during 25 years as an open source project.

Open Source 76

Open Source Healthcare Social Media Database 76

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. As VMAF evolves and is integrated with more encoding and streaming workflows within Netflix, we need scalable ways of fostering video quality innovations.

Media 171

Media Innovation Metrics Latency 171

Percona

OCTOBER 12, 2023

An example of a flame graph can be found below: Each box is a function in the stack, and wider boxes mean more time the system was busy on CPU on these functions. Kubernetes limitations In Linux, by default, performance system events can’t be collected by unprivileged users.

Code 107

Code Tuning C++ Benchmarking 107

The Netflix TechBlog

NOVEMBER 9, 2020

Netflix is known for its loosely coupled and highly scalable microservice architecture. This solves many of the consistency and development velocity challenges with minimal tradeoffs on dimensions like scalability and operability. Independent services allow for evolving at different paces and scaling independently.

Architecture 359

Architecture Engineering Scalability Open Source 359

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. sysbench is a widely used open-source benchmarking tool that is designed to evaluate the performance of CPU, memory, disk I/O, and database systems. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

Percona

AUGUST 7, 2023

Both logs are crucial in the ACID (Atomicity, Consistency, Isolation, Durability) properties of database systems. Crash recovery: In the event of a system crash or restart, the undo log helps restore the database to a consistent state by applying the necessary undo operations based on the recorded before-images.

Database 94

Database Tuning Storage Open Source 94

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. We’d like to get deeper insight into the host, the underlying operating system, and any third-party services used by our application.

Metrics 176

Metrics Monitoring Database Network 176

Dynatrace

FEBRUARY 10, 2021

Critical success factors – velocity, resilience, and scalability. Resilience : Critical production business systems must not fail. Stay tuned for another blog post demonstrating how Dynatrace Cloud Automation addresses velocity, resilience, and scalability from a practitioner’s point of view.

Cloud 171

Cloud DevOps Speed Azure 171

Dynatrace

NOVEMBER 4, 2019

In order to accomplish this, one of the key strategies many organizations utilize is an open source Kubernetes environment, which helps build, deliver, and scale containerized Cloud Native applications. Logs: A log file tells you about an event that has already happened; it is a record of events from software and operating systems.

Monitoring 219

Monitoring Cloud Metrics Code 219

Percona

JANUARY 4, 2024

In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning.

Storage 85

Storage Engineering Database Hardware 85

Percona

JULY 27, 2023

MySQL previously released software quarterly as part of a continuous delivery system where new features were made available. The sync_relay_log_info, binlog_format, and group_replication_recovery_complete_at system variables are deprecated and will be removed. This could be handy for tracking query tuning and performance auditing.

Servers 81

Servers Open Source Tuning Cache 81

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption.

Database 212

Database Traffic Transportation Open Source 212

Dynatrace

NOVEMBER 4, 2019

In order to accomplish this, one of the key strategies many organizations utilize is an open source Kubernetes environment, which helps build, deliver, and scale containerized Cloud Native applications. Logs: A log file tells you about an event that has already happened; it is a record of events from software and operating systems.

Monitoring 100

Monitoring Cloud Metrics Code 100

HammerDB

JANUARY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are specific to the context of HammerDB as an independent personal project and are not related to Intel in any way. Scalability. Repeatability.

Benchmarking 40

Benchmarking Database Social Media Scalability 40

All Things Distributed

APRIL 11, 2012

Werner Vogels weblog on building scalable and robust distributed systems. And increasingly, search is applied to data that, though called a "document" for the purposes of search, is really just a record in a database or an object in a NoSQL system. All Things Distributed. Expanding the Cloud â?? Introducing Amazon CloudSearch.

Cloud 149

Cloud AWS Technology Technology 149

Rigor

SEPTEMBER 11, 2019

Rachel is also one of the people behind Perch , a PHP content management system (CMS). Sergey is an open source developer, tireless educator on performance topics, and author of many web performance-related tools, including ShowSlow , SVN Assets , drop-in.htaccess and more. Scott Jehl. Scott Jehl.

Performance 89

Performance Education Google Website 89

HammerDB

OCTOBER 18, 2019

As noted previously the main developer of HammerDB is an Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are my own, specific to the context of HammerDB as an independent personal project and not representing Intel. So by default, the system boots into powersave. 3834 2696 .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Percona

JULY 30, 2018

In modern data architectures, we’re increasingly moving from single-node design systems to distributed architectures using multiple nodes – often spread across multiple databases and multiple continents. In this presentation, we will look at how we can use MySQL to engineer distributed multi-node systems. Register Now.

Architecture 41

Architecture Database Open Source Internet 41

Abhishek Tiwari

JULY 12, 2018

In a nutshell, a data pipeline is a distributed system. If tuned for performance, there is a good change reliability is compromised - and vice versa. Pipeline is infinitely scalable Given the elasticity offered by public clouds, one would think that data pipelines are infinitely scalable which is entirely misleading.

Latency 63

Latency Analytics Scalability Engineering 63