Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 246

AWS Efficiency Azure Cloud 246

InfoQ

JUNE 26, 2023

Microsoft has recently unveiled several new features for Azure Cosmos DB to enhance cost efficiency, boost performance, and increase elasticity. These features are burst capacity, hierarchical partition keys, serverless container storage of 1 TB, and priority-based execution. By Steef-Jan Wiggers

Azure 87

Azure Serverless Performance Storage 87

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Using AI for Enhanced Cloud Operations The integration of AI in cloud computing is enhancing operational efficiency in several ways.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

DZone

JANUARY 23, 2022

Hardware - servers/storage hardware/software faults such as disk failure, disk full, other hardware failures, servers running out of allocated resources, server software behaving abnormally, intra DC network connectivity issues, etc. . – this is addressed through monitoring and redundancy. Redundancy by building additional data centers.

Hardware 243

Hardware DevOps Network Storage 243

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Scalegrid

NOVEMBER 29, 2023

As CTOs, database developers & experts, and DBAs seek more efficient, secure, and scalable cloud services solutions, DBaaS emerges as a compelling choice. A DBaaS automates several processes, such as using, erasing, and spinning up storage without interventions from IT staff. Your data will always be intact.

Healthcare 130

Healthcare Hardware Database Scalability 130

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. In a paper published this week at SIGMOD'17 , the Amazon Aurora team presents the design considerations for the new database engine and how they addressed them.

Database 117

Database Design Cloud Storage 117

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Dynatrace

SEPTEMBER 8, 2023

Similar to the tutorial extension, we created an extension that performs queries against databases. To achieve this, we’ll create a Grail bucket specifically designed to retain data for a duration of 10 years (3,657 days). Notably, the SQL query is not limited to specific columns or data with specific metric values (int or float).

Database 269

Database Artificial Intelligence Metrics Monitoring 269

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Caching partially stores your data and is not used as permanent storage.

Performance 125

Performance Cache Servers Social Media 125

Scalegrid

JANUARY 9, 2024

Defining Enterprise Cloud Security In today’s business landscape, the reliance on cloud services for data storage and processing has made enterprise cloud security a crucial factor. Data encryption should be applied along with robust access controls and efficient encryption key management procedures.

Strategy 130

Strategy Cloud Best Practices Government 130

Dynatrace

JUNE 7, 2023

Kubernetes also gives developers freedom of choice when selecting operating systems, container runtimes, storage engines, and other key elements for their Kubernetes environments. Like Kubernetes, it allocates resources efficiently and ensures high availability and fault tolerance. What is OpenShift?

Open Source 206

Open Source Social Media Infrastructure Operating System 206

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. These cultural points resonated with me most: freedom and responsibility, high bar for performance, and no hiring of brilliant jerks.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. A second job taps the data feed from the first job, does tail sampling of data and writes traces to the storage system.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

MAY 26, 2021

Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. After all, it’s key to sample and store traces efficiently while not missing out on important events. OTel is designed to ensure flexibility and stability. So, the design of OTel allows for flexibility.

AWS 212

AWS Strategy Storage Metrics 212

Dynatrace

DECEMBER 15, 2022

ITOps refers to the process of acquiring, designing, deploying, configuring, and maintaining equipment and services that support an organization’s desired business outcomes. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 202

Artificial Intelligence DevOps Hardware Virtualization 202

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

SEPTEMBER 30, 2021

Not only will they get much more out of the tools they use daily, but they’ll also be able to deliver superior functionality, efficiency, and performance to your customers. By carving the right AWS certification path, developers can even use their certification and training to advance their careers long term.

AWS 209

AWS Best Practices Analytics Cloud 209

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Dynatrace

MAY 26, 2021

Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. After all, it’s key to sample and store traces efficiently while not missing out on important events. OTel is designed to ensure flexibility and stability. So, the design of OTel allows for flexibility.

AWS 147

AWS Strategy Storage Metrics 147

Percona

JANUARY 19, 2023

While the technologies have evolved and matured enough, there are still some people thinking that MySQL is only for small projects or that it can’t perform well with large tables. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 93

Open Source Storage Database Big Data 93

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

APRIL 26, 2022

Understanding why a user is experiencing transactional or performance issues enables organizations to achieve greater observability that goes beyond metrics, traces and logs. DEM can give organizations business observability—insight into the effects of user experience on the bottom line. Endpoint monitoring (EM).

Monitoring 203

Monitoring Social Media IoT Metrics 203

CSS - Tricks

SEPTEMBER 21, 2020

In that example, usually, we’re thinking about performance moreso than energy consumption, but that’s interesting right away: does good performance map to lower energy usage? I can guess that maps pretty well to other platforms and other performance metrics. Imagine the performance implications of that.

Website 97

Website Energy Storage Efficiency 97

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. Percona XtraBackup performs crash recovery on the files to make a consistent, usable database again. This search tuple (key) is used to find the record to perform the undo operation. Old design (until Percona XtraBackup 8.0.33-27):

Cache 88

Cache Benchmarking Servers Design 88

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JUNE 4, 2023

While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation. It continues to be developed and maintained by the open source community and remains free to use under the GNU General Public License.

Open Source 52

Open Source Servers Storage Scalability 52

Percona

AUGUST 17, 2023

PostgreSQL has powerful and advanced features, including asynchronous replication, full-text searches of the database, and native support for JSON-style storage, key-value storage, and XML. It’s reliable, robust, feature-rich, and performant. It all helps ensure the cluster’s peak performance.

Open Source 81

Open Source Healthcare Social Media Database 81

Smashing Magazine

JANUARY 15, 2019

How Improving Website Performance Can Help Save The Planet. How Improving Website Performance Can Help Save The Planet. In 2013, A List Apart published Sustainable Web Design by James Christie. An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. Jack Lenox.

Website Performance 73

Website Performance Website Energy Performance 73

Testsigma

JULY 3, 2021

If you’ve been performing on-premise testing in your organization, you know the rules already. But for the uninitiated, on-premise testing is a form of testing where testers perform tests on local machines, systems, or devices set up at an office. As the name suggests, it happens on-premise. Photo by freestocks on Unsplash.

Cloud 57

Cloud Testing Storage DevOps 57

The Netflix TechBlog

MAY 21, 2019

The device ecosystem is rich with partners ranging from Silicon-on-Chip (SoC) manufacturers, Original Design Manufacturer (ODM) and Original Equipment Manufacturer (OEM) vendors. Solving the above problems could help Netflix and our Partners save time and money during the entire lifecycle of device design, build, test, and certification.

Testing 163

Testing AWS Lambda Network 163

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Scalability Architecture 130

The Morning Paper

JUNE 16, 2019

Such a design rules out an entire class of application errors, protecting private data from accidentally leaking. Although state-of-the-are databases have security features designed for exactly this purpose, such as row-level access policies and grants of views, these features are too limiting for many web applications.

Database 90

Database Cache Benchmarking Efficiency 90