The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. Organizations are taking advantage of having managed backups, lots of built-in security features, an uptime SLA of 99.99%, and an always up-to-date environment where they are no longer responsible for patching SQL Server or the operating system. GB per vCore.

Azure 63

Azure Performance Storage Latency 63

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Kubernetes is emerging as the “operating system” of the cloud. Kubernetes moved to the cloud in 2022.

Open Source 340

Open Source Java Operating System Programming 340

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 243

AWS Efficiency Azure Cloud 243

Dynatrace

MARCH 24, 2023

Containers enable developers to package microservices or applications with the libraries, configuration files, and dependencies needed to run on any infrastructure, regardless of the target system environment. This means organizations are increasingly using Kubernetes not just for running applications, but also as an operating system.

Infrastructure 182

Infrastructure Open Source Operating System Cloud 182

Particular Software

MAY 11, 2017

If you're using Azure Storage Persistence and haven't upgraded to NServiceBus 6 yet, get ready for a tremendous performance boost for your application when you do especially if you make use of sagas. Azure Table Storage, where saga data is stored, is limited to indexing on two columns: the Partition Key and the Row Key.

Azure 40

Azure Storage Performance Systems 40

Dynatrace

JUNE 7, 2023

According to the Kubernetes in the Wild 2023 report, “Kubernetes is emerging as the operating system of the cloud.” ” In recent years, cloud service providers such as Amazon Web Services, Microsoft Azure, IBM, and Google began offering Kubernetes as part of their managed services. Ease of use.

Open Source 203

Open Source Social Media Infrastructure Operating System 203

Scalegrid

JANUARY 8, 2024

By analyzing real-time data, AI-based models can: Adjust the allocation of resources in response to demand Boost business performance Reduce unnecessary expenditures Lead to significant cost savings Improve scalability Operational Efficiency through Automation Automation is a significant way AI enhances cloud operations.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. The Kubernetes experience.

Virtualization 160

Virtualization Infrastructure Monitoring Cloud 160

Percona

JANUARY 24, 2023

Our Operators provide built-in backup and restore capabilities, but some users are still looking for old-fashioned ways, like storage-level snapshots (i.e., Both your storage and Container Storage Interface (CSI) must support snapshots. Example for mongod-data-my-cluster-name-cfg-0 : apiVersion: snapshot.storage.k8s.io/v1

Database 68

Database Storage Open Source AWS 68

Particular Software

JUNE 20, 2022

The key to a successful Cosmos DB system is its data partitioning strategy. Like the rows of shrubs in a hedge maze, the logical partitions that divide data must be carefully planned, because that affects the scalability of the system and defines the boundaries for logical transactions. In version 1.1

Azure 52

Azure Storage Strategy Tuning 52

Percona

DECEMBER 4, 2023

The percona-postgis33 and percona-pgaudit packages on YUM-based operating systems are renamed percona-postgis33_15 and percona-pgaudit15 respectively Download Percona Distribution for PostgreSQL 15.5 Percona XtraBackup 8.0.35-30 30 Percona XtraBackup 8.0.35-30 30 was released on December 4, 2023. Download Percona Backup for MongoDB 2.3.1

Open Source 82

Open Source Azure Servers Programming 82

Tasktop

JANUARY 9, 2020

Turning software delivery data into IT and business intelligence is nothing new; it’s the 21st-century gold rush. There’s a reason that the data integration market is expected to be worth $12.24 Data is the currency of business. . billion by 2022 and growing at a respectable 13.7% Challenge 2: DBA Reliance.

Software 59

Software Software Metrics Database 59

High Scalability

APRIL 16, 2019

Thus, whenever a master MySQL goes down (whether due to a MySQL crash, OS crash, system reboot, etc.), This ensures that the system continues to be available to the applications. At ScaleGrid, we offer highly available hosting for MySQL on AWS and MySQL on Azure that is implemented based on the concepts explained in this blog series.

Availability 149

Availability Network Azure AWS 149

Adrian Cockcroft

APRIL 7, 2023

Sunset in Morocco — photo taken by Adrian We want to reduce carbon emissions of our compute and storage workloads, and one way of doing this is to choose a time and place where the “grid mix” of energy consumed is less carbon intensive. If it gets too small, they provision more racks of systems.

Energy 52

Energy AWS Azure Cloud 52

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

OCTOBER 6, 2023

Grail: Enterprise-ready data lakehouse Grail, the Dynatrace causational data lakehouse, was explicitly designed for observability and security data, with artificial intelligence integrated into its foundation. Tables are a physical data model, essentially the type of observability data that you can store.

Artificial Intelligence 258

Artificial Intelligence Analytics Metrics Storage 258

Dynatrace

APRIL 19, 2023

Creating an ecosystem that facilitates data security and data privacy by design can be difficult, but it’s critical to securing information. When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration.

Design 188

Design Storage Programming Analytics 188

Dynatrace

SEPTEMBER 17, 2019

Some vendors have just bolted on individual capabilities which often leads to six data silos. PostgreSQL & Elastic for data storage. MaaSS for Business: Data per SaaS-Tenant. The Business teams therefore built a set of dashboards that contain the data they want to see. REDIS for caching.

AWS 127

AWS Monitoring Ecommerce Lambda 127

ScaleOut Software

JULY 19, 2021

How are we managing the torrent of telemetry that flows into analytics systems from these devices? Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The list goes on.

IoT 78

IoT Analytics Big Data Architecture 78

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require. It also shows real-time aggregate results being fed to displays for immediate consumption by operations managers.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications in operational environments such as these require. It also shows real-time aggregate results being fed to displays for immediate consumption by operations managers.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications such as these require. It’s not enough to just pick out interesting events from an aggregated data stream and then send them to a database for offline analysis using Spark.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JUNE 22, 2020

Going back to the mid-1990s, online systems have seen relentless, explosive growth in usage, driven by ecommerce, mobile applications, and more recently, IoT. The pace of these changes has made it challenging for server-based infrastructures to manage fast-growing populations of users and data sources while maintaining fast response times.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

ScaleOut Software

JUNE 22, 2020

Going back to the mid-1990s, online systems have seen relentless, explosive growth in usage, driven by ecommerce, mobile applications, and more recently, IoT. The pace of these changes has made it challenging for server-based infrastructures to manage fast-growing populations of users and data sources while maintaining fast response times.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. Note: It makes sense to use S3 as the cloud object storage solution only if we also use Amazon’s service for virtual servers on the cloud, EC2 , for running the application. Leonardo Losoviz. 2018-11-08T12:30:30+01:00.

AWS 44

AWS Servers Storage Cloud 44

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 106

Storage Strategy Cloud Azure 106

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Abhishek Tiwari

JULY 22, 2023

These policies encompass a wide range of concerns, including security best practices, data protection measures, industry regulations, privacy laws, accessibility requirements, and internal organizational policies. OPA can be integrated with a wide range of tools and systems, making it highly versatile.

AWS 52

AWS Best Practices Infrastructure Traffic 52

Percona

DECEMBER 27, 2022

Encrypting data at rest in a database management system (DBMS) refers to securing data by encrypting it when it is not being used or accessed. This is often done to protect sensitive data from unauthorized access or theft. The level granularity only encrypts the full or partial disk. Cluster-level encryption.

Database 94

Database Storage Servers Strategy 94

ScaleOut Software

APRIL 3, 2020

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. These questions can be answered using the latest data as it streams in from the field. How many ventilators currently are in repair by make?”.

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

APRIL 3, 2020

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. These questions can be answered using the latest data as it streams in from the field. How many ventilators currently are in repair by make?”.

Logistics 52

Logistics Analytics Scalability Cloud 52

ScaleOut Software

JULY 14, 2021

The Microsoft Azure IoT ecosystem offers a rich set of capabilities for processing IoT telemetry, from its arrival in the cloud through its storage in databases and data lakes. Acting as a switchboard for incoming and outgoing messages, Azure IoT Hub forms the core of these capabilities.

IoT 52

IoT Azure Analytics Serverless 52

Scalegrid

MARCH 14, 2024

Implementing a hybrid cloud solution involves careful decision-making regarding application and data placement, migration strategies, and choosing compatible cloud service providers while ensuring seamless integration and addressing security and compliance challenges. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Tasktop

MARCH 16, 2021

What if we could provide them with everything they need to practice data-driven value stream management (VSM) to measure and analyze the flow of customer value across their software portfolio? . Data Analyst : Performs analysis of data from the various tools, transforming and aligning them to generate value stream metrics.

Metrics 52

Metrics Healthcare Automotive Innovation 52

Dynatrace

NOVEMBER 20, 2023

Across the cloud operations lifecycle, especially in organizations operating at enterprise scale, the sheer volume of cloud-native services and dynamic architectures generate a massive amount of data. Generative AI brings data quality risks But generative AI also brings risks in terms of data quality. What is predictive AI?

AWS 206

AWS Artificial Intelligence Analytics Cloud 206