Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform.

Open Source 347

Open Source Java Operating System Programming 347

Scalegrid

DECEMBER 21, 2023

Such as: RedisInsight – Offers an easy way for users to oversee their Redis® information with visual cues; Prometheus – Providing long-term metrics storage solutions when tracking performance trends involving your instances; Grafana – Its user-friendly interface allows advanced capabilities in observing each instance.

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. It also supports the flexibility and scalability of the database infrastructure.

Availability 105

Availability Database Open Source Hardware 105

Scalegrid

JULY 13, 2020

Recognized as the fastest growing database by popularity, PostgreSQL was named the DBMS of the year in both 2018 and 2017 by DB-Engines, and continues to grow in popularity in 2019. Scalability. PostgreSQL offers free scalability, and can scale up to millions of transactions per seconds. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This not only enhances performance but also enables you to make more efficient use of your hardware resources, potentially resulting in cost savings on infrastructure.

Tuning 52

Tuning Database Performance Hardware 52

Percona

FEBRUARY 24, 2023

Use reduction at scale requires a cultural shift, and engineers must consider the cost as they think of memory or bandwidth as another deployment KPI. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2.

Cloud 116

Cloud Serverless AWS Storage 116

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

DECEMBER 27, 2023

The field of Platform Engineering has witnessed significant advancements, as evidenced by the publication of the CNCF platform whitepaper and the introduction of a dedicated Platform Engineering day at the upcoming KubeCon event. They also remove toil and allow engineers to focus on application development vs platform engineering work.

Cloud 77

Cloud Open Source Strategy Best Practices 77

Percona

NOVEMBER 1, 2023

MySQL backups play a pivotal role in safeguarding the integrity of your data, providing defense against various unforeseen calamities, hardware malfunctions, data loss, corruption, and inadvertent deletions. Encryption Backups have sensitive data, so it’s highly recommended to encrypt, especially for offsite storage.

Best Practices 78

Best Practices Storage Strategy Database 78

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . driver: intel_pstate CPUs which run at the same hardware frequency: 0 .

Best Practices 40

Best Practices Scalability Performance C++ 40

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

MARCH 7, 2013

Werner Vogels weblog on building scalable and robust distributed systems. s fast and easy scalability can be quickly applied to building high scale applications. We have also reduced our underlying costs through significant technical innovations from our engineering team. All Things Distributed. Comments (). s prices by 70%.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

All Things Distributed

MARCH 11, 2016

Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

Percona

SEPTEMBER 1, 2023

Scalability is a significant concern, as databases must handle growing data volumes and user demands while maintaining peak performance. Vertical scaling is also often discussed, which involves increasing the resources of a single server, which can have limitations in hardware capabilities and become costly as demands grow.

Best Practices 70

Best Practices Traffic Database Servers 70

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. These factors meant that often when looking for database performance information, the results for a particular combination of software and hardware were not available. What is HammerDB? Why HammerDB was developed.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Can you afford the necessary hardware, software, and operational costs of maintaining a PostgreSQL HA solution? there cannot be high availability.

Availability 82

Availability Open Source Architecture Database 82

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. This method distributes data evenly across partitions to achieve balanced storage and optimal query performance. You want to ensure that table lookups go to the correct partition or group of partitions.

Strategy 40

Strategy Storage Database Best Practices 40

Testsigma

JULY 3, 2021

More control: While performing on-premise testing, organizations have more control over configurations, setup, hardware, and software. The security and data storage infrastructure has to meet certain security compliances and standards; only then, the infrastructure is good to go for testing. Scalability comes at a price.

Cloud 57

Cloud Testing Storage DevOps 57

All Things Distributed

AUGUST 24, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 Comments ().

Storage 108

Storage Hardware AWS Data Engineering 108

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. faster access to external storage and data locality (I/O, bandwidth). Under the hood, the BlueData used several enhancements to boosts the I/O performance and scalability of container-based clusters. Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

All Things Distributed

OCTOBER 7, 2015

In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. QuickSight is a fast, cloud native, scalable, business intelligence service for the 1/10th the cost of old-guard BI solutions.

Cloud 137

Cloud Big Data AWS Analytics 137

Adrian Cockcroft

JUNE 21, 2022

So in 1988 I joined the Sun sales force and became a Systems Engineer (nowadays we would say Solutions Architect). I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Not everyone is operating at Netflix or Spotify scale data engineering function. A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Morning Paper

SEPTEMBER 19, 2019

AliGraph covers Alibaba’s distributed graph engine supporting the development of new GNN applications. Autoscaling tiered cloud storage in Anna. It handles an order of magnitude more throughput than a prototype built on a stream processing engine. Could it be Analyzing efficient stream processing on modern hardware ?

Blockchain 46

Blockchain Hardware Google Analytics 46

Percona

DECEMBER 14, 2022

The CITUS columnar extension is just one part of a larger set of capabilities of this extension that when fully implemented creates a fully scalable distributed Postgres database system. The CITUS columnar extension feature set includes: Highly compressed tables: Reduces storage requirements. Columnar storage. References tables.

Database 92

Database Analytics Storage Processing 92

High Scalability

NOVEMBER 25, 2019

This is a guest post by Kalpesh Patel , an Engineer, who for Egnyte from home. It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Optimize on prem cold storage cost. 500+ Storage nodes powered by Tomcat/Nginx.

Architecture 52

Architecture Cache Azure Storage 52

Highly Scalable

APRIL 2, 2012

Taking into account the previous considerations, performance requirements were set as 1000 faceted navigation requests/second per typical hardware blade. The deployment schema includes three types of nodes – processing nodes, storage nodes, and maintenance nodes. Storage nodes are basically Coherence storage nodes.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

All Things Distributed

SEPTEMBER 6, 2013

Shell''s scientists, especially the geophysicists and drilling engineers, frequently use cloud computing to run models. Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Recently I had great conversations with Troy Otillio, Senior Development Manager at Intuit and Jack Murgia, Senior DevOps Engineer at Edmodo. Jack and his engineers have created a safe social app for teachers and students. All Things Distributed.

Innovation 146

Innovation AWS Education Network 146

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Driving Storage Costs Down for AWS Customers. All Things Distributed.

Cloud 118

Cloud AWS Automotive Latency 118

HammerDB

DECEMBER 5, 2020

From an engineering perspective this may be all that you need to know. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. The simple answer is nothing, the workloads are exactly the same workloads derived from the TPC-C and TPC-H specifications and HammerDB v4.0

C++ 40

C++ Benchmarking Virtualization Open Source 40

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. The early GPU systems were very vendor specific and mostly consisted of graphic operators implemented in hardware being able to operate on data streams in parallel. Driving Storage Costs Down for AWS Customers. All Things Distributed. Comments ().

AWS 136

AWS Latency Programming Architecture 136

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. The second work presented a novel scalable distributed capability mechanism for security and protection in such systems.

Architecture 12

Architecture Hardware Cache Storage 12

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. Modularity and flexibility.

Big Data 154

Big Data Processing Lambda Database 154

SQL Server According to Bob

JANUARY 11, 2020

​​ The storage ​​ space that is required ​​ for the sparse file is only that of the actual bytes written to the file and not the ​​ maximum ​​ file ​​ size.

Servers 40

Servers Cache Database Media 40