Dynatrace

AUGUST 11, 2022

Effective application development requires speed and specificity. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. Infrastructure as a service (IaaS) handles compute, storage, and network resources.

Development 256

Development Serverless Best Practices Lambda 256

Dynatrace

OCTOBER 6, 2023

Grail: Enterprise-ready data lakehouse Grail, the Dynatrace causational data lakehouse, was explicitly designed for observability and security data, with artificial intelligence integrated into its foundation. Buckets are similar to folders, a physical storage location. There is a default bucket for each table.

Artificial Intelligence 266

Artificial Intelligence Analytics Metrics Storage 266

The Netflix TechBlog

SEPTEMBER 24, 2021

From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step. Since not all projects are terabytes projects, allocating the largest cloud storage to all packager instances is not an efficient use of cloud resources.

Cloud 237

Cloud Media Storage Cache 237

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Efficiency 199

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

MARCH 14, 2024

It provides significant advantages that include: Offering scalability to support business expansion Speeding up the execution of business plans Stimulating innovation throughout the company Boosting organizational flexibility, enabling quick adaptation to changing market conditions and competitive pressures.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Scalegrid

JANUARY 12, 2024

Storage is a critical aspect to consider when working with cloud workloads. High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. This also aids scalability down the line.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

KeyCDN

FEBRUARY 22, 2023

PWAs are designed to work offline, be fast, and provide a seamless user experience across different devices. Motion UI Motion UI is a design trend involving animation and other interactive elements to create a more dynamic and engaging user experience. They thus adapt to the user's browser, screen size, and device specifications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Percona

JULY 24, 2023

PBM) introduced a GA version of incremental physical backups , which can greatly impact both the recovery time and the cost of backup (considering storage and data transfer cost). Well, it is because we believe that open source philosophy is not only about the source but also about design and decision-making.

Availability 74

Availability Open Source Strategy Storage 74

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet.

AWS 96

AWS Cloud Storage Internet 96

Brendan Gregg

FEBRUARY 28, 2023

## References I've reproduced the references from my SREcon22 keynote below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

FEBRUARY 6, 2020

’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

Dynatrace

NOVEMBER 23, 2020

While speeding up development processes and reducing complexity does make the lives of Kubernetes operators easier, the inherent abstraction and automation can lead to new types of errors that are difficult to find, troubleshoot, and prevent. Configuring storage in Kubernetes is more complex than using a file system on your host.

Virtualization 162

Virtualization Infrastructure Monitoring Cloud 162

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 9, 2015

At Amazon we have hundreds of teams using machine learning and by making use of the Machine Learning Service we can significantly speed up the time they use to bring their technologies into production. Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc.

Lambda 122

Lambda Cloud IoT AWS 122

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius.

Database 106

Database AWS Network Design 106

Abhishek Tiwari

JULY 22, 2023

However, amidst the drive for speed, ensuring policy compliance is often overlooked, leading to potential security vulnerabilities and compliance risks. For instance, Sentinel policies can enforce rules such as "All AWS S3 buckets must have server-side encryption enabled" or "Only specific IAM roles can access certain resources."

AWS 52

AWS Best Practices Infrastructure Traffic 52

Percona

MAY 2, 2023

The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process. Percona Backup for MongoDB is an uncomplicated command-line tool by design that lends itself well to backing up larger data sets. Records backup progress logging.

Best Practices 52

Best Practices Database Storage Servers 52

High Scalability

JULY 20, 2018

DonHopkins : NeWS differs from the current technology stack in that it was all coherently designed at once by James Gosling and David Rosenthal, by taking several steps back and thinking deeply about all the different problems it was trying to solve together. Some are lucky enough to also have a production environment." Not so many this week.

Internet 121

Internet Internet Scalability Automotive 121

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform is a revolution in the way we handle infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. A future blog will continue my exploration into Citus by scaling out pgbench into other architectures.

Database 102

Database Benchmarking Latency C++ 102

All Things Distributed

JULY 19, 2012

AWS customers are bringing their most demanding workloads onto the cloud. Customers are also bringing workloads on AWS that require dedicated and high performance IO for which we are now introducing a new Amazon EC2 instance type, the High I/O Quadruple Extra Large (hi1.4xlarge), to meet their needs. Comments ().

Cloud 129

Cloud Performance AWS Virtualization 129

Enprowess

JANUARY 12, 2022

Web development is evolving at a rapid speed with each passing year. And so, it optimizes the page loading speed and reduces the bounce rate. So it is convenient for all to use irrespective of internet speed and it works offline using cached data. Its visual design pattern became a mainstream trend in web app development.

Blockchain 59

Blockchain IoT Development Serverless 59

Smashing Magazine

JUNE 25, 2020

We’ll also discuss the costs and benefits of CDNs and dedicated file storage solutions. Instead, like the other articles in the Django Highlights series (see below), it’s intended as a guide for front-end developers and designers to understand other parts of the process of creating a web application.

Media 69

Media Cache Storage AWS 69

The Netflix TechBlog

NOVEMBER 3, 2022

When a new leader is elected it loads all data from external storage. The path over which data travels from Titus Job Coordinator to a Titus Gateway cache can be described as a sequence of event queues with different processing speeds: A message generated by the event source may be buffered at any stage. V., & Gharachorloo, K.

Cache 224

Cache Latency Traffic Systems 224

Smashing Magazine

OCTOBER 22, 2019

At the intersection of the two is website speed. It should come as no surprise that images cause a lot of the problems websites have with speed. And while you could always just trim the fat and build more minimally designed and content-centric sites, why compromise? Images are a powerful force on the web.

Mobile 63

Mobile Media Website Storage 63

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform is a revolution in the way we handle infrastructure.

Open Source 40

Open Source DevOps AWS Azure 40

All Things Distributed

APRIL 9, 2015

At the time, I wrote about how containerization makes it easier for customers to decompose their applications into smaller building blocks resulting in increased agility and speed of feature releases. Our customers have told us that scaling and operating these data storage systems is very challenging.

Energy 115

Energy AWS Scalability Availability 115

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Recommendations.

Architecture 52

Architecture Cache Azure Storage 52

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. Indexing can help to speed up read queries, but it comes with an extra cost of storage, and they will slow down write operations. Having indexes that will never be used is a waste of storage and will slow down write operations.

Database 78

Database Servers Storage Strategy 78

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40