Dynatrace

DECEMBER 15, 2022

As more organizations adopt cloud-native technologies, traditional approaches to IT operations have been evolving. Complex cloud computing environments are increasingly replacing traditional data centers. The importance of ITOps cannot be overstated, especially as organizations adopt more cloud-native technologies.

Artificial Intelligence 208

Artificial Intelligence DevOps Hardware Virtualization 208

The Morning Paper

OCTOBER 26, 2020

Helios: hyperscale indexing for the cloud & edge , Potharaju et al., Cloud-native systems represent by far the largest, most distributed, computing systems in our history. And the established cloud-native architectural principles behind them aren’t changing here. PVLDB’20. Emphasis mine ). Emphasis mine ).

Cloud 104

Cloud Big Data Latency Architecture 104

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? AWS Identity and Access Management brings together on-premises and cloud identity management. Comments ().

Storage 115

Storage AWS Virtualization Cloud 115

Dynatrace

DECEMBER 22, 2021

Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage. With limited visibility, teams have a narrow understanding of how those decisions impact other software components and vice-versa. Observability is made up of three key pillars: metrics, logs, and traces.

Artificial Intelligence 183

Artificial Intelligence Metrics Architecture DevOps 183

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. When a new leader is elected it loads all data from external storage. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? For cost calculations, the costs are a combination of compute costs, storage costs, data scan costs, and software license costs.

Architecture 76

Architecture Cloud Storage Serverless 76

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Testsigma

FEBRUARY 12, 2021

The implementation of emerging technologies has helped improve the process of software development, testing, design and deployment. Any organization recruits experienced testing agencies to comply with their specifications for software testing. Here is the list of software testing trends you need to look out for in 2021.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Dynatrace

APRIL 26, 2022

With DEM solutions, organizations can operate over on-premise network infrastructure or private or public cloud SaaS or IaaS offerings. STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables).

Monitoring 209

Monitoring Social Media IoT Metrics 209

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads.

AWS 94

AWS Benchmarking Performance Traffic 94

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Since we were optimizing at the logging level for storage and performance, we had less data and metadata to play with to optimize the query performance.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

APRIL 9, 2015

AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. Customers have been asking to add file system functionality to our set of solutions as much of their traditional software required a broad accessible shared file system. Details on the AWS Blog. The Amazon Elastic File System.

Lambda 122

Lambda Cloud IoT AWS 122

All Things Distributed

NOVEMBER 13, 2014

Capital-intensive storage solutions became as simple as PUTting and GETting objects in Amazon S3. At AWS we innovate by listening to and learning from our customers, and one of the things we hear from them is that they want it to be even simpler to run code in the cloud and to connect services together easily.

Lambda 136

Lambda AWS Cloud Scalability 136

Percona

JULY 17, 2023

MongoDB Community Edition software might set the stage for achieving your high-volume database goals, but you quickly learn that its features fall short of your enterprise needs. So you look at MongoDB Enterprise software, but its costly and complex licensing structure does not meet your budget goals.

Open Source 74

Open Source Database Scalability Software 74

ScaleOut Software

JULY 14, 2021

The Microsoft Azure IoT ecosystem offers a rich set of capabilities for processing IoT telemetry, from its arrival in the cloud through its storage in databases and data lakes. ScaleOut Software’s Digital Twin Streaming Service provides precisely these capabilities. Azure digital twins serve a different purpose.

IoT 52

IoT Azure Analytics Serverless 52

O'Reilly Software

APRIL 30, 2018

When designing cloud architecture, it’s critical to consider that your applications could be affected by failures and that you must be prepared to respond to those failures quickly and effectively. Modern hybrid applications typically utilize public cloud components, including content delivery networks and cloud storage.

Cloud 68

Cloud Traffic Internet Internet 68

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. Investing tons of efforts into IT, building complicated deployment and clustering software etc. It would mean a great deal to me.

Internet 121

Internet Internet Scalability Automotive 121

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy.

AWS 52

AWS Database Serverless Storage 52

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. Let’s take a closer look at today’s conventional streaming analytics architectures, which can be hosted in the cloud or on-premises.

IoT 78

IoT Analytics Big Data Architecture 78

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Resolvers operate in a completely separate hierarchy which is bottoms up, starting with software caches in a browser or the OS, to a local resolver or a regional resolver operated by an ISP or a corporate IT service. Driving Storage Costs Down for AWS Customers.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

Particular Software

AUGUST 16, 2021

which provides saga and outbox storage for NServiceBus endpoints that is transactionally consistent with the business data you store in Cosmos DB. But where Cosmos DB really shines is for systems that require worldwide low latency with flexible pricing. Cosmos DB is clearly positioned as the successor to Azure Table storage.

Azure 52

Azure Serverless Storage Database 52

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. The requirements for a fully hosted cloud database service needed to be at an even higher bar than what we had set for our Amazon internal system.

Internet 128

Internet Internet AWS Performance 128

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

All Things Distributed

MARCH 11, 2016

Almost from day one, we knew that the software we were building would not be the software that would be running a year later. We needed to build such an architecture that we could introduce new software components without taking the service down. Build evolvable systems. Automation is key.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. The client keeps a map of Redis nodes, which is updated in case of failover.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process.

Best Practices 52

Best Practices Database Storage Servers 52

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. This paper is a real joy to read.

Database 106

Database AWS Network Design 106

All Things Distributed

DECEMBER 14, 2011

Expanding the Cloud â?? This new Region has been highly requested by companies worldwide, and it provides low-latency access to AWS services for those who target customers in South America. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â??

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

JUNE 21, 2017

As we said at the time, DynamoDB was a result of 15 years of learning in the area of large scale non-relational databases and cloud services. DynamoDB was the first service at AWS to use SSD storage. These high-throughput, low-latency requirements need caching, not as a consideration, but as a best practice. " Canon INC.

Speed 121

Speed Cache Latency AWS 121