Adrian Cockcroft

NOVEMBER 26, 2023

The Pantheon in Rome — Extremely sustainable architecture — photo by Adrian I wrote a medium post after AWS re:Invent 2022 summarizing the (lack of) news and all the talks related to Sustainability. This includes providing the efficient, resilient services AWS customers expect, while minimizing their environmental footprint.

AWS 52

AWS Energy IoT Best Practices 52

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Storage I/O. We help where we can. File System. Networking.

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

FEBRUARY 9, 2022

Cloud vendors such as Amazon Web Services (AWS), Microsoft, and Google provide a wide spectrum of serverless services for compute and event-driven workloads, databases, storage, messaging, and other purposes. Stay tuned for updates. Dynatrace news. AI-powered automation and deep, broad observability for serverless architectures.

Serverless 180

Serverless Azure Lambda AWS 180

Dynatrace

DECEMBER 5, 2023

But take a look at the latest iterations of, for example, AWS Graviton2, which delivered a 40% price/performance boost, and Graviton3, which had an additional 27% price/performance improvement over Graviton2. Huge performance leaps in recent years The top priority is often performance, where ARM resources have improved significantly.

Efficiency 259

Efficiency Architecture Energy Monitoring 259

Dynatrace

JUNE 26, 2020

Virginia (AWS) ?, California (AWS), San Jose (Azure), Texas (Azure), Ohio (AWS), Toronto (Azure) ?, London (AWS), London (Azure), Frankfurt (AWS) ?, Sydney (AWS) ? Hong Kong (Azure), Tokyo (Azure), Sao Paulo (AWS). Storage and management of credentials via the Synthetic Monitoring credential vault.

Monitoring 252

Monitoring Azure AWS Traffic 252

The Netflix TechBlog

SEPTEMBER 24, 2021

From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step. Since not all projects are terabytes projects, allocating the largest cloud storage to all packager instances is not an efficient use of cloud resources.

Cloud 237

Cloud Media Storage Cache 237

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. The KV DAL allows applications to use a well-defined and storage engine agnostic HTTP/gRPC key-value data interface that in turn decouples applications from hard to maintain and backwards-incompatible datastore APIs.

Latency 243

Latency Storage Big Data Tuning 243

Scalegrid

JULY 29, 2019

Managing a database is hard, as it needs continuous updating, tuning, and monitoring to ensure the performance of your website. Host MySQL on AWS , or MySQL on Azure with configurable instance sizes through the top two cloud providers in the world. We support two different MySQL DBaaS plans on both AWS and Azure. Stay tuned!

Database 166

Database Cloud Website Azure 166

Dynatrace

APRIL 21, 2022

To stay tuned, keep an eye on our release notes. Configuration API for AWS and Azure supporting services. You can now get a list of all AWS and Azure supporting services on your cluster, by current version, using the AWS credentials API and Azure credentials API respectively. New features and enhancements.

Azure 209

Azure Metrics AWS Monitoring 209

Scalegrid

OCTOBER 7, 2019

AWS, however, has taken a significant leap from our last report, where they now average 77.4% AWS was not the only cloud provider to grow – we found that 19.4% of #PostgreSQL cloud deployments are run on AWS Click To Tweet. of PostgreSQL cloud use compared to 55.0% of PostgreSQL hosting. Java #Python #C Click To Tweet.

Strategy 182

Strategy Cloud Java Open Source 182

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. Log analysis can reveal potential bottlenecks and inefficient configurations so teams can fine-tune system performance. billion in 2020 to $4.1 Optimized system performance.

Analytics 202

Analytics Monitoring Artificial Intelligence DevOps 202

The Netflix TechBlog

OCTOBER 15, 2019

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. High availability, via standby instances across AWS Availability Zones. We currently support MySQL and Postgres, including when deployed in AWS RDS and its Aurora flavor. Please stay tuned.

Transportation 192

Transportation Architecture Processing Storage 192

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 Be sure to check back.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

DECEMBER 20, 2018

Now that Database-as-a-service (DBaaS) is in high demand, there is one question regarding AWS services that cannot always be answered easily : When should I use Aurora and when RDS MySQL ? Linux OS Tuning for MySQL Database Performance. Tuning PostgreSQL Database Parameters to Optimize Performance. About ZFS Performance.

Database 40

Database Tuning Performance AWS 40

Adrian Cockcroft

JUNE 21, 2022

I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R. I saw Erik Fisher last time I was in Budapest, and Constantin Gonzalez later became one of the first AWS solutions architects in Germany, too many names to mention.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

JULY 2, 2023

Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

Tech News Gather

JUNE 16, 2023

Stay tuned to learn how to lay the foundation for a successful clone app that converts readers into leads. Stay tuned for valuable insights on designing a captivating UberEats clone. Stay tuned for insights on building a robust and scalable UberEats clone app. Stay tuned for insights on promoting your UberEats clone effectively.

Social Media 52

Social Media Tuning Strategy Media 52

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge Redundancy can potentially decrease overall performance. A future blog will continue my exploration into Citus by scaling out pgbench into other architectures.

Database 104

Database Benchmarking Latency C++ 104

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Recommendations.

Architecture 52

Architecture Cache Azure Storage 52

Brendan Gregg

SEPTEMBER 5, 2017

Both Xen and KVM have had many performance and security improvements, and workloads can now be tuned to run at almost bare metal speeds (say, a 3% loss or less). If that seems wildly unacceptable, note that you can tune overcommit on Linux to not do this, and behave more like Solaris (see sysctl vm.overcommit_memory).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Percona

JANUARY 17, 2019

AWS Aurora (based on MySQL 5.6) now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). I will compare AWS Aurora with MySQL (Percona Server) 5.6 Aurora PQ works by doing a full table scan (parallel reads are done on the storage level).

Cache 46

Cache C++ AWS Airlines 46

All Things Distributed

APRIL 9, 2015

The Amazon ML console and API provide data and model visualization tools, as well as wizards to guide you through the process of creating machine learning models, measuring their quality and fine-tuning the predictions to match your application requirements. Details on the AWS Blog. Details on the AWS Blog. for a while already.

Lambda 122

Lambda Cloud IoT AWS 122

All Things Distributed

MARCH 28, 2011

We see that with our Amazon customers; when they hear a great tune on a radio they may identify it using the Shazam or Soundhound apps on their mobile phone and buy that song instantly from the Amazon MP3 store. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

NOVEMBER 28, 2012

They contain large amounts of locally attached storage on multiple spindles and are connected by a minimally oversubscribed 10 Gigabit Ethernet network. This configuration maximizes the amount of throughput between your storage and your CPUs while also ensuring that data transfer between nodes remains extremely fast. Amazon Redshiftâ??s

Cloud 164

Cloud Storage Architecture Scalability 164

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. At AWS, we believe in giving choices, so Amazon SageMaker removes that problem.

Tuning 94

Tuning AWS Scalability Infrastructure 94

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 145

Availability Performance Scalability AWS 145