Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. which provides this as a service and where the chief architect and CTO are both ex-Netflix colleagues of mine.

Serverless 145

Serverless Lambda Best Practices Traffic 145

Dynatrace

OCTOBER 10, 2022

Popular examples include AWS Lambda and Microsoft Azure Functions , but new providers are constantly emerging as this model becomes more mainstream. Code development also benefits from a serverless approach. Then, they can apply DevSecOps best practices to fully test new code and see what breaks without affecting current operations.

Serverless 168

Serverless Infrastructure Lambda Latency 168

Dynatrace

MAY 27, 2021

We’re excited to announce Dynatrace has been named as a select launch partner for a newly launched Amazon Web Services (AWS) offering, Amazon ECS Anywhere. This new extension allows customers to deploy native Amazon ECS tasks in any target environment including traditional AWS managed infrastructure and now customer-managed infrastructure.

AWS 131

AWS IoT Virtualization Infrastructure 131

Dynatrace

APRIL 7, 2021

But your infrastructure teams don’t see any issue on their AWS or Azure monitoring tools, your platform team doesn’t see anything too concerning in Kubernetes logging, and your apps team says there are green lights across the board. Kiosks, mobile apps, websites, and QR codes. Imagine you’re in a war room. So, what happens next?

Cloud 158

Cloud Monitoring Latency Games 158

All Things Distributed

NOVEMBER 13, 2014

When AWS launched, it changed how developers thought about IT services: What used to take weeks or months of purchasing and provisioning turned into minutes with Amazon EC2. Our answer is a new compute service called AWS Lambda. You can go from code to service in three clicks and then let AWS Lambda take care of the rest.

Lambda 136

Lambda AWS Cloud Scalability 136

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

Scalegrid

MARCH 14, 2024

Effective hybrid cloud management requires robust tools and techniques for centralized administration, policy enforcement, cost management, and modern infrastructure practices like Infrastructure-as-Code (IaC) and containers. It results in consistently configured environments and allows for swift deployment.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The broken Java stacks turned out to be beneficial: They helped group together the os::javaTimeMillis() calls which otherwise might have have been scattered on top of different Java code paths, appearing as thin stacks everywhere.

Speed 126

Speed Java AWS Virtualization 126

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. Data lakehouses deliver the query response with minimal latency. Agent and open technologies make it easy to ingest large volumes of observability, security, and business data. Data management.

Artificial Intelligence 213

Artificial Intelligence Storage Analytics Government 213

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. AWS has invested in optimizing Ethernet for HPC via the Elastic Fabric Adaptor (EFA) option, and the l ibfabric library.

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

MAY 17, 2023

However, this method limited us to instrumenting the code manually and collecting specific sets of data we defined upfront. It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment.

Metrics 175

Metrics Monitoring Database Network 175

The Morning Paper

FEBRUARY 6, 2020

On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network. Oh, and there’s a scheduler too of course to keep all the plates spinning.

Serverless 98

Serverless Lambda Cache Latency 98

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". They'll learn a lot and love you even more.5 5 billion : weekly visits to Apple App store; $500m : new US exascale computer; $1.7 We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

High Scalability

DECEMBER 7, 2018

It's HighScalability time: This is your 1500ms latency in real life situations - pic.twitter.com/guot8khIPX. heipei : It's Friday, I've been in a jumpsuit doing manual labor all day (crazy, I know) and weighing my options between passing out on the couch over some Youtube videos, reading the Friday @highscal blog post or writing code.

Internet 163

Internet Internet Scalability Blockchain 163

Dynatrace

JULY 10, 2019

Just a single OneAgent per host is required to collect all relevant monitoring data, all the way down to specific lines of code. With insights from Dynatrace into network latency and utilization of your cloud resources, you can design your scaling mechanisms and save on costly CPU hours.

Java 140

Java Best Practices Metrics Azure 140

Dynatrace

OCTOBER 1, 2021

DevSecOps teams can tap observability to get more insights into the apps they develop, and automate testing and CI/CD processes so they can release better quality code faster. Distributed tracing: This displays activity of a transaction or request as it flows through applications and shows how services connect, including code-level details.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

IO River

NOVEMBER 2, 2023

‍Think of a situation where you're asked to build a service in AWS that distributes static content to your users. Your first option is to use its native CDN - Amazon CloudFront, as it seamlessly integrates with all of your other AWS Services that you're using to build your service.‍For What is vendor lock-in?‍Think

Lambda 52

Lambda AWS Cache Website 52

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Again, the benefit being that the code within your containers or virtual machines is managed by the cloud provider. When code isn’t in use, the cloud providers typically throttle it all the way down.

Serverless 57

Serverless Monitoring Lambda Latency 57

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The broken Java stacks turned out to be beneficial: They helped group together the os::javaTimeMillis() calls which otherwise might have have been scattered on top of different Java code paths, appearing as thin stacks everywhere.

Speed 52

Speed Java AWS Virtualization 52

IO River

NOVEMBER 2, 2023

Think of a situation where you're asked to build a service in AWS that distributes static content to your users. Later on, your service might require security, and you might use AWS Web Application Firewall, which directly integrates with Amazon CloudFront to help secure your service. What is vendor lock-in?‍Think

Lambda 52

Lambda AWS Cache Website 52

All Things Distributed

FEBRUARY 22, 2012

Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. They must deal with the increased latency and unreliability inherent in remote communication. is extraneous to business logic and makes the application code unnecessarily complicated and hard to maintain. Expanding the Cloud â??

Cloud 130

Cloud AWS Java Scalability 130

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The broken Java stacks turned out to be beneficial: They helped group together the os::javaTimeMillis() calls which otherwise might have have been scattered on top of different Java code paths, appearing as thin stacks everywhere.

Speed 40

Speed Java AWS Virtualization 40

Smashing Magazine

AUGUST 3, 2023

HTML Processing Once a web page’s HTML file has been downloaded, the browser begins to process the contents line by line, translating code into the visual website that users interact with. This proximity significantly reduces the time it takes for the data to travel from the server to the user, thus reducing latency and improving load times.

Performance 74

Performance Cache Traffic Metrics 74

ScaleOut Software

APRIL 6, 2021

It also deploys real-time digital twin models to the in-memory data grid, which hosts instances of digital twins (one per data source) and runs application-defined code to process incoming messages. The management console installs as a set of Docker containers on the management server.

IoT 52

IoT Azure Analytics Healthcare 52

All Things Distributed

MARCH 12, 2018

The availability of large scale voice training data, the advances made in software with processing engines such as Caffe, MXNet and Tensorflow, and the rise of massively parallel compute engines with low-latency memory access, such as the Amazon EC2 P3 instances have made voice processing at scale a reality. Want to learn more?

Systems 110

Systems AWS Games Transportation 110

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. This can dramatically decrease network latency and its effect on the end-user experience.

Cloud 168

Cloud Traffic Best Practices Strategy 168

cdemi

FEBRUARY 20, 2017

Whether you choose Azure Functions or AWS Lambda, you cannot easily switch to another. Performance - Serverless Functions that are used less frequently may suffer from warmup response latency, where the infrastructure needs some time to deploy the function. Amazon: AWS Lambda. On Public Clouds: Microsoft: Azure Functions.

Serverless 64

Serverless Architecture Lambda Azure 64

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments. This format could be coded as a Prometheus Exporter.

Energy 52

Energy Metrics Cloud Operating System 52

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

The Morning Paper

NOVEMBER 17, 2019

The serverless computing abstraction, despite its many advantages, exposes several low-level operational details that make it hard for programmers to write and reason about their code. For example, to reduce latency, serverless platforms try to reuse the same function instance to process multiple requests. is the composition property.

Serverless 58

Serverless Lambda Programming Cache 58

All Things Distributed

OCTOBER 25, 2018

Expanding the AWS Cloud—An AWS Region is coming to South Africa! Today, I am excited to announce our plans to open a new AWS Region in South Africa! AWS is committed to South Africa's transformation. This news marks the 23rd AWS Region that we have announced globally. We have a long history in South Africa.

AWS 167

AWS Cloud Education Programming 167

High Scalability

MARCH 1, 2019

It's HighScalability time: 10 years of AWS architecture increasing simplicity or increasing complexity? It was made possible by using a low latency of 0.1 seconds, the lower the latency, the more responsive the robot. Michael Wittig ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon.

Internet 33

Internet Internet Scalability Blockchain 33

Dotcom-Montior

OCTOBER 6, 2021

One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. Let us dig into this deeper to understand more about this role and how it functions within organizations. On-call Support. Post-Mortem. It really depends on the day.

Engineering 67

Engineering DevOps Monitoring Google 67

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. This is followed by some common code related failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. The developers can also rework the code with the memory constraint in mind to improve performance (e.g., 41 33680 53408 0 78 100.0%

Cache 40

Cache C++ AWS Systems 40