All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

NOVEMBER 22, 2016

Some examples of popular deep learning frameworks that we support on AWS include Caffe, CNTK, MXNet, TensorFlow, Theano, and Torch. AWS will contribute code and improved documentation as well as invest in the ecosystem around MXNet. AWS will contribute code and improved documentation as well as invest in the ecosystem around MXNet.

AWS 167

AWS Open Source Scalability Programming 167

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking].

Virtualization 111

Virtualization AWS Hardware Storage 111

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. When delving into the networking aspect of a hybrid cloud deployment, complexities arise due to the requirement of linking or expanding existing on-premises network architectures into the cloud sphere.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. billion in 2020 to $4.1

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214

Dynatrace

AUGUST 11, 2022

Effective application development requires speed and specificity. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. Infrastructure as a service (IaaS) handles compute, storage, and network resources.

Development 256

Development Serverless Best Practices Lambda 256

All Things Distributed

SEPTEMBER 29, 2016

Today, I am very excited to announce our plans to open a new AWS Region in France! Over the past 10 years, we have seen tremendous growth at AWS. As a result, we have opened 35 Availability Zones (AZs), across 13 AWS Regions worldwide. As a result, we have opened 35 Availability Zones (AZs), across 13 AWS Regions worldwide.

AWS 166

AWS IoT Internet Internet 166

All Things Distributed

DECEMBER 18, 2017

Today, I'm happy to announce that the AWS EU (Paris) Region, our 18th technology infrastructure Region globally, is now generally available for use by customers worldwide. This is why tens of thousands of French customers already use AWS in Regions around the world.

AWS 112

AWS Artificial Intelligence Education Energy 112

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. The science has spawned specialized chaos engineers who dedicate themselves to disrupting cloud software and the on-prem systems they interact with to make them resilient. Speeds incident response.

Engineering 231

Engineering Entertainment Cloud Infrastructure 231

The Netflix TechBlog

NOVEMBER 3, 2022

As the number of Titus users increased over the years, the load and pressure on the system increased substantially. cell): Titus Job Coordinator is a leader elected process managing the active state of the system. For example, a batch workflow orchestration system may create multiple jobs which are part of a single workflow execution.

Cache 224

Cache Latency Traffic Systems 224

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Such demanding use cases place a great value on systems capable of fast and reliable execution, a need that spans across various industry segments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Efficiency 199

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. OneAgent is the native telemetry data collector and monitoring solution of Dynatrace.

Metrics 176

Metrics Monitoring Database Network 176

All Things Distributed

OCTOBER 25, 2013

Many of you know Thorsten von Eicken as the founder of Rightscale , the company that has helped numerous organizations find their way onto AWS. In what seems almost a previous life by now Thorsten was one of the top young professors in Distributed Systems and I had the great pleasure of working with him at Cornell in the early 90''s.

Network 96

Network Latency Operating System Speed 96

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. I learned firsthand how to bring beginners from different backgrounds up to speed.

Systems 111

Systems Performance Education Technology 111

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

Scalegrid

MAY 13, 2020

The MPP system leverages a shared-nothing architecture to handle multiple operations in parallel. Typically an MPP system has one leader node and one or many compute nodes. This allows Greenplum to distribute the load between their different segments and use all of the system’s resources parallely to process a query.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. It is worth pointing out that cloud processing is always subject to variable network conditions. There are existing distributed file systems for the cloud as well as off-the-shelf FUSE modules for S3.

Cloud 237

Cloud Media Storage Cache 237

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. For more details on AWS in Japan see [link].

AWS 112

AWS Cloud Games Latency 112

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking].

Virtualization 40

Virtualization AWS Hardware Storage 40

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. The main motivation is that while the devices themselves have a significant role in overall performance, our network and cloud infrastructure has a non-negligible impact on the responsiveness of devices.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Netflix operates in multiple AWS regions. Regional caching? —?Netflix

Media 214

Media Storage Processing Cache 214

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. Driving Storage Costs Down for AWS Customers.

AWS 96

AWS Cloud Storage Internet 96

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. A guiding principle.

Database 106

Database AWS Network Design 106

Abhishek Tiwari

JULY 22, 2023

However, amidst the drive for speed, ensuring policy compliance is often overlooked, leading to potential security vulnerabilities and compliance risks. For instance, Sentinel policies can enforce rules such as "All AWS S3 buckets must have server-side encryption enabled" or "Only specific IAM roles can access certain resources."

AWS 52

AWS Best Practices Infrastructure Traffic 52

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Data always keeps being accrued.

Scalability 159

Scalability Hardware AWS Tuning 159

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! Based in Bahrain, this will be the first Region for AWS in the Middle East. This news marks the 22nd AWS Region we have announced globally. 2017 continues a busy year for AWS in the Middle East.

Cloud 152

Cloud Education Energy Government 152

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity. Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Smashing Magazine

AUGUST 3, 2023

Largest Contentful Paint (LCP) LCP measures the perceived load speed of a webpage from a user’s perspective. You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. Adding to this complexity is the effect of seasonality.

Performance 74

Performance Cache Traffic Metrics 74

Speed Curve

FEBRUARY 5, 2024

Cue server-timing headers Historically, when looking at page speed, we've had the tendency to ignore TTFB when trying to optimize the user experience. The use of server-timing headers by content delivery networks closes a big gap. For more years than I care to mention, I've been advising folks that their TTFB should be under 500ms.

Servers 57

Servers Cache Retail Benchmarking 57

Dynatrace

NOVEMBER 23, 2020

While speeding up development processes and reducing complexity does make the lives of Kubernetes operators easier, the inherent abstraction and automation can lead to new types of errors that are difficult to find, troubleshoot, and prevent. Configuring storage in Kubernetes is more complex than using a file system on your host.

Virtualization 162

Virtualization Infrastructure Monitoring Cloud 162

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍AutomationCode-based systems also shine in automation.

Open Source 52

Open Source DevOps AWS Azure 52

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54