InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Dynatrace

MARCH 18, 2024

Following FinOps practices, engineering, finance, and business teams take responsibility for their cloud usage, making data-driven spending decisions in a scalable and sustainable manner. Aligning workload types and sizes with instance performance and capacity requirements is essential to keep costs down. Wrong-sized resources.

Best Practices 228

Best Practices Strategy Cloud AWS 228

The Netflix TechBlog

JUNE 7, 2021

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices.

Network 325

Network Transportation AWS Cloud 325

InfoQ

AUGUST 3, 2023

AWS recently announced the general availability (GA) of Amazon EC2 P5 instances powered by the latest NVIDIA H100 Tensor Core GPUs suitable for users that require high performance and scalability in AI/ML and HPC workloads. The GA is a follow-up to the earlier announcement of the development of the infrastructure.

AWS 78

AWS Availability Scalability Infrastructure 78

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

DECEMBER 8, 2016

Earlier this year, Amazon Web Services (AWS) announced it would launch a new AWS infrastructure region in Montreal, Quebec. The AWS Cloud now operates in 40 Availability Zones within 15 geographic regions around the world, with seven more Availability Zones and three more regions coming online in China, France, and the U.K.

AWS 155

AWS Cloud Lambda Innovation 155

Dynatrace

SEPTEMBER 17, 2019

AWS EKS for Integration and Production. MaaSS for Cloud Architects: Deployment and Architecture Validations. When focusing on the LanguageController service we learn that it’s currently deployed in three pods across three EKS nodes across two AWS Availability Zones (AZ). 4 AWS EFS monitoring. NGINX as an API Gateway.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Dynatrace

DECEMBER 15, 2022

While engaging the automatic instrumentation of the Dynatrace OneAgent makes log ingestion automatic and scalable , our customers have set up multiple other log ingestion methods. But there are cases where you might be limited in setting up a dedicated syslog server with OneAgent because of environment architecture or resources.

Strategy 177

Strategy AWS Open Source Transportation 177

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. As a micro-service owner, a Netflix engineer is responsible for its innovation as well as its operation, which includes making sure the service is reliable, secure, efficient and performant.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Dynatrace

DECEMBER 8, 2022

As cloud-native, distributed architectures proliferate, the need for DevOps technologies and DevOps platform engineers has increased as well. They are similar to site reliability engineers (SREs) who focus on creating scalable, highly reliable software systems. Amazon Web Services (AWS). Kubernetes.

DevOps 187

DevOps Engineering Testing Open Source 187

Dynatrace

OCTOBER 10, 2022

Many organizations today rely on cloud-native applications for their scalability and agility, among other benefits. Popular examples include AWS Lambda and Microsoft Azure Functions , but new providers are constantly emerging as this model becomes more mainstream. Serverless benefits include the following: Dynamic scalability.

Serverless 163

Serverless Infrastructure Lambda Latency 163

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems.

Architecture 76

Architecture Cloud Storage Serverless 76

InfoQ

APRIL 10, 2024

At QCon London, Doulingo’s engineers presented the asynchronous AWS architecture responsible for broadcasting messages to millions of users across seven US cities. As part of the Super Bowl marketing campaign, Duolingo sent out 4 million mobile push notifications when the company’s five-second ad aired during the commercial break.

AWS 70

AWS Architecture Mobile Engineering 70

InfoQ

MAY 25, 2021

AWS recently released Warm Pools for EC2 Auto Scaling, which reduces the time and cost to scale out (aka horizontal scaling) applications by maintaining a pool of pre-initialized instances. By Mostafa Radwan.

AWS 89

AWS Design Scalability Architecture 89

High Scalability

MARCH 18, 2021

As Kinsta’s DevOps Engineer, you will be instrumental in making sure that our infrastructure is always on the bleeding edge of technology, remaining stable and high-performing at all times. Learn the stuff they don't teach you in the AWS docs. Learn the Good Parts of AWS. Stateful JavaScript Apps. Generous free tier.

Education 100

Education DevOps AWS Scalability 100

All Things Distributed

AUGUST 17, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Back-to-Basics Weekend Reading - Staged Event-Driven Architecture. I am in São Paolo, Brazil for the 2012 AWS Latin America Summit and for The Next Web Latin America conference. Staged Event-Driven Architecture. All Things Distributed.

Architecture 95

Architecture AWS Internet Internet 95

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform.

Open Source 340

Open Source Java Operating System Programming 340

Dynatrace

NOVEMBER 20, 2023

At the AWS re:Invent 2023 conference, generative AI is a centerpiece. In this AWS re:Invent 2023 guide, we explore the role of generative AI in the issues organizations face as they move to the cloud: IT automation, cloud migration and digital transformation, application security, and more.

AWS 206

AWS Artificial Intelligence Analytics Cloud 206

High Scalability

MAY 26, 2020

Learn the stuff they don't teach you in the AWS docs. Filter out the distracting hype, and focus on the parts of AWS that you'd be foolish not to use. Learn the Good Parts of AWS. Created by former senior-level AWS engineers of 15 years. Cool Products and Services. Join more than 300,000 other learners.

Education 100

Education AWS Software Engineering Scalability 100

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Increased scalability. Improved performance and availability. The flexibility of cloud environments eliminates this guesswork.

Cloud 163

Cloud Traffic Best Practices Strategy 163

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. Dynatrace news.

Engineering 221

Engineering Entertainment Cloud Infrastructure 221

Dynatrace

OCTOBER 7, 2021

Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Scalability. Simplicity.

Serverless 276

Serverless AWS Lambda Storage 276

InfoQ

MAY 14, 2024

By combining smart and meaningful choices for each of these three components, we can build massively scalable, SLO-compliant stateful services at Netflix. Building reliable stateful services at scale isn’t a matter of building reliability into the servers, the clients, or the APIs in isolation. By Joseph Lynch

Systems 93

Systems Scalability Servers Design 93

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. which allows fast deployment times and rapid scalability.

Testing 163

Testing AWS Lambda Network 163

Dynatrace

DECEMBER 5, 2023

Without observability, the benefits of ARM are lost Over the last decade and a half, a new wave of computer architecture has overtaken the world. ARM architecture, based on a processor type optimized for cloud and hyperscale computing, has become the most prevalent on the planet, with billions of ARM devices currently in use.

Efficiency 262

Efficiency Architecture Energy Monitoring 262

InfoQ

DECEMBER 29, 2023

The company considered different storage technologies and decided to combine the relational database and the object store to strike a balance between querybility and scalability while keeping the costs down. Zendesk reduced its data storage costs by over 80% by migrating from DynamoDB to a tiered storage solution using MySQL and S3.

Storage 134

Storage Scalability Database Technology 134

InfoQ

MAY 13, 2022

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud.

Cloud 65

Cloud Architecture Scalability Network 65

High Scalability

MARCH 1, 2019

It's HighScalability time: 10 years of AWS architecture increasing simplicity or increasing complexity? Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading).

Internet 33

Internet Internet Scalability Blockchain 33

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Customers can provision up to 10,000 IOPS (input/output operations per second) per database instance to help ensure that their databases can run the most stringent workloads with rock solid, consistent performance. High Performance I/O. s architecture.

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. In serverless architecture, when applications are developed, they are typically composed of many different services. Other benefits to serverless architecture include the following: Cost. Scalability.

Serverless 57

Serverless Monitoring Lambda Latency 57

All Things Distributed

NOVEMBER 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The Amazon Simple Queue Service (SQS) is a highly scalable, reliable and elastic queuing service that just works. Similar to long polling, we expect rich client to improve the performance of SQS for our customers while decreasing their costs. Comments ().

Efficiency 104

Efficiency Cloud Games Scalability 104

InfoQ

MAY 15, 2023

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 111

Storage Systems Scalability Cloud 111

ScaleOut Software

APRIL 6, 2021

Because it runs on a scalable, highly available in-memory computing platform, it can do all this simultaneously for hundreds of thousands or even millions of data sources. Message are delivered to the grid using messaging hubs, such as Azure IoT Hub, AWS IoT Core, Kafka, a built-in REST service, or directly using APIs.

IoT 52

IoT Azure Analytics Healthcare 52

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. All Things Distributed. The Back-to-Basics Readings of 2012.

Operating System 144

Operating System Cache AWS Scalability 144

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. Dynatrace news.

Architecture 246

Architecture Software Software Development 246

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. This method of structuring, developing, and operating complex, multi-function software as a collection of smaller independent services is known as microservice architecture. Dynatrace news.

Architecture 243

Architecture Software Software Development 243