The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems.

Architecture 76

Architecture Cloud Storage Serverless 76

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 111

AWS Games Education Innovation 111

All Things Distributed

OCTOBER 25, 2013

Many of you know Thorsten von Eicken as the founder of Rightscale , the company that has helped numerous organizations find their way onto AWS. database replication, fault tolerance protocols) could not benefit from these advances at the network level. The lack of low-latency made that distributed systems (e.g.

Network 96

Network Latency Operating System Speed 96

All Things Distributed

JULY 16, 2012

Register for AWS re: Invent. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Comments ().

AWS 83

AWS Big Data Media Storage 83

Dynatrace

MAY 9, 2019

supports the tracing of database requests.NET. In preparation for the new architecture, we’ve changed how OneAgent is deployed on Windows via MSI files. This previous version of OneAgent for AIX introduced improved detection of IP addresses for network interfaces. Dynatrace news. Support for shaded AHC 2.x x in Play 2.6+.

Java 100

Java AWS Cloud Monitoring 100

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

The Netflix TechBlog

MARCH 5, 2019

All these micro-services are currently operated in AWS cloud infrastructure. The main motivation is that while the devices themselves have a significant role in overall performance, our network and cloud infrastructure has a non-negligible impact on the responsiveness of devices.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

The Netflix TechBlog

MAY 21, 2019

Lerner, as a web-service, relies on Amazon Web Services (AWS) and Netflix’s Open Source Software (OSS) tools. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

High Scalability

APRIL 16, 2019

Scenario 3 – Network Partition – Network Connectivity Breaks Down Between Master and Slave Nodes. This is a classical problem in any distributed system where each node thinks the other nodes are down, while in reality, only the network communication between the nodes is broken.

Availability 149

Availability Network Azure AWS 149

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. This can dramatically decrease network latency and its effect on the end-user experience. Migrate databases intelligently.

Cloud 161

Cloud Traffic Best Practices Strategy 161

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors.

Innovation 146

Innovation AWS Education Network 146

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. The Greenplum Architecture. The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

JULY 30, 2019

The Netflix Media Database (NMDB) is one such example. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra This opens the route to using a managed Elasticsearch cluster (a la AWS) as part of the Conductor deployment.

Lambda 189

Lambda Media Open Source Metrics 189

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. It was the first database sizing guide Sun had ever produced.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

Scalegrid

MARCH 14, 2024

The architecture usually integrates several private, public, and on-premises infrastructures. Key Components of Hybrid Cloud Infrastructure A hybrid cloud architecture usually merges a public Infrastructure-as-a-Service (IaaS) platform with private computing assets and incorporates tools to manage these combined environments.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. Route 53 provides Authoritative DNS functionality implemented using a world-wide network of highly-available DNS servers. No lock-in.

Cloud 117

Cloud Internet Internet AWS 117

InfoQ

MAY 13, 2022

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud. By Luciano Mammino.

Cloud 67

Cloud Architecture Scalability Network 67

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. Impressive!

Virtualization 111

Virtualization AWS Hardware Storage 111

Scalegrid

JANUARY 8, 2024

For example, an application could use on-premises databases while also having access to ‘cloud bursting’ capabilities during times of high demand. Like ScaleGrid’s offerings for multi-cloud architecture compatibility, its solutions are well-suited for use within a single cloud provider or a hybrid cloud setup as well.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

JUNE 29, 2022

To drive better outcomes using hybrid cloud architectures, it helps to understand their benefits—and how to orchestrate them seamlessly. What is hybrid cloud architecture? Hybrid cloud architecture is a computing environment that shares data and applications on a combination of public clouds and on-premises private clouds.

Infrastructure 176

Infrastructure Cloud Azure AWS 176

Scalegrid

APRIL 5, 2024

Grasping the concept of Redis sharding is essential for expanding your Redis database. This method involves splitting data over various nodes to improve the database’s efficiency. Redis isn’t alone in utilizing sharding strategies — it’s a common concept found throughout database technologies to distribute workload efficiently.

Scalability 130

Scalability Efficiency Java Database 130

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 249

Architecture Best Practices Engineering Open Source 249

O'Reilly

FEBRUARY 18, 2020

Software architecture, infrastructure, and operations are each changing rapidly. The shift to cloud native design is transforming both software architecture and infrastructure and operations. It’s possible that microservices architecture is hastening the move to other languages (such as Go, Rust, and Python) for web properties.

Software Architecture 136

Software Architecture DevOps Data Engineering Architecture 136

The Netflix TechBlog

FEBRUARY 18, 2022

Motivation With the rapid growth in Netflix member base and the increasing complexity of our systems, our architecture has evolved into an asynchronous one that enables both online and offline computation. This network connection heterogeneity made choosing a single delivery model difficult.

Systems 334

Systems Traffic Architecture Mobile 334

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. Impressive!

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

AUGUST 20, 2015

It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Traditionally, these connections have been stored in relational databases, with each object type requiring its own table. Enter graph databases.

Database 134

Database Logistics Availability Social Media 134

High Scalability

SEPTEMBER 8, 2018

New databases used to be announced seemingly every week. While database neogenesis has slowed down considerably, it has not gone necrotic. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! This increases the cores and network bandwidth available to serve common requests.

Storage 199

Storage Performance AWS Efficiency 199

Dynatrace

MAY 9, 2022

From a cloud adoption standpoint, Smartscape helps to do the following: Adjust service architecture or infrastructure to improve application performance. With Dynatrace’s API, customers access current and historic CPU, memory, disk, and network usage to identify if a server is optimized. Repurchase.

Strategy 191

Strategy Cloud Infrastructure Metrics 191

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started This level of granularity is not found in UI-managed systems.Â

Open Source 52

Open Source DevOps AWS Azure 52

Dynatrace

JUNE 1, 2021

However, with today’s highly connected digital world, monitoring use cases expand to the services, processes, hosts, logs, networks, and of course, end-users that access these applications — including a company’s customers and employees. Point solutions only provide a limited view of a company’s application architecture.

Monitoring 148

Monitoring Mobile Social Media Artificial Intelligence 148

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 203

Storage Latency Efficiency Data Engineering 203

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 129

Cache Cloud Performance Retail 129

All Things Distributed

APRIL 27, 2011

Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. Service-oriented architecture -- or SOA -- is the fundamental building abstraction for Amazon technologies. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Technology 151

Technology Technology AWS Storage 151

The Morning Paper

FEBRUARY 6, 2020

The canononical cloud platform architecture decouples storage and compute services so that each can be scaled and operated independently, i.e., they are disaggregated. Only now the database is itself a distributed KVS, and the slices of application functionality are much finer-grained. High level architecture. Evaluation.

Serverless 98

Serverless Lambda Cache Latency 98