Adrian Cockcroft

FEBRUARY 9, 2023

Picture by Adrian — Ka’anapali sunset 2023 There’s been a lot of discussion about platforms recently, I talked about why I think it’s a current hot meme on the WTF Podcast with Charles Humble recently, and Sam Newman just wrote a blog post “ Don’t call it a platform ”. Above that there’s a deployment platform such as Kubernetes or AWS Lambda.

Engineering 137

Engineering Serverless Lambda AWS 137

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work?

Development 239

Development Serverless Best Practices Lambda 239

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. billion in 2020 to $4.1

Analytics 198

Analytics Monitoring Artificial Intelligence DevOps 198

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. What Exactly is Greenplum?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 116

Cloud Serverless AWS Storage 116

Dynatrace

MAY 1, 2020

The investment continues—we’re anticipating an upcoming release of the AWS Graviton2 processor , which has already been announced to be significantly more powerful than its predecessor. Network measurements with per-interface and per-process resolution. Network metrics are also collected for detected processes.

Java 132

Java Hardware Tuning Metrics 132

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable.

Storage 115

Storage AWS Virtualization Cloud 115

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. A disruption spanning hardware, networks, and cloud infrastructure can require input and participation from network and infrastructure architects, risk experts, security teams, and even procurement officers.

Engineering 214

Engineering Entertainment Cloud Infrastructure 214

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 158

Cloud Traffic Best Practices Strategy 158

HammerDB

APRIL 19, 2023

In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

MAY 22, 2013

these are core principles for every AWS service. A lot of the power of AWS comes from the fact that we can invest in expertise in these sorts of areas and spread the benefits across all our customers. Amazon Redshift starts with the security foundation underlying all AWS services. s clear that Amazon Redshiftâ??s These arenâ??t

Design 110

Design AWS Hardware Media 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors.

Innovation 146

Innovation AWS Education Network 146

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. An end-to-end architecture.

Energy 52

Energy Hardware Efficiency Architecture 52

Testsigma

MAY 19, 2021

Infrastructure as a Service is the term used for those cloud-based solutions that provide complete infrastructure to the users including all the overheads, hardware, and networking facilities. As a user, you just need to pay for the services, install low-level requirements and set up the networking. Software as a Service (SaaS).

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Embedding further simplifies database operations, reduces network overhead, and boosts read and query performance. This is because the setting has no use in modern PCIe/NVMe devices.

Best Practices 52

Best Practices Design Tuning Database 52

Dotcom-Montior

OCTOBER 12, 2017

EasyTravel demo application on AWS server. LoadView scripting tool Easystep on AWS server. Firewall on AWS server. AWS server security policy. Setup Demo App EasyTravel on AWS box. Connect demo application hosted on AWS to Dynatrace. Setup Demo App EasyTravel on AWS Box. Verify hardware sizing.

AWS 40

AWS Tuning Monitoring Servers 40

Dotcom-Montior

OCTOBER 6, 2021

trying to reduce the amount of manual work and ensuring all the components (infrastructure/hardware, middleware, software, etc.) One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. What are Some Common SRE Responsibilities?

Engineering 67

Engineering DevOps Monitoring Google 67

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. In this blog, I want to give you a quick overview of what I put in this deck and hope it gives you enough ideas for your own migration project in order to complete it successfully!

Cloud 31

Cloud Traffic Database Network 31

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. x series.

Virtualization 76

Virtualization AWS Engineering Hardware 76

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. To add elasticity, reliability and durability, these data centers are connected to Google Cloud platform using high speed, secure Google Interconnect network. AWS for builds.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Moto G4) on a slow 3G network, emulated at 400ms RTT and 400kbps transfer speed. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

SEPTEMBER 3, 2021

It can be hard to visualize the huge network of hardware that allows you to send a request for a page to a server and then receive a response back. The good news is that, as developers, we can do an awful lot about it. I recently reworked the design of my personal blog in order to make it a little more user-friendly.

Website 136

Website Energy Internet Internet 136

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? Is generative AI the answer? Perhaps not yet. Now we expect wireless everywhere, and even that’s not correct.

Open Source 112

Open Source Artificial Intelligence Google Infrastructure 112

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). To be robust and scalable, this key/value store needs to be distributed for durability and availability, to protect against network partitions or hardware failures.

Latency 166

Latency Architecture AWS Open Source 166

The Netflix TechBlog

FEBRUARY 9, 2021

The homepage needs to load in a reasonable amount of time, even in poor network conditions. We can leverage high performance VMs in AWS to generate the assets. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires.

Engineering 165

Engineering Storage Latency Entertainment 165

All Things Distributed

JUNE 21, 2012

Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. Earth Networks recently launched a new lightning proximity feature for their popular WeatherBug app.

Games 142

Games Scalability AWS Database 142

All Things Distributed

NOVEMBER 15, 2010

The early GPU systems were very vendor specific and mostly consisted of graphic operators implemented in hardware being able to operate on data streams in parallel. Programming the GPU evolved in a similar fashion; it started with the early APIs being mainly pass-through to the operations programmed in hardware. Where to go from here?

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

NOVEMBER 30, 2016

Last week, I wrote a blog about helping the machine learning scientist community select the right deep learning framework from among many we support on AWS such as MxNet, TensorFlow, Caffe, etc. in ML and neural networks) and access to vast amounts of data.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165