Adrian Cockcroft

JANUARY 17, 2022

photo taken by Adrian Cockcroft A year ago I did a talk at re:Invent called Architecture Trends and Topics for 2021 , so I thought it was worth seeing how they played out and updating them for the coming year. I did a few talks on this subject early in the year, and linked this to the sustainability advantages of serverless architectures.

Serverless 98

Serverless Hardware AWS Architecture 98

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

All Things Distributed

SEPTEMBER 8, 2015

Amazon Web Services (AWS) has been working closely with the startup community in London, and Europe, since we launched back in 2006. Both London and Berlin are vibrant cities with a concentration of innovative startups building their businesses on AWS. You can also drop in if you don’t have an appointment.

AWS 107

AWS IoT Innovation Architecture 107

The Netflix TechBlog

MAY 21, 2019

We thought that reinforcement learning would be a promising approach that could provide great flexibility in the training process. Likewise it has very low requirements on the initial amount of training data. Lerner, as a web-service, relies on Amazon Web Services (AWS) and Netflix’s Open Source Software (OSS) tools.

Testing 163

Testing AWS Lambda Network 163

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 111

AWS Games Education Innovation 111

All Things Distributed

MAY 27, 2015

Over a year ago the AWS team opened a "pop-up loft" in San Francisco at 925 Market Street. The goal of opening the loft was to give developers an opportunity to get in-person support and education on AWS, to network, get some work done, or just hang out with peers. Usually $30 each, these labs are offered for free in the AWS loft.

AWS 95

AWS Education Big Data Games 95

Dynatrace

APRIL 5, 2021

Similar to AWS Lambda , Azure Functions is a serverless compute service by Microsoft that can run code in response to predetermined events or conditions (triggers), such as an order arriving on an IoT system, or a specific queue receiving a new message. Dynatrace news. What is Azure Functions? How Azure Functions works.

Azure 136

Azure Serverless IoT Lambda 136

All Things Distributed

MAY 28, 2015

An important way of engaging with AWS customers is through the AWS Global Summit Series. All AWS Summits feature a keynote address highlighting the latest announcements from AWS and customer testimonials, technical sessions led by AWS engineers, and hands-on technical training.

AWS 86

AWS Education Best Practices Architecture 86

High Scalability

MAY 26, 2020

Learn the stuff they don't teach you in the AWS docs. Filter out the distracting hype, and focus on the parts of AWS that you'd be foolish not to use. Learn the Good Parts of AWS. Created by former senior-level AWS engineers of 15 years. Learn how to train interviewers so everyone's on the same page.

Education 100

Education AWS Software Engineering Scalability 100

Scalegrid

JANUARY 11, 2024

Key Takeaways Cloud security monitoring is a comprehensive approach involving both manual and automated processes to oversee servers, applications, platforms, and websites, using tools that are customized to fit unique cloud architectures. For example, Blumira offers a third-party solution while AWS provides its own with CloudWatch.

Best Practices 130

Best Practices Cloud Monitoring Strategy 130

The Symphonia

JANUARY 21, 2019

We even put CI/CD front and center in our training courses ?—?we we help people create a Continuous Deployment pipeline before they start getting into the nitty-gritty of Serverless Architecture. Since we use so many AWS services in our work, it makes sense that we also consider AWS tools for CI/CD.

AWS 40

AWS Open Source Lambda Serverless 40

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

Percona

DECEMBER 18, 2023

A release highlight is that Docker images are now available for x86_64 architectures. Docker images are now available for x86_64 architectures. Release highlights include: AWS IAM authentication is now generally available, enabling you to use this functionality in production environments.

Monitoring 89

Monitoring Open Source Servers Scalability 89

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

O'Reilly

NOVEMBER 12, 2019

For the inaugural O’Reilly survey on serverless architecture adoption, we were pleasantly surprised at the high level of response: more than 1,500 respondents from a wide range of locations, companies, and industries participated. The high response rate tells us that serverless is garnering significant mindshare in the community.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started This offers not just an audit train but an “audit trail on steroids.”‍A

Open Source 52

Open Source DevOps AWS Azure 52

Dynatrace

JUNE 1, 2021

Application architecture to gain insights into how application architecture changes impact performance and user experience. Point solutions only provide a limited view of a company’s application architecture. With the Davis® AI engine at its core, Dynatrace provides precise answers to complex questions in real time.

Monitoring 148

Monitoring Mobile Social Media Artificial Intelligence 148

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Because cloud architectures are more distributed and dynamic resources come and go as needed, performance can be varied.

Cloud 163

Cloud Traffic Best Practices Strategy 163

The Symphonia

JUNE 19, 2018

We’ve got you covered), partnering with friends on a fascinating open source project, our most comprehensive training course yet, plenty of speaking engagements (see our expanding portfolio of talks that we can give to your team here ), and a revisit of an old friend. Next up Lynn Langit gave a talk on Serverless SQL , updated for 2018.

Serverless 40

Serverless AWS DevOps Open Source 40

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. This offers not just an audit train but an “audit trail on steroids.”‍A

Open Source 40

Open Source DevOps AWS Azure 40

Adrian Cockcroft

JUNE 21, 2022

I also learned how marketing worked, and began to build my presentation and training skills as I was sent around the world by Sun to teach workshops and speak at events. I still code in R… One role I had for many years was to lead technical training events for the global specialist systems engineers, which we called the Ambassador Program.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Symphonia

MARCH 13, 2018

And of course, if you’re interested in getting some help in April or May for architecture review, DevSecCostOps (™) , or building a Lambda-backed proof-of-concept, then drop us a line. If you’re looking for training we have several tutorials and workshops on the calendar. Just saying. See our complete speaking schedule here.

Serverless 40

Serverless Lambda AWS DevOps 40

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. When it comes to making a decision at a node in the tree, each node has a fixed threshold t , learned during the training phase, against which it compares the input value.

Energy 52

Energy Hardware Efficiency Architecture 52

O'Reilly

DECEMBER 2, 2019

I’ve always been unimpressed by streaming services for music and video, at least partly because they’re least available when you most want them: when you’re flying or on a train, in at a technical conference with 3,000 attendees maxing out the hotel’s network. We recently conducted a survey on serverless architecture adoption.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Smashing Magazine

AUGUST 3, 2023

As an online booking platform, we connect travelers with transport providers worldwide, offering bus, ferry, train, and car transfers in over 30 countries. We recognize the potential benefits of serving static content, which involves delivering pre-generated HTML files like you would see in a Jamstack architecture.

Performance 74

Performance Cache Traffic Metrics 74

The Symphonia

DECEMBER 6, 2017

The light show at the re:Play party Another re:Invent has come and gone, and us mere AWS-using mortals are now rapidly trying to sort the wheat from the chaff of a heady harvest of announcements. It’s funny to think that AWS Lambda was announced at re:Invent only 3 years ago?—?the skip to the end if you want my take on those.

Serverless 40

Serverless Lambda AWS Traffic 40

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 232

Open Source AWS Infrastructure Energy 232

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 134

Open Source AWS Infrastructure Energy 134

O'Reilly

OCTOBER 19, 2021

Cloud-based data warehouses, such as Snowflake , AWS’ portfolio of databases like RDS, Redshift or Aurora , or an S3-based data lake , are a great match to ML use cases since they tend to be much more scalable than traditional databases, both in terms of the data set sizes as well as query patterns. Software Architecture.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. We make sure there is no training/serving skew by using the same data and the code for online and offline feature generation.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 249

Architecture Best Practices Engineering Open Source 249

The Netflix TechBlog

OCTOBER 18, 2022

These include ETL pipelines, ML model training workflows, batch jobs, etc. Meson was based on a single leader architecture with high availability. As the usage increased, we had to vertically scale the system to keep up and were approaching AWS instance type limits. Figure 1 shows the high-level architecture.

Java 202

Java Scalability Traffic Architecture 202

High Scalability

NOVEMBER 9, 2018

You can now train CIFAR10 for just $0.06 That central chip ties together the 7nm CPU chiplets, creating a massively scalable architecture. The R5a, M5a and T3a instances purportedly will offer a 10% price-to-performance advantage over AWS's other cloud instances. and ImageNet for $12.60 (4x less than in April!): [link].

Internet 192

Internet Internet Scalability Blockchain 192

O'Reilly

MAY 19, 2020

Live online training, videos, books, certification prep, and more, from O’Reilly and our partner publishers. AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

High Scalability

OCTOBER 24, 2022

There is no structural separation as there is with a train service. You can even go old school and use non cloud-native architectures. For example, AWS created Nitro. Would Nitro have been invented if AWS was restricted to being a platform provider? You can switch between clouds with effort. It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. The challenges begin with collecting, cleaning, and formatting training data.

Tuning 94

Tuning AWS Scalability Infrastructure 94

High Scalability

AUGUST 3, 2018

Paco Nathan : Frankly, I’d feel a lot more comfortable sending my kids off to school in a self-driving bus if the machine learning models hadn’t been trained solely by Google’s proprietary data. margin over the same period. You can further set up a cross-region read replica for disaster recovery. million (US $3.6

Internet 113

Internet Internet Scalability Blockchain 113