All Things Distributed

JULY 17, 2013

Werner Vogels weblog on building scalable and robust distributed systems. AWS re:Invent 2013. The AWS re:Invent user conference last year in Las Vegas was by many described as the best technology conference they had been to in a long time. The registration for AWS re:Invent is now open at this site. Comments ().

AWS 87

AWS Strategy Scalability Cloud 87

Scalegrid

JANUARY 12, 2024

What is workload in cloud computing? Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. The environments, which were previously isolated, are now working seamlessly under central control.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. I had attended these events when I was based in the UK, but became one of the organizers. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

DECEMBER 13, 2016

In November 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in the United Kingdom. Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

High Scalability

OCTOBER 24, 2022

There's a move to regulate cloud providers by vertically separating the services they offer. Like railroads of yore, who were not allowed to provide freight services on top of their base services, cloud providers would not be allowed to provide services on top of their base platform services. The job of a cloud is to run workloads.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

High Scalability

NOVEMBER 9, 2018

Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. You can now train CIFAR10 for just $0.06 That central chip ties together the 7nm CPU chiplets, creating a massively scalable architecture. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it.

Internet 192

Internet Internet Scalability Blockchain 192

High Scalability

JUNE 29, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. kellabyte : LOL at racking up an AWS bill of $140,000 in 4 hours of compute time. We spun up a cluster of 100,000 AWS instances multiple times.

Scalability 131

Scalability Internet Internet Wireless 131

High Scalability

AUGUST 3, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. Instead, let’s get every possible edge case understood by mingling Google’s training data with that from the other manufacturers.

Internet 113

Internet Internet Scalability Blockchain 113

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 232

Open Source AWS Infrastructure Energy 232

High Scalability

JULY 6, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. Someone needs to revamp the G sales and support approach if they want to grow in the cloud space. It would mean a great deal to me.

Internet 110

Internet Internet Scalability Google 110

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 134

Open Source AWS Infrastructure Energy 134

Percona

AUGUST 21, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. It is an enhanced, source-available, and highly-scalable database that is a fully-compatible, drop-in replacement for MongoDB 6.0.7 It includes Percona Server for MongoDB and Percona Backup for MongoDB.

Open Source 81

Open Source AWS Servers Database 81

O'Reilly

OCTOBER 19, 2021

Cloud-based data warehouses, such as Snowflake , AWS’ portfolio of databases like RDS, Redshift or Aurora , or an S3-based data lake , are a great match to ML use cases since they tend to be much more scalable than traditional databases, both in terms of the data set sizes as well as query patterns. Software Development Layers.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. We make sure there is no training/serving skew by using the same data and the code for online and offline feature generation. Our machine learning models train on several weeks of data.

Storage 187

Storage Design Scalability Latency 187

Percona

DECEMBER 18, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. Release highlights include: AWS IAM authentication is now generally available, enabling you to use this functionality in production environments. Download Percona Distribution for MongoDB 6.0.12

Monitoring 84

Monitoring Open Source Servers Scalability 84

Scalegrid

MAY 13, 2020

Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum can run on any Linux server, whether it is hosted in the cloud or on-premise, and can run in any environment. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started This offers not just an audit train but an “audit trail on steroids.”‍A

Open Source 52

Open Source DevOps AWS Azure 52

All Things Distributed

NOVEMBER 29, 2017

Though the AWS Cloud gives you access to the storage and processing power required for ML, the process for building, training, and deploying ML models has unique challenges that often block successful use of this powerful new technology. The challenges begin with collecting, cleaning, and formatting training data.

Tuning 94

Tuning AWS Scalability Infrastructure 94

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. This offers not just an audit train but an “audit trail on steroids.”‍A

Open Source 40

Open Source DevOps AWS Azure 40

Percona

APRIL 10, 2023

It is the most stable, scalable, and secure open-source MySQL distribution, with two download options: one based on Percona Server for MySQL and one based on Percona XtraDB Cluster. Percona XtraDB Cluster (PXC) supports critical business applications in your public, private, or hybrid cloud environment. was released on March 28, 2023.

Open Source 76

Open Source Servers AWS Database 76

Percona

MARCH 27, 2023

It is the most stable, scalable, and secure open-source MySQL distribution, with two download options: one based on Percona Server for MySQL and one based on Percona XtraDB Cluster. It supports critical business applications in your public, private, or hybrid cloud environment. Download Percona Monitoring and Management 2.36

Open Source 76

Open Source Servers Scalability Cache 76

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Technology 151

Technology Technology AWS Storage 151

The Netflix TechBlog

DECEMBER 11, 2020

The schema registry also integrates with our CI/CD systems like Spinnaker to automatically setup cloud networking for DGSs. We partnered with Netflix’s Developer Experience (DevEx) team to build out documentation, training materials, and tutorials for developers. In Studio Edge, every DGS team needs to build expertise in GraphQL.

Architecture 249

Architecture Best Practices Engineering Open Source 249

Adrian Cockcroft

JANUARY 20, 2023

Custom HPC optimized CPUs and GPUs will become the mainstream in the next few years, with chiplets based on the ARM and RISC-V pattern libraries and tooling, with competition between cloud providers, startups and the large systems vendors. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

OCTOBER 10, 2013

I am very excited to announce AWS Activate , a program designed to provide startups with the resources they need to build applications on AWS. Startups will forever be a very important customer segment of AWS. When we launched AWS the original mission was. and Tellybug , and many more.

AWS 124

AWS Best Practices Infrastructure Programming 124

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Migration to cloud. Cloud Platform. Google cloud.

Architecture 52

Architecture Cache Azure Storage 52