Dynatrace

JANUARY 17, 2024

And an O’Reilly Media survey indicated that two-thirds of survey respondents have already adopted generative AI —a form of AI that uses training data to create text, images, code, or other types of content that reflect its users’ natural language queries. AI requires more compute and storage. AI performs frequent data transfers.

Strategy 222

Strategy Artificial Intelligence Storage Cloud 222

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. I had attended these events when I was based in the UK, but became one of the organizers.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

FEBRUARY 13, 2023

Media Feature Storage: Amber Storage Media feature computation tends to be expensive and time-consuming. This feature store is equipped with a data replication system that enables copying data to different storage solutions depending on the required access patterns.

Media 290

Media Storage Infrastructure Systems 290

Scalegrid

JANUARY 12, 2024

Storage is a critical aspect to consider when working with cloud workloads. High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. This also aids scalability down the line.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

MAY 13, 2020

It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Polymorphic Data Storage.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

MARCH 14, 2023

Much of the ML literature focuses on model training, evaluation, and scoring. Dawn Chenette , Design Lead This approach had several benefits for product engineering. At the same time, we kept the design open enough to allow future extensibility. This service leverages Cassandra and Elasticsearch for data storage and retrieval.

Media 291

Media Innovation Energy Architecture 291

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above.

Open Source 232

Open Source AWS Infrastructure Energy 232

Percona

OCTOBER 18, 2023

Flexibility and scalability Open source databases provide much greater flexibility regarding customization and configuration. Compatibility Open source databases are designed with interoperability at their core, adhering to industry standards and offering support for a wide range of data import and export formats.

Open Source 91

Open Source Database Hardware Strategy 91

Percona

JUNE 12, 2023

Percona Distribution for MySQL is the most stable, scalable, and secure open-source MySQL distribution, with two download options: one based on Percona Server for MySQL and one based on Percona XtraDB Cluster. It is an enhanced, source-available, and highly-scalable database that is a fully-compatible, drop-in replacement for MongoDB 5.0.18

Open Source 82

Open Source Servers Database Scalability 82

Percona

MAY 8, 2023

A freely available MongoDB database alternative, it gives you a single solution that combines enterprise components from the open source community, designed and tested to work together. It is an enhanced, source-available, and highly-scalable database that is a fully-compatible drop-in replacement for MongoDB 5.0.16 14 was released.

Monitoring 76

Monitoring Open Source Database Servers 76

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above.

Open Source 134

Open Source AWS Infrastructure Energy 134

The Morning Paper

OCTOBER 10, 2019

To make all this work at scale, two important additional features are the use of subsampling to ensure scalability across hundreds of thousands of classes, and a binarization module to reduce the storage costs and prediction latency. The Flashlight, Lens, and Shop-The-Look datasets are all used as inputs to the training process.

Latency 58

Latency Storage Architecture Traffic 58

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails. This flexibility can be crucial in designing a scalable architecture.

Availability 107

Availability Database Open Source Hardware 107

All Things Distributed

DECEMBER 13, 2016

At re:Invent 2016 , AWS announced Greengrass (in limited preview), a new service designed to extend the AWS programming model to small, simple, field-based devices. Fraud.net use AWS to support highly scalable, big data applications that run machine learning processes for real-time analytics. Fraud.net is a good example of this.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Technology 151

Technology Technology AWS Storage 151

High Scalability

OCTOBER 24, 2022

There is no structural separation as there is with a train service. Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security. Without cloud services, there is no cloud because a cloud is literally defined by the services it offers. For example, AWS created Nitro.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Percona

APRIL 10, 2023

It is the most stable, scalable, and secure open-source MySQL distribution, with two download options: one based on Percona Server for MySQL and one based on Percona XtraDB Cluster. It is an enhanced, source-available, and highly-scalable database that is a fully-compatible, drop-in replacement for MongoDB 6.0.5 Community Edition.

Open Source 77

Open Source Servers AWS Database 77

Percona

DECEMBER 12, 2022

It is a single solution with the best and most critical enterprise components from the MySQL open-source community, designed and tested to work together. It is a freely available MongoDB database alternative, giving you a single solution that combines enterprise components from the open source community, designed and tested to work together.

Open Source 62

Open Source Azure Database Servers 62

IO River

NOVEMBER 2, 2023

‍Unlike CloudFormation, which was confined to AWS resources, Terraform was designed with a multi-cloud approach in mind. This offers not just an audit train but an “audit trail on steroids.”‍A Beyond just VM instances, this scalability extends to other aspects of your infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

The Morning Paper

APRIL 16, 2019

During the ten week course, students implement four different assignments: an exactly-once RPC protocol; a primary-backup system; Paxos; and a scalable, transactional key-value storage system. It highlights a case where students, perhaps trained on good TDD practices (do students get taught that these days??)

Systems 43

Systems Efficiency Testing Strategy 43

The Netflix TechBlog

FEBRUARY 13, 2020

It brought a whole range of additional features such as spatial scalability, region of interest coding, range of supported bit-depths, flexible number of color planes, lossless coding, etc. The Alliance for Open Media (AOM) has recently extended this format to specify the storage of AV1-encoded images in its AVIF format.

Code 212

Code Metrics Efficiency Open Source 212

IO River

NOVEMBER 2, 2023

Unlike CloudFormation, which was confined to AWS resources, Terraform was designed with a multi-cloud approach in mind. This offers not just an audit train but an “audit trail on steroids.”‍A Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision.

Open Source 40

Open Source DevOps AWS Azure 40

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture 52

Architecture Cache Azure Storage 52