High Scalability

MAY 26, 2020

has hours of system design content. They also do live system design discussions every week. Learn to balance architecture trade-offs and design scalable enterprise-level software. Check out Educative.io 's bestselling new 4-course learning track: Scalability and System Design for Developers.

Education 100

Education AWS Software Engineering Scalability 100

Percona

DECEMBER 4, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. It is the most stable, scalable, and secure open source MySQL distribution based on Percona Server for MySQL. Release highlights include: Docker images are now available for x86_64 architectures.

Open Source 79

Open Source Azure Servers Programming 79

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management.

Latency 52

Latency Hardware Cache Architecture 52

Percona

DECEMBER 27, 2023

AI and MLOps Kubernetes has become a new web server for many production AI workloads, focusing on facilitating the development and deployment of AI applications, including model training. The newly formed Open Source AI Alliance , led by META and IBM, promises to support open-source AI.

Cloud 79

Cloud Open Source Strategy Best Practices 79

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. With its modular architecture, DLA is scalable, highly configurable, and designed to simplify integration and portability.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Dynatrace

SEPTEMBER 30, 2021

The breadth of fully-featured services, the pay-as-you-go scalability, and the agility of cloud platforms enable organizations to expand their modern approaches to building and managing digital services in a way they can’t with on-premises apps and infrastructure. Increased scalability. Reduced cost. Inconsistent performance.

Cloud 165

Cloud Traffic Best Practices Strategy 165

Official Blog - World Web Technology

DECEMBER 4, 2023

It’s a cost-effective and time-efficient process that most software developers utilize to build and design state-of-the-art software. Programmers use SDLC to create low- to high-level designs and software plans. Design documents are the highlight when working with software development life cycle. What is SDLC? The Concept!

Processing 64

Processing Software Software Development 64

Testsigma

SEPTEMBER 15, 2020

The upfront time required in writing the scripts for test cases, creation of the framework, training the team and maintenance is reduced considerably. To design an automation testing framework is the initial step, it doesn’t conclude the automation testing framework creation. Time Efficiency. Easier Maintenance.

Testing 59

Testing Testing Tools Code DevOps 59

High Scalability

NOVEMBER 9, 2018

You can now train CIFAR10 for just $0.06 AMD is now using the second-gen Infinity Fabric to connect a multi-chip design with a 14nm I/O die serving as the linchpin of the design. That central chip ties together the 7nm CPU chiplets, creating a massively scalable architecture. AMD has improved the Infinity Fabric.

Internet 192

Internet Internet Scalability Blockchain 192

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. I had attended these events when I was based in the UK, but became one of the organizers.

Tuning 52

Tuning Benchmarking Engineering C++ 52

High Scalability

AUGUST 3, 2018

Paco Nathan : Frankly, I’d feel a lot more comfortable sending my kids off to school in a self-driving bus if the machine learning models hadn’t been trained solely by Google’s proprietary data. Department of Homeland Security has designated 16 sectors of infrastructure as 'critical', and 14 of them depend on GPS.

Internet 113

Internet Internet Scalability Blockchain 113

The Netflix TechBlog

AUGUST 17, 2023

The tool provides an efficient way for creatives (photo editors, artwork designers, etc.) Watching every moment of content to find the best frames and select them manually takes a lot of time, and this approach is often not scalable. Intro to AVA Discovery View AVA is an internal tool that surfaces still frames from video content.

Media 169

Media Scalability Architecture Strategy 169

The Netflix TechBlog

MARCH 14, 2023

Much of the ML literature focuses on model training, evaluation, and scoring. Specifically, we will dive into the architecture that powers search capabilities for studio applications at Netflix. Dawn Chenette , Design Lead This approach had several benefits for product engineering. Incredible!”

Media 291

Media Innovation Energy Architecture 291

The Netflix TechBlog

APRIL 26, 2022

We built Axion primarily to remove any training-serving skew and make offline experimentation faster. We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

OCTOBER 18, 2022

These include ETL pipelines, ML model training workflows, batch jobs, etc. As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company.

Java 202

Java Scalability Traffic Architecture 202

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

NOVEMBER 13, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. It includes the Docker images for x86_64 architectures and aims to simplify the developers’ experience with the Distribution. Updated Release of Percona Distribution for PostgreSQL 16.0

Innovation 85

Innovation Open Source Scalability Database 85

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. Reloaded was well-architected, providing good stability, scalability, and a reasonable level of flexibility. This drove the approach of the “release train”. The microservice architecture provides strong decoupling between services.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 249

Architecture Best Practices Engineering Open Source 249

Percona

DECEMBER 18, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. A release highlight is that Docker images are now available for x86_64 architectures. Docker images are now available for x86_64 architectures. or stay on 5.7 Install Percona Xtrabackup 2.4.29

Monitoring 86

Monitoring Open Source Servers Scalability 86

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 232

Open Source AWS Infrastructure Energy 232

Percona

SEPTEMBER 18, 2023

Percona software is designed for peak performance, uncompromised security, limitless scalability, and disaster-proofed availability. It is a freely available MongoDB database alternative, giving you a single solution that combines enterprise components from the open source community, designed and tested to work together.

Open Source 79

Open Source Servers Database Scalability 79

O'Reilly

OCTOBER 19, 2021

In effect, the engineer designs and builds the world wherein the software operates. Since the needs of data-intensive applications are diverse, it is useful to have a general-purpose compute layer that can handle different types of tasks from IO-heavy data processing to training large models on GPUs. Software Architecture.

DevOps 138

DevOps Software Engineering Infrastructure Open Source 138

The Netflix TechBlog

DECEMBER 23, 2020

everything from the frontend API for netflix.com, to machine learning training workloads, to video encoders. Titus internally employs a cellular bulkhead architecture for scalability, so the fleet is composed of multiple cells. We do this for reliability, scalability, and efficiency reasons.

Media 286

Media Metrics Systems Processing 286

Dynatrace

DECEMBER 10, 2020

Change starts by thoroughly evaluating whether the current architecture, tools, and processes for configuration, infrastructure, code delivery pipelines, testing, and monitoring enable improved customer experience faster and with high quality or not. Rethinking the process means digital transformation.

Strategy 178

Strategy Performance Logistics Monitoring 178

The Netflix TechBlog

NOVEMBER 20, 2023

Whether in analyzing A/B tests, optimizing studio production, training algorithms, investing in content acquisition, detecting security breaches, or optimizing payments, well structured and accurate data is foundational. The incremental processing solution (IPS) described here has been designed to address the above problems.

Processing 210

Processing Big Data Efficiency Engineering 210

Percona

FEBRUARY 13, 2023

It is the most stable, scalable, and secure open source MySQL distribution, with two download options: one based on Percona Server for MySQL and one based on Percona XtraDB Cluster. It is an enhanced, source-available, and highly-scalable database that is a fully-compatible, drop-in replacement for MongoDB 6.0.4 3 was released.

Open Source 83

Open Source Database Servers Scalability 83

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails.

Availability 107

Availability Database Open Source Hardware 107

The Netflix TechBlog

DECEMBER 3, 2019

On the other hand, very few data scientists feel strongly about the nature of the data warehouse, the compute platform that trains and scores their models, or the workflow scheduler. In this hypothetical example, the flow trains two versions of a model in parallel and chooses the one with the highest score.

Open Source 134

Open Source AWS Infrastructure Energy 134

The Morning Paper

OCTOBER 10, 2019

As image recognition architectures are evolving quickly, we want to iterate our three specialized embeddings with modern architectures to improve our three visual search products. Model architecture. The whole model is trained using PyTorch on one p3.16xlarge Amazon EC2 instance with eight Tesla V100 graphics cards.

Latency 58

Latency Storage Architecture Traffic 58

High Scalability

OCTOBER 24, 2022

There is no structural separation as there is with a train service. You can even go old school and use non cloud-native architectures. Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security. You can switch between clouds with effort. It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. Service-oriented architecture -- or SOA -- is the fundamental building abstraction for Amazon technologies. All Things Distributed.

Technology 151

Technology Technology AWS Storage 151

Smashing Magazine

AUGUST 3, 2023

As an online booking platform, we connect travelers with transport providers worldwide, offering bus, ferry, train, and car transfers in over 30 countries. You need to watch out for complex design elements, large media files, or slow browser rendering can delay the time it takes for the largest contentful element to render.

Performance 74

Performance Cache Traffic Metrics 74

IO River

NOVEMBER 2, 2023

‍Unlike CloudFormation, which was confined to AWS resources, Terraform was designed with a multi-cloud approach in mind. This offers not just an audit train but an “audit trail on steroids.”‍A Beyond just VM instances, this scalability extends to other aspects of your infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

IO River

NOVEMBER 2, 2023

Unlike CloudFormation, which was confined to AWS resources, Terraform was designed with a multi-cloud approach in mind. This offers not just an audit train but an “audit trail on steroids.”‍A Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision.

Open Source 40

Open Source DevOps AWS Azure 40

The Netflix TechBlog

FEBRUARY 13, 2020

It brought a whole range of additional features such as spatial scalability, region of interest coding, range of supported bit-depths, flexible number of color planes, lossless coding, etc. However, VMAF, as of today, is a metric trained and developed to judge encoded videos rather than static images.

Code 212

Code Metrics Efficiency Open Source 212