Percona

JULY 30, 2018

Please join Percona’s CEO, Peter Zaitsev as he presents Using MySQL for Distributed Database Architectures on Tuesday, July 31st, 2018 at 7:00 AM PDT (UTC-7) / 10:00 AM EDT (UTC-4). Such architectures bring many benefits (such as scalability and resiliency), but can also bring a lot of pain if incorrectly designed and executed.

Architecture 42

Architecture Database Open Source Internet 42

High Scalability

AUGUST 24, 2021

Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. The geolocation database or API detects location, proxy and other >20 parameters. Try it today!

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

OCTOBER 27, 2021

Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. The geolocation database or API detects location, proxy and other >20 parameters. Try it today!

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

SEPTEMBER 29, 2021

Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. The geolocation database or API detects location, proxy and other >20 parameters. Try it today!

Education 100

Education DevOps Infrastructure Benchmarking 100

High Scalability

SEPTEMBER 15, 2021

Pinecone is a fully managed vector database that makes it easy to add vector search to production applications. No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. The geolocation database or API detects location, proxy and other >20 parameters. Try it today!

Education 100

Education DevOps Infrastructure Benchmarking 100

InfoQ

DECEMBER 4, 2023

LinkedIn was able to dramatically improve the scalability and performance of its Espresso database by migrating it from HTTP1.1 to HTTP2, resulting in a reduction in the number of connections, latency, and garbage collection times. By Rafal Gancarz

Latency 99

Latency Scalability Database Performance 99

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. Most recently, in StackOverflow’s 2022 Stack Developer Survey , PostgreSQL took a slight lead over MySQL (46.48% to 45.68%) as the most popular database platform among professional developers. What is PostgreSQL used for? Is PostgreSQL enterprise-ready?

Open Source 82

Open Source Healthcare Social Media Database 82

Software Architecture

AUGUST 24, 2017

Source: [link] Cassandra has tunable consistency which means that not only on the database level, you can tune the immediate and eventual consistency of your data per query/operation by setting the read CL (consistency level) and write CL. Comments and thoughts welcome.

Tuning 100

Tuning Software Architecture Database C++ 100

Dynatrace

DECEMBER 8, 2020

It inherits the automation, AI, scalability, and enterprise-grade robustness of the Dynatrace platform. With new RASP capabilities of the Dynatrace OneAgent, the same trusted approach extends the Dynatrace platform to application security: automatic, intelligent, highly scalable. Stay tuned – this is only the start.

Cloud 287

Cloud Open Source Internet Internet 287

SQL Performance

JULY 8, 2021

The basic unit of SQL tuning is the query. It’s also a good way to not overwhelm the database servers … usually. That kind of feedback is necessary to help build maintainable, scalable solutions. Michael J Swart is a passionate database professional and blogger who focuses on database development and software architecture.

Design 92

Design Software Architecture Database Servers 92

HammerDB

OCTOBER 12, 2018

Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB. As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. As is exactly the same with PostgreSQL for system choice a 2 socket system is optimal for MySQL OLTP performance.

Best Practices 40

Best Practices Scalability Performance C++ 40

The Netflix TechBlog

AUGUST 30, 2021

The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Hardware 213

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Software Architecture

AUGUST 24, 2017

Consistency The topic and concept of consistency is very important when you work with a distributed database like Cassandra. When you’re working with a database which runs on only one server, consistency is a non-issue. Read CL controls how many replica nodes must send their most recent copy of partition to the coordinator.

Software Architecture 100

Software Architecture Database Tuning Servers 100

O'Reilly Software

APRIL 4, 2018

Considerations for setting the architectural foundations for a fast data platform. Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. Back in the days of Web 1.0,

Architecture 80

Architecture Scalability Google Operating System 80

Percona

AUGUST 30, 2018

One of the common ways to classify database workloads is whether it is “read intensive” or “write intensive”. Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability.

Benchmarking 48

Benchmarking Database Operating System Architecture 48

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, we’ll define plans and offers, review the legacy architecture and some of its shortcomings, and dig into our new architecture and some of its advantages. Let’s take a deeper look at the architecture, protocols, and systems involved. The database contains the plans, prices and offers.

Engineering 142

Engineering Scalability Architecture Innovation 142

Brendan Gregg

APRIL 30, 2018

In this year's CFP we’re looking for topics covering the latest trends and best practices in cloud computing, containerization, machine learning, big data, infrastructure, scalability, DevOps, IT management, automation, reliability, monitoring, performance tuning, security, databases, programming, datacenters, and more.

DevOps 43

DevOps Network Best Practices Programming 43

Brendan Gregg

APRIL 29, 2018

In this year's CFP we’re looking for topics covering the latest trends and best practices in cloud computing, containerization, machine learning, big data, infrastructure, scalability, DevOps, IT management, automation, reliability, monitoring, performance tuning, security, databases, programming, datacenters, and more.

DevOps 40

DevOps Network Best Practices Programming 40

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. Reloaded was well-architected, providing good stability, scalability, and a reasonable level of flexibility. Several promising ideas were abandoned owing to the outsized work needed to overcome architectural limitations.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 202

Java Scalability Traffic Architecture 202

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns.

Systems 334

Systems Traffic Architecture Mobile 334

The Netflix TechBlog

MARCH 25, 2019

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

The Netflix TechBlog

MAY 14, 2021

Managing and operating asynchronous workflows can be difficult without the proper tools and architecture that puts observability, debugging, and tracing at the forefront. Once you finally find useful identifiers, you may begin writing SQL queries against your production database to find out what went wrong.

Traffic 160

Traffic Latency Java Google 160

The Netflix TechBlog

NOVEMBER 2, 2021

As VMAF evolves and is integrated with more encoding and streaming workflows within Netflix, we need scalable ways of fostering video quality innovations. The Reloaded system is a well-matured and scalable system, but its monolithic architecture can slow down rapid innovation. via bug fixes). We call this system Cosmos.

Media 171

Media Innovation Metrics Latency 171

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 21, 2020

This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture. Other than these principles, there are some other design considerations to support and enable: Multi-tenancy with database and table prioritization.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

OCTOBER 27, 2020

At Netflix, we also heavily embrace a microservice architecture that emphasizes separation of concerns. As the paved path for moving data to key-value stores, Bulldozer provides a scalable and efficient no-code solution. Figure 1 shows how we use Bulldozer to move data at Netflix. Moving data with Bulldozer at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

All Things Distributed

MARCH 7, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Many of our customers have, with the click of a button, created DynamoDB deployments in a matter of minutes that are able to serve trillions of database requests per year. s fast and easy scalability can be quickly applied to building high scale applications.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

All Things Distributed

DECEMBER 12, 2013

We launched DynamoDB last year to address the need for a cloud database that provides seamless scalability, irrespective of whether you are doing ten transactions or ten million transactions, while providing rock solid durability and availability. Traditionally, databases have been scaled as a whole –tables and indexes together.

Games 130

Games Scalability Database Retail 130

All Things Distributed

NOVEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Unlike traditional row-based relational databases, which store data for each row sequentially on disk, Amazon Redshift stores each column sequentially. This means that Redshift performs much less wasted IO than a row-based database because it doesnâ??t

Cloud 164

Cloud Storage Architecture Scalability 164

All Things Distributed

MARCH 28, 2011

Werner Vogels weblog on building scalable and robust distributed systems. We see that with our Amazon customers; when they hear a great tune on a radio they may identify it using the Shazam or Soundhound apps on their mobile phone and buy that song instantly from the Amazon MP3 store. All Things Distributed. Comments ().

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

OCTOBER 8, 2014

We started with Amazon Dynamo, a simple key-value store that was built to be highly available and scalable to power various mission-critical applications in Amazon’s e-commerce platform. The original Dynamo paper inspired many database solutions, which are now popularly referred to as NoSQL databases.

Availability 145

Availability Performance Scalability AWS 145

High Scalability

NOVEMBER 25, 2019

Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice. In general, Egnyte connect architecture shards and caches data at different levels based on: Amount of data. SOA architecture based on REST APIs. Edge caching.

Architecture 52

Architecture Cache Azure Storage 52