Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare PostgreSQL vs. Oracle functionality across available tools, capabilities and services. Not available. Not available.

Open Source 244

Open Source Tuning C++ Database 244

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I also built online serving systems and microservices powering Walmart’s e-commerce. At this conference, I also got to know my current team: Consolidated Logging (CL).

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

The Netflix TechBlog

DECEMBER 14, 2020

The mystery begins Towards the end of 2017, I was on a conference call to discuss an issue with the Netflix application on a new set top box. They supplied a script to automate the process. To play a 60fps video, the highest frame rate available in the Netflix catalog, the device must render a new frame every 16.66

Engineering 352

Engineering Code Hardware Open Source 352

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers.

Virtualization 40

Virtualization AWS Hardware Storage 40

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system contains a number of privacy-enhancing building blocks, but the privacy guarantees of any end-to-end system will always depend on how they are used.

Systems 71

Systems Design Google Servers 71

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 amazon").

Virtualization 76

Virtualization AWS Engineering Hardware 76

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). How-to documentation is readily available.

Open Source 80

Open Source Healthcare Social Media Database 80

Dynatrace

FEBRUARY 25, 2021

since 2017, and many customers have used it with great success while we collected requirements for the next iteration of our Lambda extension. To handle N parallel requests, N Lambda instances need to be available, and AWS will spin up up to 1000 such instances automatically to handle 1000 parallel requests.

Lambda 215

Lambda AWS Monitoring Serverless 215

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Sharding is a preferred approach for database systems facing substantial growth and needing high availability.

Best Practices 73

Best Practices Traffic Database Servers 73

Percona

MARCH 30, 2023

In simple terms, an open source database is this: It’s a database with source code that is free and available to all. Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. What is an open source database?

Open Source 77

Open Source Database Storage Scalability 77

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. Back in 2017 the engineering team at Facebook had a problem. Without in-person conferences this year, income is down and events are under threat.

Virtualization 126

Virtualization Latency Storage Systems 126

Alex Russell

JANUARY 30, 2024

This split decision was available via last year's update , but was somewhat buried. the term "smartphone dependence" has been coined to describe folks without other ways to access the increasing fraction of essential services only available through the internet. Going forward, I'll produce both as top-line guidance. In the U.S.,

Performance 90

Performance Network Mobile Speed 90

Dynatrace

OCTOBER 17, 2019

And with today’s increasing financial, availability, performance and innovation requirements meaning applications need to be geographically dispersed to constantly changing dynamic powerhouses, it has become simply not possible to provision, update, monitor and decommissions them by only leveraging manual processes.

Code 108

Code Infrastructure DevOps Serverless 108

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. What is MariaDB?

Open Source 52

Open Source Servers Storage Scalability 52

Scalegrid

APRIL 2, 2019

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. were in the process of migrating to PostgreSQL and the last 14.1% different database systems, including PostgreSQL itself. are using public clouds.

Database 185

Database Cloud Open Source Azure 185

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. cat /sys/devices/system/clocksource/clocksource0/current_clocksource.

Speed 126

Speed Java AWS Virtualization 126

Percona

AUGUST 15, 2023

This blog was originally published in February 2017 and was updated in August 2023. MySQL replication is a process in which data from a primary MySQL database is copied and sent to one or more secondary databases, known as replicas. Start the replica server’s replication process. What is MySQL Replication?

Servers 52

Servers Database Availability Traffic 52

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. Modern network performance and availability. The Moto G4 , for example. Hard Reset.

Performance 124

Performance Network Cache Metrics 124

Adrian Cockcroft

JANUARY 29, 2023

There is no way to model how much more traffic you can send to that system before it exceeds it’s SLA. This is unfortunate, because we’d really like to be able to build systems that have an SLA that we can share with the consumers of our interfaces, and be able to measure how well we are doing.

Lambda 98

Lambda Latency Cache C++ 98

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. Starting with the Linux 4.18

Servers 90

Servers Media Cache Storage 90

SQL Server According to Bob

FEBRUARY 11, 2019

SQL Server 2017 leverages up to 4 log writer workers, on hidden schedulers, to assist in transaction log processing activities. You may find the number of log write workers has been increased to 8 when running newer releases of SQL Server to accommodate larger systems. Total number NUMA nodes * 2.

Servers 40

Servers Availability Software Software 40

The Netflix TechBlog

MAY 1, 2019

In late 2017, we received some critical feedback from the brothers on the Stranger Things 2 audio mix: in some scenes, there was a reduced sense of where sounds are located in the 5.1-channel We want your experience to be brilliant even if you aren’t listening with a state-of-the-art home theater system. We began streaming 5.1

Engineering 274

Engineering Network Media Entertainment 274

Particular Software

DECEMBER 14, 2020

ServiceControl is the nerve center of your distributed system, storing the data and providing the APIs that allow ServicePulse and ServiceInsight to function. Saga audit processing In the new version, we’ve scaled out saga audit processing so that you can use saga audits even in production.

Azure 52

Azure Transportation Tuning Processing 52

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. We already have 44 Availability Zones across 16 geographic Regions that customers can use today. 2017 continues a busy year for AWS in the Middle East.

Cloud 152

Cloud Education Energy Government 152

Tech News Gather

NOVEMBER 15, 2022

Apple’s official move into augmented reality was announced at WWDC in 2017. Especially if you buy apecoin , you can vote on how the ApeCoin DAO Fund should be used through the permissionless governance process. This causes less strain on the system, less delay, and less sickness.

Development 52

Development Virtualization Government Media 52

Percona

APRIL 12, 2023

Let’s start with this: MongoDB is accurately referred to as source-available software. Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2017: MongoDB goes public, trading as MDB.

Open Source 83

Open Source Programming Database Servers 83

Smashing Magazine

JANUARY 21, 2021

After the latest redesign in late 2017, it was Ilya Pukhalski on the JavaScript side of things (part-time), Michael Riethmueller on the CSS side of things (a few hours a week), and yours truly, playing mind games with critical CSS and trying to juggle a few too many things. Moving From Automated Critical CSS Back To Manual Critical CSS.

Performance 145

Performance Cache Mobile Network 145

Alex Russell

FEBRUARY 21, 2023

is astonishingly dense with delayed features, inadvertantly emphasising just how far behind WebKit has remained for many years and how effective the Blink Launch Process has been in allowing Chromium to ship responsibly while consensus was witheld in standards by Apple. Regardless, Safari 16.4 31st : Web Share changes Feb. Safari 16.4

Energy 79

Energy Games Engineering Design 79

O'Reilly

APRIL 23, 2024

As the internet grew, the amount of information available to consumers became so vast that it outran traditional human means of curation and selection. Yet many of the most pressing risks are economic , embedded in the financial aims of the companies that control and manage AI systems and services. Available at: [link].

Social Media 108

Social Media Google Internet Internet 108

Testsigma

JANUARY 29, 2021

That’s not all, the global mobile traffic is expected to increase sevenfold between 2017 and 2022. In this blog, we deep dive into the various aspects of mobile website testing, including the tools that can accelerate the testing process. The daily media consumption on mobile devices has grown by 504 percent since 2011[2].

Website 98

Website Mobile Testing Strategy 98

Testsigma

JANUARY 13, 2021

Studies show that in 2017, the worldwide failure rate of iOS apps was as high as 54%, with Android apps crashing 10% of the time. What business processes help with testing mobile apps ? Not only will this help speed track the testing process, it will also help make the objectives clearer.

Mobile 54

Mobile Strategy Testing Efficiency 54

Enprowess

JANUARY 12, 2022

Convenient Debugging : Debugging process is easy for the developers as single page application SPA offer developers tools. Twitter Lite PWA : It was integrated as the standard User Interface in 2017. AI chatbots can handle complex processes and prompt answering, thereby providing seamless digital experiences with a company.

Blockchain 59

Blockchain IoT Development Serverless 59

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Count of APIs available from JavaScript by Web Confluence.

Media 145

Media Games Education Engineering 145

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

SQL Performance

SEPTEMBER 17, 2019

For years SSRS was bundled with the installation of SQL Server, which helped add to some of the confusion around licensing and support for the product, so beginning with SSRS 2017, the installation package for Reporting Services is a separate download. Unlike the system database tempdb, ReportServerTempDB is not recreated at startup.

Tuning 67

Tuning Servers Database Best Practices 67