All Things Distributed

MARCH 30, 2017

This weekend I am travelling to Australia for the first AWS Summit of 2017. One topic that always gets me excited is how to take computer science research and implement it in production systems. real systems do not fail by stopping in a nice and clean way). At times, it makes research unsuitable for production (e.g.

Systems 92

Systems AWS Design Technology 92

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I also built online serving systems and microservices powering Walmart’s e-commerce. At this conference, I also got to know my current team: Consolidated Logging (CL).

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Smashing Magazine

JULY 11, 2019

Inspired Design Decisions: Pressing Matters. Inspired Design Decisions: Pressing Matters. Its publishers hope to inspire newcomers to printmaking, but as I thumbed through its pages, I found there is plenty about the design of Pressing Matters which can inspire web designers too. Andrew Clarke. 2019-07-11T12:30:59+02:00.

Design 93

Design Media Mobile Energy 93

O'Reilly

FEBRUARY 18, 2020

The shift to cloud native design is transforming both software architecture and infrastructure and operations. Up until 2017, the ML+AI topic had been amongst the fastest growing topics on the platform. R-related usage on O’Reilly online learning fell by 8% between 2017-18 and by 6%, year-over-year, in 2019. Coincidence?

Software Architecture 132

Software Architecture DevOps Data Engineering Architecture 132

The Netflix TechBlog

DECEMBER 23, 2020

By Fabio Kung , Sargun Dhillon , Andrew Spyker , Kyle , Rob Gulewich, Nabil Schear , Andrew Leung , Daniel Muino, and Manas Alekar As previously discussed on the Netflix Tech Blog, Titus is the Netflix container orchestration system. Road to Implementation We began work to enable user namespaces in early 2017.

Media 286

Media Metrics Systems Processing 286

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0

Performance 52

Performance Latency Hardware Storage 52

Dynatrace

DECEMBER 16, 2019

Even small amounts of technical debt compound as new code branches from old, further embedding the shortcomings into the system. Technical Debt—Dilbert Comic Strip on 2017-01-03. The sudden lure of artificial intelligence (AI) and machine learning (ML) systems designed for IT brings new urgency to the topic of intellectual debt.

Artificial Intelligence 153

Artificial Intelligence Traffic Efficiency Innovation 153

ACM Sigarch

APRIL 26, 2018

BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0 With its modular architecture, DLA is scalable, highly configurable, and designed to simplify integration and portability.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

The Netflix TechBlog

JULY 1, 2019

The goal of this experience from a UX design perspective was to bring together a tightly-related set of original titles that, though distinct entities on their own, also share a connected universe. We hypothesized this design would net a far greater visual impact than if the titles were distributed individually throughout the page.

Cache 166

Cache Design Testing Development 166

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 124

Performance Network Cache Metrics 124

Brendan Gregg

APRIL 27, 2023

Observability tools are designed have the lowest overhead possible so that they are safe to run in production while analyzing an active performance issue. Keeping overhead low can require tradeoffs in other areas: tcpdump(8), for example, will drop packets if the system is overloaded, resulting in incomplete visibility.

Open Source 52

Open Source Monitoring Engineering Design 52

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Now let’s look at how we designed the tracing infrastructure that powers Edgar. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 78

Open Source Healthcare Social Media Database 78

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

The Netflix TechBlog

MAY 1, 2019

In late 2017, we received some critical feedback from the brothers on the Stranger Things 2 audio mix: in some scenes, there was a reduced sense of where sounds are located in the 5.1-channel We want your experience to be brilliant even if you aren’t listening with a state-of-the-art home theater system. We began streaming 5.1

Engineering 274

Engineering Network Media Entertainment 274

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". However, some seem to have missed Davidson's point regarding the importance of resources and rely almost entirely on waits to present a picture of query performance and system health.

Tuning 115

Tuning Servers Monitoring Hardware 115

SQL Server According to Bob

FEBRUARY 10, 2019

SQL Server 2017 introduced a small change to SQL Server’s default worker thread calculation, accounting for smaller environments. The additional worker level is increased by 32 workers per CPU when the system presents 64 or more CPUs. When running on smaller environments SQL Server reduces the worker target.

Servers 40

Servers Design Systems 40

Tech News Gather

NOVEMBER 15, 2022

Apple’s official move into augmented reality was announced at WWDC in 2017. ” The VR and XR gear will have a futuristic design. In addition, the system uses the user’s gaze to optimize the visual quality and resolution precisely where it matters most: where the user is looking (exactly how the human eye does).

Development 52

Development Virtualization Government Media 52

Percona

JULY 7, 2023

Where a high availability design once worked well, it can no longer keep up with more complex requirements. The majority of SPOFs are a consequence of scale, where designs that were once adequate (excellent, even) no longer meet evolving, more complex requirements. Failover is essential to minimizing downtime.

Availability 84

Availability Open Source Architecture Database 84

Smashing Magazine

JUNE 3, 2022

What would the world’s most ideal, best practice and design research-driven highly legible serif, sans serif, and slab serif possibly be like? How good is a new typeface, and how good is it compared to a similar typeface designed in previous years? Fast forward to the early 1960s, phototypesetting systems appeared.

Performance 111

Performance Design Best Practices Testing 111

Smashing Magazine

DECEMBER 22, 2021

Created by Jon Yablonski, this lovely website explains 21 psychological principles that designers can consider to create more human-centered products and experiences. The right tools at the right time, help streamline the design process. User experience research is a crucial component of the human-centered design process.

Airlines 129

Airlines Mobile Design Strategy 129

Alex Russell

FEBRUARY 21, 2023

Recall that Cupertino manages the actual work of Safari engineers through Apple-internal systems (previously named "Radar" ), making public bug reports a sort of parallel track; once an issue is imported from a public bug to a private tracker, it's more likely to get developer attention. But needs must.

Energy 79

Energy Games Engineering Design 79

SQL Server According to Bob

MAY 19, 2019

The reduction effort started when we shipped SQL Server 2017 ( [link].) Partitioning allows SQL Server to scale to the largest systems with record-setting performance. When promoted to a super-latch on a 64 CPU system the memory requirement becomes 32 + (32 *64) = 2080 bytes. SQL Server 2017. IO Request Caches.

IoT 61

IoT Servers Development Cache 61

Scalegrid

APRIL 2, 2019

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. different database systems, including PostgreSQL itself. by PostgreSQL respondents for its simple and flexible design, and their advanced feature set at seventh with 6.4%.

Database 185

Database Cloud Open Source Azure 185

All Things Distributed

SEPTEMBER 25, 2017

2017 continues a busy year for AWS in the Middle East. We have supported the development of technology skills across the region with Training and Certification programs to help customers develop skills to design, deploy, and operate their infrastructure and applications on the AWS Cloud.

Cloud 152

Cloud Education Energy Government 152

Percona

MARCH 30, 2023

Instead, the business may design and redesign systems as customer expectations change and business objectives evolve. PostgreSQL PostgreSQL , a non-relational database system, has rapidly gained in popularity among professional developers. MongoDB MongoDB is a popular open source* non-relational (NoSQL) database.

Open Source 75

Open Source Database Storage Scalability 75

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. million requests per second.

Internet 128

Internet Internet AWS Performance 128

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). What is MariaDB? What is MySQL?

Open Source 52

Open Source Servers Storage Scalability 52

Smashing Magazine

JANUARY 21, 2021

After the latest redesign in late 2017, it was Ilya Pukhalski on the JavaScript side of things (part-time), Michael Riethmueller on the CSS side of things (a few hours a week), and yours truly, playing mind games with critical CSS and trying to juggle a few too many things. Image source: Lighthouse Metrics ) ( Large preview ).

Performance 145

Performance Cache Mobile Network 145

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Sharding is a preferred approach for database systems facing substantial growth and needing high availability.

Best Practices 72

Best Practices Traffic Database Servers 72

Alex Russell

FEBRUARY 3, 2023

They did the opposite, doubling down, breathlessly announcing vapourware year after year to defer critical thinking about the fundamental errors in the design. You'd be forgiven for thinking the verbiage was designed obfuscate. It's functional purpose (outside of signaling) is to obscure furious plate spinning.

Social Media 119

Social Media Website Technology Technology 119

Rigor

SEPTEMBER 11, 2019

Rachel is also one of the people behind Perch , a PHP content management system (CMS). His keynote address from O’Reilly Fluent 2017, Reflecting on 20 years on the web , is a must-see. He served as the Editor-in-Chief of Smashing Magazine until October 2017 when he passed the baton to the remarkable Rachel Andrew.

Performance 89

Performance Education Google Website 89

Testsigma

JANUARY 29, 2021

That’s not all, the global mobile traffic is expected to increase sevenfold between 2017 and 2022. This essentially means that your website should not only be mobile-friendly but it should also have a Responsive Web Design so that your target customers can access your products (or services) with ultra-ease on their hand-held devices.

Website 98

Website Mobile Testing Strategy 98

Testsigma

JANUARY 13, 2021

Studies show that in 2017, the worldwide failure rate of iOS apps was as high as 54%, with Android apps crashing 10% of the time. Companies must complete this review process before even finishing the new feature’s wireframe design. Even a small bug will make consumers avoid, uninstall and leave bad reviews for your application.

Mobile 54

Mobile Strategy Testing Efficiency 54

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98