High Scalability

Designing Instagram

High Scalability

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem.

Design 280

Designing Tinder

High Scalability

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem.

Design 275
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Designing WhatsApp

High Scalability

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem.

Design 282

Designing Uber

High Scalability

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem.

Design 268

Designing Netflix

High Scalability

This is a guest post by Ankit Sirmorya. Ankit is working as a Machine Learning Lead/Sr. Machine Learning Engineer at Amazon and has led several machine-learning initiatives across the Amazon ecosystem.

Design 279

Evolution of search engines architecture - Algolia New Search Architecture Part 1

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the first article in a series.

Scaling indexing and search - Algolia New Search Architecture Part 2

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the second article in a series. Here's Part 1.

Linux Kernel vs. Memory Fragmentation (Part I)

High Scalability

This post introduces common methods to prevent Linux memory fragmentation, the principle of memory compaction, how to view the fragmentation index, etc. Linux Performance

Benchmark (YCSB) numbers for Redis, MongoDB, Couchbase2, Yugabyte and BangDB

High Scalability

This is guest post by Sachin Sinha who is passionate about data, analytics and machine learning at scale. Author & founder of BangDB.

A Short on How Zoom Works

High Scalability

Zoom scaled from 20 million to 300 million users virtually over night. What's incredible is from the outside they've shown little in the way of apparent growing pains, though on the inside it's a good bet a lot of craziness is going on.

Stuff The Internet Says On Scalability For April 30th, 2021

High Scalability

Hey, HighScalability is back! This channel is the perfect blend of programming, hardware, engineering, and crazy. After watching you’ll feel inadequate, but in an entertained sort of way. Love this Stuff? I need your support on Patreon to keep this stuff going.

One Team at Uber is Moving from Microservices to Macroservices

High Scalability

There may be an undiscovered tribe deep in some jungle somewhere that hasn’t made up their mind on microservices, but I doubt it. People love microservices or love to hate microservices. There’s not much in between.

Stuff The Internet Says On Scalability For Sep 18th, 2020

High Scalability

Hey, it's HighScalability time! I can't wait for the duel. Just don't shoot into the air. Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff won't happen. Know someone who could benefit from becoming one with the cloud? Of course you do.

Stuff The Internet Says On Scalability For March 17th, 2021

High Scalability

Hey, HighScalability is here again! Reverse engineering an ancient analog computer is a detective story worth reading. A Model of the Cosmos in the ancient Greek Antikythera Mechanism. Do you love this Stuff? Without your encouragement on Patreon this Stuff won't stuffin’ stuff.

Architecture of Max reHIT Workout

High Scalability

Today I have the pleasure of announcing my new app— Max reHIT Workout —on Product Hunt. Max reHIT Workout is an exercise app that guides you through interval workouts. I won’t pitch the app here.

Stuff The Internet Says On Scalability For February 1st, 2021

High Scalability

Hey, it's HighScalability time once again! Amazon converts expenses into revenue by transforming needs into products. Take a look at a fulfillment center and you can see the need for Outpost, machine learning, IoT, etc, all dogfooded. Willy Wonka would be proud. Do you like this sort of Stuff?

Sponsored Post: Close, Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

High Scalability

Who's Hiring? Close is building the sales communication platform of the future and we're looking for a Site Reliability Engineer to help us accomplish that goal. If you have a passion for databases (both SQL and NoSQL), significant experience building, managing, and monitoring infrastructure, databases, and backend services at scale and want to work with a rag-tag team of hardworking, but humble humans, then come check us out!

Engineering dependability and fault tolerance in a distributed system

High Scalability

This is a guest post by Paddy Byers , Co-founder and CTO at Ably , a realtime data delivery platform. You can view the original article on Ably's blog. Users need to know that they can depend on the service that is provided to them.

Socratic vs. Euclidean Forms of API Documentation

High Scalability

I was emailing a service about their documentation and while their doc was good, about one particularly tricky concept they told me that once you use it for a while, that’s when you’ll understand it. In other words: you’ll only understand it after you understand it.

Reducing Your Database Hosting Costs: DigitalOcean vs. AWS vs. Azure

High Scalability

If you’re hosting your databases in the cloud, choosing the right cloud service provider is a significant decision to make for your long-term hosting costs. This is especially apparent in today's world where organizations are doing whatever they can to optimize and reduce their costs.

Azure 249

Stuff The Internet Says On Scalability For October 4th, 2021

High Scalability

Hey, HighScalability is here again! The circulatory system of the internet. tylermorganwall. Love this Stuff? I need your support on Patreon to keep this stuff going. Sorry for the long gap in posting, but I’ve been building a new app.

Moore's Law is not Ending Soon and the Reason May Surprise You

High Scalability

Jim Keller recently gave a fascinating and far ranging interview on the AI Podcast. You can find it at Moore's Law, Microprocessors, Abstractions, and First Principles. One of the many topics of discussion was the often predicted death of Moore's Law.

ShiftLeft on Refactoring a Live SaaS Environment

High Scalability

This is guest a post by Preetam Jinka , Senior Infrastructure Engineer at ShiftLeft. Originally published here. ShiftLeft NextGen Static Analysis (NG SAST) is a software-as-a-service static analysis solution that allows developers to scan every pull request for security issues.

Moving HPC to the Cloud: A Guide for 2020

High Scalability

This is a guest post by Limor Maayan-Wainstein , a senior technical writer with 10 years of experience writing about cybersecurity, big data, cloud computing, web development, and more. High performance computing (HPC) enables you to solve complex problems which cannot be solved by regular computing.

How did they send money in the olden days of telegraphs?

High Scalability

It's not all that different really, especially that part where you can lose all your bitcoin. Here's an excerpt from East of Eden by John Steinbeck: Say, Carlton, how do you go about telegraphing money?”

Stuff The Internet Says On Scalability For May 14th, 2020

High Scalability

Hey, it's HighScalability time! Who knew a birthday service could lead to an existential crisis? Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff can't happen. You are that important to the fate of the smart and thoughtful world.

Stuff The Internet Says On Scalability For June 26th, 2020

High Scalability

Hey, it's HighScalability time! Line noise? Still uncertain? It's how you program a quantum computer. Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff can't happen. You are that important to the fate of the smart and thoughtful world.

How TripleLift Built an Adtech Data Pipeline Processing Billions of Events Per Day

High Scalability

This is a guest post by Eunice Do , Data Engineer at TripleLift , a technology company leading the next generation of programmatic advertising. What is the name of your system and where can we find out more about it? The system is the data pipeline at TripleLift.

Stuff The Internet Says On Scalability For March 27th, 2020

High Scalability

Hey, it's HighScalability time! Awesome explanation of how to build a PID controller to fly a rocket! BPS.space via Orbital Index ). Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff can't happen. You are that important to the fate of the intelligent world.

Free Google Book: Building Secure and Reliable Systems

High Scalability

Google added another book into their excellent SRE series: Building Secure and Reliable Systems. It's free to download, so don't be shy. It's not short: 557 pages and 21 chapters! So what's it about? In short it's about "reliability through the lens of security.".

Google 208

Stuff The Internet Says On Scalability For June 25th, 2021

High Scalability

Hey, it's HighScalability time! Only listen if you want a quantum earworm for the rest of the day. Not your style? This is completely different. No, it’s even more different than that. Today in things that nobody stopped me from doing: The AWS Elastic Load Balancer Yodel Rag.

The DynamoDB Book: An Interview With Alex DeBrie On His New Book

High Scalability

You know nothing about DynamoDB. At least that’s what I realized the first time I heard Rick Houlihan give his now infamous talk at AWS re:Invent 2018 on Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB.

Stuff The Internet Says On Scalability For February 28th, 2020

High Scalability

Wake up! It's HighScalability time: The Smithsonian has million of pieces of delicious open access content. I ate up this 3D representation of the 1903 Wright Flyer. Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff won't happen.

Sponsored Post: Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

High Scalability

Who's Hiring? Wynter is looking for system administrators, engineers, and developers to join its research panel. Participate in research surveys, get paid ($90-$180/hr) for your feedback and comments. Super low key commitment, 10-15 mins per survey. Learn more and sign up. DevOps Engineer : At Kinsta , we set out to create the best managed hosting platform in the world.

How is software developed at Amazon?

High Scalability

How is software developed at Amazon? Get a couple of prime pizzas delivered and watch this excellent interview with Ken Exner, GM of AWS Developer Tools. It's notable Ken is from the tools group, because progress in an industry is almost always made possible by the development of better tools. The key themes from the talk: decomposition, automation, and organize around the customer. The key idea: Scaling is by mitosis. Teams split apart into smaller teams that completely own a service.

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use

High Scalability

Wondering which databases are trending in 2019 ? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year. SQL vs. NoSQL

Stuff The Internet Says On Scalability For February 14th, 2020

High Scalability

Wake up! It's HighScalability time: Visualize the huge scale of Deep Time by identifying key reference points along the way. Do you like this sort of Stuff? Without your support on Patreon Stuff won't happen.

Stuff The Internet Says On Scalability For December 19th, 2020

High Scalability

Hey, it's HighScalability time once again! Do you like this sort of Stuff? Without your support on Patreon this Stuff won't happen. Know someone who could benefit from becoming one with the cloud? I wrote Explain the Cloud Like I'm 10 just for them. On Amazon it has 212 mostly 5 star reviews.

Part 2: The DynamoDB Book: An Interview With Alex DeBrie On His New Book

High Scalability

This is the second part of my interview with Alex DeBrie on his new insta-classic: The DynamoDB Book. To read the first part of the interview please mosey on over to The DynamoDB Book: An Interview With Alex DeBrie On His New Book. Go ahead. Take your time. It's worth it. Quick Fire Round.

Stuff The Internet Says On Scalability For July 31st, 2020

High Scalability

Hey, it's HighScalability time! Serverless is really complex. Or is it? paulbiggar sparked a thoughtful Twitter thread. Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff won't happen.

From bare-metal to Kubernetes

High Scalability

This is a guest post by Hugues Alary , Lead Engineer at Betabrand , a retail clothing company and crowdfunding platform, based in San Francisco. This article was originally published here. Early infrastructure. Rackspace. Hardware infrastructure. The scalability and maintainability issue. Scaling development processes. The advent of Docker. Kubernetes. Learning Kubernetes. Officially migrating. The development/staging environments. A year after. kubernetes

The Read Aloud Cloud: An Interview With Forrest Brazeal On His New Book

High Scalability

It's Christmas time and you've been wracking your brain trying to find the perfect gift that will teach your loved ones about the cloud in a simple and entertaining way. What to do?

Sponsored Post: Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

High Scalability

Who's Hiring? Wynter is looking for system administrators, engineers, and developers to join its research panel. Participate in research surveys, get paid ($90-$180/hr) for your feedback and comments. Super low key commitment, 10-15 mins per survey. Learn more and sign up. DevOps Engineer : At Kinsta , we set out to create the best managed hosting platform in the world.