March, 2019

article thumbnail

How is software developed at Amazon?

High Scalability

How is software developed at Amazon? Get a couple of prime pizzas delivered and watch this excellent interview with Ken Exner, GM of AWS Developer Tools. It's notable Ken is from the tools group, because progress in an industry is almost always made possible by the development of better tools. The key themes from the talk: decomposition, automation, and organize around the customer.

Software 279
article thumbnail

Spinnaker Sets Sail to the Continuous Delivery Foundation

The Netflix TechBlog

Author: Andy Glover Since releasing Spinnaker to the open source community in 2015 , the platform has flourished with the addition of new cloud providers, triggers, pipeline stages, and much more. Myriad new features, improvements, and innovations have been added by an ever growing, actively engaged community. Each new innovation has been a step towards an even better Continuous Delivery platform that facilitates rapid, reliable, safe delivery of flexible assets to pluggable deployment targets.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Managing High Availability in PostgreSQL – Part II

Scalegrid

Are you deploying PostgreSQL in the cloud and want to understand your options for achieving high availability? In our previous blog post, Managing High Availability in PostgreSQL – Part I , we discussed the capabilities and functioning of PostgreSQL Automatic Failover (PAF) by ClusterLabs. In Part II, we’re introducing you to an alternative open source tool, Replication Manager from 2ndQuadrant, to be closely followed by Part III where we dive into our third alternative, Patroni by Zalan

article thumbnail

Don’t read your data from a straw

Daniel Lemire

It is common for binary data to be serialized to bytes. Data structures like indexes can be saved to disk or transmitted over the network in such a form. Many serialized data structures can be viewed as sets of ‘integer’ values. That is the case, for example, of a Roaring bitmap. We must then read back this data. An integer could be serialized as four bytes in a stream of bytes.

Java 124
article thumbnail

Redefining application communications with AWS App Mesh

All Things Distributed

At re:Invent 2018, AWS announced the AWS App Mesh public preview, a service mesh that allows you to easily monitor and control communications across applications. Today, I'm happy to announce that App Mesh is generally available for use by customers. New architectural patterns. Many customers are modernizing their existing applications to become more agile and innovate faster.

AWS 137
article thumbnail

Using Machine Learning to Ensure the Capacity Safety of Individual Microservices

Uber Engineering

Reliability engineering teams at Uber build the tools, libraries, and infrastructure that enable engineers to operate our thousands of microservices reliably at scale. At its essence, reliability engineering boils down to actively preventing outages that affect the mean time between … The post Using Machine Learning to Ensure the Capacity Safety of Individual Microservices appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 29th, 2019

High Scalability

Wake up! It's HighScalability time: Uber's microservice Graph. Thousands of microservices. Crazy like a fox? Or just crazy? ( @msuriar ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 42 mostly 5 star reviews (100 on Goodreads).

Internet 198

More Trending

article thumbnail

Rendering large lists with react-window

Addy Osmani

If you use React and need to display large lists of data efficiently , you may be familiar with react-virtualized. It's a windowing library by Brian Vaughn that renders only the items currently visible in a list (within a scrolling "viewport"). This means you don't need to pay the cost of thousands of rows of data being rendered at once.

article thumbnail

Reducing High CPU on MySQL: a Case Study

Percona

In this blog post, I want to share a case we worked on a few days ago. I’ll show you how we approached the resolution of a MySQL performance issue and used Percona Monitoring and Management PMM to support troubleshooting. The customer had noticed a linear high CPU usage in one of their MySQL instances and was not able to figure out why as there was no much traffic hitting the app.

C++ 101
article thumbnail

Experimenting with the Streams API

Dean Hume

I am always looking for ways to build faster, slicker web pages. Where applicable, I’ll use great new browser features such as service workers, HTTP/2 and improved compression, just to name a few. But what if I told you there was a way to build even faster web pages? I’d like to introduce you to the Streams API. Before we go any further, let’s go right back to basics.

article thumbnail

Open Sourcing Peloton, Uber’s Unified Resource Scheduler

Uber Engineering

First introduced by Uber in November 2018, Peloton , a unified resource scheduler, manages resources across distinct workloads, combining separate compute clusters. Peloton is designed for web-scale companies like Uber with millions of containers and tens of thousands of nodes. … The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 8th, 2019

High Scalability

Wake up! It's HighScalability time: A highly simplified diagram of serverless. ( @jbesw ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more. 5% : France's new digital tax revolution; $15 trillion : AI contribution to global GDP by 2030; 70% : better response time using HTTP keep-alive in lambda; 115 million :

Internet 146
article thumbnail

Netflix Public Bug Bounty, 1 year later

The Netflix TechBlog

by Astha Singhal (Netflix Application Security) As Netflix continues to create entertainment people love, the security team continues to keep our members, partners, and employees secure. The security research community has partnered with us to improve the security of the Netflix service for the past few years through our responsible disclosure and bug bounty programs.

article thumbnail

Expanding Our Horizons - Efficiently

Edge Perspectives

In our Big Shift world, we confront the imperative of institutional innovation – shifting from institutional models built on scalable efficiency to institutional models built on scalable learning. I’ve written and spoken about this a lot over the years and one of the most common pushbacks I get is – “so, are you against efficiency?” This post seeks to answer that question.

article thumbnail

Lazy Loading, faster webpages, SEO friendly

Dareboost

Images are a key content on your website? If you’re serious about your website performance, you have probably optimized them. But have you considered to lazy load your images? Lazy loading images improves the user experience by saving bandwidth for important content first. Some reject the technique for SEO considerations.

article thumbnail

A Note to Business Leaders on Software Engineering

Strategic Tech

Software developers are interchangeable. A software developer with a computer science degree will produce the same quality of work as any other software developer with a computer science degree. It makes business sense to hire cheap programmers and put in place a standard process. If that sounds like something you would say or think, then your perception of software development is severely detrimental to the health of your business.

article thumbnail

Improving the User Experience with Uber’s Customer Obsession Ticket Routing Workflow and Orchestration Engine

Uber Engineering

Every day, Uber users around the world initiate customer support tickets through our Customer Obsession Platform. To ensure a seamless user experience, each of those tickets must be matched with an agent who speaks the user’s language and who … The post Improving the User Experience with Uber’s Customer Obsession Ticket Routing Workflow and Orchestration Engine appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 22nd, 2019

High Scalability

Wake up! It's HighScalability time: Van Gogh? Nope. A satellite image of phytoplankton populations or algae blooms in the Baltic Sea. ( NASA ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 41 mostly 5 star reviews. They'll learn a lot and love you even more.5 billion : weekly visits to Apple App store; $500m : new US exascale computer; $1.7 billion : EU's newest fine on Goo

Internet 134
article thumbnail

Trace Event, Chrome and More Profile Formats on FlameScope

The Netflix TechBlog

FlameScope sub-second heatmap visualization. Less than a year ago, FlameScope was released as a proof of concept for a new profile visualization. Since then, it helped us, and many other users, to easily find and fix performance issues, and allowed us to see patterns that we had never noticed before in our profiles. As a tool, FlameScope was limited.

Storage 100
article thumbnail

Home Automation Using the Internet of Things (IoT) – 2019

Simform

Read the tutorial blog on how to implement Home Automation using IoT. It covers the software, hardware, sensors, protocols, architecture and platforms. Applications of IoT-enabled connectivity are home security, air quality monitoring, infotainment delivery, smart lock etc. The post Home Automation Using the Internet of Things (IoT) – 2019 appeared first on Insights on Latest Software Technologies - Simform Blog.

IoT 75
article thumbnail

Planning for Responsive Images

CSS - Tricks

The first time I made an image responsive, it was as simple as coding these four lines: img { max-width: 100%; height auto; /* default */ }. Though that worked for me as a developer, it wasn’t the best for the audience. What happens if the the image in the src attribute is heavy? On high-end developer devices (like mine with 16GB RAM), few or no performance problems occur.

Media 72
article thumbnail

Two-Factor Authentication With TOTP Using Node.js And Speakeasy

The Polyglot Developer

Almost two years ago I had written a tutorial around 2FA in a Node.js API with time-based one-time passwords. If you’re unfamiliar, two-factor authentication is becoming the norm, which it wasn’t necessarily back in 2017. If you’re managing user accounts in your web applications, it is critical that you offer your users a second factor of authentication to prevent phishing and malicious login attempts.

article thumbnail

A tester's guide to leveraging Kubernetes

TechBeacon Testing

With the advent of agile and DevOps, organizations are moving from specialized roles to cross-functional teams—and that means cross-functional sharing of the specialized tools used in each silo.

DevOps 66
article thumbnail

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure.

Software 122
article thumbnail

Performance Budgets That Stick

Tim Kadlec

Occasionally I hear some chatter about performance budgets “not working.” And, to be fair, I have seen companies who adopt a budget and then are unable to make meaningful improvements towards that goal. Over time those ineffective budgets get pushed to the sideline where they accumulate dust before being forgotten about altogether. It’s not really about the performance budget, though.

article thumbnail

How to Make an app like Airbnb : Develop your own Vacation Rental App

Simform

My take on making an app like Airbnb, leveraging my experience of working with 50+ Airbnb type app startups. Learn everything that you need to build and develop an app like Airbnb for vacation rental. The post How to Make an app like Airbnb : Develop your own Vacation Rental App appeared first on Insights on Latest Software Technologies - Simform Blog.

article thumbnail

Zoom In Filters for High Impact

Edge Perspectives

Small moves, smartly made, can set big things in motion. That’s a key to succeeding in a world of mounting performance pressure. In a previous post , I briefly alluded to the need to “zoom out” to smartly make small moves. In today’s post, I want to focus in more detail on the need to zoom in. Zoom out/zoom in strategies                         �

article thumbnail

Three Other Models of Computer System Performance: Part 1

ACM Sigarch

With two blog posts, we argue for more use of simple models beyond Amdahl’s Law. This Part 1 discusses Bottleneck Analysis and Little’s Law, while Part 2 presents the M/M/1 Queue. Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Existing systems can be studied with measurement, while prospective systems are most often studied by extrapolating from measurements of prior systems or via simulation software t

Systems 60
article thumbnail

The top 7 test automation mistakes: How to avoid your next fail

TechBeacon Testing

In their desire to do more automated testing, QA teams often make mistakes that cost time, money, and trust—and derail progress. These blunders can make your team too nervous to try again.

Testing 61
article thumbnail

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure.

Software 116
article thumbnail

Making Sense of Chrome Lite Pages

Tim Kadlec

Google formally announced Lite Pages the other day and the response has been… let’s say mixed. Understandably so. The announcement post was a fairly typical product announcement post which is to say it was light (no pun intended) on the technical details and leaves a lot of open questions. Sometimes that’s fine. But in this case, the announcement has to deal with Google making changes to HTTPS content which, as you would expect, makes folks a little more nervous.

Google 63
article thumbnail

How to Ensure Software Quality through Functional Testing?

QAMentor

In today’s competitive business landscape, software products have to meet the experience desired by users. If a product fails to offer this experience, users take no time to turn that off and move to another product. Quality assurance and testing both play crucial roles in the entire SDLC process. Until testers are able to fully … The post How to Ensure Software Quality through Functional Testing?

article thumbnail

Track Element Viewability With JavaScript Or Google Tag Manager

The Polyglot Developer

As you might know, sponsored advertisements are one of the things that are funding The Polyglot Developer and everything it accomplishes, so keeping sponsors happy and supplying them the metrics they need is very important. However, in most circumstances, more specifically when it comes to banner creatives, page views is not enough. For example if your sponsors or potential sponsors asked how many impressions each of your advertisement zones gets, you can’t just list off the page views tha

Google 52
article thumbnail

Three Other Models of Computer System Performance: Part 2

ACM Sigarch

With two blog posts, we argue for more use of simple models beyond Amdahl’s Law. Part 1 previously discussed Bottleneck Analysis and Little’s Law, while this post (Part 2) presents the M/M/1 Queue. Previously, Part 1 of these two blog posts provided our thesis that analytic models can complement measurement and simulations to give quick insight, show what is not possible, provide a double-check, and suggest future directions.

Systems 53
article thumbnail

SQL Server Transaction Log and High Availability Solutions

SQL Shack

In the previous article of this series on the SQL Server transaction log, we discuss the SQL Server database recovery models, Full, Simple and Bulk-Logged, and the how the recovery model option of the database affects the way the SQL Server Engine works with the transaction logs. In this article, we will discuss the different […].

Servers 53
article thumbnail

Using React Loadable for Code Splitting by Components and Routes

CSS - Tricks

In a bid to have web applications serve needs for different types of users, it’s likely that more code is required than it would be for one type of user so the app can handle and adapt to different scenarios and use cases, which lead to new features and functionalities. When this happens, it’s reasonable to expect the performance of an app to dwindle as the codebase grows.

Code 52
article thumbnail

Waste (and production efficiency)

Allen Holub

Why is it that, when I bring up concerns surrounding production efficiency, some people react as if I’m suggesting we return to the abuses 19th century factories? Agile is, of course, focused on delivering value. However, no business can succeed if it squanders money on inefficiency. That is, outcome is critical, and that’s where our… The post Waste (and production efficiency) appeared first on Allen Holub.