High Scalability

AUGUST 22, 2018

Decentralized systems will continue to lose to centralized systems until there's a driver requiring decentralization to deliver a clearly superior consumer experience. Unfortunately, that may not happen for quite some time. I say unfortunately because ten years ago, even five years ago, I still believed decentralization would win. Why? For all the idealistic technical reasons I laid out long ago in Building Super Scalable Systems: Blade Runner Meets Autonomic Computing In The Ambient Cloud.

Internet 220

Internet Internet Google Scalability 220

Uber Engineering

AUGUST 16, 2018

At Uber, we spend a considerable amount of resources making the driver sign-up experience as easy as possible. At Uber’s scale, even a one percent increase in the rate of sign-ups to first trips (the driver conversion rate) carries a … The post Maximizing Process Performance with Maze, Uber’s Funnel Visualization Platform appeared first on Uber Engineering Blog.

Processing 110

Processing Performance Engineering Architecture 110

The Polyglot Developer

AUGUST 1, 2018

Have you ever needed to work with comma separated value (CSV) data that wasn’t formatted in a great way or figure out complete address information based on very little provided address information? While unrelated, these two topics come up quite a bit, more frequently when I’m dealing with person information or lead data that I retrieve from conferences and other events.

Processing 83

Processing Development 83

O'Reilly Software

AUGUST 29, 2018

The O’Reilly Media Podcast: Daniel Krook, IBM developer advocate, on the Call for Code Global Initiative at IBM. Disasters hit unexpectedly and cause life-threatening issues across the world. Large groups of people are left without water, electricity, or other basic systems that sustain life. In an effort to help the communities of the world be better prepared to handle these tough situations, David Clark Cause launched Call for Code along with IBM as the founding partner.

Code 80

Code Artificial Intelligence Development Blockchain 80

All Things Distributed

AUGUST 1, 2018

A while back I wrote about the Alexa Prize , a university competition where participating teams are creating socialbots focused on advancing computer to human interaction. We are now in year two, heading into the final stretch for 2018 and I thought I would give everyone an update. For those who aren't familiar, Alexa Prize teams use customer feedback to advance several areas of conversational AI, with the grand challenge being a socialbot that can engage coherently for 20 minutes in a fun,

Entertainment 66

Entertainment Innovation Speed Technology 66

Randon ASCII

AUGUST 16, 2018

I wasn’t looking for trouble. I wasn’t trying to compile a huge project in the background ( 24-core CPU and I can’t move my mouse ), I was just engaging in that most mundane of 21st century tasks, writing an email at 10:30 am. And suddenly gmail hung. I kept typing but for several seconds but no characters were appearing on screen. Then, suddenly gmail caught up and I resumed my very important email.

Programming 75

Programming Virtualization Processing Code 75

High Scalability

AUGUST 13, 2018

Decentralized systems will continue to lose to centralized systems until there's a driver requiring decentralization to deliver a clearly superior consumer experience. Unfortunately, that may not happen for quite some time. I say unfortunately because ten years ago, even five years ago, I still believed decentralization would win. Why? For all the idealistic technical reasons I laid out long ago in Building Super Scalable Systems: Blade Runner Meets Autonomic Computing In The Ambient Cloud.

Internet 116

Internet Internet Google Scalability 116

The Polyglot Developer

AUGUST 8, 2018

A while ago, I ran into a situation where I needed to make web application into a desktop application for a corporate client. The idea was to leverage as much of the existing app as possible, while still meeting the requirement of having a “desktop” application. As a primarily Java developer, I had no idea how to do this, so I started doing research and found out that my best bet would be using JavaScript technologies.

Website 59

Website Java Google Technology 59

O'Reilly Software

AUGUST 23, 2018

Lessons from hundreds of development practice assessments across the industry. For more than 15 years, my colleagues and I at the Software Improvement Group (SIG) have been in the business of evaluating the quality of code, architecture, and development practices for our customers. Recently, we dove into our assessment data to discover—and quantify —trends in software development, each time comparing 2016 to 2017.

Software 73

Software Software Development Code 73

Tim Kadlec

AUGUST 14, 2018

Eric Meyer was recently in Uganda , where he experienced first-hand a very undesirable side effect of HTTPS. The area he was in was served by satellite internet access, and experienced significant latency (a floor of 506 milliseconds) and packet loss (between 50-80% was typical). In addition, there is a cap on the data that an account can use in any given month.

Cache 64

Cache Mobile Servers Latency 64

Smashing Magazine

AUGUST 17, 2018

Designing For Micro-Moments. Designing For Micro-Moments. Suzanne Scacca. 2018-08-17T13:50:09+02:00. 2019-04-29T18:34:58+00:00. A couple of years ago, Google announced a new mobile-first initiative it wanted web designers and marketers to pick up on. This was our introduction to micro-moments. These are not to be confused with micro-interactions, which are miniscule engagements websites have with visitors when they "touch" key points of the interface.

Design 62

Design Google Website Small Business 62

High Scalability

AUGUST 7, 2018

Who's Hiring? NationBuilder — if you’re a systems engineer, SRE or DevOps focused developer and have been looking for a place where you can help other people while still working in tech? We can give that opportunity. Please apply here. Twitch's commerce team in San Francisco is looking to hire senior developers to keep up with rapidly increasing demand for our Subscriptions and Payment platform.

Ecommerce 107

Ecommerce Metrics Software Engineering Engineering 107

Uber Engineering

AUGUST 7, 2018

To facilitate the growth of Uber’s global operations, we need to be able to quickly store and access billions of metrics on our back-end systems at any given time. As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog.

Open Source 104

Open Source Metrics Infrastructure Scalability 104

Randon ASCII

AUGUST 23, 2018

In my last post I promised to give more details about some rabbit holes that I went down during the investigation, including page tables, locks, WMI, and a vmmap bug. Those details are here, along with updated code samples. But first, a really quick summary of the original issue: In the last post I talked about how every time a CFG-enabled process allocates executable memory some Control Flow Guard (CFG) memory is allocated as well.

Operating System 58

Operating System Code Processing Systems 58

O'Reilly Software

AUGUST 2, 2018

Practical examples of how to integrate personal and tool-based feedback into your code review process. In one of my previous posts , I explained how strong feedback loops make strong software teams and how the most effective feedback loops are a mixture of daily best practices, automation, tools, and human intervention. Good quality control combines tool-based measurement with manual review and discussion.

Best Practices 62

Best Practices Architecture Metrics Code 62

Percona

AUGUST 31, 2018

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. Default values are set to ensure that PostgreSQL runs everywhere, with the least resources it can consume and so that it doesn’t cause any vulnerabilities. It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload.

Tuning 58

Tuning Database Performance Benchmarking 58

Smashing Magazine

AUGUST 30, 2018

A Brief Guide About Competitive Analysis. A Brief Guide About Competitive Analysis. Mayur Kshirsagar. 2018-08-30T14:00:57+02:00. 2019-04-29T18:34:58+00:00. In this article, I will introduce the subject of competitive analysis , which is basically a method to determine how well your competitors are performing. My aim is to introduce the subject to those of you who are new to the concept.

Design 59

Design Google Strategy Website 59

High Scalability

AUGUST 31, 2018

Hey, it's HighScalability time: This mind blowing creation is from John Williamson. It's the first million integers, represented as binary vectors indicating their prime factors, laid out with UMAP. No, I really have no idea what that means either, but it did make me consider that our universe could be created by an algorithm. What are the wiggly cycles on the periphery?

Internet 105

Internet Internet Scalability Serverless 105

Percona Community

AUGUST 23, 2018

I was recently asked a question by mail about MySQL Lossless Semi-Synchronous Replication. As I think the answer could benefit many people, I am answering it in a blog post. The answer brings us to the internals of transaction committing, of semi-synchronous replication, of MySQL (server) crash recovery, and of storage engine (InnoDB) crash recovery.

Storage 52

Storage Servers Engineering 52

Randon ASCII

AUGUST 26, 2018

I’ll bet I had more fun commuting during September 2018 than you did. In April 2017 I gave myself the challenge of commuting to work using a different method every workday for a month – twenty ways in twenty days! The write up and video are here. It was great fun and it also served as a joyous celebration of the many ways to make commuting more fun than sitting alone in traffic.

Transportation 58

Transportation Media Traffic Availability 58

The Polyglot Developer

AUGUST 15, 2018

As you probably know, I’ve been doing a lot with GraphQL recently. I’ve released tutorials that include Java with GraphQL , Node.js with GraphQL , as well as Golang with GraphQL , but I’ve only ever demonstrated testing those GraphQL APIs with cURL. If you’ve ever used cURL for anything, not specific to GraphQL, you’ll know it works well, but it isn’t the most friendly tool available.

Google 52

Google Testing Java Availability 52

Percona

AUGUST 29, 2018

For optimum performance, a PostgreSQL database depends on the operating system parameters being defined correctly. Poorly configured OS kernel parameters can cause degradation in database server performance. Therefore, it is imperative that these parameters are configured according to the database server and its workload. In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned.

Tuning 58

Tuning Database Servers Systems 58

Website Optimization

AUGUST 12, 2018

There is such a thing as over optimization in PPC. In your quest to lower costs you can actually go too far. This article shows the effects of driving down CPC and cost per conversion and a potential solution.

49

49

High Scalability

AUGUST 21, 2018

Who's Hiring? NationBuilder — if you’re a systems engineer, SRE or DevOps focused developer and have been looking for a place where you can help other people while still working in tech? We can give that opportunity. Please apply here. Twitch's commerce team in San Francisco is looking to hire senior developers to keep up with rapidly increasing demand for our Subscriptions and Payment platform.

Ecommerce 105

Ecommerce DevOps Java Engineering 105

ACM Sigarch

AUGUST 20, 2018

In this post, I argue that software and data interoperability, a hallmark of the modern computer ecosystem, is at the core of several widespread security problems. An alternate approach is to tie data and potentially software to specific physical instances of a digital system. While such an approach would eliminate the ease with which we can share software and data, it could eliminate incidents where data is lost to attackers or where systems are attacked by malware.

Hardware 47

Hardware Operating System Architecture Software 47

Professor Beekums

AUGUST 19, 2018

Who writes code? The obvious answer is that developers write code. Who makes sure the code works? The answer to this question also seems obvious. It should also be developers… right? Fairly often, that is not actually the case. Many companies have separate QA departments that are responsible for making sure code works. Developers write code, then they throw it over a wall for someone else to test for them.

Code 45

Code Testing Development 45

ScaleOut Software

AUGUST 18, 2018

In previous blogs , we have explored the power of the digital twin model for stateful stream-processing. Digital twins are software abstractions that track the behavior of individual devices in IoT applications. They combine an event handling function with state information about each device. This state information is used to track evolving device status and help analyze incoming events, and it enables deeper introspection on the evolving status of the device than would be possible by just exami

IoT 45

IoT Ecommerce Analytics Latency 45

Percona

AUGUST 30, 2018

One of the common ways to classify database workloads is whether it is “read intensive” or “write intensive”. In other words, whether the workload is dominated by reads or writes. Why should you care? Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability.

Benchmarking 48

Benchmarking Database Operating System Architecture 48

Speed Curve

AUGUST 8, 2018

One of the longest-standing items on my performance monitoring tool wishlist is an automatically-generated performance improvement checklist , with the improvements ordered by the impact that they will have on the website. In a previous life, I spent countless hours writing performance reports and conducting A/B performance tests to figure out which change would have the biggest impact on a website's performance.

Performance 45

Performance Website Performance Website Google 45

High Scalability

AUGUST 17, 2018

Hey, it's HighScalability time: The amazing Zoomable Universe from 10^27 meters—about 93 billion light-years—down to the subatomic realm, at 10^-35 meters. Do you like this sort of Stuff? Please lend me your support on Patreon. It would mean a great deal to me. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10.

Internet 105

Internet Internet Scalability Games 105

Software Testing Help

AUGUST 27, 2018

A Complete Overview of Positive Testing: This tutorial will give you a brief introduction of one of the most prominent testing types ‘Positive testing’. Software Testing is the process of. Read more Positive Testing: Meaning and Merits Explained with Real Test Scenarios. The post Positive Testing: Meaning and Merits Explained with Real Test Scenarios appeared first on Software Testing Help.

Testing 40

Testing Software Software Processing 40

Professor Beekums

AUGUST 5, 2018

Automated testing is a wonderful thing. Think about it. Why spend hours, or even a few minutes, doing something that takes a computer less than a second. I’ve never regretted writing tests, especially after seeing the time to debug and fix bugs in a subsystem go from hours to minutes. Bug report -> investigation -> code fix -> test -> release, can all be done in under 15 minutes when automated tests are around.

Testing 45

Testing Code 45

The Agile Manager

AUGUST 31, 2018

As we saw in the previous posts in this series, organizations of autonomous teams can scale. Scaling requires different team characteristics (requisite variety, redundancy of function, double-loop learning and minimum critical specification), a different mental model of organization (brain, not machine), a different kind of hierarchy (purpose, not control), and a different style of leadership (guide, not command).

Innovation 40

Innovation Technology Technology Development 40

Percona

AUGUST 27, 2018

MySQL Resource Groups, introduced in MySQL 8, provide the ability to manipulate the assignment of running threads to specific resources, thereby allowing the DBA to manage application priorities. Essentially, you can assign a thread to a specific virtual CPU. In this post, I’m going to take a look at how these might work in practice. Let us start with a disclaimer.

Tuning 45

Tuning Virtualization Testing Servers 45

Abstracta

AUGUST 30, 2018

The e-commerce industry’s busiest day is just around the corner… Are you ready? Everyone knows that Black Friday and Cyber Monday are the most popular online shopping days of the year (besides Amazon’s Prime Day), but it’s also a day that is notorious for website. The post Top Performance Testing Tools to Prepare Your Website for Black Friday appeared first on Abstracta Software Testing Services.

Testing Tools 40

Testing Tools Website Performance Testing Testing 40

High Scalability

AUGUST 24, 2018

Hey, it's HighScalability time: Images from a far flung galaxy? Nope. It's the mind blowing swirling beauty of ink in motion. Do you like this sort of Stuff? Please lend me your support on Patreon. It would mean a great deal to me. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10.

Internet 102

Internet Internet Scalability Best Practices 102

Percona Community

AUGUST 29, 2018

MongoDB ships powerful features in each release. The new release brings new features while revisions add bug fixes, security patches or improvements to existing features. To bring most out these releases to your plate you should always consider upgrading your MongoDB deployments. Planning your database upgrade can avoid the nightmares caused due to database-upgrade-gone-wrong or avoid not-so-simple rollbacks in your production database.

Database 40

Database 40