March, 2020

PostgreSQL Connection Pooling: Part 3 – Pgpool-II

Scalegrid

In our previous posts in this series, we discussed the case for connection pooling and introduced PgBouncer. In this post, we will discuss its most popular alternative – Pgpool-II. Pgpool-II is the swiss army knife of PostgreSQL middleware. It supports high-availability, provides automated load balancing, and has the intelligence to balance load between masters and slaves so write loads are always directed at masters, while read loads are directed to slaves.

Cache 168

Unit Testing Log Messages Made Easy

DZone

As a Java Developer, we need to cover a lot of scenarios to ensure the quality of our software and catch bugs as soon as possible when introducing a new code. For 99% of all my use cases AssertJ, Junit, Mockito, and Wiremock are sufficient enough do cover the test cases. But for the other use cases, like unit testing info, debug or warn log messages, these frameworks don't help you out. There is also no other framework that can provide an easy to use method to capture log messages.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

How to Estimate Web Performance Impact Before Making Fixes

Jos

Web Performance is important for user experience and business metrics. Estimating its impact is key to be able to prioritize it, yet it’s difficult to quantify its benefits until the work has been done. We need to break this chicken-and-egg loop. This post explains several ways of assessing the potential performance gains with little effort and, more importantly, without actually implementing fixes. What is the business opportunity for web performance improvements?

Up your quality and agility factor – using automation to build “performance-as-a-self-service”

Dynatrace

Dynatrace news. Organizations are being challenged, but also seizing the opportunity, to digitally transform their businesses with better customer experiences and new and competitive services, to increase business value. The IDC FutureScape: Worldwide IT Industry 2020 Predictions highlights key trends for IT industry-wide technology adoption for the next five years and includes these predictions: Hasten to innovation.

Stuff The Internet Says On Scalability For March 13th, 2020

High Scalability

p>Hey, it's HighScalability time! The top 10,000 most spoken words in English represented by a point in hundreds of dimensions where the distance and direction between points encodes the relationship between words. roadmaps ). Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff can't happen. You are that important to the fate of the intelligent world. Know someone who wants to understand the cloud? I wrote Explain the Cloud Like I'm 10 just for them.

Ready for changes with Hexagonal Architecture

The Netflix TechBlog

by Damir Svrtan and Sergii Makagon As the production of Netflix Originals grows each year, so does our need to build apps that enable efficiency throughout the entire creative process. Our wider Studio Engineering Organization has built more than 30 apps that help content progress from pitch (aka screenplay) to playback: ranging from script content acquisition, deal negotiations and vendor management to scheduling, streamlining production workflows, and so on.

COVID-19 Preparedness at ScaleGrid

Scalegrid

Customers & Friends, With the impact of COVID-19 growing around the world, we are taking proactive steps to prepare our infrastructure to continue seamlessly as we navigate this critical time. In an abundance of caution to the rapidly growing climate of the pandemic, we are taking extreme measures to ensure the safety of our employees, customers and partners.

More Trending

Building an elastic query engine on disaggregated storage

The Morning Paper

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. As the saying goes, ‘all snowflakes are special’ – but what is it exactly that’s special about this one?

Is working-from-home affecting productivity? Use Dynatrace to find out and optimize!

Dynatrace

Dynatrace news. Since governments around the world are asking people to work-from-home in order to fight COVID-19, I keep hearing questions from colleagues, customers, and partners alike: Are people being as productive as they would be if they were working from their office desk? Are people changing their working patterns? Are the systems we rely on every day as reliable via the home internet connection? Is working via VPN as good as working from the office?

Stuff The Internet Says On Scalability For March 27th, 2020

High Scalability

Hey, it's HighScalability time! Awesome explanation of how to build a PID controller to fly a rocket! BPS.space via Orbital Index ). Do you like this sort of Stuff? Without your support on Patreon this kind of Stuff can't happen. You are that important to the fate of the intelligent world. Know someone who wants to understand the cloud? I wrote Explain the Cloud Like I'm 10 just for them. On Amazon it has 103 mostly 5 star reviews.

How Netflix uses Druid for Real-time Insights to Ensure a High-Quality Experience

The Netflix TechBlog

By Ben Sykes Continue reading on Netflix TechBlog ». apache realtime druid metrics-and-analytics kafka

NULL complexities – Part 4, Missing standard unique constraint

SQL Performance

This article is Part 4 in a series about NULL complexities. In the previous articles ( Part 1 , Part 2 , and Part 3 ), I covered the meaning of the NULL as a marker for a missing value, how NULLs behave in comparisons and in other query elements, and standard NULL handling features that are not yet available in T-SQL. This month I cover the difference between the way a unique constraint is defined in the ISO/IEC SQL standard and the way it works in T-SQL.

C++ 81

Introduction to Benchmarking in Julia

DZone

For the number of years I’ve been programming using Julia, I’ve never really been concerned with performance. Which is to say, I’ve appreciated that other people are interested in performance and have proven that Julia can be as fast as any other performance language out there. But I’ve never been one to pour over the Performance Tips section of the Julia manual trying to squeeze every last bit of performance.

When correlation (or lack of it) can be causation

The Morning Paper

Rex: preventing bugs and misconfiguration in large services using correlated change analysis , Mehta et al., NSDI’20. Check before you change: preventing correlated failures in service updates , Zhai et al., NSDI’20. Today’s post is a double header. I’ve chosen two papers from NSDI’20 that are both about correlation.

Azure 86

Understand customer experience with Session Replay without compromising data privacy

Dynatrace

Dynatrace news. Dynatrace introduced Session Replay some time ago to help modernize your DEM strategy. Session Replay enables you to capture and visually replay the complete digital experience of your end users. It helps you identify errors, analyze areas of struggle, and provides tons of analytical data for your testing teams. For details, see how to get the most value out of Session Replay.

Tuning 172

Post: Essilen Research, Fauna, Sisu, Educative, PA File Sight, Etleap, Triplebyte, Stream

High Scalability

Who's Hiring? Are you looking to improve how you hire technical talent ? Essilen Research 's free video series can help. Fix common issues in screening, interviewing, closing and on-boarding. Learn how world-class tech companies crush the hiring game!

Introducing Dispatch

The Netflix TechBlog

By Kevin Glisson, Marc Vilanova, Forest Monsen Netflix is pleased to announce the open-source release of our crisis management orchestration framework: Dispatch! Okay, but what is Dispatch? Put simply, Dispatch is: All of the ad-hoc things you’re doing to manage incidents today, done for you, and a bunch of other things you should’ve been doing, but have not had the time!

AWS 155

An approach to index tuning – part 1

SQL Performance

A performance tuning engagement can end up taking many turns as you work through it – it all depends on what is showing up as the problem and what the data tells you. Some days it lands on a specific query, or set of queries, that can be improved with indexes – either new ones or modifications to existing indexes. One of my favorite parts of tuning is working with indexes and, as I was thinking about this post, I was tempted to label index tuning as an "easier" task… but it really isn't.

Clean Unit Testing

DZone

It's easy to write "unit test" tests that use JUnit and some mocking library. They may produce code coverage that keeps some stakeholders happy, even though the tests aren't even unit tests and provide questionable value. It can also be very easy to write unit tests that are — in theory — units test but are more complex than the underlying code and hence just add to the total software entropy.

Millions of tiny databases

The Morning Paper

Millions of tiny databases , Brooker et al., NSDI’20. This paper is a real joy to read. It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. In the same spirit as Paxos Made Live , this paper describes the details, choices and tradeoffs that are required to put a consensus system into production.

Go web-scale by providing Dynatrace Managed as a service to your teams

Dynatrace

Dynatrace news. “I I now have 20 teams using Dynatrace. Within the next 2 quarters we will move our app teams to the cloud. I will then have to onboard more than 150 teams to Dynatrace! How can I do this effectively while maintaining configuration consistency across the teams?”. – A Dynatrace customer. This is a typical question we hear from our customers.

Cloud 171

Post: InterviewCamp.io, Scrapinghub, Fauna, Sisu, Educative, PA File Sight, Etleap, Triplebyte, Stream

High Scalability

Who's Hiring? InterviewCamp.io has hours of system design content. They also do live system design discussions every week. They break down interview prep into fundamental building blocks. Try out their platform. Scrapinghub is hiring a Senior Software Engineer (Big Data/AI).

Open-Sourcing riskquant, a library for quantifying risk

The Netflix TechBlog

Netflix has a program in our Information Security department for quantifying the risk of deliberate (attacker-driven) and accidental… Continue reading on Netflix TechBlog ». security risk information-security

Big Project Build Times–Chromium

Randon ASCII

A twitter discussion on build times and source-file sizes got me interested in doing some analysis of Chromium build times. I had some ideas about what I would find ( lots of small source files causing much of the build time ) but I inevitably found some other quirks as well, and I’m landing some improvements. I learned how to use d3.js to create pretty pictures and animations, and I have some great new tools. As always, this blog is mine and I do not speak for Google. These are my opinions.

C++ 72

Complete Guide To Access Forms In Selenium With Java

DZone

Have you noticed the ubiquity of web forms while surfing the internet? Almost every website or web-application you visit leverages web-forms to gain relevant information about yourself. From creating an account over a web-application to filling a brief survey, web forms are everywhere! A form comprises web elements such as checkbox, radio button, password, drop down to collect user data.

Java 130

Understanding, detecting and localizing partial failures in large system software

The Morning Paper

Understanding, detecting and localizing partial failures in large system software , Lou et al., NSDI’20. Partial failures ( gray failures ) occur when some but not all of the functionalities of a system are broken. On the surface everything can appear to be fine, but under the covers things may be going astray. When a partial failure occurs, it often takes a long time to detect the incident.

Dynatrace Business Continuity During COVID-19 

Dynatrace

Dynatrace news. Dear Dynatrace Community, As COVID-19 (the coronavirus) continues to impact communities globally, I want to update you on the measures we have taken to ensure the continuity of our offerings and services for you , as well the safety of our customers , partners and employees around the world. . A s a cloud-based SaaS company with global operations , Dynatrace products and services will not be impacted.

Post: Scrapinghub, Fauna, Sisu, Educative, PA File Sight, Etleap, Triplebyte, Stream

High Scalability

Who's Hiring? Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc. this is going to be a challenging journey for any backend engineer! Please apply here.

SVT-AV1: an open-source AV1 encoder and decoder

The Netflix TechBlog

SVT-AV1: open-source AV1 encoder and decoder by Andrey Norkin , Joel Sole , Mariana Afonso , Kyle Swanson, Agata Opalach , Anush Moorthy , Anne Aaron SVT-AV1 is an open-source AV1 codec implementation hosted on GitHub [link] under a BSD + patent license. As mentioned in our earlier blog post , Intel and Netflix have been collaborating on the SVT-AV1 encoder and decoder framework since August 2018.

Please help with STRING_SPLIT improvements

SQL Performance

We're mid-cycle between releases, where we're not yet hearing about any of the features planned for SQL Server vNext. This is probably the best time to press Microsoft for improvements, as long as we can back our requests with legitimate business cases. In SQL Server 2016, STRING_SPLIT solved a long-missing gap in a language that, admittedly, was not intended for complicated string processing. And that is what I want to bring up today.

The Pitfalls in C++ Unit Testing

DZone

Recently there has been a surge of interest in C++ unit testing. C++ unit testing has not been common in C++ development in the past. Although C++ is a kind of programming language that fits well with unit testing, several complexities require extra care. In this article, I’ll discuss the most common pitfalls. performance c++ unit testing legacy code c++ pitfalls

C++ 130

Firecracker: lightweight virtualization for serverless applications

The Morning Paper

Firecracker: lightweight virtualisation for serverless applications , Agache et al., NSDI’20. Finally the NSDI’20 papers have opened up to the public (as of last week), and what a great looking crop of papers it is. We looked at a couple of papers that had pre-prints available last week, today we’ll be looking at one of the most anticipated papers of this year’s crop: Amazon’s Firecracker.

Extend visibility into workload and cluster health by leveraging native Kubernetes events

Dynatrace

Dynatrace news. Kubernetes has become the industry standard platform for running and managing containerized workloads at scale. The Kubernetes platform, at its core, is designed to maintain and keep up with a defined state for running workloads. In many cases, events are generated as these workloads go through different phases of their life cycles. For instance, events appear when the scheduler performs actions to bring workloads back to a desired state.

Post: Fauna, Sisu, Educative, PA File Sight, Etleap, Triplebyte, Stream

High Scalability

Who's Hiring? Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Apply here. T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here.

The DevTools Performance Tab – Using Chrome’s Profiler to Optimize Your Page Speed

MachMetrics

Chrome’s DevTools suite contains some of the most powerful tools available to help you analyze and improve the speed of your website (or web app). They can also be the most overwhelming. In our most recent article , we covered one area of the DevTools that we can use to measure the load time of our site – the ‘Audit’ tab. However, we often get asked about another area of the DevTools – the ‘Performance’ tab.

Speed 64

How to identify SSD types and measure performance.

n0derunner

Start by identifying the exact SSD type by using lsscsi. lsscsi [1:0:0:0] cd/dvd QEMU QEMU DVD-ROM 2.5+ /dev/sr0 [2:0:0:0] disk ATA SAMSUNG MZ7LM1T9 404Q /dev/sda [2:0:1:0] disk ATA SAMSUNG MZ7LM1T9 404Q /dev/sdb [2:0:2:0] disk ATA SAMSUNG MZ7LM1T9 404Q /dev/sdc [2:0:3:0] disk ATA SAMSUNG MZ7LM1T9 404Q /dev/. Device Specs. The spec sheet for this ssd claims the following performance characteristics.

Improving AWS Performance For The Future

DZone

The true power of cloud computing lies in the way it can be optimized for maximum performance and efficiency. While it wasn’t always possible to run an efficient environment while maximizing performance with on-premise servers and data centers, cloud clusters are particularly flexible in this respect. From the first time you migrate to the cloud, you have the option to refactor your apps and solutions to fully take advantage of the flexibility.

AWS 124