High Scalability

DECEMBER 5, 2018

This article is written by Preetam Jinka , Senior Infrastructure Engineer at ShiftLeft. Originially published as Time Series at ShiftLeft. Time series are a major component of the ShiftLeft runtime experience. This is true for many other products and organizations too, but each case involves different characteristics and requirements. This post describes the requirements that we have to work with, how we use TimescaleDB to store and retrieve time series data, and the tooling we’ve develope

Infrastructure 193

Infrastructure Metrics Engineering Development 193

Speed Curve

DECEMBER 10, 2018

JavaScript is the main cause for making websites slow. Ten years ago it was network bottlenecks, but the growth of JavaScript has outpaced network and CPU improvements on today's devices. In the chart below, based on an analysis from the HTTP Archive , we see the number of requests has increased for both first and third party JavaScript since 2011. The following chart shows the growth in the total size of JavaScript from 2011.

Website 111

Website Network Code Availability 111

O'Reilly Software

DECEMBER 4, 2018

A new report explores how far companies have come with microservices. Fads come and go in the technology world—anyone remember AJAX ? When new, shiny things appear, architects often struggle to determine whether this is merely the latest fad or a genuine future direction. Microservices are evolving from fad to trend. Several years ago, many companies experimented with microservices but had doubts about the operational complexity and engineering maturity required to achieve success.

Software Architecture 95

Software Architecture Best Practices Architecture Engineering 95

Edge Perspectives

DECEMBER 31, 2018

As we enter the New Year, it’s an opportunity to step back and reflect in an increasingly hectic world. In an earlier post , I suggested we need to find time to reflect in a world increasingly dominated by flows – it’s a healthy form of friction that can actually enhance our ability to generate more insight from flows. Embrace the New Year as an invitation to reflect.

Social Media 85

Social Media Media Engineering Performance 85

Uber Engineering

DECEMBER 10, 2018

Uber, like most large technology companies, relies extensively on metrics to effectively monitor its entire stack. From low-level system metrics, such as memory utilization of a host, to high-level business metrics, including the number of Uber Eats orders in a … The post The Billion Data Point Challenge: Building a Query Engine for High Cardinality Time Series Data appeared first on Uber Engineering Blog.

Engineering 76

Engineering Metrics Monitoring Technology 76

MachMetrics

DECEMBER 20, 2018

Think about the last time you went out to dinner. Did you order a 5 course meal, but then only eat 2 of them? Of course not, that would be a waste. So then why are you serving an entire page of images to your website visitors when they’re only looking above the fold? I had previously written about lazy-loading your images – but at the time the implementations were still new and cumbersome.

Cache 75

Cache Speed Internet Internet 75

High Scalability

DECEMBER 7, 2018

Wake up! It's HighScalability time: This is your 1500ms latency in real life situations - pic.twitter.com/guot8khIPX. — Ivo Mägi (@ivomagi) November 27, 2018. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Know anyone looking for a simple book explaining the cloud? Then please recommend my well reviewed (31 reviews on Amazon and 72 on Goodreads!

Internet 163

Internet Internet Scalability Blockchain 163

Tim Kadlec

DECEMBER 4, 2018

Last week I had the opportunity to present at a technical SEO conference about performance. At the speakers dinner, I was enjoying a really good conversation with a few folks I met. At one point, I brought up quokkas because they’re amazing and I desperately want to hang out with one. Or a few. Anyway. It turns out, the other folks at the table were not familar.

Google 70

Google Engineering Internet Internet 70

n0derunner

DECEMBER 17, 2018

How to reduce database restore time by 50%. During.Next 2018 in London, Nutanix announced performance improvements in the core-datapath said to give up to 2X performance improvements. Here’s a real-world example of that improvement in practice. I am using X-Ray to simulate a 1TB data restore into an existing database. Specifically the IO sizes are large, an even split of 64K,128K,256K, 1MB and the pattern is 100% random across the entire 1TB dataset. bssplit=64k/20:128k/20:256k/20:512k/2

Performance 64

Performance Benchmarking Storage Network 64

Speed Curve

DECEMBER 3, 2018

The number of performance metrics is large and increases every year. It's important to understand what the different metrics represent and pick metrics that are important for your site. Our Evaluating rendering metrics post was a popular (and fun) way to compare and choose rendering metrics. Recently I created this timeline of performance metric medians from the HTTP Archive for the world's top ~1.3 million sites: Here's the same chart for mobile: People who have worked on web performance won't

Metrics 58

Metrics Mobile Tuning Network 58

TechBeacon Testing

DECEMBER 6, 2018

If you're a tester and you think you need to get up to speed on coding to become a test automation engineer, you're on the right track. But don't just learn to code. Instead, start by learning about source control, a methodology for tracking and managing changes to your code.

Testing 58

Testing Speed Code Engineering 58

High Scalability

DECEMBER 14, 2018

Wake up! It's HighScalability time: We've come a long way in 50 years. Or have we? Alan Kay : I believe ARPA spent $ 175,000 of 1968 money for that one demo. That’s probably like a million bucks today. Bill English : What we did was lease two video circuits from the phone company. They set up a microwave link: two transmitters on the top of the building at SRI, receiver/ transmitters up on Skyline Boulevard on a truck, and two receivers at the Civic Center.

Internet 141

Internet Internet Scalability Serverless 141

Testlodge

DECEMBER 12, 2018

What is an API? API stands for Application Program Interface. An API is an intermediate layer in a software system that is responsible for the data communication between the data source and the Graphical User Interface (GUI) that user’s see. In other words, the API is the business layer of the software that creates a connection between the presentation layer and the data layer.

Testing 58

Testing Testing Tools Servers Code 58

Brendan Gregg

DECEMBER 31, 2018

At the Linux Plumber's conference there were at least 24 talks on eBPF. It has quickly become not just an invaluable technology, but also an in-demand skill. Perhaps you'd like a new year's resolution: learn eBPF! eBPF should stand for something meaningful, like Virtual Kernel Instruction Set (VKIS), but due to its origins it is extended Berkeley Packet Filter.

C++ 52

C++ Virtualization Programming Code 52

The Polyglot Developer

DECEMBER 24, 2018

The 2018 year is winding down so it is time to reflect on some of the things that have happened in terms of The Polyglot Developer and all of its channels. Let this be a statistics report for everything that has happened on the blog, YouTube channel, and podcast. If you’re interested in adventuring into the world of technical content production, this will give you some perspective into what to expect.

Development 52

Development 52

Percona Community

DECEMBER 14, 2018

As mentioned in a previous post, I gave a talk at Percona Live Europe 2018 about system-versioned tables. This is a new MariaDB 10.3 feature, which consists of preserving old versions of a table rows. Each version has two timestamps that indicate the start (INSERT,UPDATE) of the validity of that version, and its end (DELETE, UPDATE). As a result, the user is able to query these tables as they appear at a point in the past, or how data evolved in a certain time range.

Systems 52

Systems 52

Randon ASCII

DECEMBER 9, 2018

Last week I wrote about the performance consequences of inadvertently loading gdi32.dll into processes that are created and destroyed at very high rates. This week I want to share some techniques for digging deeper into this behavior, and the odd things that I found when trying to use them. When I first wrote UIforETW I noticed that an inordinate amount of the size of the traces it recorded was coming from the Microsoft-Windows-Win32k provider.

Processing 53

Processing Traffic Testing Systems 53

High Scalability

DECEMBER 11, 2018

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Advertise your event here! Cool Products and Services. InMemory.Net provides a Dot Net native in memory database for analysing large amounts of data.

Java 125

Java Metrics Software Engineering DevOps 125

Speed Curve

DECEMBER 19, 2018

This blog post has a simple conclusion: Load script asynchronously! Simple, and yet the reality is that most scripts are still loaded synchronously. Understanding the importance of loading scripts asynchronously might help increase adoption of this critical performance improvement, so we're going to walk through the evolution of async script loading starting way back in 2007.

Internet 53

Internet Internet Website Traffic 53

Edge Perspectives

DECEMBER 25, 2018

The spine beckons Teasing us with so little, But pulling us To pull it off the shelf And explore what’s inside. We’re drawn page by page, Exploring new terrain, Seeking insight and inspiration, Drawn by the promise of something Much bigger than the pages in our hand. The trees that gave their lives Are grateful for our attention And hoping that they can Make our lives much richer and more satisfying Here’s hoping that your tree On Christmas morning Will add some more spines To nourish your days

52

52

Particular Software

DECEMBER 18, 2018

The wait is over! Today we’re releasing the new Azure Service Bus transport, which is fully compatible with NServiceBus 7 and.NET Core. You will now be able to run NServiceBus endpoints using Azure Service Bus anywhere. With the release of the new NServiceBus Azure Service Bus transport, we are now able to take full advantage of.NET Core and Azure. Getting up and running was simple and we don't have to worry about managing and maintaining queue databases anymore.

Transportation 49

Transportation Azure Benchmarking Availability 49

Professor Beekums

DECEMBER 4, 2018

I recently came across the need for a date/time parser that used natural language processing. Maleega’s date picker is extremely barebones and needed replacing. I left it barebones because I wanted time to figure out how to build a good date/time picker. Every one that I’ve used has felt clunky. This is probably because of the inherent challenges with date and time.

Processing 49

Processing 49

ACM Sigarch

DECEMBER 17, 2018

“A lot of people have gone further than they thought they could because someone else thought they could” — Zig Ziglar, renowned motivational speaker. Good mentoring can have an outsized impact on the careers of students, especially during early stages of their career. Countless stories that credit the right advice at the right time for launching outstanding career trajectories are commonplace.

Architecture 49

Architecture Network Strategy Systems 49

High Scalability

DECEMBER 18, 2018

Who's Hiring? pMD is a fast­ growing , highly rated health care technology company that has been recognized as a Best Place to Work by SF Business Times, Modern Healthcare, and Inc. Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast.

Healthcare 122

Healthcare Best Practices DevOps Cache 122

QAMentor

DECEMBER 25, 2018

Any software needs to go through various types of tests to assure that it has the required competitive edge. Today, when the protection of information resources is a necessary requirement of business service, penetration test allows obtaining an objective assessment of how easy it is to make unauthorized access to corporate network resources and site … The post Step-wise Guide to Perform Penetration Testing appeared first on QA Mentor Blog.

Testing 45

Testing Performance Network Software 45

Website Optimization

DECEMBER 19, 2018

Personal consumer data has become the oil of the 21st century. American companies are expected to spend close to $20 billion on consumer data in 2018 (New York Times 2018). Data trackers are the main way advertisers gather this valuable consumer data.

Speed 45

Speed Website 45

The Polyglot Developer

DECEMBER 17, 2018

A long time ago when I had been exploring session management in Node.js, I had written a tutorial titled, Session Management in Your Express.js Web Application. This was a basic tutorial that is still very functional today, however little things have changed since then when it comes to how the web works. For example, in 2015 HTTPS was never a requirement and we weren’t exposed to all the frontend web frameworks that exist today.

Development 45

Development 45

Speed Curve

DECEMBER 17, 2018

The Internet really is a complicated series of tubes. As a result, any time-based metrics we capture can have variations as those tubes wobble a bit as we shove data down them. To help reduce that variation, when we do synthetic tests, we always load a page at least three times and take the median result. But even then you'll find that, over time, your charts will still show plenty of variation.

Metrics 45

Metrics Internet Internet Traffic 45

TechBeacon Testing

DECEMBER 26, 2018

With more organizations implementing automated testing practices these days, developer and QA focus has shifted from "Do we need test automation?" to "How do with get the most out it?" The use of AI and machine learning in test automaton received a lot of attention this year, as did other core topics such as training testers to become automation engineers and developers to become better testers.

Testing 42

Testing Engineering Development 42

High Scalability

DECEMBER 4, 2018

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Advertise your event here! Cool Products and Services. InMemory.Net provides a Dot Net native in memory database for analysing large amounts of data.

Java 120

Java Metrics Software Engineering DevOps 120

Addy Osmani

DECEMBER 14, 2018

Learn how to speed up next-page navigations using prefetching

Speed 70

Speed 70

Website Optimization

DECEMBER 7, 2018

With Google's new expanded text ads (90 characters vs. 45) there is more room to make your case to potential buyers. One of the best ways to optimize a PPC account is to improve the ad text. This article shows how you can use local landmarks to boost click-through rates and conversions.

Google 45

Google 45

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. The closing of a year lends itself to looking back. And making lists. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

The Agile Manager

DECEMBER 31, 2018

The Financial Times recently ran a long article describing the breakdown of governance over the Crossrail development , the first new underground railway in London in over a century. Good governance is usually only appreciable by its absence, but the Crossrail case allows a before / after contrast between the presence of good and, after the sacking of a key board member, the presence of bad.

Government 40

Government Development Systems 40

QAMentor

DECEMBER 30, 2018

Top software testing companies effectively and efficiently analyze digital products, project documents, relevant services in order to find defects in them before they are made available to the customers. The user right # 1. Deal with the analyst, who speaks your language In discussing the project requirements it is necessary to determine the needs and … The post Top Software Testing Companies: App User Bill appeared first on QA Mentor Blog.

Software 40

Software Software Testing Efficiency 40

Dareboost

DECEMBER 28, 2018

Although we work in the same company, the daily life of each Dareboost collaborator is very specific. About a year ago, we have hired our first remote workers. That was a new organization to be found.

40

40

HammerDB

DECEMBER 20, 2018

The reason for reporting both TPM and NOPM performance metrics is for both historical and performance reasons. On the historical side HammerDB started out as Hammerora and only supported Oracle so it only needed to report Oracle TPM. However as other databases were added they all record TPM in a slightly different way so it wasn’t possible to compare TPM between different database for example Oracle and SQL Server.

Metrics 40

Metrics Performance Benchmarking Database 40