2021

article thumbnail

Evolution of search engines architecture - Algolia New Search Architecture Part 1

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the first article in a series. Search engines, and more generally, information retrieval systems, play a central role in almost all of today’s technical stacks.

article thumbnail

Top Automation Programming Languages of 2021

DZone

Introduction. In today’s highly competitive world, software development and automation play a significant role in creating robust software applications for businesses. Additionally, emerging technologies like artificial intelligence and blockchain have given a competitive edge to enterprises. For gaining maximum benefits out of automation testing , testers require hands-on experience in a minimum of one automation programming language.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight.

Network 325
article thumbnail

Auditing PostgreSQL Using pgAudit

Scalegrid

Auditing in information technology (IT) is a process of examining an organization’s IT infrastructure to ensure compliance with the requirements imposed by recognized standards or established policies. Data protection rules, such as the new GDPR regulations, are becoming increasingly stringent to protect user data, so it’s important that your database audits are set up properly […].

article thumbnail

Dynatrace leverages new AWS Lambda extensions for seamless end-to-end observability

Dynatrace

Dynatrace news. AWS Lambda is the fastest growing technology for serverless workloads and helps developers innovate faster. It removes the burden of managing underlying infrastructure and is broadly adopted for cloud-native application environments. But serverless functions don’t exist in a vacuum. It’s critical that you understand how they impact your customer-facing web applications, mobile apps, or APIs and how they interact with other functions, services, and classic technology stacks.

Lambda 299
article thumbnail

Supercharging Application Delivery

All Things Distributed

The goal of AWS Proton is simple: customers should be able to adopt, customize and evolve best practices and technologies for delivering their modern applications to the cloud, and not worry about how they roll this out – potentially to thousands of developers – across their organization.

article thumbnail

Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner

Uber Engineering

Introduction. The Fulfillment Platform is a foundational Uber domain that enables the rapid scaling of new verticals. The platform handles billions of database transactions each day, ranging from user actions (e.g., a driver starting a trip) and system actions … The post Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner appeared first on Uber Engineering Blog.

Google 145

More Trending

article thumbnail

Slack's Secret STDERR Messages

Brendan Gregg

These are rough notes. I run the Slack messaging application on Ubuntu Linux, and it recently started mysteriously crashing. I'd Alt-Tab and find it was no longer there. No error message, no dialog, just gone. It usually happened when locking and unlocking the screen. These are rough notes for how I debugged it, in case it's useful for someone searching on this topic.

Storage 145
article thumbnail

2021 Data/AI Salary Survey

O'Reilly

In June 2021, we asked the recipients of our Data & AI Newsletter to respond to a survey about compensation. The results gave us insight into what our subscribers are paid, where they’re located, what industries they work for, what their concerns are, and what sorts of career development opportunities they’re pursuing. While it’s sadly premature to say that the survey took place at the end of the COVID-19 pandemic (though we can all hope), it took place at a time when restrictions were loose

Azure 145
article thumbnail

Heuristics for Effective Software Development: A continuously evolving list.*

Allen Holub

Without psychological safety, respect, and trust, none of the following is possible. Process exists in service of people; the people come first. The best ways to work are collaborative. Negotiation is not collaboration. Isolated individuals making heroic efforts are never as effective as collaborative groups. We get the best results when customers, business people, and… The post Heuristics for Effective Software Development: A continuously evolving list.* appeared first on Allen Holub.

Software 145
article thumbnail

Scaling indexing and search - Algolia New Search Architecture Part 2

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the second article in a series. Here's Part 1. Search engines need to support fast scaling for both Read and Write operations. Rapid scaling is essential in most use cases.

article thumbnail

Fighting Fragility With Property-Based Testing

DZone

However long you work in software, you always feel late to the party. You encounter some seemingly cutting-edge new tool only to learn it has been around for decades, sometimes inspired by research papers from 1970. Still, you can’t keep up with everything and have a life. Property-based testing (PBT) is such an established technology and it deserves more attention.

Testing 344
article thumbnail

An End-to-End Guide of Load Testing

Abstracta

From planning to analysis and reporting, here’s what to know before you run your first load test If you have a public-facing web application, the odds are you. The post An End-to-End Guide of Load Testing appeared first on Abstracta Software Testing Services.

Testing 145
article thumbnail

PolyScale.ai – Scaling MySQL & PostgreSQL with Global Caching

Scalegrid

Guest post by Ben Hagan from PolyScale.ai Data-driven applications span a wide breadth of complexity, from simple microservices to real-time event-driven systems under significant load. However, as any development and/or DevOps team tasked with performance improvements will attest, making data-driven apps fast globally is “non-trivial”. Modern application architectures such as the JAMstack enforce the separation […].

Cache 279
article thumbnail

How Voice of the Customer solutions can transform digital experience monitoring

Dynatrace

Dynatrace news. The post How Voice of the Customer solutions can transform digital experience monitoring appeared first on Dynatrace blog.

article thumbnail

It’s Officially Startup Season in Space

All Things Distributed

We launched our AWS Space Accelerator to catalyze space innovation and support some of the most innovative startups that are helping shape the future of aerospace. Meet the 10 startups to take part in the first cohort of the AWS Space Accelerator.

AWS 218
article thumbnail

Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot

Uber Engineering

Uber recently launched a new capability: Ads on UberEats. With this new ability came new challenges that needed to be solved at Uber, such as systems for ad auctions, bidding, attribution, reporting, and more. This article focuses on how we … The post Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot appeared first on Uber Engineering Blog.

article thumbnail

Interactive Learning Tools For Front-End Developers

Smashing Magazine

Interactive Learning Tools For Front-End Developers. Interactive Learning Tools For Front-End Developers. Louis Lazaris. 2021-09-02T12:00:00+00:00. 2021-09-02T15:09:03+00:00. Because this industry moves so quickly, learning new skills is a regular thing for most of us. Over the last little while, I’ve been able to collect links to several interactive coding tools and apps that can help you supplement your skills in different areas of web development.

article thumbnail

ZFS Is Mysteriously Eating My CPU

Brendan Gregg

A microservice team asked me for help with a mysterious issue. They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017 and have shared the full story here. ## 1. Problem Statement The microservice was for metrics ingestion and had recently updated their base OS image (BaseAMI).

Cache 145
article thumbnail

NET 6: Threading Improvements

InfoQ

While numerous libraries exist to abstract away the complexities of asynchronous and concurrent programming, developers still need to drop down to lower thread-handling logic from time to time. Continuing our API changes for.NET 6 series, we look at some new tricks for multi-threading. By Jonathan Allen.

article thumbnail

#NoAccountability

Allen Holub

The notions of accountability and responsibility often pop up in the context of business, as if both of those ideas are good things. A culture of accountability, we’re told, is essential to running a business. The word “accountable” appears all over the 2020 Scrum Guide, as if it’s somehow an Agile notion instead of capitulation… The post #NoAccountability appeared first on Allen Holub.

145
145
article thumbnail

Benchmark (YCSB) numbers for Redis, MongoDB, Couchbase2, Yugabyte and BangDB

High Scalability

This is guest post by Sachin Sinha who is passionate about data, analytics and machine learning at scale. Author & founder of BangDB. This article is to simply report the YCSB bench test results in detail for five NoSQL databases namely Redis, MongoDB, Couchbase, Yugabyte and BangDB and compare the result side by side. I have used latest versions for each NoSQL DB and have followed the recommendations to run all the databases in optimized conditions.

article thumbnail

How To Test for Your Software’s Scalability

DZone

As companies develop, they provide services at greater capacities. To achieve new heights, a company needs to improve the quality of the platform behind its success. Several software tests can improve your digital products. Software scalability tests are imperative for any company operating in the digital market. Scalability testing and performance testing are ways to assess software capabilities.

article thumbnail

k6 Review: Open Source Load Testing Tool for Developers

Abstracta

Have you heard the hype around k6 yet? Yes, yet another open source performance testing tool is making waves. In this post, I’ll share my k6 review in. The post k6 Review: Open Source Load Testing Tool for Developers appeared first on Abstracta Software Testing Services.

article thumbnail

The future of software testing: Machine learning to the rescue

TechBeacon Testing

The last decade has seen a relentless push to deliver software faster. Automated testing has emerged as one of the most important technologies for scaling DevOps, companies are investing enormous time and effort to build end-to-end software delivery pipelines, and containers and their ecosystem are holding up on their early promise.

Software 142
article thumbnail

Bucketizing date and time data

SQL Performance

Bucketizing date and time data involves organizing data in groups representing fixed intervals of time for analytical purposes. Often the input is time series data stored in a table where the rows represent measurements taken at regular time intervals. For example, the measurements could be temperature and humidity readings taken every 5 minutes, and you want to group the data using hourly buckets and compute aggregates like average per hour.

Azure 139
article thumbnail

Diving Deep on S3 Consistency

All Things Distributed

I recently posted about Amazon S3 and how it’s evolved over the last 15 years since we launched the service in 2006 as “storage for the internet.” We built S3 because we knew customers wanted to store backups, videos, and images for applications like e-commerce web sites. Our top design priorities at the time were security, elasticity, reliability, durability, performance and cost because that’s what customers told us was most important to them for these types of applicat

Internet 218
article thumbnail

How Uber Achieves Operational Excellence in the Data Quality Experience

Uber Engineering

Uber delivers efficient and reliable transportation across the global marketplace, which is powered by hundreds of services, machine learning models, and tens of thousands of datasets. While growing rapidly, we’re also committed to maintaining data quality, as it can greatly … The post How Uber Achieves Operational Excellence in the Data Quality Experience appeared first on Uber Engineering Blog.

article thumbnail

How To Build Resilient JavaScript UIs

Smashing Magazine

How To Build Resilient JavaScript UIs. How To Build Resilient JavaScript UIs. Callum Hart. 2021-08-03T11:00:00+00:00. 2021-08-03T15:34:18+00:00. Things on the web can break — the odds are stacked against us. Lots can go wrong: a network request fails, a third-party library breaks, a JavaScript feature is unsupported (assuming JavaScript is even available), a CDN goes down, a user behaves unexpectedly (they double-click a submit button), the list goes on.

article thumbnail

How To Add eBPF Observability To Your Product

Brendan Gregg

There's an arms race to add eBPF (BPF) to commercial observability products, and in this post I'll describe how to quickly do that. This is also applicable for people adding it to their own in-house monitoring systems. People like to show me their BPF observability products after they have prototyped or built them, but I often wish I had given them advice before they started.

Latency 145
article thumbnail

Interview Performance Does Not Equal Job Performance

Professor Beekums

This is a conversation I had when I was interviewing a few years ago: Interviewer: “Yeah, a lot of candidates actually have trouble with this problem because it never shows up in the software we write.” Me: “…so why is it part of the interview?” Silence There is so much content out there right now about what candidates can do to “stand out” and “perform” well on interviews.

article thumbnail

AI Powered Misinformation and Manipulation at Scale #GPT-3

O'Reilly

OpenAI’s text generating system GPT-3 has captured mainstream attention. GPT-3 is essentially an auto-complete bot whose underlying Machine Learning (ML) model has been trained on vast quantities of text available on the Internet. The output produced from this autocomplete bot can be used to manipulate people on social media and spew political propaganda, argue about the meaning of life (or lack thereof) , disagree with the notion of what differentiates a hot-dog from a sandwich , take upon the

article thumbnail

Understanding the True Cost of Client-Side A/B Testing

Tim Kadlec

Client-side A/B testing has been a performance loving developer’s worst friend for years. The way it works is you load in some JavaScript (typically from a third-party domain), and that JavaScript runs, applying the experiments you’re running for any given situation. Since those experiments usually involve changing the display of the page in some way, these scripts are typically either loaded as blocking JavaScript (meaning nothing happens until the JavaScript arrives and gets execut

Testing 137
article thumbnail

Instrumenting Our Frontend Test Suite (.And Fixing What We Found)

DZone

Adding Instrumentation to Jest. Here at Sentry, we like to dogfood our product as much as possible. Sometimes, it results in unusual applications of our product and sometimes these unusual applications pay off in a meaningful way. In this blog post, we’ll examine one such case where we use the Sentry JavaScript SDK to instrument Jest (which runs our frontend test suite) and how we addressed the issues that we found.

Testing 330
article thumbnail

An Opinionated Guide to Performance Budgets

Speed Curve

Performance budgets are one of those ideas that everyone gets behind conceptually, but then are challenged to put into practice – and for very good reason. Web pages are unbelievably complex, and there are hundreds of different metrics available to track. If you're just getting started with performance budgets – or if you've been using them for a while and want to validate your work – this post is for you.

article thumbnail

DevOps demands quality engineering. Is your team ready?

TechBeacon Testing

For DevOps teams, quality assurance isn’t enough: You need to up your game to quality engineering if you expect to increase velocity and improve quality through continuous integration.

DevOps 141
article thumbnail

Top Frontend Frameworks

KeyCDN

Frontend frameworks let you hit the ground running when developing a new website. Due to their popularity, a wide array of frontend frameworks are available, and new ones emerge on a regular basis. Because there are so many to choose from, pinpointing the right frontend framework can be tricky. Like many developers, you may be drawn to wildly popular, tried-and-true options like Bootstrap and Foundation.

Google 135