2021

article thumbnail

Evolution of search engines architecture - Algolia New Search Architecture Part 1

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the first article in a series. Search engines, and more generally, information retrieval systems, play a central role in almost all of today’s technical stacks.

article thumbnail

Top Automation Programming Languages of 2021

DZone

Introduction. In today’s highly competitive world, software development and automation play a significant role in creating robust software applications for businesses. Additionally, emerging technologies like artificial intelligence and blockchain have given a competitive edge to enterprises. For gaining maximum benefits out of automation testing , testers require hands-on experience in a minimum of one automation programming language.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight.

Network 327
article thumbnail

Auditing PostgreSQL Using pgAudit

Scalegrid

Auditing in information technology (IT) is a process of examining an organization’s IT infrastructure to ensure compliance with the requirements imposed by recognized standards or established policies. Data protection rules, such as the new GDPR regulations, are becoming increasingly stringent to protect user data, so it’s important that your database audits are set up properly […].

article thumbnail

Dynatrace leverages new AWS Lambda extensions for seamless end-to-end observability

Dynatrace

Dynatrace news. AWS Lambda is the fastest growing technology for serverless workloads and helps developers innovate faster. It removes the burden of managing underlying infrastructure and is broadly adopted for cloud-native application environments. But serverless functions don’t exist in a vacuum. It’s critical that you understand how they impact your customer-facing web applications, mobile apps, or APIs and how they interact with other functions, services, and classic technology stacks.

Lambda 305
article thumbnail

Supercharging Application Delivery

All Things Distributed

The goal of AWS Proton is simple: customers should be able to adopt, customize and evolve best practices and technologies for delivering their modern applications to the cloud, and not worry about how they roll this out – potentially to thousands of developers – across their organization.

article thumbnail

A Guide To Modern CSS Colors

Smashing Magazine

A Guide To Modern CSS Colors. A Guide To Modern CSS Colors. Michelle Barker. 2021-11-17T16:00:00+00:00. 2021-11-17T16:37:20+00:00. There’s more to color on the web than meets the eye, and it’s about to get a lot more interesting! Today, we’ll take a look at the best ways to use colors in a design system, and what we can expect from our colors in the not-too-distant future.

Energy 145

More Trending

article thumbnail

Heuristics for Effective Software Development: A continuously evolving list.*

Allen Holub

Without psychological safety, respect, and trust, none of the following is possible. Process exists in service of people; the people come first. The best ways to work are collaborative. Negotiation is not collaboration. Isolated individuals making heroic efforts are never as effective as collaborative groups. We get the best results when customers, business people, and… The post Heuristics for Effective Software Development: A continuously evolving list.* appeared first on Allen Holub.

Software 145
article thumbnail

NET 6: Threading Improvements

InfoQ

While numerous libraries exist to abstract away the complexities of asynchronous and concurrent programming, developers still need to drop down to lower thread-handling logic from time to time. Continuing our API changes for.NET 6 series, we look at some new tricks for multi-threading. By Jonathan Allen.

article thumbnail

How Uber Achieves Operational Excellence in the Data Quality Experience

Uber Engineering

Uber delivers efficient and reliable transportation across the global marketplace, which is powered by hundreds of services, machine learning models, and tens of thousands of datasets. While growing rapidly, we’re also committed to maintaining data quality, as it can greatly … The post How Uber Achieves Operational Excellence in the Data Quality Experience appeared first on Uber Engineering Blog.

article thumbnail

Scaling indexing and search - Algolia New Search Architecture Part 2

High Scalability

What would a totally new search engine architecture look like? Who better than Julien Lemoine , Co-founder & CTO of Algolia , to describe what the future of search will look like. This is the second article in a series. Here's Part 1. Search engines need to support fast scaling for both Read and Write operations. Rapid scaling is essential in most use cases.

article thumbnail

Fighting Fragility With Property-Based Testing

DZone

However long you work in software, you always feel late to the party. You encounter some seemingly cutting-edge new tool only to learn it has been around for decades, sometimes inspired by research papers from 1970. Still, you can’t keep up with everything and have a life. Property-based testing (PBT) is such an established technology and it deserves more attention.

Testing 345
article thumbnail

An End-to-End Guide of Load Testing

Abstracta

From planning to analysis and reporting, here’s what to know before you run your first load test If you have a public-facing web application, the odds are you. The post An End-to-End Guide of Load Testing appeared first on Abstracta Software Testing Services.

Testing 145
article thumbnail

PolyScale.ai – Scaling MySQL & PostgreSQL with Global Caching

Scalegrid

Guest post by Ben Hagan from PolyScale.ai Data-driven applications span a wide breadth of complexity, from simple microservices to real-time event-driven systems under significant load. However, as any development and/or DevOps team tasked with performance improvements will attest, making data-driven apps fast globally is “non-trivial”. Modern application architectures such as the JAMstack enforce the separation […].

Cache 279
article thumbnail

How Voice of the Customer solutions can transform digital experience monitoring

Dynatrace

Dynatrace news. The post How Voice of the Customer solutions can transform digital experience monitoring appeared first on Dynatrace blog.

article thumbnail

It’s Officially Startup Season in Space

All Things Distributed

We launched our AWS Space Accelerator to catalyze space innovation and support some of the most innovative startups that are helping shape the future of aerospace. Meet the 10 startups to take part in the first cohort of the AWS Space Accelerator.

AWS 218
article thumbnail

Interactive Learning Tools For Front-End Developers

Smashing Magazine

Interactive Learning Tools For Front-End Developers. Interactive Learning Tools For Front-End Developers. Louis Lazaris. 2021-09-02T12:00:00+00:00. 2021-09-02T15:09:03+00:00. Because this industry moves so quickly, learning new skills is a regular thing for most of us. Over the last little while, I’ve been able to collect links to several interactive coding tools and apps that can help you supplement your skills in different areas of web development.

article thumbnail

USENIX LISA2021 BPF Internals (eBPF)

Brendan Gregg

For USENIX LISA2021 I gave a 40 minute deep dive talk on BPF internals for Linux, focusing on observability tracing tools. Since there are already BPF internals references online (listed in this post) I used the opportunity to create some new content, showing how bpftrace instrumentation works from user space down to machine code. I break it down to all the small components involved, where you'll find it's actually quite easy.

Website 145
article thumbnail

#NoAccountability

Allen Holub

The notions of accountability and responsibility often pop up in the context of business, as if both of those ideas are good things. A culture of accountability, we’re told, is essential to running a business. The word “accountable” appears all over the 2020 Scrum Guide, as if it’s somehow an Agile notion instead of capitulation… The post #NoAccountability appeared first on Allen Holub.

145
145
article thumbnail

The future of software testing: Machine learning to the rescue

TechBeacon Testing

The last decade has seen a relentless push to deliver software faster. Automated testing has emerged as one of the most important technologies for scaling DevOps, companies are investing enormous time and effort to build end-to-end software delivery pipelines, and containers and their ecosystem are holding up on their early promise.

Software 142
article thumbnail

Containerizing Apache Hadoop Infrastructure at Uber

Uber Engineering

Introduction. As Uber’s business grew, we scaled our Apache Hadoop (referred to as ‘Hadoop’ in this article) deployment to 21000+ hosts in 5 years, to support the various analytical and machine learning use cases. We built a team with varied … The post Containerizing Apache Hadoop Infrastructure at Uber appeared first on Uber Engineering Blog.

article thumbnail

Benchmark (YCSB) numbers for Redis, MongoDB, Couchbase2, Yugabyte and BangDB

High Scalability

This is guest post by Sachin Sinha who is passionate about data, analytics and machine learning at scale. Author & founder of BangDB. This article is to simply report the YCSB bench test results in detail for five NoSQL databases namely Redis, MongoDB, Couchbase, Yugabyte and BangDB and compare the result side by side. I have used latest versions for each NoSQL DB and have followed the recommendations to run all the databases in optimized conditions.

article thumbnail

How To Test for Your Software’s Scalability

DZone

As companies develop, they provide services at greater capacities. To achieve new heights, a company needs to improve the quality of the platform behind its success. Several software tests can improve your digital products. Software scalability tests are imperative for any company operating in the digital market. Scalability testing and performance testing are ways to assess software capabilities.

article thumbnail

k6 Review: Open Source Load Testing Tool for Developers

Abstracta

Have you heard the hype around k6 yet? Yes, yet another open source performance testing tool is making waves. In this post, I’ll share my k6 review in. The post k6 Review: Open Source Load Testing Tool for Developers appeared first on Abstracta Software Testing Services.

article thumbnail

Interview Performance Does Not Equal Job Performance

Professor Beekums

This is a conversation I had when I was interviewing a few years ago: Interviewer: “Yeah, a lot of candidates actually have trouble with this problem because it never shows up in the software we write.” Me: “…so why is it part of the interview?” Silence There is so much content out there right now about what candidates can do to “stand out” and “perform” well on interviews.

article thumbnail

AI Powered Misinformation and Manipulation at Scale #GPT-3

O'Reilly

OpenAI’s text generating system GPT-3 has captured mainstream attention. GPT-3 is essentially an auto-complete bot whose underlying Machine Learning (ML) model has been trained on vast quantities of text available on the Internet. The output produced from this autocomplete bot can be used to manipulate people on social media and spew political propaganda, argue about the meaning of life (or lack thereof) , disagree with the notion of what differentiates a hot-dog from a sandwich , take upon the

article thumbnail

Diving Deep on S3 Consistency

All Things Distributed

I recently posted about Amazon S3 and how it’s evolved over the last 15 years since we launched the service in 2006 as “storage for the internet.” We built S3 because we knew customers wanted to store backups, videos, and images for applications like e-commerce web sites. Our top design priorities at the time were security, elasticity, reliability, durability, performance and cost because that’s what customers told us was most important to them for these types of applicat

Internet 218
article thumbnail

How To Build Resilient JavaScript UIs

Smashing Magazine

How To Build Resilient JavaScript UIs. How To Build Resilient JavaScript UIs. Callum Hart. 2021-08-03T11:00:00+00:00. 2021-08-03T15:34:18+00:00. Things on the web can break — the odds are stacked against us. Lots can go wrong: a network request fails, a third-party library breaks, a JavaScript feature is unsupported (assuming JavaScript is even available), a CDN goes down, a user behaves unexpectedly (they double-click a submit button), the list goes on.

Network 145
article thumbnail

How To Add eBPF Observability To Your Product

Brendan Gregg

There's an arms race to add eBPF (BPF) to commercial observability products, and in this post I'll describe how to quickly do that. This is also applicable for people adding it to their own in-house monitoring systems. People like to show me their BPF observability products after they have prototyped or built them, but I often wish I had given them advice before they started.

Latency 144
article thumbnail

Bucketizing date and time data

SQL Performance

Bucketizing date and time data involves organizing data in groups representing fixed intervals of time for analytical purposes. Often the input is time series data stored in a table where the rows represent measurements taken at regular time intervals. For example, the measurements could be temperature and humidity readings taken every 5 minutes, and you want to group the data using hourly buckets and compute aggregates like average per hour.

Azure 139
article thumbnail

DevOps demands quality engineering. Is your team ready?

TechBeacon Testing

For DevOps teams, quality assurance isn’t enough: You need to up your game to quality engineering if you expect to increase velocity and improve quality through continuous integration.

DevOps 141
article thumbnail

Flipr: Making Changes Quickly and Safely at Scale

Uber Engineering

Introduction. Uber’s many software systems require a high volume of changes every day. Because of our systems’ size and complexity, it is a significant challenge to implement these changes without unintended consequences, ultimately slowing down developer productivity. Flipr is a … The post Flipr: Making Changes Quickly and Safely at Scale appeared first on Uber Engineering Blog.

article thumbnail

Introducing System.Threading.RateLimiting for.NET

InfoQ

While rate limiting is a well-known problem for web servers, there are many other situations where similar capabilities are needed. With the introduction of System.Threading.RateLimiting, developers will be able to add this capability without writing it themselves. By Jonathan Allen.

Servers 137
article thumbnail

Client-Side Perf Testing Using Lighthouse CI With Puppeteer

DZone

Whenever we need to do performance testing, mostly it is the APIs that come to mind. Testing the performance of an application by putting load on APIs or on servers and checking out various metrics or parameters falls under server-side performance testing.

Testing 335
article thumbnail

Understanding the True Cost of Client-Side A/B Testing

Tim Kadlec

Client-side A/B testing has been a performance loving developer’s worst friend for years. The way it works is you load in some JavaScript (typically from a third-party domain), and that JavaScript runs, applying the experiments you’re running for any given situation. Since those experiments usually involve changing the display of the page in some way, these scripts are typically either loaded as blocking JavaScript (meaning nothing happens until the JavaScript arrives and gets execut

Testing 137
article thumbnail

Top Frontend Frameworks

KeyCDN

Frontend frameworks let you hit the ground running when developing a new website. Due to their popularity, a wide array of frontend frameworks are available, and new ones emerge on a regular basis. Because there are so many to choose from, pinpointing the right frontend framework can be tricky. Like many developers, you may be drawn to wildly popular, tried-and-true options like Bootstrap and Foundation.

Google 135
article thumbnail

ct.css — Performance Hints via Injected Stylesheet Alone

CSS - Tricks

This is some bonafide CSS trickery from Harry that gives you some generic performance advice based on what it sees in your <head> element. First, it’s possible to make a <style> block visible like any other element by changing the display away from the default of none. It’s a nice little trick. You can even do that for things in the <head> , for example… head, head style, head script { display: block; }.