November, 2023

article thumbnail

Accelerate Innovation by Shifting Left

DZone

Part 1: The Challenge and the Workload FinOps is an evolving practice to deliver maximum value from investments in Cloud. Most organizations in their journey of adopting FinOps focus on highly tactical and visible activities. They perform activities post-deployment of the applications to help them understand and then optimize their cloud usage and cost.

article thumbnail

Optimize resource utilization of your Kubernetes clusters with SLOs

Dynatrace

Kubernetes is a widely used open source system for container orchestration. It allows for seamless running of containerized workloads across different environments. However, managing Kubernetes optimally can be a daunting task due to its complex architecture. Properly monitoring a Kubernetes cluster or any related environment can be difficult. Effective resource provisioning and management is a critical aspect of a Kubernetes cluster.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

1. Streamlining Membership Data Engineering at Netflix with Psyberg

The Netflix TechBlog

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Many metrics in Netflix’s financial reports are powered and reconciled with efforts from our team!

article thumbnail

DBaaS Pros & Cons

Scalegrid

In today’s rapidly evolving digital landscape, the way we manage databases is undergoing a transformative shift. The rise of Database-as-a-Service (DBaaS) is not just a trend but a strategic response to the growing complexities of data management. As CTOs, database developers & experts, and DBAs seek more efficient, secure, and scalable cloud services solutions, DBaaS emerges as a compelling choice.

article thumbnail

Standing on the shoulders of giants: Colm on constant work

All Things Distributed

The Builders' Library gathers the expertise of Amazon's most experience builders in one place. One article that really got me thinking was Colm MacCárthaigh's "Reliability, constant work, and a good cup of coffee" which is about an anti-fragility pattern that he developed for building simple, more robust, and cost-effective systems.

Systems 154
article thumbnail

AWS Restructures and Consolidates Its Well-Architected Framework

InfoQ

AWS published a new set of updates to its Well-Architected Framework, with changes across all six pillars of the framework. The performance efficiency and operational excellence pillars have been restructured and consolidated to reduce the number of best practices. Other pillars received improved implementation guidance, including recommendations and steps on reusable architecture patterns.

AWS 128
article thumbnail

Accelerate Innovation by Shifting Left FinOps, Part 2

DZone

In Part 1 , we looked at the overview of FinOps as an evolving practice to deliver maximum value from investments in the cloud. We also discussed the challenge or the need for shifting left FinOps for better optimization of your cloud usage and cost. In part 2 of the series, we will walk you through the steps on how you go about creating the FinOps cost model for an example solution.

More Trending

article thumbnail

All of Netflix’s HDR video streaming is now dynamically optimized

The Netflix TechBlog

by Aditya Mavlankar , Zhi Li , Lukáš Krasula and Christos Bampis High dynamic range ( HDR ) video brings a wider range of luminance and a wider gamut of colors, paving the way for a stunning viewing experience. Separately, our invention of Dynamically Optimized ( DO ) encoding helps achieve optimized bitrate-quality tradeoffs depending on the complexity of the content.

article thumbnail

PostgreSQL® Hostname Configuration

Scalegrid

Imagine a world where your PostgreSQL® database connections are seamless and secure. It’s possible, but only if you master the art of configuring hostnames properly. In this blog post, we’ll guide you through understanding the PostgreSQL hostname, setting it up correctly, and utilizing it effectively in SQL queries. You’ll also learn how to troubleshoot common hostname issues and enhance security with proper hostname usage.

Database 130
article thumbnail

Does Interaction to Next Paint actually correlate to user behavior?

Speed Curve

Earlier this year, Google announced that Interaction to Next Paint (INP) is no longer an experimental metric. INP will replace First Input Delay (FID) as a Core Web Vital in March of 2024. Now that INP has arrived to dethrone FID as the responsiveness metric in Core Web Vitals, we've turned our eye to scrutinizing its effectiveness. In this post, we'll look at real-world data and attempt to answer: What correlation – if any – does INP have with actual user behavior and business metri

Google 112
article thumbnail

Presentation: Performance: Adventures in Thread-per-Core Async with Redpanda and Seastar

InfoQ

John Spray describes an experience of building high performance systems with C++20 in an asynchronous runtime, and explores the challenges & tradeoffs in adopting a thread-per-core architecture.

article thumbnail

The Guide to SRE Principles

DZone

Site reliability engineering (SRE) is a discipline in which automated software systems are built to manage the development operations (DevOps) of a product or service. In other words, SRE automates the functions of an operations team via software systems. The main purpose of SRE is to encourage the deployment and proper maintenance of large-scale systems.

DevOps 289
article thumbnail

Automate CI/CD pipelines with Dynatrace: Part 2, Deploy stage

Dynatrace

In the previous installment of this blog series , we explored how to set up Dynatrace as a build-stage orchestrator to effectively address the challenges faced by Site Reliability Engineers (SREs). In this blog post, we’ll transition to the next pipeline stage, the Deploy stage, and examine the visibility advantages that Dynatrace provides during this critical phase.

Traffic 268
article thumbnail

3. Psyberg: Automated end to end catch up

The Netflix TechBlog

By Abhinaya Shetty , Bharath Mummadisetty This blog post will cover how Psyberg helps automate the end-to-end catchup of different pipelines, including dimension tables. In the previous installments of this series, we introduced Psyberg and delved into its core operational modes: Stateless and Stateful Data Processing. Now, let’s explore the state of our pipelines after incorporating Psyberg.

Tuning 244
article thumbnail

Quick Peek: MySQL 8.2 and 8.0.35

Percona

Oracle recently made their quarterly releases with MySQL 8.0.35 and MySQL 8.2. This blog post is a quick look at the release notes to see what these new versions bring to the community. You’ll want to keep an eye on the deprecations in particular because some long-accepted behavior, including wildcards, will change eventually. We get 83 and 50 bug fixes, respectively.

article thumbnail

Effective Engineering Teams

Addy Osmani

tl;dr: Google research found that psychological safety is the most important dynamic for an effective team. This was alongside other dynamics like dependability, role clarity, meaningful work and impact.

article thumbnail

Microsoft Refreshes Its Well-Architected Framework

InfoQ

Microsoft recently announced a comprehensive refresh of the Well-Architected Framework (WAF) for designing and running optimized workloads on Azure.

Azure 124
article thumbnail

Decompose Legacy System Into Microservices: Part 2

DZone

In today’s evolving technological landscape, the shift from monolithic architectures to microservices is a strategic move for many businesses. This is particularly relevant in the domain of reimbursement calculation systems. As I mentioned in my previous article Part 1 , let's explore how such a transition can be effectively managed. The Monolithic Challenge Imagine a scenario where you have a large-scale, monolithic system - possibly a bulky C# console application or an extensive SQL Server sto

Systems 286
article thumbnail

Application observability meets developer observability: Unlock a 360Âş view of your environment

Dynatrace

Cloud complexity and data proliferation are two of the most significant challenges that IT teams are facing today. Computing environments are scaling to new heights, resulting in more data that makes pinpointing root causes and vulnerabilities even more challenging. Modern cloud complexity is becoming nearly impossible for human beings to manage without AI and automation.

article thumbnail

2. Diving Deeper into Psyberg: Stateless vs Stateful Data Processing

The Netflix TechBlog

By Abhinaya Shetty , Bharath Mummadisetty In the inaugural blog post of this series, we introduced you to the state of our pipelines before Psyberg and the challenges with incremental processing that led us to create the Psyberg framework within Netflix’s Membership and Finance data engineering team. In this post, we will delve into a more detailed exploration of Psyberg’s two primary operational modes: stateless and stateful.

article thumbnail

Trip report: Autumn ISO C++ standards meeting (Kona, HI, USA)

Sutter's Mill

Today, the ISO C++ committee completed its second meeting of C++26, held in Kona, HI, USA. Our hosts, Standard C++ Foundation and WorldQuant, arranged for high-quality facilities for our six-day meeting from Monday through Saturday. We had over 170 attendees, about two-thirds in-person and the others remote via Zoom, formally representing 21 nations.

C++ 107
article thumbnail

How To Scale a Single-Host PostgreSQL Database With Citus

Percona

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out. There’s an axiom that I think aptly applies to this situation describing the differences between science and art: – Science: 1 problem -> 1 solution – Art: 1 problem -> 1,000 solutions While the two previous Citus blogs that I wrote covered the fairly

Database 107
article thumbnail

Strawberry Fields Forever

O'Reilly

Tim O’Reilly forwarded an excellent article about the OpenAI soap opera to me: Matt Levine’s “ Money Stuff: Who Controls Open AI.” I’ll skip most of it, but something caught my eye. Towards the end, Levine writes about Elon Musk’s version of Nick Bostrom’s AI that decides to turn the world to paper-clips : [Elon] Musk gave an example of an artificial intelligence that’s given the task of picking strawberries.

article thumbnail

Distributed Cloud Architecture for Resilient Systems

DZone

This is an article from DZone's 2023 Observability and Application Performance Trend Report. For more: Read the Report Employing cloud services can incur a great deal of risk if not planned and designed correctly. In fact, this is really no different than the challenges that are inherit within a single on-premises data center implementation. Power outages and network issues are common examples of challenges that can put your service — and your business — at risk.

Cloud 286
article thumbnail

Dynatrace and Red Hat expand enterprise observability to edge computing

Dynatrace

Cloud-native workloads on edge devices are gaining momentum among organizations as they extend the hybrid cloud closer to the data source and end users at the edge. Successful deployments of cloud-native workloads at the edge help to reduce costs, boost performance, and improve customer experience. As an example, many retailers already leverage containerized workloads in-store to enhance customer experiences using video analytics or streamline inventory management using RFID tracking for improve

Retail 267
article thumbnail

Detecting Speech and Music in Audio Content

The Netflix TechBlog

Iroro Orife , Chih-Wei Wu and Yun-Ning (Amy) Hung Introduction When you enjoy the latest season of Stranger Things or Casa de Papel (Money Heist) , have you ever wondered about the secrets to fantastic story-telling, besides the stunning visual presentation? From the violin melody accompanying a pivotal scene to the soaring orchestral arrangement and thunderous sound-effects propelling an edge-of-your-seat action sequence, the various components of the audio soundtrack combine to evoke the very

article thumbnail

How HubSpot Uses Apache Kafka Swimlanes for Timely Processing of Workflow Actions

InfoQ

HubSpot adopted routing messages over multiple Kafka topics (called swimlanes) for the same producer to avoid the build-up in the consumer group lag and prioritize the processing of real-time traffic. Using a combination of automatic and manual detection of traffic spikes, the company ensures the majority of customers’s workflows execute without delays.

article thumbnail

Understanding What Kubernetes Is Used For: The Key to Cloud-Native Efficiency

Percona

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. You may already be using it daily and find it makes running applications in the cloud much more manageable. But for those who are not so familiar, in this post, we will discuss how Kubernetes has emerged as the unsung hero in an industry where agility and scalability are critical success factors.

article thumbnail

Creativity Isn’t Just Remixing

O'Reilly

This is not the first time that I’ve written about AI creativity, and I doubt that it will be the last. It’s a question that comes up repeatedly, and that is very much in the current mind, with events like the strikes by the Writers’ Guild of America and the Screen Actors Guild , in which the use of AI to create scripts and to generate images of actors was an issue.

article thumbnail

Performance of ULID and UUID in Postgres Database

DZone

Hello everyone! In this article, I want to share my knowledge and opinion about the data types that are often used as an identifier. Today we will touch on two topics at once. These are measurements of search speed by key and data types for the key on the database side. I will use a PostgreSQL database and a demo Java service to compare query speeds.

Database 286
article thumbnail

Unmatched scalability and security of Dynatrace extensions now available for all supported technologies: 7 reasons to migrate your JMX and Python plugins

Dynatrace

What’s happening In our pursuit of continuous improvement, we’re bidding farewell to the Extension Framework 1.0 and focusing on a much-improved version 2.0 that offers security, scalability, and simplicity of use. Extensions 2.0 already address SNMP, WMI, SQL databases, and Prometheus technologies, serving the monitoring needs of hundreds of Dynatrace customers.

article thumbnail

Data On Kubernetes

Percona Community

If you’ve attended one of the Kubecon talks or related events, you’ve likely encountered the phrase “Data in Kubernetes.” To understand what “Data in Kubernetes” means, let’s explore some fundamental concepts related to Kubernetes, workload, stateless, and stateful applications. Kubernetes, workload, stateless and stateful applications Kubernetes is a container orchestration tool that has already become an industry standard.

78
article thumbnail

Partitioned Namespaces for Azure Service Bus Premium Are Now Generally Available

InfoQ

During the recent Ignite conference, Microsoft announced the general availability (GA) of partitioned namespaces feature for Azure Service Bus, which allows customers to use partitioning for the premium messaging tier.

Azure 67
article thumbnail

Is ANALYZE TABLE Safe on a Busy MySQL Database Server?

Percona

Sometimes, there is a need to update the table and index statistics manually using the ANALYZE TABLE command. Without going further into the reasons for such a need, I wanted to refresh this subject in terms of overhead related to running the command on production systems. However, the overhead discussed here is unrelated to the usual cost of diving into table rows to gather statistics, which we can control by setting the number of sample pages.

Servers 98
article thumbnail

Deploy HammerDB as a Web Application with CloudTK

HammerDB

From HammerDB v4.9 it is possible to deploy HammerDB through a web browser, giving you access to a fully functional HammerDB GUI in Cloud environments. The quickest way to run HammerDB with CloudTk is through Docker and in this post will we demonstrate how to pull the HammerDB CloudTK Docker image and run it to start running HammerDB through your chosen browser.

Metrics 62
article thumbnail

A Comprehensive Guide to Cloud Monitoring Tools: Ensuring Optimal Performance and Security

DZone

With its ability to scale, be flexible, and be cost-effective, cloud computing has completely changed how businesses operate. However, it can be difficult to manage and keep an eye on the intricate infrastructure of cloud environments. Tools for monitoring the cloud in this situation are useful. With the help of these potent tools, businesses can monitor the performance, availability, and security of their cloud resources in real-time.

Cloud 281
article thumbnail

Keeping data in India with AI-powered observability operated on AWS Mumbai

Dynatrace

Recently, the Parliament of India released the Digital Personal Data Protection Act 2023 , which regulates the processing of digital personal data in India and recognizes the right of individuals to protect their data in India. As of October 2023, the Dynatrace ® platform is available on AWS in Mumbai, enabling customers to maintain a local SaaS presence in India.

AWS 245