Technology Performance Pulse

From Docker Swarm to Kubernetes: Transitioning and Scaling

DZone

DECEMBER 4, 2023

This article delves into the nuances of transitioning from Docker Swarm to Kubernetes, focusing on best practices, strategic considerations, and the scaling advantages Kubernetes offers. Kubernetes , on the other hand, is an open-source platform designed to automate the deployment, scaling, and operation of application containers.

Best Practices

Best Practices Open Source Scalability Design

Congestion Control in Cloud Scale Distributed Systems

DZone

DECEMBER 19, 2023

Systems that operate at a cloud scale can get expected or unexpected surges of traffic from one or multiple callers and are expected to perform in a predictable manner. Distributed systems are composed of multiple systems that are wired together to provide a specific functionality.

Systems

Systems Cloud Traffic Performance

Scaling SRE Teams

DZone

NOVEMBER 20, 2023

For more: Read the Report From cultural and structural challenges within an organization to balancing daily work and dividing it between teams and individuals, scaling teams of site reliability engineers (SREs) comes with many challenges. In this article, we explore the challenges of scaling and review a successful scaling framework.

Engineering

Engineering Performance

Managing IoT Edge Devices at Scale: Device Lifecycle and Configuration Management

DZone

FEBRUARY 12, 2024

In this article, we will explore the strategies and tools for managing IoT edge devices at scale , focusing on device lifecycle and configuration management. The Scale of IoT Edge Device Management The proliferation of IoT devices presents organizations with the following challenges:

IoT

IoT Strategy Efficiency

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This approach has a handful of benefits.

Traffic

Traffic Latency Tuning Systems

Scaling Site Reliability Engineering (SRE) Teams the Right Way

DZone

MAY 27, 2023

This is when these teams may need to scale. Let’s unpack what scaling a team is all about, what are the indicators, what are steps you can take, and how you know if you’re done. Scaling Triggers Sometimes it is very easy to tell whether you need to scale your team or not. For example:

Engineering

Docker Swarm: Simplifying Container Orchestration at Scale

DZone

NOVEMBER 25, 2023

A simple and scalable method for deploying, scaling, and managing containers across multiple hosts is provided by Docker Swarm, a native clustering and orchestration solution from Docker. It can be difficult to manage and orchestrate containers across a distributed infrastructure in the world of containerization and cloud computing.

Scalability

Scalability Infrastructure Cloud

Automated observability, security, and reliability at scale

Dynatrace

JULY 18, 2023

With Configuration as Code, developers can manage their observability and security tasks with config files that can be developed alongside source code conveniently and at scale. However, scaling up software development requires more tools along the software product lifecycle, which must be configured promptly and efficiently.

Best Practices

Best Practices Code Infrastructure Latency

Alipay: Large-Scale Model Training on Billions of Files

DZone

JUNE 5, 2023

With the exponential growth of data, we create and optimize infrastructure that enables large-scale model training and overcomes the performance bottleneck while reducing the cost of data storage and computation. The group owns the world’s largest mobile payment platform Alipay, which serves over 1.3 billion users and 80 million merchants.

Storage

Storage Mobile Infrastructure Performance

Scaling indexing and search - Algolia New Search Architecture Part 2

High Scalability

OCTOBER 11, 2021

Search engines need to support fast scaling for both Read and Write operations. Rapid scaling is essential in most use cases. In most use cases, both Read and Write operations scale but not at the exact same moment. In most use cases, both Read and Write operations scale but not at the exact same moment.

Architecture

Architecture Efficiency Engineering Performance

Scaling Is Not Just About Products – It’s About Teams, Too

DZone

SEPTEMBER 19, 2021

As our user base increases, our systems reach hyper-scale (which is a good thing!). We want our teams to scale along with our user base. However, to build highly successful products, this is not the only type of scalability that we should worry about. Software engineering team scalability is equally important.

Scalability

Scalability Software Engineering Engineering Systems

Ensure safe and secure releases at scale by providing Golden Paths

Dynatrace

NOVEMBER 14, 2023

To bring these practices to life within an organization at scale, the discipline of platform engineering has gained popularity. The post Ensure safe and secure releases at scale by providing Golden Paths appeared first on Dynatrace news. We’d love to hear your feedback about Site Reliability Guardian.

Government

Government Best Practices DevOps Engineering

Presentation: Effective Performance Engineering at Twitter-Scale

InfoQ

APRIL 12, 2024

Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering. By Yao Yue

Engineering

Engineering Performance Design Scalability

Mastering System Design: A Comprehensive Guide to System Scaling for Millions (Part 1)

DZone

JANUARY 19, 2024

A transformative journey into the realm of system design with our tutorial, tailored for software engineers aspiring to architect solutions that seamlessly scale to serve millions of users.

Systems

Systems Design Software Engineering Scalability

Monitoring Applications at Scale in AWS

DZone

NOVEMBER 28, 2023

The Problem There are various scenarios when we choose to deploy our applications in different AWS accounts: There are multiple microservices deployed in different AWS accounts in different regions based on the use case. For an organization, there could be multiple AWS accounts configured that will deploy related/unrelated services.

AWS

AWS Monitoring Metrics

Scaling Quality Engineering: Embracing End-to-End Testing for Agile Success in SAFe

DZone

JUNE 20, 2023

In today's fast-paced software development environment, the Scaled Agile Framework (SAFe) has emerged as a leading methodology for organizations to scale Agile practices. This article aims to explore the significance of end-to-end testing within the Scaled Agile Framework (SAFe) and its role in ensuring high-quality software delivery.

Testing

Testing Engineering Performance Testing Software

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

JUNE 7, 2021

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. So how do we ingest and enrich these flows at scale ? After several iterations of the architecture and some tuning, the solution has proven to be able to scale.

Network

Network Transportation AWS Cloud

Lessons Learned Running Presto at Meta Scale

High Scalability

JULY 16, 2023

Running anything at scale - tools, processes, services - takes problem solving to overcome unexpected challenges. Here are four things we learned while scaling up Presto to Meta scale, and some advice if you’re interested in running your own queries at scale.

Open Source

Open Source Engineering Processing Scalability

Getting answers from data starts with automated log acquisition, at any scale

Dynatrace

OCTOBER 14, 2022

This contextualization of log data enables AI-powered problem detection and root cause analysis at scale. Many Dynatrace customers complain that typical sources for logs are ephemeral and short-lived pods or microservices, which brings new challenges in scaling up observability efforts.

Storage

Storage Government Network Infrastructure

AIOps Now: Scaling Kubernetes With AI and Machine Learning

DZone

FEBRUARY 4, 2024

If you are a site reliability engineer (SRE) for a large Kubernetes-powered application, optimizing resources and performance is a daunting job.

Scalability

Scalability Engineering Performance

Scalable Products: Why, When, and How to Scale Your Digital Product?

DZone

MARCH 7, 2024

Do you know what the global edtech and smart classroom market size was in 2022? Then, we must inform you that it was somewhere around USD 115.80 billion, which is estimated to grow from USD 133.55 billion in 2023 to USD 433.17 billion in 2030. Yes, you read that right!

Scalability

Scalability Performance Development

HDMI?—?Scaling Netflix Certification

The Netflix TechBlog

SEPTEMBER 4, 2020

Scaling Netflix Certification Scott Bolter , Matthew Lehman , Akshay Garg ¹ At Netflix, we take the task of preserving the creative vision of our content all the way to a subscriber TV screen very seriously. To deal with these scaling challenges, we have opted to integrate API-enabled HDMI Signal Analyzers into our test infrastructure.

Media

Media Testing Entertainment Virtualization

Dynatrace collaborates with Microsoft to empower DevSecOps at scale

Dynatrace

FEBRUARY 28, 2023

Customers relying on the Dynatrace software intelligence platform are able to use the power of Grail™ to get answers to security questions, in real time, at scale, and on budget. The post Dynatrace collaborates with Microsoft to empower DevSecOps at scale appeared first on Dynatrace news.

Analytics

Analytics Cloud Software Software

How to Scale for Reliability and Trust

DZone

MARCH 28, 2021

Dealing with both the increased expectations and challenges of reliability as you scale is difficult. At the same time, as you bring on more customers, the technical demands put on your service increase as well. You’ll need to maintain your development velocity and build customer trust through transparency.

Development

Development Engineering DevOps

Scaling Revenue & Growth Tooling

The Netflix TechBlog

MARCH 22, 2021

As we grow, we must be selective in the projects we take on, and careful about managing our portfolio of full-stack products and tools to scale with the needs of the engineering teams we support. Engineers need to ensure that operations teams scale to meet the needs of the operations teams that maintain and refine the Netflix product.

Engineering

Engineering Innovation Strategy Java

Predictable Pitfalls of Scaling VoIP to Cluster

DZone

JANUARY 15, 2020

Avoid these pitfalls of scaling VoIP to cluster. You may also like: Application Scalability — How To Do Efficient Scaling. VoIP technologies have a reputation for being rather complex and not without good reason.

Open Source

Open Source Servers Scalability Efficiency

Managing Dynatrace Managed at scale

Dynatrace

JULY 2, 2020

It’s easy to scale out such a cluster to support thousands of connected systems in one tenant, but also to host hundreds of individual tenants – each of them a separate monitoring environment. How large is “large scale”? The post Managing Dynatrace Managed at scale appeared first on Dynatrace blog.

Virtualization

Virtualization Monitoring Servers Architecture

Top 10 Best Practices for Scaling Your Application: Expert Tips for Optimizing Performance and Ensuring Reliability

DZone

FEBRUARY 7, 2023

If so, it's time to focus on scaling. In this article, we'll provide you with ten expert tips for scaling your application and optimizing its performance. Scaling your application is the process of increasing its capacity to meet these demands, and it's crucial for ensuring the success of your application.

Best Practices

Best Practices Performance Processing

What are quality gates? How to use quality gates to deliver better software at speed and scale

Dynatrace

FEBRUARY 21, 2024

How to use quality gates to deliver better software at speed and scale appeared first on Dynatrace news. Interested in delivering better software faster? Start a 15-day free trial today. Get started The post What are quality gates?

Speed

Speed Software Software Latency

Proactive self-monitoring ensures seamless operations for Dynatrace Managed at scale

Dynatrace

FEBRUARY 24, 2022

With Dynatrace SaaS deployments, customers don’t need to concern themselves with scaling the Dynatrace platform or its underlying infrastructure. The cluster utilization dashboard tiles show you how much additional load the cluster can handle and when you should consider scaling up capacity. Scaling the cluster is highly recommended.

Monitoring

Monitoring Metrics Analytics Processing

How Dynatrace empowers performance engineering teams to test at scale

Dynatrace

APRIL 30, 2021

But because of the complexity involved in executing and analyzing test results of dynamic systems, performance engineering is difficult to scale — especially with lean staff or resources. Organizations are having trouble scaling, too — only 10% of their projects are tested. Why are they grappling with these challenges?

Engineering

Engineering Testing Performance Performance Testing

Scale self-service configuration of Davis notifications with secure automation options

Dynatrace

MAY 5, 2021

To ensure effective administration of Dynatrace in such web-scale environments, Dynatrace provides centralized configuration controls. This blog post is the first in a series that introduces some of the improvements that ensure easy manageability at scale. If so, start your free trial today to experience software intelligence at scale!

DevOps

DevOps Cloud Monitoring Infrastructure

Data on Kubernetes Community initiatives: Automated storage scaling

Percona Community

JANUARY 9, 2024

Automated storage scaling stands out as a critical challenge. In the world of Kubernetes, where everything evolves quickly. Members of the Data on Kubernetes Community have proposed a solution to address this issue for Kubernetes operators.

Storage

Presentation: Sleeping at Scale - Delivering 10k Timers per Second per Node with Rust, Tokio, Kafka, and Scylla

InfoQ

APRIL 26, 2024

Lily Mara, Hunter Laine walk through the design of a system, its performance characteristics, and how they scaled it. By Lily Mara, Hunter Laine

Design

Design Systems Performance Scalability

AI-driven analysis of Spring Micrometer metrics in context, with typology at scale

Dynatrace

APRIL 7, 2022

Deploy at scale with auto-configuration and secure communication. The post AI-driven analysis of Spring Micrometer metrics in context, with typology at scale appeared first on Dynatrace blog. Topology-related custom metrics for seamless reports and alerts. Here’s how it works. of Micrometer.

Metrics

Metrics Latency Java Cache

Dynatrace extends automatic and intelligent observability to cloud and Kubernetes logs for smarter automation at scale

Dynatrace

FEBRUARY 8, 2021

But putting all the data points into context to gain actionable insights can’t be achieved without automation in web-scale environments. Getting actionable answers from log data is impossible at scale without the bigger context, automation, and AI. Manually maintaining dependencies among components doesn’t scale.

Cloud

Cloud Azure Analytics Open Source

Securely scale your API operations with personal access tokens

Dynatrace

MARCH 5, 2021

The post Securely scale your API operations with personal access tokens appeared first on Dynatrace blog. If you haven’t done so already, we encourage you to take a look at the Dynatrace API documentation. New to Dynatrace? If so, start your free trial today!

Metrics

Metrics Monitoring Design Systems

Why Compute and Storage Should Be Decoupled for Log Management at Scale

DZone

AUGUST 6, 2021

On a small scale, this isn’t problematic but when dealing with large-scale deployments, organizations end up using lots of computing, storage, and human resources just to manage their indexes. Most log management solutions store log data in a database and enable search by storing an index of the data.

Storage

Storage Database Systems Efficiency

Tuning EMQX To Scale to One Million Concurrent Connection on Kubernetes

DZone

JUNE 6, 2023

When building an IoT-based service, we need to implement a messaging mechanism that transmits data collected by the IoT devices to a hub or a server. That mechanism is known as a messaging protocol. A messaging protocol is a set of rules and formats that are agreed upon among entities that want to communicate with each other.

IoT

IoT Tuning Storage Network

Enable your teams to scale better with fine-grained settings and permissions for Digital Experience Management

Dynatrace

AUGUST 19, 2021

The post Enable your teams to scale better with fine-grained settings and permissions for Digital Experience Management appeared first on Dynatrace blog. Dynatrace news.

Scale your API operations with our version 2 APIs

Dynatrace

JUNE 2, 2020

Scale your API operations with pagination. Pagination is a critical feature for API operation at scale, as returning too many data fields can result in an overload of the client or the integrating application. When your API operation scales, it’s absolutely necessary to have fine-grained control over user permissions.

Metrics

Metrics Scalability Tuning Monitoring

Dynatrace and ServiceNow partner on new Service Graph Connector for Cloud AIOps at scale

Dynatrace

SEPTEMBER 16, 2021

The post Dynatrace and ServiceNow partner on new Service Graph Connector for Cloud AIOps at scale appeared first on Dynatrace blog. Dynatrace news.

Cloud

Autonomous Cloud Enablement aka Scaling NoOps via Self-Service

Dynatrace

FEBRUARY 6, 2020

Over the years we have seen three major waves of evolution for us: Speed, Stability and Scale. The illustration below gives you an overview of this evaluation, the focus, the mindset and how we measured success: 3 waves of DevOps evolution led us to Autonomous Cloud which allows us to Scale NoOps across the enterprise.

Cloud

Cloud DevOps Engineering Speed

Jaeger and ScyllaDB Integration: High Performance at Scale

DZone

OCTOBER 10, 2023

Jaeger has gained significant popularity in the software development community due to its powerful capabilities and ease of integration with various programming languages and frameworks.

Performance

Performance Storage Traffic Programming

From Docker Swarm to Kubernetes: Transitioning and Scaling

Congestion Control in Cloud Scale Distributed Systems

Trending Sources

Scaling SRE Teams

Managing IoT Edge Devices at Scale: Device Lifecycle and Configuration Management

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

Scaling Site Reliability Engineering (SRE) Teams the Right Way

Docker Swarm: Simplifying Container Orchestration at Scale

Automated observability, security, and reliability at scale

Alipay: Large-Scale Model Training on Billions of Files

Scaling indexing and search - Algolia New Search Architecture Part 2

Scaling Is Not Just About Products – It’s About Teams, Too

Ensure safe and secure releases at scale by providing Golden Paths

Presentation: Effective Performance Engineering at Twitter-Scale

Mastering System Design: A Comprehensive Guide to System Scaling for Millions (Part 1)

Monitoring Applications at Scale in AWS

Scaling Quality Engineering: Embracing End-to-End Testing for Agile Success in SAFe

How Netflix uses eBPF flow logs at scale for network insight

Lessons Learned Running Presto at Meta Scale

Getting answers from data starts with automated log acquisition, at any scale

AIOps Now: Scaling Kubernetes With AI and Machine Learning

Scalable Products: Why, When, and How to Scale Your Digital Product?

HDMI?—?Scaling Netflix Certification

Dynatrace collaborates with Microsoft to empower DevSecOps at scale

How to Scale for Reliability and Trust

Scaling Revenue & Growth Tooling

Predictable Pitfalls of Scaling VoIP to Cluster

Managing Dynatrace Managed at scale

Top 10 Best Practices for Scaling Your Application: Expert Tips for Optimizing Performance and Ensuring Reliability

What are quality gates? How to use quality gates to deliver better software at speed and scale

Proactive self-monitoring ensures seamless operations for Dynatrace Managed at scale

How Dynatrace empowers performance engineering teams to test at scale

Scale self-service configuration of Davis notifications with secure automation options

Data on Kubernetes Community initiatives: Automated storage scaling

Presentation: Sleeping at Scale - Delivering 10k Timers per Second per Node with Rust, Tokio, Kafka, and Scylla

AI-driven analysis of Spring Micrometer metrics in context, with typology at scale

Dynatrace extends automatic and intelligent observability to cloud and Kubernetes logs for smarter automation at scale

Securely scale your API operations with personal access tokens

Why Compute and Storage Should Be Decoupled for Log Management at Scale

Tuning EMQX To Scale to One Million Concurrent Connection on Kubernetes

Enable your teams to scale better with fine-grained settings and permissions for Digital Experience Management

Scale your API operations with our version 2 APIs

Dynatrace and ServiceNow partner on new Service Graph Connector for Cloud AIOps at scale

Autonomous Cloud Enablement aka Scaling NoOps via Self-Service

Jaeger and ScyllaDB Integration: High Performance at Scale

Stay Connected