article thumbnail

Leveraging ML-Based Anomaly Detection for 4G Networks Optimization

DZone

Artificial intelligence and machine learning already have some impressive use cases for industries like retail, banking, or transportation. All these areas are receiving the same amount of coverage — although cities and towns need more internet traffic, and forests require very little

Network 130
article thumbnail

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

Uber is committed to delivering safer and more reliable transportation across our global markets. To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Dynatrace adds support for AWS Transit Gateway with VPC Flow Logs

Dynatrace

VPC Flow Logs is a feature that gives you the capability to capture more robust IP traffic data that traverses your VPCs. These include Source IP, destination IP, transport protocol, source port, and destination port. Dynatrace news.

AWS 195
article thumbnail

How Netflix brings safer and faster streaming experience to the living room on crowded networks…

The Netflix TechBlog

To achieve that, we are efficiently using ABR (adaptive bitrate streaming) for a better playback experience, DRM (Digital Right Management) to protect our service and TLS (Transport Layer Security) to protect customer privacy and to create a safer streaming experience. for streaming traffic.

Network 192
article thumbnail

Kubernetes vs Docker: What’s the difference?

Dynatrace

Just like shipping containers revolutionized the transportation industry, Docker containers disrupted software. This opens the door to auto-scalable applications, which effortlessly matches the demands of rapidly growing and varying user traffic. Dynatrace news.

article thumbnail

HTTP/3 From A To Z: Core Concepts (Part 1)

Smashing Magazine Graphics

Its intended replacement, a new transport protocol named QUIC , differs enough from TCP in a few key ways that running HTTP/2 directly on top of it would be very difficult. For example, if the device is a firewall, it might be configured to block all traffic containing (unknown) extensions.

article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

This was the most important question we considered when building our infrastructure because data sampling policy dictates the amount of traces that are recorded, transported, and stored. Our trace data collection agent transports traces to Mantis job cluster via the Mantis Publish library.

article thumbnail

Let's talk about Kafka

Particular Software

While Kafka can deal with high traffic volumes, the right partition strategy is a key factor and will have a major impact on the scalability and elasticity of the whole system. We get a lot of questions about Kafka. Is it good? Does it live up to the hype?

article thumbnail

Towards a Reliable Device Management Platform

The Netflix TechBlog

MQTT is an OASIS standard messaging protocol for the Internet of Things (IoT) and was designed as a highly lightweight yet reliable publish/subscribe messaging transport that is ideal for connecting remote devices with a small code footprint and minimal network bandwidth.

article thumbnail

Edgar: Solving Mysteries Faster with Observability

The Netflix TechBlog

Edgar captures 100% of interesting traces , as opposed to sampling a small fixed percentage of traffic. Distributed tracing is the process of generating, transporting, storing, and retrieving traces in a distributed system.

article thumbnail

Delta: A Data Synchronization and Enrichment Platform

The Netflix TechBlog

Data Pipeline using Delta In the following sections, we are going to describe the Delta-Connector that connects to a datastore and publishes CDC events to the Transport Layer, which is a real-time data transportation infrastructure routing CDC events to Kafka topics. No need to acquire locks on tables, which is essential to ensure that the write traffic on the database is never blocked by our service.

Big Data 163
article thumbnail

Getting NServiceBus ready for the cloud

Particular Software

Cloud-ready message transport The first aspect we needed to upgrade was the old application’s use of MSMQ. Any queue traffic between applications on different machines would be between MSMQ instances, using MSMQ’s specific communication.

article thumbnail

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks.

article thumbnail

Simple streaming telemetry

The Netflix TechBlog

Introducing gnmi-gateway: a modular, distributed, and highly available service for modern network telemetry via OpenConfig and gNMI By: Colin McIntosh, Michael Costello Netflix runs its own content delivery network, Open Connect , which delivers all streaming traffic to our members.

article thumbnail

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks.

article thumbnail

The Ever Given is Not a Black Swan Event

The Agile Manager

The disruption is not simply the result of a ship running aground and blocking traffic in a busy, narrow passageway.

article thumbnail

Commute Challenge 2018

Randon ASCII

It was great fun and it also served as a joyous celebration of the many ways to make commuting more fun than sitting alone in traffic. Day 7: June (videographer and Kirkland’s Transportation Strategic Advisor). I’ll bet I had more fun commuting during September 2018 than you did. In April 2017 I gave myself the challenge of commuting to work using a different method every workday for a month – twenty ways in twenty days! The write up and video are here.

article thumbnail

Top 9 web development trends to expect in 2022

Enprowess

According to Ericsson’s analysis, international mobile data traffic is projected to become 4.5 The Top web development trends in 2022.

article thumbnail

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

However, it is paramount that we validate the complete set of identifiers such as a list of movie ids across producers and consumers for higher overall confidence in the data transport layer of choice.

article thumbnail

API Security: The Complete Guide

KeyCDN

If a single IP generates a lot of traffic volume, The WAF can assume that it is an attempt at a Distributed Denial of Service (DDoS) attack. REST: A less complex approach to APIs utilizing HTTP/S as the protocol for transport and typically utilizing the JSON format for data transfer.

article thumbnail

Scale Your Liferay Application by Clustering

Enprowess

And whenever one server isn’t sufficient to serve the high traffic needs of your portal, you can scale your Liferay portal by adding additional servers. It is mainly required for parallel processing, fault tolerance and load balancing, high traffic on the application.

Cache 52
article thumbnail

Expanding the Cloud – The Second AWS GovCloud (US) Region, AWS GovCloud (US-East)

All Things Distributed

US International Traffic in Arms Regulations (ITAR). Drakontas provides products for law enforcement, criminal justice, infrastructure protection, transportation, and military communities. Today, I'm happy to announce that the AWS GovCloud (US-East) Region, our 19th global infrastructure Region, is now available for use by customers in the US.

AWS 97
article thumbnail

Välkommen till Stockholm – An AWS Region is coming to the Nordics

All Things Distributed

AWS is helping them reach their goal of becoming the leader in sustainable transport. The airline has also been able to scale quickly to cope with spikes in seasonal traffic, cutting application latency and improving the overall customer experience. flights, allowing the airline to expand twelvefold to cope with the spike in traffic that it experienced at the time. Today, I am very excited to announce our plans to open a new AWS Region in the Nordics!

article thumbnail

Why I hate MPI (from a performance analysis perspective)

John McCalpin

This will typically include environment variables that can influence the behavior of the MPI runtime, and might include environment variables that can influence the behavior of the lower-level shared-memory transport and/or network hardware interfaces. MPI runtime libraries are typically built to interact with one or more lower-level interfaces to shared-memory transport implementation(s) and networking hardware. The processor hardware available to support shared-memory transport.

article thumbnail

Let's Encrypt: an automated certificate authority to encrypt the entire web

The Morning Paper

We hope that in the near future, clients will start using HTTPS as the default web transport. Eventually, we may marvel that there was ever a time when Web traffic traveled over the Internet as plaintext.

article thumbnail

HSTS and Let's Encrypt

Tim Kadlec

One of the follow-up questions that popped up was about HTTP Strict Transport Security (HSTS) and whether Let’s Encrypt’s helps with it. HTTP Strict Transport Security (HSTS) helps to fix this problem by telling the browser that it should never request content from your site using HTTP. To enable HSTS, you set a Strict-Transport-Security header whenever your site is accessed over HTTPS. One of those questions asks if you would like to redirect all HTTP traffic to HTTPS.

article thumbnail

Evolution of Netflix Conductor:

The Netflix TechBlog

This addition also provides the option to use the Elasticsearch RestClient instead of the Transport Client which was enforced in the previous version. We need to enhance the grpc modules to leverage the bidirectional channel to push tasks to workers as and when they are scheduled, thus reducing network traffic, load on the server and redundant client calls.

Lambda 160
article thumbnail

Observations on the Importance of Cloud-based Analytics

All Things Distributed

This allows local councils to keep certain streets well lit, to accommodate high foot traffic, bring on lighting during adverse weather, when ambient light dims to a dangerous level, or even turn lighting down, for example in an industrial estate, where there are no people. The City of Chicago is one of the first to bring sensors throughout the city that will permanently measure air quality, light intensity, sound volume, heat, precipitation, wind and traffic.

article thumbnail

HTTP/3: Practical Deployment Options (Part 3)

Smashing Magazine Graphics

Note that there is an Apache Traffic Server implementation, though.). However, to the firewall, this will look as if a new connection is being used without first using a handshake, which might just as well be an attacker sending malicious traffic.

Servers 74
article thumbnail

Listen

The Agile Manager

The authors traffic in interesting data, but either lack the courage to draw any conclusion beyond Things Might Change But Nobody Knows (thanks for that, so helpful), or use the data selectively to present defenses for their preference of what the future will be.

article thumbnail

An In-Depth Guide To Measuring Core Web Vitals

Smashing Magazine

This is applicable to pages that receive little to no traffic, so small sites without field data don’t need to be worried. An In-Depth Guide To Measuring Core Web Vitals. An In-Depth Guide To Measuring Core Web Vitals. Barry Pollard. 2021-04-19T08:30:00+00:00. 2021-04-19T08:35:54+00:00.

Google 105
article thumbnail

Dutch Enterprises and The Cloud

All Things Distributed

Using cloud computing as the underlying technology to run the LBS platform Tom Tom is able to provide developers with on-demand content that will enable them to build location based applications for fleet management, route planning, traffic management or spatial analytics. . This spring I travelled through Europe for the AWS Global Summit series.

Cloud 77
article thumbnail

Innovation Exhaustion

The Agile Manager

There are plenty of examples - music publishing, mass-market retailing, local transportation - where new entrants have left a wake of creative destruction in their path. The chattering classes are telling us that we live in an "ideas economy" a full half-century after it was ripe to traffic in ideas.

article thumbnail

Questions of Value

The Agile Manager

Value traffics in moving, worth in storage. Buyers define all kinds of evaluation criteria, things like proximity to public transportation, newer appliances, and rooms and layout that accommodates their possession and lifestyle. In March, we looked at questions of worth. This month, we look at "questions of value". In the dictionary, value is defined by worth, and worth is defined by value. Why ask the question twice?

article thumbnail

HTTP/3: Performance Improvements (Part 2)

Smashing Magazine Graphics

An often used metaphor is that of a pipe used to transport water. One aspect of performance is about how efficiently a transport protocol can use a network’s full (physical) bandwidth (i.e. Luckily, QUIC was designed with TLS in mind from the start, and as such does combine both the transport and cryptographic handshakes in a single mechanism. HTTP/3: Performance Improvements (Part 2). HTTP/3: Performance Improvements (Part 2). Robin Marx. 2021-08-23T06:20:00+00:00.

article thumbnail

Can You Afford It?: Real-world Web Performance Budgets

Alex Russell

Contended, over-subscribed cells can make “fast” networks brutally slow, transport variance can make TCP much less efficient , and the bursty nature of web traffic works against us. TL;DR: performance budgets are an essential but under-appreciated part of product success and team health. Most partners we work with are not aware of the real-world operating environment and make inappropriate technology choices as a result.

Network 63
article thumbnail

Front-End Performance Checklist 2021

Smashing Magazine

CrUX generates an overview of performance distributions over time, with traffic collected from Google Chrome users. But account for the different types and usage behaviors of your customers (which Tobias Baldauf called cadence and cohorts ), along with bot traffic and seasonality effects.

article thumbnail

Front-End Performance Checklist 2020 [PDF, Apple Pages, MS Word]

Smashing Magazine

For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Front-End Performance Checklist 2020 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2020 [PDF, Apple Pages, MS Word]. Vitaly Friedman.

Cache 114
article thumbnail

Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]

Smashing Magazine

For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Vitaly Friedman. 2019-01-07T12:00:13+00:00. 2019-04-29T18:34:58+00:00. Web performance is a tricky beast, isn’t it? How do we actually know where we stand in terms of performance, and what our performance bottlenecks exactly are?

Cache 76