Remove Architecture Remove AWS Remove Scalability Remove Transportation
article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement.

Network 325
article thumbnail

Three smart log ingestion strategies in Dynatrace (without OneAgent)

Dynatrace

While engaging the automatic instrumentation of the Dynatrace OneAgent makes log ingestion automatic and scalable , our customers have set up multiple other log ingestion methods. Syslog is a popular standard for transporting and Ingesting log messages. 3: Ingest AWS Fargate logs with Fluent Bit. Log ingestion strategy no.

Strategy 190
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Kubernetes in the wild report 2023

Dynatrace

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform.

article thumbnail

Dutch Enterprises and The Cloud

All Things Distributed

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129
article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey.

article thumbnail

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. The database is sending them to a transport that DBLog can consume. We use the term ‘ change log’ for that transport. DBLog High Level Architecture. High Availability DBLog uses active-passive architecture.

Database 197
article thumbnail

How We Optimized Performance To Serve A Global Audience

Smashing Magazine

As an online booking platform, we connect travelers with transport providers worldwide, offering bus, ferry, train, and car transfers in over 30 countries. We aim to eliminate the complexity and hassle associated with travel planning by providing a one-stop solution for all transportation needs.