The end of the legacy Azure Service Bus transport

Particular Software

A while back, we introduced a brand new transport for use with Azure Service Bus. This transport was a necessary step in our Azure offering to allow users to target.NET Standard and.NET Core. More importantly, it started the process of deprecating the now-legacy Azure Service Bus transport. After May 1, 2021, the legacy transport will no longer be supported and won’t receive updates, patches, or fixes. Why are we deprecating the legacy transport?

Introducing the new Azure Service Bus transport for.NET Core

Particular Software

Today we’re releasing the new Azure Service Bus transport, which is fully compatible with NServiceBus 7 and.NET Core. With the release of the new NServiceBus Azure Service Bus transport, we are now able to take full advantage of.NET Core and Azure. With this news, we’re rebranding the previous transport as the “legacy” Azure Service Bus transport. The legacy transport will receive only critical bug fixes and security patches from this point on. The wait is over!

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Engineering On-Demand Transportation for Business with Uber Central

Uber Engineering

When Uber launched in 2009, our mission was simple: make transportation as reliable as running water everywhere, for everyone. While our mission remains the same today, the number of Uber use cases have grown dramatically, motivating our engineers to think … The post Engineering On-Demand Transportation for Business with Uber Central appeared first on Uber Engineering Blog.

A new Azure Service Bus transport—but not just yet

Particular Software

Update : The new Azure Service Bus transport for.NET Standard is in preview and will be available soon. This makes it impossible for us to upgrade the NServiceBus Azure Service Bus transport you know and love to support.NET Core as is, and forces us to write a brand-new transport as well. The older WindowsAzure.ServiceBus client only supports the full.NET Framework, so there's no way our Azure Service Bus transport can support.NET Core using that.

How the Swedish Transport Agency learned distributed systems in six months

Particular Software

But the real reason for this post is to tell you about Martin Hägerås and Mattias Olgerfelt from the Swedish Transport Agency. For better or for worse, online education has become the most common (and in many cases, the only) way to learn these days. Schools and universities have had to adapt to a remote environment while companies such as Pluralsight have stepped up and offered online courses for free or at a discount.

WaI vs. WaP: NYC Subway Edition

J. Paul Reed

human-factors transportationJulian Dunn tweeted out this Vox longread on the New York City subways, and the myriad reasons the MTA can’t seem to make the system run on time. As an infrastructure nerd, I found it fascinating. But as a student of human factors, this bit also stood out to me: Four years later, signal failure caused one train to rear-end another on the Williamsburg Bridge , the fourth such collision in two years. The driver died, and several dozen passengers were injured.

Speed 40

Beam-Up Load Balancing: The Portable Next Generation App Experience

DZone

But, ah yes, the matter transporter. We’ve seen many of the technological advances described in the Star Trek milieu become reality over the last 50 years, from personal communication devices and instant translators to GMOs, medical robots, 3D printing and weapons that stun.

Uber Infrastructure in 2019: Improving Reliability, Driving Customer Satisfaction

Uber Engineering

Ready for changes with Hexagonal Architecture

The Netflix TechBlog

Outside of the business logic are the Data Sources and the Transport Layer: Data Sources are adapters to different storage implementations. Transport Layer can trigger an interactor to perform business logic. The most common transport layer for microservices is the HTTP API Layer and a set of controllers that handle requests. By having business logic extracted into interactors, we are not coupled to a particular transport layer or controller implementation.

Remote Debugging Java Applications With JDWP

DZone

The exact way of transporting the packets is not specified and is up to the implementation to define transport mechanisms. Most Java developers have had to debug their applications, usually to find and fix an issue there. In many cases, the application to debug (known as the “debuggee” ) is launched from within the IDE used by the developer, while the debugger is also integrated into the IDE, allowing easy inspection of the program state in a step-by-step manner.

Java 100

MSMQ is dead

Particular Software

The NServiceBus API gives you an abstraction away from the raw MSMQ API, making it quite a bit easier to transition to some other message transport than if you'd written directly against MSMQ to start with. The first thing you'll need to do is select an alternate message transport.

Exploring MySQL Binlog Server – Ripple

Scalegrid

164] Failed to connected to host: <Hosname>, port: 3306, err: Failed to connect: Connections using insecure transport are prohibited while --require_secure_transport=ON. MySQL does not limit the number of slaves that you can connect to the master server in a replication topology. However, as the number of slaves increases, they will have a toll on the master resources because the binary logs will need to be served to different slaves working at different speeds.

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

Uber is committed to delivering safer and more reliable transportation across our global markets. To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog.

Databook: Turning Big Data into Knowledge with Metadata at Uber

Uber Engineering

From driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data. Data powers Uber’s global marketplace, enabling more reliable and seamless user experiences across our products for riders, … The post Databook: Turning Big Data into Knowledge with Metadata at Uber appeared first on Uber Engineering Blog.

Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go

Uber Engineering

Cherami is a distributed, scalable, durable, and highly available message queue system we developed at Uber Engineering to transport asynchronous tasks. We named our task queue after a heroic carrier pigeon with the hope that this system would be just … The post Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go appeared first on Uber Engineering Blog. Architecture Open Source API Cassandra Cherami Distributed Systems Go Ringpop RocksDB TChannel Zookeeper

How Netflix brings safer and faster streaming experience to the living room on crowded networks…

The Netflix TechBlog

To achieve that, we are efficiently using ABR (adaptive bitrate streaming) for a better playback experience, DRM (Digital Right Management) to protect our service and TLS (Transport Layer Security) to protect customer privacy and to create a safer streaming experience. is the latest version of the Transport Layer Security protocol. How Netflix brings safer and faster streaming experience to the living room on crowded networks using TLS 1.3

Checksums in Storage Systems and Why the Enterprise Should Care

DZone

That data must then be safely transported over a network to the storage system where it is written to disk. Random bit flips are far more common than most people, even IT professionals, think. Surprisingly, the problem isn’t widely discussed, even though it is silently causing data corruption that can directly impact our jobs, our businesses, and our security.

Delta: A Data Synchronization and Enrichment Platform

The Netflix TechBlog

Data Pipeline using Delta In the following sections, we are going to describe the Delta-Connector that connects to a datastore and publishes CDC events to the Transport Layer, which is a real-time data transportation infrastructure routing CDC events to Kafka topics. Kafka & Transport Layer The transport layer of Delta events were built on top of the Messaging Service in our Keystone platform.

Edgar: Solving Mysteries Faster with Observability

The Netflix TechBlog

This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics).

Microsoft's new SQL client is here!

Particular Software

For NServiceBus users, we have a few packages that are affected: For the SQL Server Transport , we now have two separate packages: NServiceBus.SqlServer has been updated to version 6, and will continue to use the System.Data.SqlClient.

Stuff The Internet Says On Scalability For March 8th, 2019

High Scalability

There was already a transportation network called the US Postal Service, and Royal Mail, and Deutsche Post, all over the world, that could deliver our packages. Wake up! It's HighScalability time: A highly simplified diagram of serverless. ( @jbesw ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more.

Getting NServiceBus ready for the cloud

Particular Software

Cloud-ready message transport The first aspect we needed to upgrade was the old application’s use of MSMQ. However, we were able to access the cloud transport (the queue in Azure) from anywhere, including from this on-premises server.

Azure 52

Snap: a microkernel approach to host networking

The Morning Paper

I’m jumping ahead a bit here, but the component of Snap which provides the transport and communications stack is called Pony Express. Rather than reimplement TCP/IP or refactor an existing transport, we started Pony Express from scratch to innovate on more efficient interfaces, architecture, and protocol. Snap: a microkernel approach to host networking Marty et al., SOSP’19.

The Best Photo Carry-On: Pelican Air 1525 Hard Case

Website Optimization

Airplanes, especially smaller ones, are the most challenging for transporting photo equipment. As photographers, we're always looking for the best way to carry our gear when traveling. Checking your cameras and lenses, even in a hard case, increases the risk of damage or theft. Most photographers prefer packing their delicate optics into carry-on bags, and leaving tripods, lighting equipment, and other more robust equipment in checked baggage.

Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go

Uber Engineering

Cherami is a distributed, scalable, durable, and highly available message queue system we developed at Uber Engineering to transport asynchronous tasks. We named our task queue after a heroic carrier pigeon with the hope that this system would be just … The post Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go appeared first on Uber Engineering Blog. Architecture Open Source API Cassandra Cherami Distributed Systems Go Ringpop RocksDB TChannel Zookeeper

NServiceBus for.NET Core beta

Particular Software

On NuGet, you can now find beta packages for: NServiceBus RabbitMQ Transport SQL Server Transport SQL Persistence Many of our samples have also been updated to work with.NET Core. Update : NServiceBus 7 for.NET Core has been released. Today we're happy to announce that you can start building production-grade NServiceBus systems on.NET Core. Although the bits are currently marked as beta, a release candidate with a go-live license is coming soon.

Has Microsoft really changed?

Particular Software

When we were building the Azure Service Bus transport for.NET Core we got a chance to find out. Making zero-downtime deployment work for our new Azure Service Bus transport for.NET Core proved to be a bit of a challenge. The old transport still had two completely different ways to organize Azure topics and queues, called topologies. So, we decided to release one last version of the old transport that would include a migration feature. So we released the new transport.

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

In the push model paradigm, various platform tools such as the data transportation layer, reporting tools, and Presto will publish lineage events to a set of lineage related Kafka topics, therefore, making data ingestion relatively easy to scale improving scalability for the data lineage system. We are continuing to address the ingestion challenges by adopting a system level instrumentation approach for spark, other compute engines, and data transport tools.

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

The database is sending them to a transport that DBLog can consume. We use the term ‘ change log’ for that transport.

QUIC - Faster Content Delivery on Layer 4

KeyCDN

After HTTP/2 has fulfilled its task of speeding up HTTP(S) and has become the basis for fast TLS connections, QUIC goes one step further by aiming to replace the TCP transport protocol in the Internet. QUIC - the next level of acceleration on the transport layer. After HTTP/2, coming up next is QUIC (Quick UDP Internet Connections). Google has been working for quite some time to speed up its network protocols in order to minimize website response times.

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

The database is sending them to a transport that DBLog can consume. We use the term ‘ change log’ for that transport.

Need for Speed: Cubic’s Journey with Tasktop Viz and Flow Metrics

Tasktop

It’s why the company has racked up so many industry firsts across transportation, defense and beyond. “I feel the need — the need for speed” – Peter “Maverick” Mitchell . Just like the sky-soaring heroes of Top Gun, Cubic has only one speed — fast.

Speed 52

Transforming enterprise integration with reactive streams

O'Reilly Software

Let’s also create a Transport [11] enumeration so we can easily instruct the main method where we want to read our orders from, and where we want to produce our invoices to. enum Transport {. As arguments, the invoker will have to specify which transport is going to be used from the input, as well as the output, of the program. inputTransport == Transport. fromFile : ( inputTransport == Transport. fromJms : ( inputTransport == Transport.

Commute Challenge 2018

Randon ASCII

Day 7: June (videographer and Kirkland’s Transportation Strategic Advisor). I’ll bet I had more fun commuting during September 2018 than you did. In April 2017 I gave myself the challenge of commuting to work using a different method every workday for a month – twenty ways in twenty days! The write up and video are here. It was great fun and it also served as a joyous celebration of the many ways to make commuting more fun than sitting alone in traffic.

Why I hate MPI (from a performance analysis perspective)

John McCalpin

This will typically include environment variables that can influence the behavior of the MPI runtime, and might include environment variables that can influence the behavior of the lower-level shared-memory transport and/or network hardware interfaces. MPI runtime libraries are typically built to interact with one or more lower-level interfaces to shared-memory transport implementation(s) and networking hardware. The processor hardware available to support shared-memory transport.

Let's Encrypt: an automated certificate authority to encrypt the entire web

The Morning Paper

We hope that in the near future, clients will start using HTTPS as the default web transport. Let’s encrypt: an automated certificate authority to encrypt the entire web , Aas et al., CCS’19.

Distributed tracing with W3C Trace Context for improved end-to-end visibility (EAP)

Dynatrace

These headers aren’t always transported by third-party components such as middleware, which can result in broken transactions. Dynatrace news. What is distributed tracing? Distributed tracing is used to understand control flow within distributed systems. Especially in dynamic microservices architectures, distributed tracing is an essential component of efficient monitoring, application optimization, debugging, and troubleshooting.

Azure 151

NServiceBus on.NET Core - It's time

Particular Software

This initial release will include.NET Core compatible versions of the RabbitMQ transport and SQL persistence. Update : NServiceBus 7 for.NET Core has been released. During Build 2017, Microsoft released.NET Core 2.0 Preview 1. While we previously determined it was too early to seriously consider adopting.NET Core, with this release we now believe that the current platform can support a comprehensive, reliable, and production-ready version of NServiceBus. As a result, we are happy to say.

Evolution of Netflix Conductor:

The Netflix TechBlog

This addition also provides the option to use the Elasticsearch RestClient instead of the Transport Client which was enforced in the previous version. and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. If you’re new to Conductor, this earlier blogpost and the documentation should help you get started and acclimatized to Conductor.

Lambda 164

The new MongoDB support for NServiceBus

Particular Software

The package supports sagas, subscriptions, and the outbox for all message transports. If you're using (or considering) MongoDB with NServiceBus, we've got good news: we've just released our official MongoDB persister. This replaces the previous community-created (but now abandoned) MongoDB persistence options and is now a fully supported part of the Particular Service Platform. As NoSQL databases have gained in popularity, MongoDB has emerged as one of the go-to choices in the field.

From Integrated Pipelines to Value Stream Management

Tasktop

An essential component of Tasktop Hub , the Flow Fabric is the data transportation backbone between data siloes. The memory of meeting Tasktop CEO, Dr. Mik Kersten, is eternally sketched into my mind. It was just after I had given my talk at the initial Gene Kim DevOps Enterprise Summit in San Francisco in 2014. During the talk, I had mentioned that Tasktop played an integral role in connecting information across our toolchain to enhance visibility and flow.

Experimenting with the Streams API

Dean Hume

I totally agree with you, but NDJSON is needed because there is currently no standard for transporting instances of JSON text within a stream protocol. I am always looking for ways to build faster, slicker web pages. Where applicable, I’ll use great new browser features such as service workers, HTTP/2 and improved compression, just to name a few. But what if I told you there was a way to build even faster web pages? I’d like to introduce you to the Streams API.

RPCValet: NI-driven tail-aware balancing of µs-scale RPCs

The Morning Paper

It’s designed for “ emerging architectures featuring fully integrated NIs and hardware-terminated transport protocols.” RPCValet: NI-driven tail-aware balancing of µs-scale RPCs Daglis et al., ASPLOS’19. Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager.