Skip to main content
Backend, Data / ML, Engineering

Introducing uGroup: Uber’s Consumer Management Framework

October 21, 2021 / Global
Featured image for Introducing uGroup: Uber’s Consumer Management Framework
Figure 1. uGroup Service Deployment
Figure 2. uGroup Service High Level Architecture
Figure 3. Streaming Job Internal
Figure 4. Observability Module Internal
Qichao Chu

Qichao Chu

Qichao Chu is a Senior Software Engineer on Uber’s Streaming Data Team. He has been working on highly available, fault resilient streaming systems, including Kafka Consumer Proxy and Uber internal Kafka client libraries.

Yupeng Fu

Yupeng Fu

Yupeng Fu is a Principal Software Engineer on Uber’s Data team. He leads several streaming teams building scalable, reliable, and performant streaming solutions. Yupeng is an Apache Pinot committer.

Mingmin Chen

Mingmin Chen

Mingmin Chen is a Director of Engineering and head of the Data Infrastructure Engineering team at Uber. He has been leading the team to build and operate Hadoop data lake to power multiple Exabytes of data in storage, Kafka infrastructure to power tens of trillions messages per day, and compute infrastructure to power hundreds of thousands compute jobs per day. His team builds highly scalable, highly reliable yet efficient data infrastructure with innovative ideas while leveraging many open-source technologies such as Hadoop (HDFS/YARN), Hudi, Kafka, Spark, Flink, Zookeeper etc.

Haitao Zhang

Haitao Zhang

Haitao Zhang is a former Software Engineer on Uber’s Streaming Data Team. He has worked on projects and tools to improve the user experience of Kafka as a reliable and scalable async message queue, as well as improve monitoring and alerting of Kafka ecosystem.

Xiaoman Dong

Xiaoman Dong

Xiaoman Dong is a former Senior Software Engineer on Uber’s Streaming Data Team. He has worked on projects to provide improved monitoring and alerting of the Kafka ecosystem.

Posted by Qichao Chu, Yupeng Fu, Mingmin Chen, Haitao Zhang, Xiaoman Dong