RabbitMQ Summit 2021

Building distributed system for retail with RabbitMQ | Maryna Zhygadlo | RabbitMQ Summit 21 - Software Developer @ Diebold Nixdorf ABSTRACT This talk is devoted to the real distributed system in retail that has been running on production for 3 years with RabbitMQ cluster in cloud and around 900 nodes on-premises. There will be presented an evolution from a proof of concept to a rollout on the field in numbers and graphs. It introduces the approaches on how to tune RabbitMq through its configuration and different plugins (e.g. federation and shovel). • Timecodes 00:00 - 05:35 - Introduction 05:36 - 08:01 - What are the use cases? 08:02 - 13:48 - What is under the hood? 13:47 - 18:01 - System in numbers 18:02 - 23:06 - Cloud cluster 23:07 - 31:59 - QnA • See & download slides: https://docs.google.com/presentation/d/1tiDs9uV2HfrX_Q1PiXuZDGya7XlMFWgM/edit?usp=sharing&ouid=108127681042389591021&rtpof=true&sd=true • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Bringing a Ferrari to a Horse Race: Going From Background Jobs to Event-Driven Microservices with RabbitMQ | Sophie DeBenedetto & Steven Nunez Software Engineers @Github ABSTRACT RabbitMQ is capable of handling millions of messages per second, running clustered for high availability setups, and has clients in every language around. So, how about we use it to process just a few background jobs? In this talk, learn about how introducing RabbitMQ for background jobs led us to an explosion of microservices and the creation of a messaging framework that changed and grew alongside our business. We'll share lessons learned from managing and scaling RabbitMQ as a background job orchestrator, tell you how RabbitMQ empowered us to move away from a legacy monolith and towards an event-driven, distributed system, and sell you on RabbitMQ (along with another citizen of the BEAM, Elixir) as the backbone for a robust, performant, scalable and maintainable event-driven system. • See & download slides: https://drive.google.com/file/d/1_GD6ZAUcW0T0D0ihp6jtPpIdxAjtonto/view • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

ABSTRACT RabbitMQ is driving an effort to implement a log-type data structure, with stream support on top of the AMQP 0-9-1 protocol and a new blazing fast protocol created for the occasion. Streams unlock scenarios that could have been tedious to implement in the old days of RabbitMQ: large fan-outs, replay & time travel, large logs, very high throughput (1 million messages per second on a 3-node cluster). • See & download slides: https://drive.google.com/file/d/12q0wUSNcbgsTbO0QbDBqgRUtlbu2ln5V/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

RabbitMQ continues to be the most widely deployed open source message broker, used by over 35,000 companies worldwide. Don't miss out on your chance to hear the case studies, success stories and RabbitMQ development strategies from the leading people behind the development and support of RabbitMQ.

Fireside chat session on client libraries with Gavin Roy; Michael Klishin; Carl Hörberg hosted by John Samuel ABSTRACT With over 70 clients on the RabbitMQ website there are a vast array of client libraries to choose from. We get our fireside guests to explore aspects of this ever expanding client side universe. --- PANELISTS Gavin Roy - Chief Technology Officer, AWeber. Gavin M. Roy has over 25 years of experience in the Internet industry as a CTO, CIO, VP of Architecture and technology leader. Gavin is the author of RabbitMQ in Depth (ISBN 1617291005) and currently the VP of Architecture at AWeber Communications. Michael Klishin - Senior Principal Software Engineer at VMware. Michael is a long time RabbitMQ contributor and distributed systems enthusiast. Carl Hörberg - CEO and founder, CloudAMQP 84 Codes. --- RabbitMQ Summit Twitter: https://twitter.com/RabbitMQSummit

Panel discussion: The new RabbitMQ Streams with Arnaud Cogoluègnes; Diana Parra Corbacho; Karl Nilsson; Gabor Olah hosted by Ayanda Dude ABSTRACT A panel discussion with experts run by Ayanda Dube to answer questions, such as: - What are RabbitMQ Stream Queues? - What are the key new features and functionality which they introduce for RabbitMQ users? - How do Stream Queues compare to Classic Queues? - How do Stream Queues compare to Quorum Queues? - A new binary protocol implies new client libraries. What's the current state of Streams client libraries? - How soon can we expect full Streams support for all (or most popular) client libraries? - How does performance (throughput) compare to other queue types? and many more... PANELISTS: Arnaud Cogoluègnes - Staff Engineer, VMware Diana Parra Corbacho - Staff Software Engineer, VMware Gabor Olah - Developer, Erlang Solutions Karl Nilsson - Senior Member Of Technical Staff, VMware

RabbitMQ has a problem. Let us tell you about it | David Ansari & Gerhard Lazu - Software Engineers @ VMware ABSTRACT RabbitMQ exposes a wealth of metrics, logs, and events, and has decent dashboards. However, we know that users only look at dashboards when there is a problem. Wouldn't it be great if RabbitMQ notified you when there is a problem in the making? How about a run book on how to fix that specific problem? Imagine if some problems could even be fixed automatically. Let us show you what we have so far, and the direction that we are going towards. • Timecodes 00:00 - 02:10 - Introduction 02:11 - 10:29 - Demo: I know nothing. What do I do? 10:30 - 16:10 - 2nd Problem 16:11 - 17:22 - Potential Fix 17:23 - 18:59 - Our Fix to the Problem 19:00 - 23:54 - Past Problems 23:55 - 25:28 - Summary 25:29 - 29:49 - RabbitMQ 3.9 29:50 - 37:01 - QnA • See & download slides: https://drive.google.com/file/d/1wdz4-Y-S5eC-q5FtrQwQbsjtgflxseE-/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit LinkedIn: https://www.linkedin.com/company/code-sync/ • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global

Update from Rabbit Core Team | Ed Byford, Yaron Parasol, Michal Kuratczyk ABSTRACT Curious about what the RabbitMQ team has been up to since 3.8.16 shipped in May 2021? In this talk we will cover what's coming in next releases. • Timecodes 00:00 - 00:44 - Introduction 00:45 - 04:42 - RabbitMQ Offerings 04:43 - 07:49 - Industry Themes 07:50 - 09:33 - Scalability 09:34 - 10:33 - Streams - Upcoming 10:34 - 11:20 - Classic Queues - Work in Progress 11:21 - 11:43 - Quorum Queues - Work in Progress 11:44 - 13:29 - Observability 13:30 - 15:37 - Resiliency 15:38 - 16:25 - Development Experience 16:26 - 19:17 - Tanzu RabbitMQ Updates 19:18 - 20:41 - Tanzu RabbitMQ Ease of Use 20:42 - 21:22 - Tanzu RabbitMQ Scalability - Coming 21:23 - 22:20 - Tanzu RabbitMQ from VMs (for TAS) 22:21 - 24:38 - Team Update 24:39 - 30:24 - QnA • See & download slides: https://drive.google.com/file/d/1qw48YsRi-1x6UhkmMMmlWhOTVYvlTDr2/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Varonis journey deploying RabbitMQ for on premise customers - making sure that RabbitMQ keeps working | Ophir Ziskind - Software Engineer @ Varonis ABSTRACT Key Topics of this talk: Storage Exchange - How we made RabbitMQ capable of storing large amount of persistent messages with improved performance but less boot time and less memory usage. Packing Exchange - How we improved our messaging throughput by utilizing compression and packing of messages. Capping Exchange - How we minimized message loss by creating a custom exchange that manages the limits of the queues that are bound to it. Watchdog Plugin - How we monitor RabbitMQ and fix issues during runtime. • Timecodes 00:00 - 02:55 - Introduction 02:56 - 04:56 - We are not the Common Use Case 04:57 - 05:46 - Who we are 05:47 - 07:26 - Goal #1 - Supporting High Throughput & Less Network Usage 07:27 - 10:41 - Packing Exchange More Throughput and Less Network Usage 10:42 - 14:39 - Goal #2 - Resiliency to Slow/ Stopped Consumers 14:40 - 20:04 - Storage Exchange - Resiliency to Consumer Down-Time 20:05 - 23:59 - Storage Exchange - Why not Store in RabbitMQ? 24:00 - 26:35 - Resiliency to Consumer Down-Time Method #2 26:36 - 28:08 - Goal #3 - Guarding RabbitMQ 28:09 - 29:58 - Watchdog Pluggin, Monitoring RabbitMQ 29:59 - 34:39 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Building Scalable Resilient IoT Messaging | Gregory Green & Demetrious Robinson - Advisor Solution Engineer @ VMware & Member Of Technical Staff II @ VMware ABSTRACT The session will illustrate how to build scalable and resilient IoT messaging solutions. This session will include a demonstration of microservice-based applications that utilize RabbitMQ for Reliable messaging and High throughput. • Timecodes 00:00 - 06:39 - Introduction - General problems 06:40 - 16:20 - Demo - Part 1 16:21 - 18:39 - Internet of Things 18:40 - 29:18 - Demo - Edge 29:19 - 32:11 - Messaging Streaming 32:12 - 38:26 - Demo - Streaming 38:27 - 40:22 - QnA • See & download slides: https://drive.google.com/file/d/13gTL... • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?la... LinkedIn: https://www.linkedin.com/company/2715... • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47e...

How we built at Vonage a scalable multichannel notification system | Ori Shofman Shimoni - Technical Manager @ Vonage ABSTRACT In the past year and a half, we've built here at Vonage, a complex notification system based on RabbitMQ which is used today for most of the notifications our services send to our client side applications. We would like to share our story in which we - Designed a system architecture with a complex sharding solution & low to zero downtime, faced many issues with the way we used RabbitMQ and creative solutions we found to surpass our issues, and provided a flexible notification infrastructure. • Timecodes 00:00 - 02:25 - Introduction 02:26 - 04:02 - What do we do at Vonage? 04:03 - 10:30 - Messaging Bus 10:31 - 10:55 - Locust io 10:56 - 18:53 - Types of load tests 18:54 - 22:52 - Ios 13 22:53 - 24:48 - Taking a bus ride with Shredder 25:49 - 33:30 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit LinkedIn: https://www.linkedin.com/company/code-sync/ • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global

Migrating from Kafka to RabbitMQ at SimpleBet: Why and How | David Lucia - VP, Engineering @ SimpleBet. ABSTRACT At Simplebet, we are striving to make every moment of every sporting event a betting opportunity. In doing so, we initially chose Kafka to deliver market updates. The result was a setup which was difficult and expensive to maintain, and non-trivial for our customers to integrate with. After researching other delivery mechanisms, we migrated to RabbitMQ, as it provided us with a low-cost, low-latency alternative that satisfied our business needs. Best of all, it provided a familiar, standards-based means of integration for our customers with superior flexibility to what Kafka offers. In this talk, we will cover the technical and business reasons for why RabbitMQ has proven itself to be a great platform for building a B2B SaaS product, how it compares to other tools on the market, and where it excels in flexibility for our customers. • Timecodes 00:00 - 04:00 - Introduction 04:01 - 04:51 - The first steps at Simplebet and the problem 04:52 - 05:42 - Serving Odds 05:43 - 06:24 - Market Publishing Requirements 06:25 - 15:22 - Kafka 15:23 - 16:28 - Re-evaluating our Integration 16:29 - 26:55 - RabbitMQ enters the picture 26:56 - 35:00 - QnA • See & download slides: https://davydog187.github.io/migrating_from_kafka/ • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Stream processing IoT time series data with RabbitMQ & InfluxDB | Samantha Wang - Product Manager @ InfluxData ABSTRACT In this session, Samantha Wang, Product Manager at InfluxData will showcase how to stream time series data to your IoT application using RabbitMQ queues and InfluxDB, drawing upon deployments done at Cisco, IBM, PayPal, and Tesla that allow both to ingest 1 million metrics per second. • Timecodes 00:00 - 04:08 - What is Time Series Data? 04:09 - 10:45 - What is Time Series Database? 10:46 - 14:56 - Time-series Use Cases? 14:57 - 21:29 - Simple IoT Solutions 21:30 - 28:20 - Demo 28:21 - 30:11 - Summary 30:12 - 34:09 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

101 ways to break your RabbitMQ | Denis Germain - Senior SRE @ Deezer ABSTRACT 3 years ago, the company I worked for decided to start again, from scratch. Instead of on-prem softwares, we started to develop dozens of cloud based microservices communicating with each other AND on-prem cutting equipments. And which tool better to do this than RabbitMQ? But of course, deploying highly available message brokers in a cloud based environment with no prior experience has brought its share of surprises. In this talk, I'll share with you some of the rookie mistakes that we may or may not have made • Timecodes 00:00 - 02:16 - Introduction 02:17 - 13:30 - Let's brake RabbitMQ 13:31 - 13:51 - RabbitMQ Usage 13:52 - 16:40 - Security 16:41 - 17:46 - new connections love TCP packets 17:47 - 18:42 - Connections / Channels 18:43 - 23:22 - Prefetch 23:23 - 25:27 - Observe 25:28 - 26:19 - Conclusion 26:20 - 39:23 - QnA • See & download slides: https://drive.google.com/file/d/1TPLQCgv2pC6_Ybr0fvLLRM49qUWAIwph/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Handle different RabbitMQ clusters in Kubernetes with Traefik | Gabriele Santomaggio - Staff Software Engineer @ VMware ABSTRACT Traefik is one of the most popular service mesh, the 2.x version supports TCP TLS. In this session, we will see how to use SNI to expose different RabbitMQ clusters in Kubernetes using a single public IP address in a secure way. • Timecodes 00:00 - 04:36 - Introduction 04:37 - 05:45 - What is Traefik? 05:45 - 07:44 - What is SNI? 07:45 - 10:50 - Access through Proxy 10:51 - 21:52 - Demo 21:53 - 28:09 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

War stories from the CloudAMQP support | Annie Blomgren & Johan Rhodin - Technical Support Engineer @ CloudAMQP 84 Codesb & Chief Customer Officer @ CloudAMQP 84Codes ABSTRACT In CloudAMQP we handle more than 3000 support cases per year. In this talk we go through what the most common issues are, and what can be learned from them, as well as some rare issues that can be hard to track down. We also cover some statistics of RabbitMQ clients and their usage. • Timecodes 00:00 - 03:07 - Introduction 03:06 - 05:56 - My messages are lost 05:57 - 07:59 - I keel loosing my messages 08:00 - 10:37 - My Quorum Queues took all my memory 10:36 - 11:48 - Does it affect consumption? 11:49 - 13:20 - My RabbitMQ MQTT server is running out of memory 13:21 - 18:46 - What is using all that RAM? 18:47 - 22:17 - Some ETS tables are slowly eating my memory 22:18 - 26:36 - Statistics update 26:37 - 41:16 - QnA • See & download slides: https://drive.google.com/file/d/10MaBK_P2XzMZ3wr7nJtXeWPoFfJRrI9A/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Proxying Rabbits For Stability & Reliability | Adam Casey - Senior Software Engineers @ GitHub ABSTRACT The Systems Data Distribution Engineering team at Bloomberg provides a reliable and maintainable RabbitMQ as a Service platform to the company's 6,500+ software engineers. This talk will introduce amqpprox, our AMQP 0.9.1 proxy. We will dive deep into how it works and how we use it to tackle problems such as Load Balancing & Broker Upgrades. • Timecodes 00:00 - 04:50 - Quick intro to Bloomberg 04:51 - 07:02 - Why do we need a proxy? 07:03 - 11:05 - Introducing amqpprox 11:06 - 23:12 - What does amqpprox give us? 23:31 - 17:46 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Take The Path Of Least Resistance For Your Test Data | Zach Attas - Lead SDET @ ReviewTrackers ABSTRACT Great E2E tests have realistic, unique data, but when a test depends on multiple systems’ databases for its data, this becomes challenging. Sure, you can use a script to insert data into each separate system’s DB. But great E2E tests take advantage of RabbitMQ messaging to get data in place in the same way that would occur in production. This talk covers architecting E2E tests to use implicit waits, to adapt to an event-driven RabbitMQ world! With tests like these, unforeseen, deployment-halting bugs can be found, and you can have confidence in the natural flow of data into your systems under test! • Timecodes 00:00 - 02:30 - Introduction 05:36 - 07:35 - What is Review Trackers? 08:02 - 11:35 - How data moves around in production?? 13:47 - 21:41 - How to utilize this system to move around data tests 18:02 - 33:45 - Other great uses of RabbitMQ for tests 23:07 - 38:02 - QnA • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

An introduction to Rejected, a Consumer Framework | Gavin Roy - Chief Technology Officer @ AWeber ABSTRACT Rejected is an open-source RabbitMQ consumer framework that makes writing and testing Python based consumers easy. In this talk you will learn what makes rejected different, why your organization should use it, and review real world examples of its use. • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw

Khepri - Mnesia replacement | Michael Klishin - Senior Software Engineers @ GitHub ABSTRACT In this talk we will cover recent developments around the next generation schema data store that RabbitMQ plans to adopt. The talk will be most relevant to RabbitMQ operators and those interested about how things work under the hood. • Timecodes 00:00 - 02:00 - Intro 02:01 - 04:21 - Schema storage in RabbitMQ 04:22 - 07:18 - Mnevis 07:19 - 08:09 - A different approach. Something that would not... 08:10 - 20:06 - Meet Khepri 20:07 - 22:55 - Kubernetes 22:56 - 39:34 - QnA • See & download slides: https://drive.google.com/file/d/1UA45AhmTzJbdMFiu-1uFwPWj8LcQ2QCI/view?usp=sharing • Follow us on social: Twitter: https://twitter.com/rabbitmqsummit?lang=en LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw