Observability across serverless asynchronous managed services | Aviad Mor | Conf42 Cloud Native 2021
Aviad Mor CTO @ Lumigo While applying distributed tracing on your own code is relatively simple, the real challenge is how to trace a full transaction across services. In this session, we'll understand the technical challenges gaining observability with managed services and see together how we can solve them. Serverless computing transactions are a combination of owned code (like AWS Lambda) and managed services (Like SNS, SQS, EventBridge, DynamoDB and more). Applying distributed tracing on your own code through instrumentation is relatively simple (though require a lot of work). The challenge lays with the managed service, how to trace a full transaction across services like queues, streams, and databases. In this session we will discuss: - The technical challenges gaining observability with managed services. - Methods to build the full trail of transactions across managed services. - Ideas on how to obtain observability in a highly async distributed world. - We’ll technically drill down to some managed services examples. Let’s have an async observability discussion, to be continued on Discord. — 00:00 Intro 00:40 Preamble 01:00 Agenda 01:35 Who am I? 02:19 Serverless Changes Everything 02:32 Serverless Components 03:46 Serverless Impact 05:28 Serverless Challenges 06:22 Async Patterns 07:21 Troubleshooting Serverless 07:47 Severity 11:04 Debug 12:52 Solutions 13:02 Option 1 Cloudwatch & Friends 14:12 Option 2 Homebrewed Solutions 18:10 Option 3 Serverless Monitoring Solutions 19:37 Medtronic & Lumigo - Backtrace chain of async events 21:40 Pinpoint 1 invocation out of 1B 22:06 Optimize 22:33 Track deploy effects 23:11 Takeaways 24:00 Thank you! — 🥇 Gold Sponsors: Chaos Native Fugue Honeycomb.io StackPulse Teleport 🥈 Silver Sponsors: 7bulls.com Aerospike Alwaysdata Aspecto bxblue Capgemini CircleCi Container Solutions CloudSkiff Earthly Hazelcast Imply Lightrun Logz.io Lumigo MongoDB Nuaware Qwinix Zeti 🤝 Media Partners: AWS Inside Dev Manning — Website 🚀🪐 https://www.conf42.com Reach Out 📧📭 mark@conf42.com Discord Server 🧑🤝🧑💬 https://discord.com/invite/dT6ZsFJ5ZM LinkedIn 👨💼💼 https://www.linkedin.com/company/4911... Twitter 🎵🐦https://twitter.com/conf42com Conf42Cast 🎧 http://www.conf42.com/podcast