Conf42 Kube Native 2022

Conf42 Kube Native is going live! Schedule, Lineup & RSVP: https://www.conf42.com/kubenative2022 Join Discord to interact: https://discord.gg/DnyHgrC7jC 0:00 intro, sponsors keynote 0:45 Arsh Sharma getting started 1:19 Rob Richardson 1:40 Abhishek Gupta 2:37 Tim Spann security 3:12 Jose Manuel Ortega 3:46 Matt Williams 4:28 Ole Lensmar deep dive 5:03 Twinkll Sisodia 5:48 Trista Pan 6:33 Shahar Azulay 7:10 Utibeabasi Umanah lessons learned 7:40 Megha Kadur 8:55 David Joyce 9:45 Thank you, Join our Discord to interact! https://discord.gg/DnyHgrC7jC

Containerization made us realize that it made more sense to break our monolithic applications into a bunch of smaller microservices that interacted with each other. We changed how we deploy our applications and architect our applications, but we STILL had developers continuing to write code using the same old tools they did before. This introduced frictions in the development process: - developers had to spend a lot of time configuring things before they could get to the ""code writing"" phase - being able to accurately mimic the production setup during development became almost impossible - the feedback loop became very slow due to CI pipelines and staging environments being the only way to be able to test changes in a production setup This talk will go into the details of these problems and analyze how they lead to a bad developer experience when working on microservices-based applications. After discussing these problems, the talk will also go over the current attempts we as an industry are making to solve these issues and make lives easier for developers. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

Now that the app is running in Kubernetes, how do we scale it to meet demand? What metric should we use? CPU? Requests? something else? Let's dig into why we auto-scale, and how we auto-scale with lots of examples. Finally we'll look at potential pitfalls and gotchas like how to scale to 0 and how to avoid scaling too big for your budget. Come learn how to scale with Kubernetes. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

The combination of Containers and Kubernetes has emerged as a de-facto standard for packaging, deploying and orchestrating applications. But the (harsh?) reality is that Kubernetes app development workflows and specifications are dominated by YAML config which become harder to manage and maintain over time. Solutions such as Helm, Kustomize etc. help relieve some of the pain, but at the end of the day, they too are YAML-centric. What if you could just write Go code to define Kubernetes applications? Well, cdk8s (short form for Cloud Development Kit for Kubernetes) is an open-source CNCF project that allows developers to build ""reusable abstractions using familiar programming languages and rich object-oriented APIs"" This talk will provide an overview of cdk8s and it's workflow, how to define your first cdk8s application and building reusable components called ""constructs"". You will also see ""cdk8s in action"" with some live-coding and demos! All of this will be done using Go, which has first-class support in cdk8s. The attendees can expect to walk away with: 1. Understanding the concept of ""Infrastructure-Is-Code"" in the context of Kubernetes 2. How to leverage Go for writing infrastructure code for Kubernetes based applications 3. Learn about an end-to-end scenario of how to practically use cdk8s to define and deploy apps to a Kubernetes cluster Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

I will get you started with real-time cloud native streaming programming with Java, Golang, Python and Apache NiFi. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

In this talk I will show how to save secret keys in Docker containers and K8s in production and best practices for saving and securing distribution of secrets. With Docker and k8s secrets we can manage information related to keys that are needed at runtime but cannot be exposed in the Docker image or source code repository. These could be the main talking points: 1.Challenges of security and secret keys in containers 2.Best practices for saving and securing distribution of secrets in Docker Containers 3.Managing secrets in Kubernetes using volumes and sealed-secrets 4.Other tools for distributing secrets in containers like Hashicorp Vault and KeyWhiz Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

Users. Roles. Single-sign on. These are enterprise features. I don’t need them in my homelab, right? Everyone’s homelab is different and the reasons for building one are just as different. No matter why you built it, everyone should always be thinking least privilege. The problem is that least privilege, especially with Kubernetes, is hard. It doesn’t have to be. In this talk you will see what can happen when you don’t implement least privilege, how to configure roles, and how to use them. We will look at how to do this with a number of tools and end with a quick look at doing everything with Infra which is 100% open source. You will leave the session with actionable next steps to get single sign on up and running in minutes at home using only open source tools. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

In a clear “how-to” tutorial, learn what’s needed for Development and DevOps teams to work together to manage Kubernetes configuration tasks at scale ensuring better overall productivity and deployment success the first time by leveraging open-source projects to accomplish the following tasks in an easy, straightforward way: - Identify & fix validation errors immediately - Provide a quick overview of k8s resources and their relationships - Debug & validate the output of Kustomize and Helm - Find & fix configuration errors. Diff local vs remote resources vs clusters before deployment - Leverage easy-to-use editors and templates to ensure best practices, security & consistency across Dev and DevOps teams Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

During my presentation, I will go into detail about why monitoring is important and how it enhances the infrastructure workflow. This talk will also explore why sometimes monitoring becomes challenging in the Kubernetes world. We’ll also explore how can we implement Prometheus, Alertmanager - an open source monitoring system and Grafana - an open source analytics platform in our clusters. You’ll leave this talk with a better understanding of how can a Kubernetes cluster be made more powerful by adding monitoring tools within it. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

Although RDS allows you to quickly create a database cluster on the cloud, efficiently distributed OLTP (Online Transaction Processing) queries or elastic computing remain a challenge. How to load balance and manage data traffic between apps and databases, to deliver optimal user experience while maintaining query cost awareness? How to SQL audit or block list apps’ visits? This talk will focus on providing you with a solution for elastic and secure OLTP cloud computing with your MySQL, PostgreSQL, SQLServer, and Oracle database. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

Gaining affordable, in-depth insights is always the first observability task of engineering teams. When you take a conventional, monolith-friendly monitoring architecture and try to graft it onto a distributed, cloud-native app problems arise - you can no longer have both.Centralized architectures, where raw data is being trucked all the way to the observability provider before being digested for insights (such as metrics), have started to weigh heavy on their teams - usually by way of immense burdening costs. Suddenly to get the desired logs, metrics and traces, teams had loads more data to collect, since a monolithic single app now gave way to a complex array of microservices. A new breed of observability architectures are out there and it’s time we all get acquainted. These architectures collect and digest raw data in a distributed manner, where the data actually lies. They break the link between the data volume monitored and the volume of data being sent, handled, and stored to support in-depth monitoring insights - reducing costs, network usage and irrelevant data collection. We’ll delve into a real life  implementation of such an approach, showing how it can redefine modern observability today, and allow sustainable scale in the future. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

Have you ever modified something in your Kubernetes cluster and forgotten about it? Yeah, happens to the best of us. GitOps practices help to eliminate some of these challenges as all the configuration is stored in Git....in other words, Git is the single source of truth. In this talk, we will take a brief look at GitOps and ArgoCD and what they can do for you as a Cloud Engineer Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

A story about a girl, who moved to Bengaluru to explore her career. That landed her into DevOps world. Yes, that’s me. I started as electronics engineer where I was managing an entire production floor that manufactures electronics product. With no prior experience in IT firm, I quit my current electronics job and started discovering options to join IT firm. That’s when I got to know about DevOps world that made me curious and wanted to know more about this world and how it actually works. I started searching about DevOps lifecycle, slowly I got to know about various DevOps tools that are used. My talk is all about my journey towards DevOps. Also I would like to share some insights on things to know before starting your DevOps career. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk

At Spectrum Labs, our deep learning models are trained and validated against large data sets that can only be processed in a distributed manner. Data Scientists require the ability to invoke batch jobs as part of the the model development lifecycle, and these jobs must run in a scalable, fault-tolerant manner. Argo Workflows is chosen as our data pipeline framework as it provides a container-native workflow engine that allows us to build on our existing Kubernetes deployment. We use Apache Spark as our distributed processing engine, which we deploy and manage ourselves on Kubernetes. The integration of these 2 technologies provides us with a batch job framework to meet our Data Scientists needs. In this session, we will provide an overview of Argo Workflows and how we use it within Spectrum Labs to execute Spark jobs that process datasets that contain over 100 million records. We will demo our current pipelines and describe how we have built a framework that allows us to deploy a scalable Spark application with only a few lines of configuration. We will also provide an overview of Argo Events which allows us to orchestrate our pipelines in an automated manner. Lastly, we will discuss some of the advantages and challenges of using the Argo framework. Other talks at this conference 🚀🪐 https://www.conf42.com/kubenative2022 — 0:00 Intro 0:22 Talk