In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Christian Posta - VP and Global Field CTO at Solo.io about all things Service Mesh. They discuss how things have evolved from the early Linkerd days to sidecar less istio service mesh implementations. They also talk about how service mesh can help you connect to application components running outside Kubernetes, and how developers and platform engineers have a shared responsibility model when it comes to implementing service mesh using internal developer platforms.

Check out our website at https://kubernetesbytes.com/

Episode Sponsor: Nethopper
Learn more about KAOPS: @nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now! https://mynethopper.com/auth

Cloud Native News:

• https://loft.sh/blog/our-24m-series-a-led-by-khosla-ventures/
• https://www.harness.io/blog/celebrating-150m-in-new-financing-to-accelerate-innovation
• https://www.akamai.com/newsroom/press-release/akamai-announces-intent-to-acquire-api-security-company-noname
• https://www.linkedin.com/posts/rouvenbesters_its-official-the-otomi-platform-has-activity-7194604616901120000-48g7?utm_source=share&utm_medium=member_desktop
• https://www.wiz.io/blog/celebrating-our-1-billion-funding-round-and-12-billion-valuation

Show Links:

• https://devsummit.infoq.com/conference/boston2024
• https://www.solo.io/topics/cakes-stack/
• https://www.solo.io/

Timestamps:

• 00:06:10 Cloud Native News
• 00:15:37 Interview with Torsten
• 01:01:58 Key takeaways

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications.

Check out our website at https://kubernetesbytes.com/

Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code “KUBERNETESBYTES” to get a 10% discount on your registration fees!

Episode Sponsor: Nethopper

• Learn more about KAOPS: @nethopper.io
• For a supported-demo: info@nethopper.io
• Try the free version of KAOPS now!
• https://mynethopper.com/auth

Cloud Native News:

• https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/
• https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud
• https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/
• https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html
• https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release
• https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/

Show Links:

• https://www.enterprisedb.com/news/edb-acquires-splitgraph
• https://www.enterprisedb.com/resources/events
• https://www.enterprisedb.com/

Timestamps:

• 00:03:22 Cloud Native News
• 00:17:45 Interview with Torsten
• 00:57:00 Key takeaways

Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.

Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code “KUBERNETESBYTES” to get a 10% discount on your registration fees!

Nethopper

• Learn more about KAOPS: @nethopper.io
• For a supported-demo: info@nethopper.io
• Try the free version of KAOPS now! https://mynethopper.com/auth

News

• https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
• https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
• https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
• https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
• https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
• https://www.observeinc.com/blog/stepping-on-the-gas/
• https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
• https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
• https://www.suse.com/c/meet-rancher-prime-3-0/
• https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
• https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s
• https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/
• https://github.com/Azure/kaito
• https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
• https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/
• https://docs.solo.io/gloo-network/latest/about/overview/
• https://github.com/kosmos-io/kosmos
• https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/
• https://newrelic.com/press-release/20240319
• https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control, auditing, etc.

Check out our website at https://kubernetesbytes.com/

Episode Sponsor: Elotl

Links:

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial

Timestamps:

• 07:46 Interview with Charlie
• 01:02:00 Key takeaways

Show Links:

• OPA Ecosystem https://www.openpolicyagent.org/ecosystem/
• OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin
• Charlie's site: https://charlieegan3.com
• OPA Docs: https://www.openpolicyagent.org/docs/latest/
• OPA Playground: https://play.openpolicyagent.org
• OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup

Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization.

Timestamps

• 00:06:24 - Discussion with Chris and Dan
• 00:51:44 - Takeaways

Episode Links

• What Happened to Platform Engineering? (ebook/pdf)
• LinkedIn Audio Recording "What Happened to Platform Engineering"
• Website resources on platform engineering/IDP
• LinkedIn Newsletter about KAOPS/Platform Engineering/IDP

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them.

Check out our website at https://kubernetesbytes.com/

Episode Sponsor: Elotl

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial

Timestamps:

• 02:02 Cloud Native News
• 15:31 Interview with Jani
• 01:11:00 Key takeaways

Cloud Native News:

• https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/
• https://www.civo.com/blog/kubefirst-joins-civo
• https://cast.ai/kubernetes-cost-benchmark
• https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to
• https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gke
• https://dok.community/dok-events/dok-day-kubecon-paris/
• https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa

Show Links:

• https://www.youtube.com/janakirammsv
• https://www.linkedin.com/in/janakiramm/
• - NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.html
• NVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-plugin
• NVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discovery
• Hugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/index
• Hugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/index
• ChromaDB - https://www.trychroma.com/

In this episode of Kubernetes Bytes. Hosts Bhavin and Ryan dive into what makes up a Internal Development Platform (IDP). Bhavin and Ryan help to define what an IDP is, how it relates to the overarching topic of platform engineering as well as the pros and cons of implementing an IDP.

• 00:03:01 - News
• 00:12:11 - Discussion Topic on IDPs

Discount for KCD New York! https://community.cncf.io/events/details/cncf-kcd-new-york-presents-kcd-new-york-2024/

Please make sure to use the voucher code “KUBERNETESBYTES” to get a 10% discount

News:

• https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/
• https://github.com/Ume0344/mongokube
• https://www.businesswire.com/news/home/20240207876324/en/ZEDEDA-Secures-72M-in-Growth-Capital-to-Meet-the-Skyrocketing-Demand-for-Edge-AI-and-Computing
• https://fintech.global/2024/02/15/ktrust-secures-5-3m-in-seed-funding-to-revolutionise-kubernetes-security
• https://thenewstack.io/kubernetes-predictions-were-wrong/
• https://cloudnativenow.com/features/crossplane-maintainers-add-python-support-to-control-plane/
• https://blog.crossplane.io/crossplane-v1-15/

Links:

• Mercado Libre IDP Talk: https://youtu.be/y-X1ZcPxRnI?si=q9UoglFrZycIcZ_l

IDP Companies and Projects

• Cortex
• OpsLevel
• Port
• Argonaut
• Upbound
• Nethopper
• Mia Platform
• Amazee
• Configure8
• Otomi-Core
• BackStage Roadie
• Qovery
• Plural
• Kubermatic
• Clutch
• Lagoon
• Garden.io
• Portainer

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Jason Dobies - Director of Edge Engineering at SUSE to talk about all things K3s. They discuss why Kubernetes is best suited for Edge deployments, and why K3s was built and how it helps users architect their edge solutions. The discussion goes into topics like Security, Storage, High Availability at the Edge. 

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Elotl  

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial 

 Timestamps: 

• 01:20 Cloud Native News 
• 06:01 Interview with Jason 
• 50:42 Key takeaways  

Cloud Native News:

• https://vmblog.com/archive/2024/01/29/dynatrace-to-acquire-runecast-to-enhance-cloud-native-security-and-compliance.aspx - 
• https://chronosphere.io/news/chronosphere-acquires-calyptia/  

Show links: 

• https://k3s.io/ 
• https://www.linkedin.com/in/jdob/