Katherine Druckman talks to fellow Intel Open Source Evangelist Ezequiel Lanza about building and deploying AI applications using Retrieval Augmented Generation. We break down RAG concepts and processes involved in providing additional context to general AI models for specialized use cases.

Guest:

Katherine speaks with Demetris Cheatham, the Chief of Staff to the CEO of GitHub, about her unique perspective on the open source landscape. The discussion covers her experiences in various sectors and the impactful 'All In' project created to elevate developers from underrepresented backgrounds. They highlight the significance of community, the power of relationships, and the pivotal role of natural language and AI in making coding more accessible globally. The talk also addresses critical challenges like the digital divide, funding for diversity programs, and the importance of evolving diversity, equity, and inclusion efforts in tech.

00:00 Introduction 00:26 Connecting Through Open Source 02:02 Role and Responsibilities at GitHub 05:06 Diversity and Inclusion Initiatives 09:16 Challenges in Computer Science Education 12:51 Equity and Systemic Change 16:21 The Journey to a Billion Developers 24:07 Building Relationships in Open Source 31:37 Final Thoughts and Takeaways

Ezequiel Lanza and Katherine Druckman from Intel's Open Ecosystem team chat with Daniel Whitenack, founder and CEO of Prediction Guard. They discuss the importance and implementation of guardrails for securing generative AI platforms and cover the operational challenges and security considerations of running AI models, the concept of responsible AI, and practical advice for integrating guardrails into AI workflows. Additionally, the conversation touches on multi-model integrations, open source contributions, and the significance of vendor-neutral frameworks in achieving a secure and efficient AI ecosystem.

00:00 Introduction 01:28 What is Prediction Guard? 03:31 Understanding Guardrails in AI 06:49 Security Risks and Responsible AI 13:30 Open Source and Model Security 19:00 Open Platform for Enterprise AI 20:26 Contributing to Open Source Projects 27:12 Final Thoughts

Guest:

Daniel Whitenack (aka Data Dan) is a Ph.D. trained data scientist and founder of Prediction Guard. He has more than ten years of experience developing and deploying machine learning models at scale, and he has built data teams at two startups and an international NGO with 4000+ staff. Daniel co-hosts the Practical AI podcast, has spoken at conferences around the world (ODSC, Applied Machine Learning Days, O’Reilly AI, QCon AI, GopherCon, KubeCon, and more), and occasionally teaches data science/analytics at Purdue University.

Taylor Dolezal from the Cloud Native Computing Foundation discusses his role as the Head of Ecosystem, working closely with end-users implementing CNCF projects. He shares his open source origin story, tracing back to high school programming experiences. We touched on community dynamics, experiences with project forks, and the evolving landscape of AI and its intersection with open source. We also discuss the importance of sustainability in open source communities and the critical role of vendor neutrality.

00:00 Introduction 01:45 Open Source Origin Story 11:04 Project Forks and Community Dynamics 17:20 HashiCorp and OpenTofu: A Fork in the Road 19:46 Navigating the AI Frontier 23:28 The Challenges of AI Standardization 26:17 The Importance of Vendor Neutrality 28:02 Balancing Priorities in Open Source 29:51 Sustaining Open Source Communities

Taylor Dolezal navigates the cloud native universe with a knack for puns and a keen eye for psychology. Living in the heart of LA, he blends tech innovation with mental insights, one punny cloud at a time. Avid reader, thinker, and cloud whisperer.

In this episode, we chat with Luis Villa, co-founder of Tidelift, about everything from supporting open source maintainers to coding with AI. Luis, a former programmer turned attorney, shares stories from his early days of discovering Linux, to his contributions to various projects and organizations including Mozilla and Wikipedia. We discussed the critical importance of open source software, the challenges faced by maintainers, including burnout, and how Tidelift works toward compensating maintainers. We also explore broader themes about the sustainability of open source projects, the impact of AI on code generation and legal concerns, and the need for a more structured and community-driven approach to long-term project maintenance.

00:00 Introduction 03:20 Challenges in Open Source Sustainability 07:43 Tidelift's Role in Supporting Maintainers 14:18 The Future of Open Source and AI 32:44 Optimism and Human Element in Open Source 35:38 Conclusion and Final Thoughts

Luis Villa is co-founder and general counsel at Tidelift. Previously he was a top open source lawyer advising clients, from Fortune 50 companies to leading startups, on product development, open source licensing, and other matters.

Luis is also an experienced open source community leader with organizations like the Wikimedia Foundation, where he served as deputy general counsel and then led the Foundation’s community engagement team. Before the Wikimedia Foundation, he was with Greenberg Traurig, where he counseled clients such as Google on open source licenses and technology transactions, and Mozilla, where he led the revision of the Mozilla Public License.

He has served on the boards at the Open Source Initiative and the GNOME Foundation, and been an invited expert on the Patents and Standards Interest Group of the World Wide Web Consortium and the Legal Working Group of OpenStreetMap.

Recent speaking engagements include RedMonk’s Monki Gras developer event, FOSDEM, and as a faculty member at the Practicing Law Institute’s Open Source Software programs.

Luis holds a JD from Columbia Law School and studied political science and computer science at Duke University.

In this episode, Madelyn Olson, a maintainer of the Valkey project and an AWS engineer, joins us to discuss the life of an open source maintainer and the experiences surrounding the launch of the Valkey project. We cover the pivotal moments that led to the creation of Valkey, a Redis fork, following the Redis license change. Madelyn also shares insights on the challenges and pressures of being a maintainer, strategies to manage burnout, and the significance of creating a community-driven, open source project. The episode highlights the technical advancements and future directions for Valkey, working to leverage modern hardware, manage large clusters, and expand the extension ecosystem.

00:00 Introduction

00:48 Redis License Change and Birth of Valkey

06:17 Maintainer Life and Burnout

14:54 Forking a Repository: When and Why

19:30 Community-Driven Open Source Projects

21:32 Future of Valkey and Closing Remarks

In this episode, Intel's open source AI evangelist Ezequiel Lanza and Dave Nielsen from IBM join the discussion to talk about the AI Alliance, a collaborative initiative formed by IBM and Meta in December 2023. We discussed the importance of openness in AI, how it fosters innovation, community involvement, and ensures AI remains safe and trustworthy. We also covered the significance of community in technology development, and upcoming events such as the Open Source AI Demo Night showcasing innovative AI applications. The episode emphasizes the role of open models in making technology more accessible globally.

00:00 Introduction 00:43 What is the AI Alliance? 04:48 The Importance of Openness in AI 11:47 AI for Good and Community Involvement 15:28 Upcoming Events and How to Get Involved

In this episode, John Kjell, Director of Open Source at TestifySec, discusses his involvement in various open source projects and the intricacies of maintaining such projects. John sheds light on his work with the CNCF and OpenSSF, and the impact of tools like Witness, Archivista, and SLSA. He outlines the challenges maintainers face, especially around security, and offers insights into balancing professional and personal responsibilities. John also explores the significance of community, inclusivity, and a secure developer identity in open source ecosystems.

00:00 Introduction and Guest Background 01:20 Maintainer Burnout and Security Challenges 04:41 Balancing Multiple Projects and Personal Life 07:15 Security Risks in Smaller Projects 10:13 Developer Identity and Reputation 19:37 Open Source Origin Story and Community Involvement 24:11 Optimism for the Future of Open Source Security

Enhancing Open Source Security: Introducing Siren by OpenSSF – Open Source Security Foundation

Security at Every Step: Why Software Supply Chains Are Critical