Tony is joined by Nathan Odle to talk about how he takes consumer hardware and puts together systems to do fun AI tasks. He has built systems using 7x NVIDIA 4090 and 7x Intel Arc A770. Come here about his experience building the systems and using the software to solve real problems and squeeze maximum performance out of GPUs you can buy yourself.

Guest:

Nathan Odle is an engineer, rally racer, and AI enthusiast who enjoys combining cutting-edge technology with practical applications. In the pursuit of backprop, Nathan recently built a custom AI server using seven Intel Arc A770 graphics cards, showcasing how consumer hardware can be used for advanced AI tasks. You can learn more about how to build your own on his website: http://mov-axbx.com

Nathan Odle

Resources:

Nathan's X

https://x.com/mov_axbx

https://www.intel.com/content/www/us/en/products/details/discrete-gpus/arc.html

Intel Extension for PyTorch

https://github.com/intel/intel-extension-for-pytorch

Quality of content and the web can be extremely challenging. Is the quality and civility of the content appropriate? Seekr is using AI to determine that for you as a business. They also are able to extend their learnings to help businesses build better LLMs for their own custom usages.

Stefanos Poulis, Chief of AI Research and Development, joins us to discuss how to build LLMs that measure civility or any other characteristic of a piece of content. He also talks about how they are exposing their capabilities to allow other businesses to do the same based on their own criteria

Stefanos Poulis

Rahul Nair

Learn More:

Seekr

https://www.seekr.com/

Intel® Liftoff for Startups

https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm

Intel® Tiber™ Developer Cloud

https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html

Intel® Gaudi® Al Accelerators

https://www.intel.com/content/www/us/en/products/details/processors/ai-accelerators/gaudi-overview.html

As AI applications become more prevalent, one of the biggest challenges is efficiently and cost effectively deploying your AI solution. For some it is as simple as following whatever pricing model a backend API SaaS from Google or OpenAI charges. But for others who are looking to deploy their own solutions, this can be challenging. By leveraging inefficiencies in the cloud compute market, NodeShift is making compute resources accessible to a wider range of businesses.

Guest:

Mihai Mărcuță is an Oxford University data science alumni with a professional background from Microsoft (Azure), Twitter (X), Epic Games (Fortnite) and Cisco. He co-founded NodeShift two years ago with Andrey Surkov.

Mihai Mărcuță

Resources:

Nodeshift

http://nodeshift.com

Intel Tiber Developer Cloud

https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html

Intel Tiber Developer Cloud Blog

https://community.intel.com/t5/Blogs/Tech-Innovation/Artificial-Intelligence-AI/AI-Cloud-for-Everyone-Nodeshift-Leverages-the-Intel-Tiber-Cloud/post/1598332

Intel Ignite

https://intelignite.com

Intel Liftoff for Startups

https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.html

Scott Parker joins Tony to discuss the progress getting applications running on Aurora Supercomputer nodes. From 2022 where the project started to today, significant progress has been made using a variety of programming models. Kokkos, OpenMP and oneAPI have enabled migration of scientific and AI applications to run on the Intel CPUs and GPUs Aurora is built on.

Guest:

Scott Parker

Resources:

Aurora Super Computer - https://www.alcf.anl.gov/aurora

Intel Data Center Max GPU - https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html

Intel Xeon Processors - https://www.intel.com/content/www/us/en/products/details/processors/xeon.html

Intel oneAPI Base Toolkit - https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit.html

Eduardo joins Tony to talk about the latest news from OpenAI with GPT-4o and Google I/O with Gemini. They also talk about who needs a large context windows and do developers benefit from these context windows getting larger. Finally they discuss whether a larger context window can address the same issues as RAG or other solutions.

Guest:

Eduardo Alvarez - AI Solutions Engineer @ Intel

Eduardo Alvarez

Links:

OpenAI

https://openai.com

Google I/O

https://io.google/2024/

Eduardo's RAG E-Book

https://www.linkedin.com/feed/update/urn:li:activity:7188539670400565249/

Intel on AI Podcast

https://podcasts.apple.com/us/podcast/intel-on-ai

Follow Ryan Carson and check out our X Space 9AM PST M/W/F

https://twitter.com/ryancarson

EpochZero and Bilic join Tony to discuss their experience last year in the Intel Liftoff Hackathon for African AI Startups. They talk about how to get the most out of a hackathon as well as the benefits they got from participating in this particular hackathon.

Intel supports startups through a variety of program. Hear about how Intel Liftoff Hackathon for AI Startups is supporting innovation on the African Continent. Also learn about a variety of programs, initiatives and collations driving deep tech in Africa.

Mayowa Abejirin

Dr. Kenneth Aguh

Saminu Salisu

Resources:

EpochZero

https://epochzero.xyz

Bilic

https://bilic.io

Intel® Liftoff Hackathon for African AI Startups

https://airtable.com/apphzz2omOZhalJDw/pagjhWl13D0jE2hnU/form

ModusAfrica

https://modus.vc

Intel® Tiber™ Developer Cloud

https://cloud.intel.com

Dr. Bienvenu Soglo joins Tony to discuss the challenges of deep tech AI start up in Africa, and how the second annual Intel Liftoff Hackathon for AI Startups is helping to bridge some of those gaps. They also discuss supporting the African continent to foster innovation.

Intel supports startups through a variety of program. Hear about how IntelLiftoff Hackathon for AI Startups is supporting innovation on the African Continent. Also learn about a variety of programs, initiatives and collations driving deep tech in Africa.

Dr Bienvenu Soglo

Resources:

Intel® Liftoff Hackathon for African AI Startups

https://airtable.com/apphzz2omOZhalJDw/pagjhWl13D0jE2hnU/form

ModusAfrica

https://modus.vc

Um6P Mohammed VI Polytechnic University

https://um6p.ma/en

Prosper Africa

https://www.prosperafrica.gov

iZET Hub

https://izet.zetech.ac.ke

Open Startup

https://www.linkedin.com/company/open-startup-international/

FAST Accelerator

https://www.fastaccelerator.com

Innov8 Hub

https://www.innov8hub.ng

N50 Project

https://www.n50project.org

Rahul Nair joins Tony to discuss how Generative AI is changing how innovators innovate and how this shows up in the many hackathons Intel Liftoff for Startups participates in. Generative AI enables immediate value creation from ideas. From creating UIs from drawings and building backend solutions in hours instead of months, GenAI is changing how we build solutions.

Rahul Nair

Intel® Liftoff for Startups https://www.intel.com/content/www/us/en/developer/tools/oneapi/liftoff.htm

Intel® Developer Cloud https://www.intel.com/content/www/us/en/developer/tools/devcloud/services.html

Intel® Data Center GPU Max Series https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/max-series.html

Hugging Face https://huggingface.co/

LA Hacks https://lahacks.com/home