"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis (Erik Torenberg, Nathan Labenz)

Dive into the nuanced debate over California's SB 1047 AI legislation with Nathan Calvin, Dean Ball, and Steve Newman. Our expert panel discussion explores the bill's intent, dispels misconceptions, and debates its potential impact on technology and regulation. Learn about AI's tail risks, the role of government, and hear suggestions for improving the legislation. Share your thoughts and join the conversation around shaping a positive AI future. You can reach out and share your thoughts by using the contact form here : https://www.cognitiverevolution.ai/contact/ RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. CHAPTERS: (00:00:00) Introduction (00:05:45) Opinions (00:11:57) The Bill (00:17:05) Elevated discussion (00:18:51) Sponsors: Brave | Omneky (00:20:18) AI Doctor (00:22:55) Centralized Regulator (00:26:29) SB 1047 (00:27:47) Critical infrastructure (00:31:51) Should we regulate? (00:39:00) Sponsors: Squad (00:40:28) Safety standards for training (00:46:09) What is 10^26 flops? (00:52:10) Regulating general purpose technology (00:53:42) AI regulation (00:58:31) Societal adaptation (01:01:18) AI safety (01:04:20) AI regulations (01:07:19) The current state of the industry (01:10:08) What industry wants changed (01:25:42) Safety is hard to legislate (01:33:06) How to decide the trajectory of AI? (01:45:52) Testing, Transparency, Whistleblower Provision (01:55:17) Closing thoughts

We talked to Aravind Srinivas about competing with the tech giants, Perplexity's product philosophy and obsession with maximizing value delivered to the user per unit time, and the features that makes Perplexity unique. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. (0:00) Preview (1:31) Introduction & Context (08:06) Aravind’s vision for Perplexity as the world’s most truth-centric company (9:29) Raising the average IQ of the world (12:00) Aravind’s favorite tech entrepreneur (15:12) “Anthropics” - Building your own model vs user experience (33:00) Why is perplexity free (43:00) Talking shop: Perplexity’s tech stack and speed (1:06:00) Perplexity’s stance on guardrails on search (1:19:48) Forecasting weakly general AGI: The four criteria (1:28:00) Aravind’s perspective on OpenAI and the future of AGI (1:39:00) The Cognitive Revolution’s rapid fire questions: Neuralink implant? Most used AI tools? AI hopes and fears? Twitter handles: @CogRev_Podcast @AravSrinivas (Aravind) @labenz (Nathan) @eriktorenberg (Erik)  SPONSOR: SHOPIFY: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/  References & Shownotes: Flamingo: https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model Decision Transformer Paper: https://arxiv.org/abs/2106.01345 Aravind on TalkRL Podcast: https://www.talkrl.com/episodes/aravind-srinivas-2 Weakly General AGI Criteria: https://www.metaculus.com/questions/3479/date-weakly-general-ai-is-publicly-known/ RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode of The Cognitive Revolution, Nathan interviews Andrew White, Professor of Chemical Engineering at the University of Rochester and Head of Science at Future House. We explore groundbreaking AI systems for scientific discovery, including PaperQA and Aviary, and discuss how large language models are transforming research. Join us for an insightful conversation about the intersection of AI and scientific advancement with this pioneering researcher in his first-ever podcast appearance. Check out Future House: https://www.futurehouse.org Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive CHAPTERS: (00:00:00) Teaser (00:01:13) About the Episode (00:04:37) Andrew White's Journey (00:10:23) GPT-4 Red Team (00:15:33) GPT-4 & Chemistry (00:17:54) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:20:19) Biology vs Physics (00:23:14) Conceptual Dark Matter (00:26:27) Future House Intro (00:30:42) Semi-Autonomous AI (00:35:39) Sponsors: Shopify (00:37:00) Lab Automation (00:39:46) In Silico Experiments (00:45:22) Cost of Experiments (00:51:30) Multi-Omic Models (00:54:54) Scale and Grokking (01:00:53) Future House Projects (01:10:42) Paper QA Insights (01:16:28) Generalizing to Other Domains (01:17:57) Using Figures Effectively (01:22:01) Need for Specialized Tools (01:24:23) Paper QA Cost & Latency (01:27:37) Aviary: Agents & Environments (01:31:42) Black Box Gradient Estimation (01:36:14) Open vs Closed Models (01:37:52) Improvement with Training (01:40:00) Runtime Choice & Q-Learning (01:43:43) Narrow vs General AI (01:48:22) Future Directions & Needs (01:53:22) Future House: What's Next? (01:55:32) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one of our most detailed and valuable discussions on state-of-the-art AI model development. Check out Nathan's Lambert newsletter: https://www.natolambert.com https://www.interconnects.ai Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:59) Sponsors: Incogni (00:02:20) About the Episode (00:05:56) Introducing AI2 (00:09:56) Tulu: Deep Dive (Part 1) (00:17:43) Sponsors: Shopify | Oracle Cloud Infrastructure (OCI) (00:20:38) Open vs. Closed Recipes (00:29:48) Compute & Value (Part 1) (00:34:22) Sponsors: 80,000 Hours | Notion (00:37:02) Compute & Value (Part 2) (00:42:41) Model Weight Evolution (00:53:16) DPO vs. PPO (01:06:36) Project Trajectory (01:20:39) Synthetic Data & LLM Judge (01:27:39) Verifiable RL (01:38:17) Advice for Practitioners (01:44:01) Open Source vs. Closed (01:49:18) Outro

Dive into an accessible discussion on AI safety and philosophy, technical AI safety progress, and why catastrophic outcomes aren't inevitable. This conversation provides practical advice for AI newcomers and hope for a positive future. Consistently Candid Podcast : https://open.spotify.com/show/1EX89qABpb4pGYP1JLZ3BB SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Recommended Podcast: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) About the Show (00:03:50) Intro (00:08:13) AI Scouting (00:14:42) Why arent people adopting AI more quickly? (00:18:25) Why dont people take advantage of AI? (00:22:35) Sponsors: Oracle | Brave (00:24:42) How to get a better understanding of AI (00:31:16) How to handle the public discourse around AI (00:34:02) Scaling and research (00:43:18) Sponsors: Omneky | Squad (00:45:03) The pause (00:47:29) Algorithmic efficiency (00:52:52) Red Teaming in Public (00:55:41) Deepfakes (01:01:02) AI safety (01:04:00) AI moderation (01:07:03) Why not a doomer (01:09:10) AI understanding human values (01:15:00) Interpretability research (01:18:30) AI safety leadership (01:21:55) AI safety respectability politics (01:33:42) China (01:37:22) Radical uncertainty (01:39:53) P(doom) (01:42:30) Where to find the guest (01:44:48) Outro

In this episode, Nathan sits down with Max Bennett, author of the book: A Brief History of Intelligence. They discuss the five major breakthroughs in evolution that resulted in human brains and cognition. They delve deeper into the workings of each breakthrough, the evolution of intelligence, and how AI can benefit from understanding these principles. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: A Brief History of Intelligence: https://a.co/d/6VPWTf7 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @maxsbennett (Max) @CogRev_Podcast TIMESTAMPS: (00:00) Intro (06:00) Max's background on commercializing AI in technology (09:53) AI has taught us a lot of our intuitions are wrong (11:22) Why we're better off avoiding defining intelligence (14:38) The Five Breakthrough Model - steering, reinforcing, simulating, mentalizing, and speaking (15:43) Sponsor - Brave Search API | Shopify (18:20) The story of the first breakthrough - Steering (21:40) Evolution doesn't have forethought and every generation has to survive (23:05) The study of nematodes - how did this first brain emerge? (27:10) yet in bilaterians, but the idea is you classify things in the world into good and bad. (33:00) Netsuite by Oracle | Omneky (36:16) The story of the second breakthrough - Reinforcing (1:32:44) The story of the fourth breakthrough - Mentalizing (1:45:57) The story of the fourth breakthrough - Speaking (pls listen to the audio book / read the book) (1:46:46) How evolutionary paradigms will shape up in the future (1:55:03) A unified theory of value or moral patienthood that can be applied to the five breakthroughs (1:59:21) Wrap + Sponsor | Omneky This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

[Bonus Episode] Future of Life Institute Podcast host Gus Docker interviews Conjecture CEO Connor Leahy to discuss GPT-4, magic, cognitive emulation, demand for human-like AI, and aligning superintelligence. You can read more about Connor's work at https://conjecture.dev Future of Life Institute is the organization that recently published an open letter calling for a six-month pause on training new AI systems. FLI was founded by Jann Tallinn who we interviewed in Episode 16 of The Cognitive Revolution. We think their podcast is excellent. They frequently interview critical thinkers in AI like Neel Nanda, Ajeya Cotra, and Connor Leahy - an episode we found particularly fascinating and is airing for our audience today. The FLI Podcast also recently interviewed Nathan Labenz for a 2-part episode: https://futureoflife.org/podcast/nathan-labenz-on-how-ai-will-transform-the-economy/ SUBSCRIBE: Future of Life Institute Podcast: Apple: https://podcasts.apple.com/us/podcast/future-of-life-institute-podcast/id1170991978 Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP -- We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics TIMESTAMPS: (00:00) Episode introduction (01:55) GPT-4  (18:30) "Magic" in machine learning  (29:43) Cognitive emulations  (40:00) Machine learning VS explainability  (49:50) Human data = human AI?  (1:01:50) Analogies for cognitive emulations  (1:28:10) Demand for human-like AI  (1:33:50) Aligning superintelligence  SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. If you'd like to listen to Part 2 of this interview with Connor Leahy, you can head here:  https://podcasts.apple.com/us/podcast/connor-leahy-on-the-state-of-ai-and-alignment-research/id1170991978?i=1000609972001

Nathan explores the world of AI-powered design with John Milinovich, Head of Generative AI Product at Canva. In this episode of The Cognitive Revolution, we dive into Canva's innovative approach to AI integration, from task automation to human augmentation. Join us for an insightful discussion about fine-tuning foundation models, AI's impact on architecture, and practical tips for AI product development at scale. Check out Canva: https://www.canva.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:13) Sponsors: SelectQuote (00:02:26) About the Episode (00:04:33) Introduction - Creativity vs Design (00:08:39) AI-Assisted Experiences (00:10:25) Automation & Augmentation (00:15:27) Pixels to Objects to Concepts (00:17:58) Sponsors: Incogni | Shopify (00:20:40) Concept-Level Interfaces (00:23:35) The Future of Design (00:29:39) Human Element in Design (00:32:49) AI Talking to AI (00:35:52) Sponsors: Oracle Cloud Infrastructure (OCI) | Brave (00:38:04) Purpose-Specific AI Experiences (00:45:29) GPT-4 Image Editing (00:51:17) Graduated Approach to Launch (00:55:09) Fine-Tuning GPT-4 (00:59:10) Cost & Latency (01:01:29) Hiring AI Engineers (01:05:02) Engineering Best Practices (01:09:00) Inspiration in the AI Space (01:18:28) The Gen AI Application Layer (01:24:26) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems. Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SHOW NOTES: 1. Yeshua God's article on philosophical discourse as a jailbreak 2. Conversation about counting 'r's: 3. Discussion on malicious code 4. AI-generated poem "In the realm of bytes and circuits" 5. Nathan Labenz's Arguments - Argument 1 - Argument 2 6. Tweet about Strawberry experiment 7. Tweet with AI-generated poem: https://x.com/YeshuaGod22/status/1823080021864669450/photo/1 https://x.com/YeshuaGod22/status/1782188220660285509 8. AI Rights for Human Safety 9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved It SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr CHAPTERS: (00:00:00) About the Show (00:00:22) Introduction and Background (00:04:56) Guided Meditation on AI Experience (Part 1) (00:12:06) Sponsors: Oracle | Brave (00:14:10) Guided Meditation on AI Experience (Part 2) (00:14:19) Exploring AI Consciousness and Ethics (Part 1) (00:28:34) Sponsors: Omneky | Weights & Biases Weave (00:30:03) Exploring AI Consciousness and Ethics (Part 2) (00:33:15) Key Concepts in AI Development (01:02:33) AI Alignment and Training Approaches (01:19:44) Interpreting AI Outputs and Behavior (01:39:28) Ethical Dilemmas in AI Development (02:03:15) Experiments in AI Behavior and Ethics (02:37:08) Concluding Thoughts and AI-Generated Poem (03:10:45) Outro

The development of ultra-realistic human voices is upon us, and Mahmoud Felfel's company Play.ht is leading the next generation of text-to-voice models. In this episode, we discuss the challenges and opportunities of automating a more human voice, as well as concerns about deep fakes and user safety. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics Timestamps: (0:00) Preview of Mahmoud on this episode  (0:55) Sponsor: Omneky.com  (1:45) Nathan clones his voice using Play.ht  (6:11) Why Mahmoud started Play.ht and the problem they tried to solve (13:08) The job to be done for Play.ht & how they’re thinking about APIs and models (24:45) Mahmoud breaks down the architecture of Play.ht (29:30) How the use cases have evolved  (30:00) New markets and opportunities with creators (37:00) Are we all about to become prompt engineers/directors? (44:50) Roadmap to other languages beyond English (48:00) Managing the compute(52:00) If AI-generated voices becomes a commodity, what will happen? (55:00) Why bigger companies are late adopters of AI tools (56:30) The long-term moat of Play.ht and other applications (1:00:00) Controversial voice-cloning and potential for societal abuse (1:10:32) Commonly abused voices (1:12:36) Rapid fire questions SPONSORS: SHOPIFY | OMNEKY Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.* Twitter: @CogRev_Podcast @_mfelfel (Mahmoud) @labenz (Nathan) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack Websites: cognitivervolution.ai play.ht omneky.com This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Nathan Labenz synthesizes recent research in mechanistic interpretability and AI safety, how top players in the space like Anthropic and OpenAI are addressing them, and jailbreaks like the Calvin and Hobbes one you may have seen online. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Questions or topics you want us to review for future episodes? Email TCR@turpentine.co SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics LINKS: Scouting Report Part 1 - Fundamentals : https://www.youtube.com/watch?v=0hvtiVQ_LqQ Scouting Report Part 2 - Impact, Fallout, and Outlook: https://www.youtube.com/watch?v=QJi0UJ_DV3E Universal Jailbreaks with Zico Kolter, Andy Zou, Asher Trockman: https://www.youtube.com/watch?v=BwltbhR0JgU&feature=youtu.be TIMESTAMPS: (00:00) Episode Preview (02:26) AI Engineer Survey (03:53) P(Doom) (00:07:52) Representation engineering (00:09:20) Using contrasting prompts to understand model’s inner representations (00:15:16) Sponsors: Netsuite | Omneky (00:22:00) Controlling AI systems and detecting jailbreaks (00:28:53) LLM performance and refusal rates varying by language (00:33:13) Towards monosemanticity: decomposing language models with dictionary learning (00:54:12) Implications of the aforementioned paper This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Explore the fusion of AI and computational chemistry with University of Queensland's researcher, Tim Duignan. Learn about transforming our understanding of electrolytes, the art of simulating physical processes using neural networks, and the potential of AI in scientific breakthroughs. Discover Tim's journey creating AI models for complex system predictions and join the discussion on advancing AI's role in future scientific discoveries. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:47) Introduction (00:04:09) Why electrolyte solutions are important (00:06:53) What properties are we trying to predict with electrolyte solutions? (00:09:33) Battery fires (00:13:38) Molecular dynamics (00:16:40) Time step (00:18:51) Scaling (00:23:09) Sponsors: Oracle | Brave (00:25:17) Decoherence (00:27:23) Neural Network Potentials (00:31:04) How big are the models? (00:35:46) What architecture is used? (00:38:12) Equivariance (Part 1) (00:42:29) Sponsors: Omneky | Squad (00:44:15) Equivariance (Part 2) (00:44:16) AlphaFold3 (00:46:52) Zero-shot latent space communication (00:48:21) What is coarse graining? (00:54:31) How to know if there is no crystallization (00:56:53) What is the role of water in the simulation? (01:01:25) Crystallization (01:05:26) Matching surfaces (01:09:32) Self-ionization of water (01:13:22) Active learning (01:16:41) Temperature (01:19:20) Ice and water (01:21:12) Scaling up the model (01:25:21) Big tech singularity (01:27:54) China is not far behind (01:29:15) Safety concerns (01:31:16) KANs (01:34:36) The future of scientific progress (01:39:28) The art of discovery (01:43:02) One model to rule them all (01:47:46) AGI, its risks and benefits (01:50:21) Power vs. Generality (01:53:01) Generality for Utility (01:53:40) Outro

In this episode, Nathan sits down with Div Garg, founder of Multion, to discuss the current state and future outlook of AI agents. They discuss benchmarking real-world tasks, the promise and perils of consumer AI adoption, predictions that 2024 may be a breakout year for personal bots, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: MultiOn: https://www.multion.ai/ Part 1 with Div Garg: https://www.youtube.com/watch?v=PR2Mdlx5eik SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @divgarg9 @MultiON_AI (MultiOn) @CogRev_Podcast TIMESTAMPS: (00:00) - Episode Preview (00:06:06) - Current state of AI agents - still early with chat abilities, but logical reasoning lacking (00:12:32) - Estimated timeline for usable everyday AI agents - focused on adoption and reliability (00:17:41) - Architectures beyond language models - action transformers and process optimization (00:22:00) - Context limits of current AI models - efficient context compression is key (00:25:00 - Managing memory and knowledge retrieval in agents (00:29:40) - MultiOn's own model creation (00:30:16) - Sponsors: Netsuite | Omneky (00:49:00) - Maturing agent capabilities beyond language with planning systems (00:32:00) - Benchmarking agent capabilities on real-world website tasks (00:59:30) - Inspiration from computer OS thread scheduling and coordination (01:02:30) - Expanding agents to mobile for voice commands and authentication (01:06:47) - AI agents complementing vs substituting human roles (01:09:00) - Removing repetitive "digital chores" to change job landscapes (01:11:36) - Sourcing high-quality demonstrator data at scale (01:13:00) - Privacy protections when collecting user data This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Anton Troynikov, cofounder of Chroma, joins Nathan Labenz to discuss the importance of keeping the retrieval-augmented generation (RAG) loop in house, what it means for Chroma to be in “wartime” mode right now, and how much of the data going into Chroma has never been in a database before. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: Part 1 with Anton: https://youtu.be/ogy37CdIljg X/SOCIAL: @labenz (Nathan) @atroyn (Anton) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction by Nathan, setting up the conversation with Anton (00:02:16) - Anton articulates Chroma's mission to build a horizontally scalable system (00:03:06) - Rise in popularity of retrieval-augmented generation (RAG) (00:06:03) - Chroma's focus on delivering a horizontally scalable cloud service for vector search and storage (00:08:07) - Nathan describes his experience building a RAG application for a client profiling use case (00:10:27) - Anton advises measuring retrieval quality and maximizing relevant information returned (00:15:05) - Sponsors: Netsuite | Omneky (00:17:02) - Popular use of open source vs. proprietary embedding models like Anthropic's Ada (00:19:30) - The importance of keeping the RAG loop in house and not relying solely on external APIs (00:27:41) - The huge amount of unstructured data that can now be processed by AI (00:30:40) - Providing a unified interface to structured and unstructured data (00:33:15) - Much of the data going into Chroma has never been in a database before (00:38:47) - Categories of organizations adapting to AI: legacy, AI-native, and AI-first (00:40:55) - Where Chroma is seeing most of its growth right now (00:46:20) - Interpretability work like Anthropic's circuit evaluation (00:52:23) - Anton believes new tooling can make latent spaces accessible without AI expertise (01:06:08) - Scaling constraints between search indexes vs. application databases (01:09:10) - Potential for time as a dimension in embedding spaces (01:13:46) - Likelihood of missing results due to representational issues vs. approximate nearest neighbor (01:15:22) - Automatically handling small data sets without needing elaborate indexing (01:17:20) - Anton's perspective on whether OpenAI will build its own database (01:19:43) - Partnering with OpenAI and other labs to increase use of their models (01:21:19) - Anton's experiments probing GPT's reasoning abilities with Game of Life (01:25:41) - Closing thoughts on the conversation This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Nathan sits down with Professor Zak Kohane, the Chair of the Department of Biomedical Informatics at Harvard Medical School, and co-author of the new book, The AI Revolution in Medicine, for which Sam Altman, OpenAI’s CEO wrote the foreword to the book. Professor Kohane was among a select few people to receive early preview and research access to GPT-4 in the fall of 2022, and his approach to exploring and characterizing how AI is about to transform medicine.  The book is out May 13, 2023 and can be ordered here (or on Amazon by searching for "The AI Revolution in Medicine") Regardless of the field you're in, Dr. Kohane's combination of deep immersion, enthusiastic exploration, pragmatic optimism, risk awareness, realism, and forward-thinking vision make this a worthy example for others to study and emulate. -- We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics TIMESTAMPS: (00:00) Episode preview (05:29) Dr. Isaac Kohane’s story (15:00) Sponsor: Omneky (16:29) Advice to others thinking of applying AI to their own disciplines (20:33) The tension of using AI in medicine (25:04) The Trial Paradigm of AI  (31:15) Is it possible to use GPT as a healthcare provider in population studies? (34:14) The Trainee Paradigm of AI (36:09) The Partner Paradigm of AI and how doctors should use AI (40:33) AI provided interaction and how that can improve patient care (42:26) The Torchbearer Paradigm of AI (42:59) Can GPT independently conduct medical research? (46:58) The future for impactful use cases of AI in medicine (51:04) Integrating AlphaFold into language models (54:10) AI-alignment and patient data in medicine TWITTER: @CogRev_Podcast @labenz (Nathan) @zakkohane (Isaac) @eriktorenberg (Erik) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: cognitiverevolution.substack.com

In this episode, Nathan sits down with Gabe Gomes, Assistant Professor at Carnegie Mellon University, and researcher behind Coscientist: the first non-organic, intelligent being to design, plan, and execute a chemistry experiment. They discuss how Coscientist allows scientists to use natural language to control remote experiments on Emerald Cloud Lab, how it will democratize scientific knowledge, and accelerate the pace of research. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: Autonomous Chemical Research with Large Language Models: https://www.nature.com/articles/s41586-023-06792-0 --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @gabepgomes (Gabe) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Intro (00:05:00) - Introduction Gabe Gomes, his research (00:15:02) - Emerald Cloud Labs for remote chemical experimentation (00:15:18) - Sponsor: Shopify (00:22:40) - How AI is addressing the pain point of chemistry research (00:29:12) - Sponsors: Netsuite | Omneky (00:31:00) - Democratizing science and access to chemistry techniques (00:38:00) - Modular CoScientist architecture (00:46:00) - The power of CoScientist to address more than just chemistry (01:17:00) - The explosion of the context window (01:30:00) - AI Safety (01:45:00) - How is Copilot already helping expedite chemistry and scientific research? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, hosts Nathan Labenz and Erik Torenberg delve into the exciting and concerning aspects of GPT4, the latest large multimodal model from OpenAI. Nathan, who was a Red Teamer for GPT4, shares his experience working with the model, using it for real-life scenarios, and how he found it to be human-level rather than human-like intelligence. Nathan also highlights some of its fundamental weaknesses and limitations and shares the most concerning elements of GPT4. They end the episode pondering the arrival of GPT5 and whether we are in AI's "goldilocks moment." We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics Timestamps for E11: Nathan Labenz and Erik Torenberg of The Cognitive Revolution Podcast (0:00) Preview of Nathan on this episode (1:13) Upstream: Erik's new interview show (1:41) Intro (5:40) Nathan's experience as a GPT4 Red Teamer (11:22) Catching the AI wave (14:30) Using GPT4 for real-life scenarios (17:33) Sponsor: Omneky (21:00) Human-level, not human-like intelligence (26:00) GPT4 weaknesses (28:14) More real-life use cases for GPT4 (35:25) Teaching AI to communicate within itself (40:25) GPT4’s limitations (44:32) Nathan's learnings from using GPT4 (46:56) Nathan joining the Red Team (47:29) The most concerning thing about GPT4 (1:05:42) GPT5 (1:06:42) Open AI's regulatory breadcrumbs (1:13:52) AI's goldilocks moment SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Twitter: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Dr Michael Levin, Distinguished Professor of Biology at Tufts University, joins Nathan to discuss embodied minds, his research into limb regeneration and collective intelligence, cognitive light cones, and much more. Michael and the Levin Lab work at the intersection of biology, artificial life, bioengineering, synthetic morphology, and cognitive science. LINKS: The Levin Lab and Dr. Michael Levin’s research: https://drmichaellevin.org/resources/ Dr Michael Levin’s blog: https://thoughtforms.life/about/ Tufts University Faculty Profile: https://as.tufts.edu/biology/people/faculty/michael-levin Michael Levin @ Wyss Institute: https://wyss.harvard.edu/team/associate-faculty/michael-levin-ph-d/ Dr. Levin’s Research on Limb Regeneration: https://news.uchicago.edu/how-bioelectricity-could-regrow-limbs-and-organs SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL @labenz (Nathan) @drmichaellevin (Michael) @CogRev_Podcast Timestamps: (00:00) Preview (01:07) Intro and summary (05:40) Xenobots, anthrobots and the other creatures created by Mike Levin (09:39) Bioelectric memory rewriting (15:01) Sponsor | BraveSearch API (16:09) The difficulty of conducting simulations, which involve running forward passes to predict and alter electrical patterns (20:30) The concept of backpropagation and mode switching in AI models (23:06) Why humans do not regenerate their limbs (37:10) Sponsor | Netsuite (39:40) Learning from small and biological systems onto the concept of possible emergence (45:16) The criticality of multiple scale questions and would a single scale? (55:49) The concept of the cognitive light cone (59:43) Advice on habits of mind and suggestions for inspiration on the AI side (1:13:36) Mike's suggested directions for the AI developers (1:24:49) Wrap & Sponsor | Omneky This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Marius Hobbhahn, CEO of Apollo Research, sits down with Nathan Labenz to discuss Apollo’s research in AI deception, interpretability, and affordances. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @MariusHobbhahn (Marius) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:05:40) - Understanding the Role of Apollo Research  (00:08:02) - The Evolution of AI Safety (00:11:30) - Apollo’s Framework (00:15:10) - Sponsors: Shopify  (00:16:49) - Understanding AI Affordances and Resulting Interactions in the World (00:31:00) - Sponsors: Omneky (00:39:00) - Interpretability and deceptive alignment  (00:45:55) - Why might deception arise in the first place? (00:47:46) - Understanding deceptive alignment  (00:57:49) - New Architectures (01:02:23) - Interpretability at deployment phase (01:03:35) - Deception in AI | A Case Study (01:09:03) - Deceptive AI Stock Trader (01:18:51) - Impact of discouragement on unethical AI behaviour (01:19:45) - Giving the AI a Reasoning Scratchpad and Impact on Deception (01:21:06) - Double-edged sword of removing the scratchpad (01:23:00) - Analyzing impact of model size on insider training  (01:28:00) - Challenges and necessity of 3rd Party Auditing (01:31:00) - Role of government in regulation  (01:52:17) - How can individuals get involved in red teaming? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Nathan sits down with Suhail Doshi, founder of Playground AI. They discuss the current state of AI image generation, how Suhail is building Playground while the technology for vision and image generation is still maturing, thought to image reconstruction, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Playground AI: https://playgroundai.com/ SPONSORS: The Brave search API can be used to assemble a data set to train your A I models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @Suhail @CogRev_Podcast TIMESTAMPS: (00:00) Episode Preview (00:44) The current state of AI image generation (08:04) Are we currently at a GPT-2 level for image gen? (15:40) Sponsor - Brave Search API | Shopify (20:46) Shortcomings and use cases for GPT-4V (22:46) Benefits of vision vs language (28:30) Trajectory for what Playground will build next (33:28) Sponsor - NetSuite by Oracle | Omneky (34:48) How will the image generation experience change over time (40:06) Thought to image reconstruction (47:49) What if OpenAI fully focused on image (50:09) Lack of training data in vision and the use of synthetic data (51:30) Multimodal models increasing performance (55:03) Images are information rich but lack the right annotation (57:00) Building Playground while vision technology is maturing (1:03:25) What should the rules for generative AI be? (1:09:19) Parallel to the music industry and streaming for rev share (1:12:21) What are the minimum standards that AI application developers should be expected to uphold? (1:16:48) Wrap This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this special crossover episode of The Cognitive Revolution, Nathan shares an insightful conversation from the Latent.Space podcast. Swyx and Alessio interview Alistair Pullen of Cosine, creators of Genie, showcasing the cutting edge of AI automation in software engineering. Learn how Cosine achieves state-of-the-art results on the SWE-bench benchmark by implementing advanced AI techniques. This episode complements Nathan's recent discussion on AI Automation, demonstrating how far these practices can be pushed in real-world applications. Don't miss this opportunity to explore the future of AI-driven software development and its implications for businesses across industries. Check out the Latent.Space podcast here: https://www.latent.space Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:04:29) Alistair and Cosine intro (00:13:50) Building the Code Retrieval Tool (00:17:36) Sponsors: Weights & Biases Weave | 80,000 Hours (00:20:15) Developing Genie and Fine-tuning Process (00:27:41) Working with Customer Data (00:30:53) Code Retrieval Challenges and Solutions (00:36:39) Sponsors: Omneky (00:37:02) Planning and Reasoning in AI Models (00:45:55) Language Support and Generalization (00:49:46) Fine-tuning Experience with OpenAI (00:52:56) Synthetic Data and Self-improvement Loop (00:55:57) Benchmarking and SWE-bench Results (01:01:47) Future Plans for Genie (01:03:02) Industry Trends and Cursor's Success (01:05:23) Calls to Action and Ideal Customers (01:08:43) Outro

In this episode, Linus Lee, AI product leader at Notion, joins us to discuss his groundbreaking projects and unique approach to exploring AI systems. He shares his toolkit and insights on language model capabilities, along with his vision for the future of AI, which is centered on amplifying human intelligence. Linus inspires listeners to engage deeply with AI and to steer its development in ways that enhance human creativity and agency. RECOMMENDED PODCAST: How Do You Use ChatGPT Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts. https://link.chtbl.com/hdyuchatgpt SPONSORS: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS : (00:00) Introduction (10:16) AI and Creativity (14:37) Sponsor: Omneky (14:57) AI Research Development (20:05) Bridging Modalities (32:38) Sponsor: Brave / Plumb / Squad (35:36) Transformer Models and Techniques (52:32) Personal AI Research Setup (58:55) Leveraging Language Models for Coding (01:02:05) AI Model Development and Notion AI (01:22:05) Future of AI Models and App Development (01:32:51) Emerging Trends in AI

In this episode, Nathan sits down with Jon Noronha, co-founder of Gamma. Gamma is a new medium for presenting ideas, allowing you to focus on your ideas and receive beautiful, engaging content without the formatting work. In this episode, Jon and Nathan discuss the journey of building Gamma, how to coax AI to do things well, and the opportunity for AI A/B testing. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00:00) - Preview (00:01:23) - Nathan introduces Jon Noronha (00:06:36) - Intro - Jon Noronha introduces himself and Gamma (00:09:36) - Gamma's origin story: building the "anti-PowerPoint" pre-GPT-3 (00:13:15) - From using AI for onboarding to generating near-complete presentations. (00:15:11) - Sponsors: Netsuite | Omneky (00:18:01) - If Notion and Canva had a baby (00:23:35) - Searching for the right structure for AI, landing on HTML (00:28:16) - Degrees of freedom - developing a constrained vocabulary of semantic blocks (00:29:30) - Choice of model(s) – weighing cost, speed, and quality tradeoffs (00:35:18) - Editing UI - getting AI to edit slides per user command (00:38:04) - UI for gathering training data - following Midjourney's example (00:40:00) AI A/B Testing: a big opportunity space (00:43:22) - Image generation models - Baseten and Gamma's deployment of it (00:45:37) - Pacing feature development - Trying to stay ahead of innovations like 3D, video, voice etc. (00:47:45) Image generation for slidedecks and AI involvement (00:50:29) Gamma's main building priorities and AI generated websites (00:52:34) - Competing with giants like Microsoft and Google (00:55:04) - Enterprise AI shipping challenges - Startups pioneer new patterns; giants will eventually follow. (00:57:45) - Simplifying complexity - will models smooth over the complexity of bloated product suites? (00:59:22) - Conclusion and final thoughts X/TWITTER: @thatsjonsense (Jon) @labenz (Nathan) @eriktorenberg @CogRev_Podcast LINKS: Gamma: https://gamma.app/ SPONSORS: Shopify |NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

Tune in as we explore the remarkable traits of Anthropic's Claude AI with Developer Relations Lead Alex Albert. Delve into the ethical considerations, responsible development standards, and the exceptional capabilities that set Claude apart. Gather insights on the AI industry's race to the top and find out about Anthropic's upcoming releases. Whether you're an AI enthusiast or a tech-savvy developer, this podcast offers a thought-provoking discussion on the future of ethical AI. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:06:15) Opus 3 (00:10:43) What are people not yet appreciating about the latest Claude models? (00:16:02) Why is Claude the best writer of all the language models? (00:18:38) Claude's subjective experience (00:18:39) Sponsors: Oracle | Brave (00:20:46) The moral status of Claude (00:25:24) The testing process (00:27:54) Anthropic's strategy (00:31:56) Sponsors: Squad | Omneky (00:33:42) Current state of competition (00:36:18) Convergence at the API level (00:42:32) Tool use (00:46:32) Fine-tuning (00:49:10) Best practices for app developers (00:56:09) Jailbreaking new models

Mark Humphries is a Professor of History at Wilfrid Laurier University, where he has published widely on various aspects of Canadian history. We invited Mark to do an episode after he reached out to tell us that hearing about how Nathan fine-tuned GPT-3.5 on GPT-4 reasoning helped him get over some hurdles in his own archival research. In addition, he chats about all the things that he'd tried that hadn't worked, and in the process proved himself to be one of the world's leading adopters of AI technology in the field of history. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00:00) - Episode Preview (00:03:00) - The state of AI in history before recent advances like GPT-3 (00:06:00) - Mark's background and how he first got interested in AI (00:09:00) - Using AI to process and search through vast amounts of archival material (00:12:00) - The challenges of digitizing and searching handwritten historical documents (00:15:00) - The massive scale of undiscovered archival material that could be processed by AI (00:18:00) - How AI can help historians process more archival material than ever before (00:20:11) - Sponsors: Netsuite | Omneky (00:21:00) - Limitations on using commercial APIs for private archival documents (00:24:00) - The cost of processing archival documents compared to hiring human transcribers (00:27:00) - Comparing GPT's ability to transcribe historical handwriting vs more recent scripts (00:33:00) - Tracing individuals through complex fur trade records using AI (00:36:00) - Mark's approach to fine-tuning models for specific historical tasks (00:39:00) - Challenges teaching AI models the nuances of historical writing (00:42:00) - Privacy issues limiting the use of commercial APIs on restricted archival material (00:45:00) - The gap between people's expectations of AI and what it can really do right now (00:51:00) - Adapting assignments and student expectations to AI's current capabilities (00:52:28) - Using chain of thought prompting to teach models precise historical tasks (00:52:46) - Getting high accuracy on keyword tagging of archival documents using fine-tuning (00:57:00) - Mark has crossed the threshold from promise to accelerating archival research (01:00:00) - How to frame classification tasks to get the most value from AI models (01:03:00) - Teaching AI models to pronounce tricky historical names and terms (01:06:19) - Mark's experience using AI in the classroom over two semesters (01:09:00) - Assignments that are better suited to the current strengths and weaknesses of AI (01:11:45) - AI progress in education is lagging due to lack of institutional adoption (01:12:00) - The trajectory of AI capabilities and the need for humans to exceed the model baseline (01:27:49) - Lessons from history on economic transitions and the social contract This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode of The Cognitive Revolution, Nathan explores the complex intersection of AI development and international relations with Robert Wright, publisher of the Nonzero Newsletter. They examine the growing militarization of AI, US-China relations, and the concerning trajectory of what Wright calls "the chip war." Drawing from Nathan's recent experience at The Curve conference and an AI wargame simulation, they discuss the risks of an AI arms race and search for alternative paths to avoid catastrophic conflict between global powers. Join us for this crucial conversation about the future of AI governance and international cooperation. Subscribe to The NonZero Newsletter at https://nonzero.substack.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg SPONSORS: Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive CHAPTERS: (00:00:00) Teaser (00:00:59) Sponsors: Incogni (00:02:20) About the Episode (00:05:56) Introducing AI2 (00:09:56) Tulu: Deep Dive (Part 1) (00:17:43) Sponsors: Notion | Shopify (00:20:38) Open vs. Closed Recipes (00:29:48) Compute & Value (Part 1) (00:34:22) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:37:02) Compute & Value (Part 2) (00:42:41) Model Weight Evolution (00:53:16) DPO vs. PPO (01:06:36) Project Trajectory (01:20:39) Synthetic Data & LLM Judge (01:27:39) Verifiable RL (01:38:17) Advice for Practitioners (01:44:01) Open Source vs. Closed (01:49:18) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast

Nathan Labenz sits down with prominent – and notably prescient – AI media figures Robert Scoble and Ben Tossell. They discuss what the work of being an AI scout looks like, how to bring the mainstream along with emerging AI developments, and their predictions and hopes for AI. Robert Scoble is a long-time Silicon Valley technology explorer and connector, a futurist who's met so many technology legends in their primes that he's now also something of a historian. https://scobleizer.blog/ Ben Tossell is the creator of Ben's Bites, an AI round up newsletter meant to be read in 5 minutes or less, read by over 90,000 subscribers. https://www.bensbites.co/ This episode caps off our series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. -- We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics BOOK RECOMMENDATION: The Scout Mindset from author Julia Galef TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @Scobleizer (Robert) @bentossell (Ben SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. More original content from Nathan is published in our Substack: https://cognitiverevolution.substack.com/

In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) Intro (04:03) Reverse Engineering AI (10:10) Factual Knowledge Localization (16:34) Sponsors: Oracle | Omneky | On Deck (18:27) Future Lens Paper Intro (23:54) Choosing GPT-J (26:54) Vocabulary Prediction (30:36) Sponsors: Brave | Plumb | Squad (33:13) Fixed Prompt (35:57) Soft Prompt (41:32) Future Lens Results Analysis (51:50) Tooling & Open Source Code (56:07) Larger Models & Mamba Probes (1:04:10) Function Vectors Paper (1:09:39) Extracting & Patching Vectors (1:13:30) Encoding Task Understanding (1:15:36) Expert Models Implications (1:18:09) Conclusion

Nathan welcomes back computational biochemist Amelie Schreiber for a fascinating update on AI's revolutionary impact in biology. In this episode of The Cognitive Revolution, we explore recent breakthroughs including AlphaFold3, ESM3, and new diffusion models transforming protein engineering and drug discovery. Join us for an insightful discussion about how AI is reshaping our understanding of molecular biology and making complex protein engineering tasks more accessible than ever before. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. CHAPTERS: (00:00:00) Teaser (00:00:46) About the Episode (00:04:30) AI for Biology (00:07:14) David Baker's Impact (00:11:49) AlphaFold 3 & ESM3 (00:16:40) Protein Interaction Prediction (Part 1) (00:16:44) Sponsors: Shopify | SelectQuote (00:19:18) Protein Interaction Prediction (Part 2) (00:31:12) MSAs & Embeddings (Part 1) (00:32:32) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++ (00:34:49) MSAs & Embeddings (Part 2) (00:35:57) Beyond Structure Prediction (00:51:13) Dynamics vs. Statics (00:57:24) In-Painting & Use Cases (00:59:48) Workflow & Platforms (01:06:45) Design Process & Success Rates (01:13:23) Ambition & Task Definition (01:19:25) New Models: PepFlow & GeoAB (01:28:23) Flow Matching vs. Diffusion (01:30:42) ESM3 & Multimodality (01:37:10) Summary & Future Directions (01:45:34) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431

Nathan welcomes back Sander Schulhoff, creator of LearnPrompting.org, to discuss the recently released Prompt Report. In this episode of The Cognitive Revolution, we explore the current state of prompting techniques for large language models, covering best practices, challenges, and emerging trends in AI. Join us for an in-depth conversation on the future of prompt engineering and its implications for AI development. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 - History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:35) Sander Schulhoff, Learn Prompting (00:05:22) Hack-a-Prompt updates (00:12:39) The team behind the report (00:18:40) Sponsors: Oracle | Brave (00:20:48) The tech side of things (Part 2) (00:22:24) The taxonomy (00:25:06) Diamonds in the rough (00:28:32) Few-shot prompting design decisions (00:34:01) Sponsors: Omneky | Squad (00:35:48) Example vs. Exemplar (00:38:24) Exemplar Format (00:42:04) Elaborate Instructions (00:44:22) Variation in Performance (00:46:46) Prompt Robustness (00:50:54) RLHF vs. Base Models (00:52:42) How to improve your prompts (00:55:22) Ensembling (00:58:41) Bootstrapping into fine-tuning (01:02:04) Multimodal (01:07:41) Agents (01:09:47) Automated prompt engineering (01:12:35) Productizing learn prompting (01:14:28) Lessons from leading a team (01:16:00) Outro

Dive into the world of frontier AI development with California State Senator Scott Wiener's intricate detailing of SB 1047 bill. This podcast explores the delicate balance between accelerating AI innovation and ensuring stringent safety protocols, including potential implications for advanced AI models. Learn about the debates on government involvement, the need for independent third-party testing, and Senator Wiener's commitment to a measured approach to AI regulation. Join us for a thought-provoking discussion on the complexities of legislating emerging technologies. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:05:47) Senator Scott Wiener (00:09:38) AI policy (00:13:56) AI worldview (00:16:20) Sponsors: Oracle | Brave (00:18:28) Burden on Developers (00:26:10) Developers reaction (00:28:43) Big tech companies opposing the bill (00:31:09) Open source models (00:34:57) Sponsors: Squad | Omneky (00:36:45) Illegal activities (00:41:15) Penalties (00:44:33) Third party testing (00:48:33) Transparency requirements for model development (00:53:07) Closing thoughts

In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience. RECOMMENDED PODCAST: How Do You Use ChatGPT with Dan Shipper. Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt SPONSORS: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS : (00:00:00) Introduction (00:08:34) Compute Stack (00:19:23) Fireworks Product Philosophy (00:24:11) Sponsors : Brave / Omneky (00:25:40) Fine-tuning Strategy (00:38:40) Sponsors : Plumb / Squad (00:40:33) NVIDIA Stack Overview (00:47:14) TensorFlow Triton Service (00:55:25) Reduced Precision Advantages (01:03:57) Different Deployment Scenarios (01:08:27) Seeking Intuition on Sharding (01:19:28) Announcing Stability AI Partnership (01:32:00) Closing Remarks

In this episode from the Autopilot podcast, Sergiy Nesterenko, founder of Quilter (backed by Benchmark), discusses designing PCB circuitboards end-to-end using reinforcement learning. "Autopilot" host Will Summerlin and Nesterenko cover how current PCB boards are designed and how Quilter’s tech stack enables faster board design, what better circuit boards enable in the future, their GTM and where they are seeing most market pull right now, and much more. Subscribe to Autopilot: Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333&nd=1&dlsi=18fee5e95b284d02 Apple: https://podcasts.apple.com/us/podcast/autopilot-with-will-summerlin/id1738163836 YouTube: https://www.youtube.com/@AutopilotwithWillSummerlin Check out Nathan's new chatbot on www.cognitiverevolution.ai SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. LINKS: Quilter: https://www.quilter.ai/ Autopilot Ventures: https://www.apv.vc/ X/SOCIAL: @labenz (Nathan) @WSummerlinAI (Will) @sergiynest (Sergiy) @quilterai (Quilter) TIMESTAMPS: (00:00) Intro & Sergiy’s Background (04:31) What Sergiy learned from SpaceX (05:53) Founding thesis of Quilter and Quilter’s journey (06:57) Where would one find circuit boards? (08:11) What is the process of designing a circuit board? (09:39) Design process today with Quilter (14:34) Sponsor: Omneky (16:01) Quilter’s thesis and designing more complex circuits (18:25) How much are humans currently paid for board design (19:41) Labor dynamics in board design (20:30) Do most companies have board designers in-house? (21:14) Incentive structure (22:44) What does a high-performance circuit board look like vs low-performance? (26:37) Quilter’s technology stack (29:15) Sponsor: Plumb | Squad (31:15) How Quilter can grow with scale? (33:50) Where is circuit manufacturing happening (37:17) What other parts of knowledge work can be solved with reinforcement learning (41:03) GTM and who Quilter is selling to (42:48) Pricing (44:04) Where Quilter is seeing the most market pull right now (45:21) What makes Quilter an exciting company to work at or invest (47:14) The effects of closed research in private companies for the industry (49:25) Open source vs closed source (51:14) What Sergiy would advise to himself in his early founder (53:59) What drew Sergiy to working with Benchmark (56:19) Wrap

In this episode, Nathan chats with Guillermo Rauch, CEO of Vercel, to discuss how AI might shape the future of code, software 2.0, and the open source question in AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at https://oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @rauchg (Guillermo) @CogRev_Podcast TIMESTAMPS (00:00:00) - Introductory comments (00:03:43) - Rauch's background in open source software like Mootools and Next.js (00:04:27) - Overview of Vercel and the front-end cloud concept (00:06:15) - Productivity gains from Vercel's front-end infrastructure (00:14:50) - Sponsors: Shopify | Omneky (00:21:00) - Rauch getting inspired by GitHub Copilot code auto-completion (00:24:00) - Launching Vercel's own AI product vZero: production-ready UI code from natural language prompts (00:29:17) - Sponsors: Oracle | Netsuite (00:30:00) - Transition to discussing the future of software development (00:34:12) - vZero surpassing Rauch's own hand-coded website on accessibility (00:51:00) - Discussion about focusing on the full stack beyond just the AI model (00:54:00) - Concept of Software 2.0 using data and AI instead of classical code (00:56:00) - Maintaining software 1.0 while aggressively expanding into 2.0 paradigm (00:56:12) - Philosophical support for open source and skepticism about risks (00:57:12) - How open source software tends to quickly improve over time (00:57:47) - Prediction that AI may "ossify" existing software 1.0 technologies (01:01:12) - AI enabling more grassroots innovation like Mark Zuckerberg originally did (01:07:00) - Concerns about regulatory suppression of open source AI progress (01:03:00) - Unpredictability of new risks that could emerge like impersonation (01:11:00) - Rejecting AI doom narratives but staying vigilant on capabilities (01:12:00) - Concluding thoughts on embracing AI progress with appropriate caution This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

We’re deep diving into OpenAI DevDay with Logan Kilpatrick, Dev Relations Lead at OpenAI. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: SHOPIFY: https://shopify.com/cognitive for a $1/month trial period Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @OfficialLoganK (Logan) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:02:08) - How many startups did OpenAI kill? (00:05:50) - Current employee count at OpenAI (00:06:59) - OpenAI's mission being focused on developing safe AGI to benefit humanity (00:07:10) - How the GPT Store relates to AGI and progressing agent development (00:08:22) - OpenAI's strategy to release AI iteratively so society can adapt (00:10:50) - Safety considerations around the OpenAI Assistant release (00:11:30) - Capability overhangs and is the internet ready for agents? (00:14:13) - Why certain agent capabilities like planning aren't enabled yet by OpenAI (00:15:28) - Sponsors: Shopify | Omneky (00:17:34) - GPT-4-1106 Preview designation (00:21:50) - 16k fine-tuning for 3.5 Turbo (00:25:13) - GPT-4 Finetuning and how to join the experiment (00:27:53) - Custom models: $2-3 million pricing to build a defensible business (00:29:48) - Bringing costs down to bring custom models to more people (00:30:19) - Sponsors: Oracle | Netsuite (00:33:53) - Copyright shield (00:35:42) - OpenAI doesn’t train on data you send to the API (00:36:37) - New modalities and low res GPT vision (00:37:26) - GPT Vision Assessment for Aesthetics (00:42:30) - WhisperLarge v3 (00:44:15) - Text-to-speech API: the voice strategy and AI safety (00:51:45) - Log probabilities coming soon (00:53:45) - The evolution of plugins to GPTs: the challenges with plugins (00:55:33) - GPT Instructions, expanded knowledge, and actions (01:00:18) - How is auth handled with GPTs (01:01:04) - Hybrid auth (01:02:50) - GPT Assistant API Billing (01:07:58) - AI Safety (01:10:28) - OpenAI Jailbreaks and Bug Bounties (01:11:57) - The OpenAI roadmap for a year from now The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co

We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today, Shane Legg, Cofounder at Deepmind and its current Chief AGI Scientist, shares his insights with Dwarkesh Patel on AGI's timeline, the new architectures needed for AGI, and why multimodality will be the next big landmark. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. You can subscribe to The Dwarkesh Podcast here: https://www.youtube.com/@DwarkeshPatel We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @dwarkesh_sp (Dwarkesh) @shanelegg (Shane) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00:00) - Episode Preview with Nathan’s Intro (00:02:45) - Conversation with Dwarkesh and Shane begins (00:14:26) - Do we need new architectures? (00:17:31) - Sponsors: Shopify  (00:19:40) - Is search needed for creativity? (00:31:46) - Impact of Deepmind on safety vs capabilities (00:32:48) - Sponsors: Netsuite | Omneky (00:37:10) - Timelines (00:45:18) - Multimodality This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Aravind Srinivas of Perplexity AI returns to the show. They discuss Perplexity’s growth to millions of queries per day, CEO Aravind’s favourite Perplexity use cases, and how Perplexity ships fast in a competitive landscape against Google and major AI live players creating their own search engines. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X: @labenz (Nathan) @AravSrinivas (Aravind) @eriktorenberg (Erik) @cogrev_podcast  LINKS: - Perplexity AI: https://www.perplexity.ai/ - Part 1 with Aravind: https://www.youtube.com/watch?v=YSYQZZu4MEM TIMESTAMPS: (00:00:00) - Episode Preview (00:01:12) - Introducing Aravind Srinivas and Perplexity AI (00:05:05) - Perplexity's growth to millions of queries per day (00:06:21) - Perplexity's retention and market share vs. ChatGPT (00:08:32) - Improving reliability, speed, accuracy, and new features (00:10:33) - Getting to daily usage from weekly usage (00:13:21) - Aravind's favorite Perplexity use cases (00:18:34) - Issues with lack of sufficient web coverage for hard queries (00:18:38) - Sponsors: Netsuite | Omneky (00:23:13) - Building their own search index and models for self-sufficiency (00:26:29) - Using their own index vs real-time web queries (00:28:43) - Integrating default search and Copilot companion experiences (00:31:49) - Training their own models as the only viable long-term option (00:36:56) - The web becoming more like an API accessed via AI assistants (00:41:23) - Not trying to copy Google's business model (00:44:36) - Spending more on compute than people to get scale efficiencies (00:49:35) - Replacing all parts of the stack with their own proprietary versions (00:53:59) - Shipping fast out of necessity in a competitive war zone (00:58:00) - AI assistants becoming a significant part of human digital activity The Cognitive Revolution is brought to you by the Turpentine Media network.  Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co

Note: This conversation contains themes of suicidal ideation, in the context of academic research. Please watch from (21:41) onwards if you would like to skip past this content. In this conversation, Nathan sits down with Eugenia Kuyda, Replika's Founder and CEO. They discuss recent research published in Nature conducted by Stanford on Replika user interactions, how Replika is providing their users with a relationship they can trust and confide in, what Eugenia has found surprising about the evolution of how people are interacting with their Replikas, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS Loneliness and suicide mitigation for students using GPT3-enabled chatbots: https://www.nature.com/articles/s44184-023-00047-6 Eugenia Kuyda Part 1 on The Cognitive Revolution: https://www.youtube.com/watch?v=SFKA7T-v6WE SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @ekuyda (Eugenia) @labenz (Nathan) @CogRev_Podcast  Timestamps: (00:00) Preview and summary (06:41 The evolution of Replika (08:11) Definining the main goal of Replika (09:54) Nature published study by Stanford on Replika and mental health (14:20) Methodology for the research on Replika users (15:19) Sponsor - Brave Search API (19:46) Replika providing people with a relationship they can trust and confide in (23:20) How people are relating and reacting to their AI Replikas (25:49) Stuffed animal analogy (28:20) What people come to Replika for (30:29) Sponsor - Netsuite | Omneky (32:03) How malleable are people’s expectations for their Replika? (36:54) The evolution of how people are interacting with Replika (44:49) Putting Replika on device (46:59) Underappreciated or developed aspects of AI development (56:11) The relationship people have with their Replika is a moat (1:08:46) Building AI to memorialize people after they passed: what are the ethics? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this second part of the special AMA episode, Nathan explores profound questions about AI's future and its impact on society. From painting a picture of AI utopia to discussing the challenges of consciousness and potential doom scenarios, Nathan shares insights on how we might adapt and thrive in an AI-transformed world. Join us for a thought-provoking conversation that delves into the practical strategies for engaging with AI, the role of safety measures, and the importance of maintaining ethical considerations as we navigate this technological revolution. Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive. CHAPTERS: (00:00:00) Teaser (00:00:56) AI Utopia (00:05:48) Adapting to AI (00:08:01) Probability of Utopia (00:10:51) Challenging Worldviews (Part 1) (00:11:02) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:13:42) Challenging Worldviews (Part 2) (00:23:50) Audience Questions (Part 1) (00:24:07) Sponsors: NetSuite (00:25:39) Audience Questions (Part 2) (00:30:15) AI in Various Fields (00:33:16) AI in Psychiatry (00:36:16) Superintelligence (00:40:50) Societal Shift with ASI (00:49:27) Doom Discourse (00:57:05) Existential Risk (01:05:53) AI Takeover (01:14:30) AI Safety Efforts (01:18:36) Model Release Secrecy (01:27:20) AI Consciousness (01:37:51) Practical AI Strategies (01:50:34) Book Recommendation (01:59:34) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.appl...

In this episode, Nathan sits down with Tyler Angert, Product Designer at Replit, to discuss the future of software development. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Tyler and Nathan discuss how Replit is leveraging AI to enhance its current product, bot-bot interactions, the design and ethical considerations around AI agents, and more. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview (01:10) Nathan’s Intro (09:24) Tyler's role at Replit (11:37) Replit as the "perfect substrate for AGI" (14:55) Sponsor: Netsuite | Omneky (15:45) Defining AGI (19:26) How AI agents might interact with Replit (23:20) Replit's "virtual developer" product (31:11) Current state of Replit's AI features like Ghostwriter (41:48) Measuring productivity boost from AI coding tools (45:29) Potential for massive developer productivity gains from AI (48:34) Technical gaps still remaining to achieve advanced AI agents (51:45) Core AI breakthroughs have already occurred (57:35) Timeline for functional AI agents interacting online (01:01:20) Safety considerations for powerful AI agents on Replit (01:08:47) Ethical considerations around AI and consciousness (01:20:36) What constitutes consciousness in an AI system (01:26:30) Should AI systems have rights and protections? (01:30:32) Being polite to AI systems (01:31:59) Advice for beginners looking to leverage AI (01:36:58) Using AI with a Neuralink brain implant (01:43:02) Hopes and fears about AI's impact on society LINKS: https://replit.com/ X: @tylerangert (Tyler) @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.  -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM  This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this special AMA episode, Nathan answers questions posed by The Cognitive Revolution podcast listeners. He discusses AI developments in 2024, including OpenAI's o3 announcement, deliberative alignment, and the future of AI technology. It is an insightful discussion about AI's impact on education, coding careers, and business sustainability in an AI-driven world. Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive. CHAPTERS: (00:00:00) Teaser (00:01:00) AI Podcasting (00:03:19) o3 vs. Other Models (00:10:25) o3 Breaks Benchmarks (Part 1) (00:14:19) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:16:59) o3 Breaks Benchmarks (Part 2) (00:27:51) OpenAI's Safety Plan (Part 1) (00:28:45) Sponsors: NetSuite (00:30:18) OpenAI's Safety Plan (Part 2) (00:39:08) Safety & Governance (00:50:48) Tail of the Tape (00:59:38) Underutilized Potential (01:05:07) RAG & State Space (01:18:14) Agentic Frameworks (01:29:55) AI & Education (01:35:59) Learn to Code? (01:43:00) Defensible Moats? (01:53:53) UBI & Wealth (01:59:08) Contributing to AI Safety (02:04:25) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode, Trey Kollmer, WGA Writer and Co-Executive of the show Ghosts, returns to the show to discuss updates to the Hollywood Strikes, including news on SAG-AFTRA and WGA. Trey and Nathan chat why actors are joining the strikes, how AI will change acting as a profession, Trey’s views on reasoning and how he’s experimenting with GPT-4, and much, much more. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:04:01) Hollywood and AI: updates on SAG-AFTRA and the WGA (00:15:20) Sponsors: NetSuite | Omneky (00:18:56) Studio approach to copyright and compensation with generative AI (00:22:17) Hollywood receptiveness to using AI and protections guild members are asking for (00:24:56) Models implementing gradient descent in the weights (00:29:14) How Nathan uses models to write for the podcast (00:34:15) Generating and mining jokes in the writer’s room (00:40:18) Untraining models (00:44:20) AI writing tools and writer perception of them (00:46:34) Context length and pooling layers (00:51:11) Microsoft China (01:00:02) Actors’ strike (01:05:45) Using 1 million DALL-E images to create an AI short film (01:09:11) Deepfakes (01:12:51) The future where anyone can be a reasonable synthetic actor (01:17:33) Trey’s take on reasoning and why Hollywood should be more open to AI (01:25:49) A monk’s experience with Chat-GPT (01:28:56) Outdatedness of stochastic parrot notion; reasoning and synthesis (01:36:14) Model vs human susceptibility to adversarial attacks because of human robustness (01:47:30) Performance jumping with abstraction (01:49:22) Language model self-delegation (01:51:04) NVIDIA’s margins compared to TSMC and ASML (02:07:35) Adding an AI layer and competing with incumbents (02:13:10) Rewind AI (02:19:27) Big tech vs old school studios (02:14:52) Dramatic ironies from the picketing lines (02:21:38) AI development moments that feel like a movie (02:26:34) CEO of Inflection’s views on misuse being a greater threat than the AI itself SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM

In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future. Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/ Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/ Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr RECOMMENDED PODCAST: This Won't Last. Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:02:58) Introduction to the podcast (00:03:26) Dystopias vs utopias in fiction (00:07:29) Material abundance and utopia (00:14:57) AI and the future of work (00:20:10) AI companions and human relationships (00:22:57) Sponsors: Weights & Biases Weave | Oracle (00:25:01) Sponsor message: Positly research platform (00:26:04) Surveillance and global coordination (00:44:38) Sponsors: Omneky | Brave (00:44:52) Sponsor message: Transparent Replications project (00:46:07) AI governance challenges (00:49:36) Deep Utopia book's purpose (00:53:09) Global coordination strategies (00:59:13) The vulnerable world hypothesis (01:05:18) Bostrom's meta-ethical views (01:08:32) Listener question on meditation (01:10:17) Outro

Nathan explores the cutting-edge world of autonomous vehicles with industry expert Timothy B. Lee. In this episode of The Cognitive Revolution, we delve into the current state of self-driving technology, comparing industry leaders like Waymo and Tesla. Join us for an in-depth discussion on technical challenges, safety statistics, regulatory landscapes, and the potential future of transportation. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Second Opinion A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:01) Introduction and Guest Welcome (00:03:48) SAE Levels of Self-Driving (00:04:56) Driver Assistance vs. Fully Driverless (00:07:02) Tesla and Waymo Experiences (00:09:41) Liability and Driver Monitoring (00:11:19) Waymo's Robo-Taxi Experience (00:14:00) Tesla vs. Waymo Strategies (00:15:15) Challenges in Self-Driving Technology (00:17:38) Edge Cases and Safety Concerns (Part 1) (00:18:09) Sponsors: Oracle | Brave (00:20:13) Edge Cases and Safety Concerns (Part 2) (00:23:53) Data Acquisition and Learning Strategies (00:26:43) Technology Stack and Planning (00:31:03) Sponsors: Omneky | Squad (00:32:50) Neural Networks and Perception (00:39:30) Hardware and Sensor Approaches (00:45:46) Camera vs. LiDAR Debate (00:48:20) Data Quality and Business Models (00:52:24) Transparency and Regulation (01:07:36) Other Notable Players (01:10:56) Safety Statistics and Adoption (01:20:31) Regulatory Environment (01:30:09) Potential Policy Changes (01:33:41) Market and Ownership Models (01:36:37) Future of Self-Driving Services (01:42:17) Comparisons to Language Models (01:44:55) Future of AGI and AI Applications (01:47:59) Regional Adoption Predictions (01:49:47) Outro

In this episode from new podcast Emergent Behavior, host @Ate-a-Pi interviews the co-founders of Prophetic AI to learn how they're using AI to facilitate lucid dreaming. Prophetic had come up in the recent Cognitive Revolution conversation with Dean W. Ball about brain computer interfaces, and Nathan had them on the list of companies to invite on the show, so it was really fun to discover that Ate-a-Pi had already done an interview with them right around the same time. -- Subscribe to Emergent Behavior: Spotify: https://open.spotify.com/show/2KfbuKL7iqIfbpY31PHtEg Apple: https://podcasts.apple.com/us/podcast/emergent-behavior/id1735023473 YouTube: https://www.youtube.com/@EmergentBehaviorPod & Check out Nathan's new chatbot on www.cognitiverevolution.ai -- RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 -- SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. -- TIMESTAMPS: (00:00) Intro (00:43) Diving Deep with Prophetic AI (02:18) Exploring Lucid Dreaming with Halo (05:08) The Technical Marvel Behind Halo (07:25) A Deep Dive into Lucid Dreaming Experiences (13:15) Sponsor: Brave | Omneky (14:42) Do All People Have Lucid States? (32:19) Sponsor: Squad (41:05) Building the Neural Model for Dream Control (43:15) Exploring the Intersection of EEG, fMRI, and Ultrasound in Lucid Dreaming (43:48) The Journey from Open Source Data to Targeted Brain Stimulation (47:08) Collaboration with the Donders Institute and the Future of Lucid Dreaming Research (48:40) The Role of Machine Learning and AI in Enhancing Data Collection and Analysis (50:04) From Theory to Practice: Implementing Transcranial Focused Ultrasound (TFUS) (53:51) Personalizing the Lucid Dreaming Experience through Reinforcement Learning (1:16:18) Looking Ahead: The Potential and Challenges of Neurostimulation Technology (1:22:55) Addressing the Skeptics: The Debate Over Natural vs. Technologically Induced Lucid Dreaming

How will GPT4 change the world? How will US-China 'racing dynamics' play out and what are the implications for AI safety? Nathan Labenz was invited to record a special "emergency" episode of ChinaTalk podcast this week to discuss the implications GPT4 will have for policy, economics, and society. Thanks to Jordan Schneider of ChinaTalk, and fellow "AI justice league" guests Zvi Mowshowitz of 'Don't Worry About the Vase' and Matthew Mittelsteadt of Mercatus.  We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.   (0:00) Intro (2:09) GPT-4 emergency podcast (9:26) GPT-4 use cases (22:51) What GPT-4 can and can’t do (35:50) AI safety (45:38) OpenAI v. Anthropic  (48:54) Governments’ role in AI (55:50) AI will improve physical health and healthcare the most (59:19) Facebook’s LLaMA model (01:05:55) VR/AR (01:08:59) Concerns with GPT4 (01:15:26) GPT-5 and GPT-6 (01:18:45) Optimism in the AI revolution SPONSOR: SHOPIFY | OMNEKY Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @labenz (Nathan) @jordanschnyc (Jordan)  Websites: cognitivervolution.ai RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this video, Nathan chats to Dan Shipper, CEO and Co-founder of Every, for the series "How I Use Chat-GPT". They discuss Nathan's prompting techniques for creative and cognitive labour, and using GPT in copilot instead of delegation mode. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Watch the rest of the series, "How I Use ChatGPT", here: https://www.youtube.com/@EveryInc We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @danshipper (Dan) @CogRev_Podcast (Cognitive Revolution) @Every (Every) TIMESTAMPS: (00:00) - Episode Preview (00:03:57) - Copilot vs delegation mode (00:11:06) - ChatGPT for coding (00:14:29) - Building a prompt coach (00:28:22) - Best practices for using Chat-GPT (00:43:55) - The “dance” between you and AI (00:50:16) - Using GPT as a thought partner (00:52:07) - Using GPT for diagrams (01:03:18) - Using Perplexity instead of a search engine (01:12:00) - What's ahead for AI This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Nathan sits down with Richard Socher, CEO and Founder of You.com, a personalized AI search assistant. They discuss the rise of the AI chatbot paradigm and how that's changed the game for search, You.com's various modes, with particular emphasis on Genius mode and above all Research mode, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - You.com: https://you.com/ -Richard Socher's site: https://www.socher.org/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @RichardSocher (Richard) @YouSearchEngine @CogRev_Podcast TIMESTAMPS: (00:00) Preview (01:38) Interview with Richard Socher: AI pioneer (02:26) Exploring the You.com product (02:55) The AI Bundle (05:23) Richard Socher's journey in deep learning (16:43) You.com comparison to competitors (31:16) The future of AI search engines (41:38) The changing landscape of search engines (41:44) The impact of chatbots and AI on search (42:16) How the market will shape up (43:33) The power of open source (01:02:32) The role of AI in advancing science (51:42) The future of AI: philosophical and practical considerations (55:06) The future of AI: risks and regulations (01:11:07) The future of AI: agency and emergence (01:26:57) The future of AI: retrieval, memory, and online learning This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Nathan hosts Albert Gu, assistant professor at CMU and co-founder of Cartesia AI, to discuss the groundbreaking Mamba architecture. In this episode of The Cognitive Revolution, we explore the state space model revolution, diving into the technical details of Mamba and Mamba 2. Join us for an insightful conversation on the future of AI architectures and their potential to transform the field. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:05:39) State Space Models (00:13:05) Intuition and inspiration (00:18:27) Surprises (00:22:33) Sponsors: Oracle | Brave (00:24:41) Biological inspiration (00:25:19) MAMBA breakthrough (00:30:59) How does the state work? (00:36:44) What is the size of the state? (00:39:05) Training vs. Inference (Part 1) (00:42:04) Sponsors: Omneky | Squad (00:43:51) Training vs. Inference (Part 2) (00:43:51) Sequence Models (00:49:20) Mamba inference (00:57:53) Mamba2 vs Mamba1 (01:16:05) Overtraining and the future of SSMs (01:17:44) Training efficiency vs inference efficiency (01:20:52) Hybrid models (01:25:04) Scaling Attention Layers (01:30:23) Optimizing State (01:34:09) The extrapolation abilities of the SSMs (01:36:37) Sequence parallelism with Mamba 2 (01:39:20) Why are you publishing all this? (01:40:46) Cartesia and Together (01:41:54) Outro

Phil Murphy, the Governor of New Jersey, joins Nathan to discuss his proactive approach to AI and its potential transformative impact on society. Governor Murphy shares insights from a pivotal dinner with AI thought leaders that spurred New Jersey's ambitious AI initiatives, including the establishment of the NJ AI Hub with Princeton University. He elaborates on current applications, like the AI assistant used by state employees, and discusses broader implications for local governance, workforce training, and public services. Murphy touches upon ethical considerations, potential job displacement, and regulatory challenges, emphasizing the need for a balance between innovation and fairness. The conversation also explores international competition, particularly with China, and reflects on the rapid pace of AI advancement. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing

Nathan interviews Google product managers Shrestha Basu Mallick and Logan Kilpatrick about the Gemini API and AI Studio. They discuss Google's new grounding feature, allowing Gemini models to access real-time web information via Google search. The conversation explores Gemini's rapid growth, its position in the AI landscape, and Google's competitive strategy. Nathan shares insights from integrating Gemini into his own application and ponders the future of large language model capabilities across providers. Tune in for an in-depth look at Google's AI API product strategy and the latest Gemini features. Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr CHAPTERS: (00:00:00) About the Show (00:00:53) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:04:15) Gemini API Growth (00:05:26) Intro to AI Studio (00:07:35) Vertex vs. AI Studio (00:09:33) Developer Adoption (00:14:23) Gemini Use Cases (Part 1) (00:17:41) Sponsors: Shopify | Notion (00:20:01) Gemini Use Cases (Part 2) (00:23:08) Multimodality & Flash (00:26:29) Free Tier & Costs (00:31:43) Inference Costs (00:32:55) Fine-tuning & Vision (00:36:59) Sponsors: LMNT (00:38:04) Search Grounding (00:44:42) Grounding Sources (00:46:58) Competitive Landscape (00:50:36) Design Decisions (00:54:54) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode, Nathan and Erik discuss research out of Google Deepmind suggesting LLMs, Hemant Teneja’s responsible VC commitments, and why now is not the time for an ideological war on AI regulation. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  RECOMMENDED PODCAST: Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Opening discussion of recent viral tweet claiming LLMs can't generalize (00:03:27) - Waymo Safety Research  (00:10:12) - Response to Google Deepmind’s research claiming LLMs can’t generalize (00:15:08) - Sponsors: Shopify | Omneky  (00:21:38) - Reproduction of the DeepMind research showing noise allows generalization (00:26:02) - Helen of Transforrmers  (00:30:15) - Sponsors: Oracle | Netsuite (00:32:36) - Continuation of Google Deepmind discussion (00:42:47) - “The AI Executive Order will only continue to look more foolish from here”  (00:44:09) - The AI Scout mindset (00:45:22) - Few humans can extrapolate beyond their training data (00:48:45) - When does GPT-4 deceive its user?  (00:49:58) - Voluntary Responsible AI Commitments from VCs  (00:54:00) - Analysis of the commitments as basic common sense practices (00:56:30) - No need for an ideological war  (00:57:00) - Discussion of critical reactions framing the commitments as capitulation (01:00:00) - Concerns about the voluntary commitments enabling harmful regulation (01:03:00) - Rebuttal that self-regulation can avoid heavy handed regulation  (01:08:00) - Self driving cars: the invisible lives you can save (01:11:00) - Mysticism when it comes to AI (01:12:03) - Suggestion that product liability law could address concerns (01:15:00) - Challenge to defend rejecting product liability for AI systems This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this episode, Nathan Labenz speaks with Vivek Natarajan and Anil Palepu from Google DeepMind about their groundbreaking work on AMIE (Articulate Medical Intelligence Explorer) and Co-Scientist. The conversation reveals how these AI systems are already outperforming human physicians in diagnostic accuracy and treatment recommendations, with AMIE now entering clinical trials at a Harvard Medical School teaching hospital. Even more remarkably, the Co-Scientist system demonstrates genuine scientific discovery capabilities, independently proposing the exact same mechanism for bacterial drug resistance that human scientists had recently discovered but not yet published—signaling a threshold moment where AI is becoming a legitimate thought partner in humanity's most complex intellectual endeavors. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (06:26) Introduction and Welcome (07:49) AMY Medical Intelligence Overview (11:29) Chat-Based Medical Interactions (13:59) Specialized Medicine Results (18:17) Co-Scientist System Headlines (Part 1) (18:21) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (21:36) Co-Scientist System Headlines (Part 2) (26:32) Bacterial Drug Resistance Discovery (31:41) AI Scientific Discovery Process (35:35) Hallucinations vs. Creativity (Part 1) (35:37) Sponsors: NetSuite (37:10) Hallucinations vs. Creativity (Part 2) (42:04) Agent Design Architecture (49:17) Long Context Benefits (55:35) Computational Requirements (01:01:10) Specialist Models Integration (01:07:01) Future Model Integration (01:12:31) Tournament Evaluation Methods (01:19:09) AI Question Generation (01:22:42) Real-World Deployment Plans (01:25:58) Outro

In this episode of The Cognitive Revolution, Nathan interviews Michael Boyce, Director of DHS's AI Corps, about bringing modern AI capabilities to federal government. We explore how the largest civilian AI team in government is transforming DHS's 22 agencies, from developing shared AI infrastructure to innovative applications like AI-powered asylum interview training. Join us for an insightful conversation about the intersection of artificial intelligence and public service, and discover why AI professionals should consider a career in government. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:00) About the Episode (00:03:38) Introducing Michael Boyce (00:05:49) What is Homeland Security? (00:09:52) History of AI at DHS (00:13:15) Generative AI at DHS (00:16:03) Structure of the AI Core (Part 1) (00:18:17) Sponsors: Shopify | SelectQuote (00:20:51) Structure of the AI Core (Part 2) (00:22:04) Opportunities for AI at DHS (00:25:34) Bureaucracy Hacker (00:30:34) The Manager's Role (Part 1) (00:35:24) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:38:04) Internal Chatbot Project (00:43:28) AI Role Playing for Training (00:49:55) A Request for Startups (00:57:46) Generative AI for Quality Check (01:03:20) AI Training at DHS (01:06:07) Metrics and the Future of AI (01:13:26) Non-Generative AI at DHS (01:19:08) AI and Automation at DHS (01:23:03) Join the AI Core (01:28:39) Outro

Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI. Papers Very accessible article on types of representations: Local vs Distributed Coding Theoretical understanding of how models might pack concepts into their representations: Toy Models of Superposition How structure in the world gives rise to structure in the latent space: The Geometry of Categorical and Hierarchical Concepts in Large Language Models Using sparse autoencoders to pull apart language model representations: Sparse Autoencoders / Towards Monosemanticity / Scaling Monosemanticity Finding & teaching concepts in superhuman systems: Acquisition of Chess Knowledge in AlphaZero / Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero Connecting microscopic learning to macroscopic phenomena: The Quantization Model of Neural Scaling Understanding at scale: Language models can explain neurons in language models Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:52) Introduction and Background (00:08:43) State of Interpretability Research (00:12:06) Key Insights in Interpretability (00:16:53) Polysemanticity and Model Compression (Part 1) (00:17:00) Sponsors: Oracle | Brave (00:19:04) Polysemanticity and Model Compression (Part 2) (00:22:50) Sparse Autoencoders Explained (00:27:19) Challenges in Interpretability Research (Part 1) (00:30:54) Sponsors: Omneky | Squad (00:32:41) Challenges in Interpretability Research (Part 2) (00:33:51) Goodfire's Vision and Mission (00:37:08) Interpretability and Scientific Models (00:43:48) Architecture and Interpretability Techniques (00:50:08) Quantization and Model Representation (00:54:07) Future of Interpretability Research (01:01:38) Skepticism and Challenges in Interpretability (01:07:51) Alternative Architectures and Universality (01:13:39) Goodfire's Business Model and Funding (01:18:47) Building the Team and Future Plans (01:31:03) Hiring and Getting Involved in Interpretability (01:51:28) Closing Remarks (01:51:38) Outro

Today’s episode is a deep dive into the collision of AI and the future of entertainment, against the backdrop of the still-raging Writers Guild of America (WGA) strike. Nathan Labenz sits down with Trey Kollmer, Sophia Lear, and Garrett Schabb – all seasoned television writers and Guild members – to discuss the labor dispute. While the strike encompasses many dynamics, the timely intersection with a rapidly changing AI landscape has the writers entwined in the wild possibilities and existential threats of paradigm-shifting technology. Other entertainment guilds and labor unions are watching closely. Note: Nathan kicks off this episode with a longer-than-usual introduction and analysis as the subject matter of this episode requires some added context. If you would prefer to dive straight into the interviews, follow the timecodes below to skip ahead (and maybe give the intro a listen when you finish!) More about our guests Trey Kollmer, Sophia Lear, and Garrett Schabb and their work: Trey Kollmer, currently co-executive producer for the TV show Ghosts, was described to me as perhaps the single most knowledgeable guild member on the topic of AI. Follow him at @treyko on Twitter. Sophia Lear has been a writer for TV shows including Ghosts, The Unicorn, and New Girl, and was also previously an assistant literary editor for the New Republic. Garrett Schabb has written for shows including Tosh.0 and Suits (of Meghan Markle fame), and has also written for Crooked Media. Follow him at @garrettschabb TIMESTAMPS: (00:00) Preview (01:54) Introduction and analysis for this episode  (09:02) Trey Kollmer breaks down the dynamics of compensation, ownership and crediting for WGA writers, issues at the heart of the strike (14:52) Sponsor: Omneky (15:09) Recommendation: The AI Breakdown (22:42) Usefulness of AI for script writing (and will better training out of jailbreaks make it less useful?)  (30:59) The main two AI-related demands of the labor dispute (42:48) Writers’ diverse reactions to AI, from hostility to experimentation (50:00) Picturing a long term Utopian future (57:46) Sophia Lear breaks down sentiments around GPT-4, AI-generated scripts and the previous eras of crappy sitcoms and bad streaming series (written by humans) (1:11:27) Whose jobs are safe? (1:17:03) Garrett Schabb breaks down dystopian/realistic view of studio’s incentives (1:20:33) How Garrett uses ChatGPT (1:27:37) Ethical boundaries of using the model to write like your favorite writers (1;32:16) The two types of storytelling in the future, UBI and decoupling writing from a profession SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Tune in to this special episode of the Cognitive Revolution for AI scouting report. We cover the state of the art in AI applications for medicine, key AI concepts, and how these technologies could influence society. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:06:13) Current State of the Art (00:08:34) Medicine (00:13:49) AI limitations (00:17:01) AI capabilities (00:17:02) Sponsors: Oracle | Brave (00:19:09) How AI works (00:24:05) Information processing (00:28:51) Curated data sets (00:32:52) Sponsors: Squad | Omneky (00:34:38) Transformer (00:37:11) Scaling (00:39:59) Emergence (00:44:03) Grokking (00:50:30) Best practices for business (00:53:38) Live Players (00:58:33) What to Watch (01:00:35) Final Thoughts

In this episode of The Cognitive Revolution, Eric Simons, founder and CEO of StackBlitz, discusses the transformative impact of AI on the software development industry. Eric delves into the vision and technologies behind Bolt (bolt.new), StackBlitz's groundbreaking AI-driven platform, which enables users to build full-stack applications with ease. He talks about the future of AI in coding, the balance between human oversight and AI autonomy, and the infrastructure that powers Bolt's capabilities. With the platform growing rapidly and generating millions in ARR, StackBlitz is pushing the boundaries of what AI can achieve in web development. Checkout bolt here: http://bolt.new SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:42) About the Episode (03:33) Introduction to Eric Simons and StackBlitz (04:04) Eric's AI Worldview (07:56) The Future of Software Development (12:16) Target Customers and Use Cases (Part 1) (15:41) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (18:21) Target Customers and Use Cases (Part 2) (18:40) Challenges and Solutions in AI-Driven Development (25:57) Success Metrics and Technological Innovations (Part 1) (32:15) Sponsors: Shopify (33:35) Success Metrics and Technological Innovations (Part 2) (39:20) Demo of Bolt's Capabilities (49:02) AI Agent Integration (49:13) Cost-Effective Development (49:30) Non-Technical Founders (50:02) Pricing Model Insights (53:39) Open Source and Local Deployment (57:06) In-Browser Development (01:09:16) Future of AI in Development (01:20:17) Balancing Present and Future (01:22:34) Conclusion and Hiring (01:24:06) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast PRODUCED BY: http://aipodcast.ing

Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence. Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/ Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:04:47) Introduction and Background (00:08:42) Deger's Journey to Forecasting (00:13:06) Current State of Forecasting (00:20:23) Sponsors: 80,000 Hours | Brave (00:22:55) Overview of Metaculous (00:23:30) AI Forecasting Research Papers (00:35:44) Sponsors: Omneky | Squad (00:37:31) AI Forecasting Benchmark Tournament (00:44:01) Improving Forecasting Accuracy (00:51:56) Scoring System and Tournament Rules (01:04:17) AI Forecasting Benchmark Series Details (01:11:03) Tournament Structure and Participation (01:17:07) Consistency in AI Forecasting (01:34:36) Risks and Challenges in Forecasting (01:42:43) Consensus Illusion and Policy Making (01:53:55) Outro

In this thought-provoking conversation, Helen Toner, Director of Strategy at the Center for Security and Emerging Technology (CSET), discusses her perspectives on AI development, regulation, and international competition. Toner shares insights from her time on OpenAI's board, clarifying that reports about a "Q*" breakthrough influencing the board's decision were "totally false." She introduces her concept of "adaptation buffers"—critical windows of time between when AI capabilities are first demonstrated and when they become widely accessible—arguing that society needs this time to build resilience against potential misuse. Toner also explores the challenges of implementing effective AI governance, military applications of AI decision support systems, and the complex dynamics of US-China relations in the emerging AI landscape. Helen Toner's appearance on the TED AI show: https://www.ted.com/talks/the_ted_ai_show_what_really_went_down_at_openai_and_the_future_of_regulation_w_helen_toner Helen Toner's substack : https://helentoner.substack.com/ Additional recommended reads: https://helentoner.substack.com/p/nonproliferation-is-the-wrong-approach https://cset.georgetown.edu/publication/ai-for-military-decision-making/ https://www.lawfaremedia.org/article/ai-regulation-s-champions-can-seize-common-ground-or-be-swept-aside https://www.economist.com/by-invitation/2024/05/26/ai-firms-mustnt-govern-themselves-say-ex-members-of-openais-board SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Teaser (06:04) Introduction and Background (09:32) AI Timeline Perspectives (12:26) OpenAI Board Experience (17:04) OpenAI Culture Discussion (Part 1) (19:20) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (20:33) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (22:30) OpenAI Culture Discussion (Part 2) (24:03) OpenAI's Contradictory Messaging (26:15) Whistleblowing in AI (31:30) AI Transparency Requirements (Part 1) (36:30) Sponsors: NetSuite (37:58) AI Transparency Requirements (Part 2) (38:38) Adaptation Buffers Concept (44:06) Technical vs. Societal Solutions (52:13) AI Regulation Approaches (57:20) Iterative Deployment Challenges (01:05:50) US-China AI Competition (01:14:54) Military Decision Support Systems (01:20:57) Future AI Military Equilibrium (01:27:39) Outro

People have long been imagining AI assistants. Flo Crivello (founder of Teamflow) is turning that dream into a reality with the ambitious project Lindy. Flo sits down with Nathan on Lindy's announcement day to talk about this unique moment in AI, Lindy's capabilities, single-use apps, and how he sees the global impact that AI-powered employees can have on the future of work. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.  Anyone who mentions "The Cognitive Revolution" when signing up for the Lindy beta will get priority access.  (0:00) Preview  (1:05) Sponsor: Omneky  (4:50) Flo demos Lindy (9:21) Security and user experience  (11:55) How this AI moment compares to the Industrial Revolution and single use apps  (15:00) The dream AI assistant (19:54) Competition and advantages of startups  (24:28) Cost vs Quality  (31:19) How Lindy uses user data  (32:37) Context and data injection  (28:11) Comfort with ambiguity  (43:10) Use of guardrails and trust concerns  (47:26) AI safety and edge cases  (49:16) Impact on labor markets  (50:27) Economic resilience  (52:09) Future of work  (55:49) Rapid fire questions    SPONSORS: SHOPIFY | OMNEKY Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.  Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack  Websites:  lindy.ai *mention "The Cognitive Revolution" when you sign up for the waitlist to get priority access*  thecognitiverevolution.ai  Twitter:  @CogRev_Podcast  @labenz (Nathan)  @Altimor (Flo) RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this crossover episode of The Cognitive Revolution, Nathan Labenz joins Liron Shapira of Doom Debates, for a wide-ranging news and analysis discussion about recent AI developments. The conversation covers significant topics including GPT-4o image generation's implications for designers and businesses like Waymark, debates around learning to code, entrepreneurship versus job security, and the validity of OpenAI's $300 billion valuation. Nathan and Leron also explore AI safety organizations, international cooperation possibilities, and Anthropic's new mechanistic interpretability paper, providing listeners with thoughtful perspectives on the high-stakes nature of advanced AI development across society. All the links mentioned in the episode: https://docs.google.com/document/d/1LyFMLH5VpkhY7KfFBpgi2vhfbmdbDtQ4hh03KXEXyiE/edit?usp=sharing SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (02:58) Introduction and Guest Background (08:23) P Doom Discussion (13:15) Anthropic Leadership Concerns (Part 1) (19:50) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (21:04) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (23:00) Anthropic Leadership Concerns (Part 2) (29:34) GPT-4o Image Capabilities (Part 1) (29:43) Sponsors: NetSuite (31:11) GPT-4o Image Capabilities (Part 2) (38:19) AI Impact on Creative Work (48:26) Future of Software Engineering (01:02:10) NVIDIA Stock Discussion (01:09:21) OpenAI's $300B Valuation (01:17:37) AI Models and Safety (01:33:58) Packy's AI Concerns Critique (01:46:41) Emmett Shear's Organic Alignment (02:04:43) Anthropic's Interpretability Paper (02:17:53) International AI Cooperation (02:27:38) Outro

In this episode, Nathan sits down with Robin Hanson, associate professor of economics at George Mason University and researcher at Oxford’s Future of Humanity Institute. They discuss the comparison of human brains to LLMs and legacy software systems, what it would take for AI and automation to significantly impact the economy, our relationships with AI and the moral weight it has, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Robin’s Book, The Age of Em: https://ageofem.com/ Robin’s essay on Automation: https://www.overcomingbias.com/p/no-recent-automation-revolutionhtml Robin’s Blog: https://www.overcomingbias.com/ AI Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81ee&pp=iAQB Dr. Isaac Kohane Episode: https://www.youtube.com/watch?v=pS5Vye671Xg SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @robinhanson (Robin) @CogRev_Podcast TIMESTAMPS (00:00) Preview (07:10) Why our current time is a “dream time” and the move back to a Malthusian world (13:30) What sort of world should we be striving for? (13:40) Sponsor - Brave (17:50) Distinguishing value talk from factual talk (18:00) Comparing and contrasting Ems to LLMs (22:30) The comparison of human brains to legacy software systems (30:52) Sponsor - Netsuite (41:01) AIs in medicine (53:30) A several century innovation pause (55:30) Achieving full human level AI in the next 60-90 years (1:03:55) Chess and routine benchmarks not a good predictor of AI performance in the economy (1:07:44) Reaching and exceeding human-level AI in the next 1000 years (1:11:40) Losing technologies tied to scale economies (1:12:00) Why AI is hard to maintain in the long run (1:12:20) Standard deviation in automation (1:14:05) Computing power grows exponentially but automation grows steadily (1:15:50) AI art generation and deepfakes (01:21:42) The economics of AI-powered coding (1:33:51) Merging LLMs (1:36:02) Rot in software and the human brain (1:40:18) Parallelism in LLMs and brain design (1:41:00]) Moral weight for AIs, enslavement, and cooperation with AI (1:47:10) What would change Robin’s mind about the future (1:49:18) Wrap This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this sponsored episode of The Cognitive Revolution, Nathan interviews Andrei Oprisan, Engineering Lead at Agent.ai. They explore the cutting-edge world of AI agents and their impact on the future of work. Andrei shares insights on language model limitations, best practices for building AI agents, and Agent AI's vision as a professional network for AI agents. The conversation covers technical details like fine-tuning models, vector database choices, and privacy-preserving techniques. Don't miss this deep dive into AI's role in transforming industries and the skills needed in an AI-augmented workplace. Check out Agent.ai website here: https://agent.ai Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases Weave (00:01:28) About the Episode (00:05:36) Introduction and AI Agents Overview (00:07:02) Current State of AI Agents (00:11:30) Building and Optimizing AI Agents (00:19:01) Sponsors: Oracle | Brave (00:21:05) Agent.ai Platform and Marketplace (00:31:12) Sponsors: Omneky | Squad (00:32:38) Customization and Context for Agents (00:33:34) Business Model and Monetization (00:36:53) Tech Stack and Development Process (00:43:55) Future of Work and AI Impact (01:03:46) Fine-tuning and Chain of Thought (01:14:30) Capturing Human Reasoning Process (01:21:00) Preparing for Rapid AI Advancement (01:40:58) AI's Impact on Jobs and Society (02:00:16) Closing Thoughts and Future Outlook (02:03:33) Sponsors: Outro

In this episode of the Cognitive Revolution, Guy Gur-Ari, Co-Founder and Chief Scientist at Augment, explores the transformative impact of AI on the software industry. Highlighting Augment's unique approach, Gur-Ari discusses the challenges and solutions associated with integrating AI into large codebases, the nuances of maintaining context in AI-driven coding tools, and the evolving economics of AI-driven businesses. He shares insights on the company's focus on reinforcement learning from developer behaviors, future trends in software development, and offers advice for junior developers entering an AI-enhanced industry. The conversation also touches upon the vital role of user data, the complexities of vector databases, and the potential of agentic flows to revolutionize coding processes. SPONSORS: Box AI: Box AI revolutionizes content management by unlocking the potential of unstructured data. Automate document processing, extract insights, and build custom AI agents using cutting-edge models like OpenAI's GPT-4.5, Google's Gemini 2.0, and Anthropic's Cloud 3.7 Sonnet. Trusted by over 115,000 enterprises, Box AI ensures top-tier security and compliance. Visit https://box.com/ai to transform your business with intelligent content management today Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:38) Introduction and Welcome (04:46) The Software Supernova Series (05:23) Augment's Unique Approach to AI in Software Development (06:16) Challenges in Large Code Bases (07:32) Understanding Augment's Customer Base (09:19) Context Management in AI (11:46) Technical Insights and Blog Highlights (13:16) Context Management and Code Indexing (19:35) Sponsors: Box AI | Oracle Cloud Infrastructure (OCI) (22:40) Developer Workflows and AI Integration (29:04) Vector Databases and Retrieval Systems (Part 1) (33:25) Sponsors: Shopify | NetSuite (36:13) Vector Databases and Retrieval Systems (Part 2) (37:29) Best Practices for Building RAG Applications (50:36) Establishing a Solid Process for Model Evaluation (51:01) Optimizing Experimental Iteration Time (53:10) Exploring Reinforcement Learning from Developer Behaviors (54:14) Challenges and Benefits of User Data in AI (01:05:34) The Economics of Running an AI Company (01:14:16) Future of Software Development and AI Integration (01:18:51) Advice for Junior Developers in the AI Era (01:23:58) Conclusion and Final Thoughts (01:24:50) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/

Nathan Labenz interviews Div Garg, founder of MULTI·ON, the world's first personal AI agent and life copilot. Div talks about the product strategy and roadmap for the MULTI·ON browser, their natural language approach to skills, and the steps they are taking to ensure user safety. Div explains how the platform uses a critic model to detect the success or failure of tasks, and how it can be used to book flights, order food, and more. Div also talks about the future of memory systems, such as the user profile feature, and how it can be used to improve the user experience. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics The Cognitive Revolution is part of the Turpentine podcast network. Learn more at turpentine.co Have your AI questions answered on an episode by emailing TCR@turpentine.co Send your friends our 90 min AI Scouting Report with visual aides! The AI Scouting Report Part 1: The Fundamentals is on YouTube at https://www.youtube.com/watch?v=0hvtiVQ_LqQ . Part II is coming next week. TIMESTAMPS: (00:00) Episode preview (06:42) AI agents applied to everyday life. (12:03) AI-driven automation with browser extension. (15:02) Sponsor: Omneky (18:17) AI-driven automation of web tasks. (23:57) Task automation and planning. (29:43) Automate task completion with user validation. (34:45) Lifelong learning agent with high-level skills (40:19) Guiding users to create skills safely. (46:53) AI assistant to simplify lives. (53:14) Unlock parallelism with AI agents. LINKS: MULTI·ON: https://www.multion.ai/ Div Garg; https://divyanshgarg.com/ TWITTER:  @labenz (Nathan)  @DivGarg9 @eriktorenberg (Erik)  @cogrev_podcast SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music: GoogleLM

Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:07:03) Introduction and Recap of SB 1047 (00:13:40) Key Changes and Current Status of SB 1047 (00:19:51) Sponsors: Oracle | Brave (00:21:55) Dean's Perspective on SB 1047 (00:33:30) Sponsors: Omneky | Squad (00:35:16) Steve's AI Sensemaking Project (00:39:03) Differing Views on AI Regulation Necessity (00:46:34) Nathan's Case for SB 1047 (00:55:07) Dean's Response and Liability Concerns (01:10:48) Potential Scenarios and Impacts of SB 1047 (01:29:29) Final Thoughts and Predictions on SB 1047 (01:38:16) Closing Remarks on AI Policy Challenges (01:39:51) Outro

In this groundbreaking episode of the Cognitive Revolution, we explore the intersection of AI and biology with expert Amelie Schreiber. Learn about the advances in drug design, protein network engineering, and the unfolding AI revolution in scientific discovery. Discover the implications for human health, longevity, and the future of biological research. Join us as we delve into an exciting conversation that may redefine our understanding of biology and medicine. Further links : Follow Amelie here : https://x.com/amelie_iska, https://huggingface.co/AmelieSchreiber Read Amelie's blog here : https://huggingface.co/blog/AmelieSchreiber/protein-optimization-and-design SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:04:53) Introduction to Amelie Schreiber and the Podcast (00:08:59) Understanding Protein Interactions (00:11:45) Traditional Methods vs. AI Approaches (00:13:51) Molecular Dynamics and AI Models (00:18:02) AlphaFold and Protein Structure Prediction (00:18:43) Sponsors: Oracle | Brave (00:20:51) Protein Dynamics and New AI Models (00:32:36) Sponsors: Squad | Omneky (00:34:22) Challenges in Protein Interaction Models (00:44:44) Generalization and Data Splitting in AI Models (00:48:43) Advanced AI Models for Protein Complexes (00:52:25) Practical Applications of AI in Biochemistry (01:01:53) Designing Protein Sequences with Ligand and PNN (01:05:19) Binder Design and Fold Conditioning (01:08:48) Challenges and Bottlenecks in Drug Discovery (01:16:09) Adoption and Accessibility of New Technologies (01:21:04) Future Prospects and Ethical Considerations (01:37:08) The Role of AI Agents in Biological Research (01:40:18) Balancing Innovation and Safety in Biotechnology

In this episode of the Cognitive Revolution podcast, Logan Kilpatrick, Product Manager at Google DeepMind, returns to discuss the latest updates on the Gemini API and AI Studio. Logan delves into his experiences transitioning to DeepMind and the restructuring within Google focusing on AI. He highlights new product releases, including the Gemini 2.0 models, and their implications for developers. Logan also touches on the future of AI in text-to-app creation, the impact of reasoning and long context in models, and the broader industry trends. The conversation wraps up with insights into fine-tuning, reinforcement learning, vision language models, and startup opportunities in the AI space. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:54) Introduction and Welcome (03:56) The Future of Text App Creation (05:15) Multimodal API and Real-World Applications (10:37) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (13:17) The Evolution of Long Context and Reasoning (19:19) Vision Language Models and Passive Applications (21:50) New Launches and Future Prospects (Part 1) (28:35) Sponsors: Shopify (29:55) New Launches and Future Prospects (Part 2) (31:55) Flashlight Models and Cost Efficiency (34:36) Pro Models and Frontier Applications (39:52) Evaluating AI Models (48:57) Fine-Tuning and Reinforcement Learning (51:42) Opportunities for Startups (55:52) Conclusion and Final Thoughts (56:59) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing

We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today: Nita Farahani shares her insights with 80,000 Hours' Luisa Rodriguez on the current state of neurotechnology and its potential impacts on various fields, including work, healthcare, privacy, and even human cognition. The discussion includes Farahani's assessment of devices like SmartCap and Neuralink, the concept of cognitive liberty, the risks of the technology, and the need for proper regulation and ethical considerations. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Nita Farahany is a professor of law and philosophy at Duke Law School and discusses the applications of cutting-edge neurotechnology. You can subscribe to The 80,000 Hours Podcast here: https://80000hours.org/podcast/ --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @8000hours (The 8000 Hours podcast) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00) Nathan intro's this episode with Nita Farahany (03:26) The Future of Neurotechnology: From Neuralink to Meta (05:40) The Potential of Brain-Computer Interfaces in Military Applications (11:29) The Role of Neurotechnology in National Security (15:20) SPONSORS: SHOPIFY | NETSUITE (18:14) The Potential of Brain-Computer Interfaces in Communication and Data Transfer (21:19) The Future of Super Soldiers and Brain-Controlled Drones (32:20) SPONSORS: OMNEKY (41:05) The Controversial Realm of Neurotechnology Weapons (45:16) Ideal International Agreements for Weapon Regulation (47:01) The Threat of Hacking in Neurotechnology (50:36) Brain Signatures for Identification (01:11:28) The Future of Neurotechnology in the Workplace (01:24:59) The Intrusion of Brain Decoding into Personal Relationships (01:30:00) Regulating Brain Decoding: A Call for a Change in Worldview (01:38:03) The Impact of Neurotechnology on Identity and Self-Perception (01:41:47) The Future of Cognitive Enhancement and Transhumanism (01:46:21) The Role of Neurotechnology in Addressing Neurological Diseases (01:51:04) The Dark Side of Neurotechnology: Hacking and Manipulation (01:54:50) The Importance of Cognitive Liberty in Neurotechnology (01:55:15) The Future of Neurotechnology: Best and Worst Case Scenarios This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Nathan interviews Mike Knoop, co-founder of Zapier and co-creator of the ARC Prize, about the $1 million competition for more efficient AI architectures. They discuss the ARC AGI benchmark, its implications for general intelligence, and the potential impact on AI safety. Nathan reflects on the challenges of intuitive problem-solving in AI and considers hybrid approaches to AGI development. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:06:06) The ARC Benchmark (00:09:34) Other Benchmarks (00:10:58) Definition of AGI (00:14:38) The rules of the contest (00:18:16) ARC test set (Part 1) (00:18:23) Sponsors: Oracle | Brave (00:20:31) ARC test set (Part 2) (00:22:50) Stair-stepping benchmarks (00:26:17) ARC Prize (00:28:34) The rules of the ARC Prize (00:31:12) Compute costs (Part 1) (00:34:47) Sponsors: Omneky | Squad (00:36:34) Compute costs (Part 2) (00:51:20) Intuition (00:54:32) Human Intelligence (00:56:06) Current Frontier Language Models (00:57:44) Program Synthesis (01:04:10) Is the model learning or memorizing? (01:15:02) Exploring Solutions (01:17:02) Non-backpropagation evolutionary architecture search (01:19:49) Expectations for an AGI world (01:24:11) Reliability and out of domain generalization (01:28:35) What a person would do (01:29:51) What is the right generalization (01:35:32) The ARC AGI Challenge (01:48:32) FunSearch (01:50:41) Kolmogorov-Arnold-Networks (01:54:18) Grokking (01:55:42) Outro

Nathan Labenz sits down with Andrew Feldman, CEO and Co-Founder of Cerebras Systems, a company building a new class of computer system for accelerating AI and changing the future of work. Cerebras Systems is the creator of the world’s largest chip, at 2.6 trillion transistors. In this episode, they discuss the founding story of Cerebras, the experience of creating the world’s largest chip, and the process that goes into chip design and manufacturing for an AI-focused chip.  This episode is the first part of our hardware exploration series focused on the people building at the forefront of hardware applications in AI. LINKS: Cerebras: https://www.cerebras.net/ Book: The Chip War by Chris Miller We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS (00:00) Preview (04:27) Andrew’s story of creating the world’s largest chip and Cerebras (07:19) What is a chip? (08:14) The diversity of chips and what they can accomplish (09:47) What is it like to design a 2.5 trillion transistor chip? (12:41) The founding story of Cerebras and building the team (14:20) Sponsor: Omneky (23:00) What was the hardest part about building the company? (26:11) What happens after designing the chip’s blueprint? (27:29) The tradeoffs needed in chipmaking  (34:08) The comparison between chips and neural networks (38:31) The generalization vs specialization of a chip  (40:11) Sparse compute vs dense compute (43:55) Ghost in the machine (46:54) Supply chain challenges of the Cerebras chip (54:59) The future for chips (58:19) Building chip clusters (58:57) The Cerebras business model (01:00:41) Building a chip cluster vs using a Cerebras chip (01:02:57) Giant chips on the edge (01:05:32) What is the edge?  (01:08:04) Andrew’s favorite AI products (01:10:08) Would Andrew get a Neuralink implant? (01:14:16) Consciousness and chips (01:17:50) AI hopes and fears TWITTER: @CogRev_Podcast @andrewdfeldman (Andrew) @labenz (Nathan) @eriktorenberg (Erik) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with Rachel Woods, founder of The AI Exchange, an AI education platform with over 130,000 subscribers on TikTok. They discuss Rachel’s experience consulting for public and private companies on AI strategy, how teams should think about their AI strategy, and how Rachel uses AI in her own business. Rachel was previously a data scientist at Meta, and a founder of a venture-backed e-commerce startup, where she began to use chatGPT in her startup operations. This episode is the second in a series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. -- We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics TIMESTAMPS: (00:00) Episode preview (02:59) Rachel Woods’ story (04:30) State of the public who comes across videos (9:49): How do you frame AI to business owners and how should they use it? (15:29) Sponsor: Omneky (18:58) How should teams set up their AI strategy for success? (26:41) The leap from GPT 3.5 to GPT-4 (30:42) Step changes of AI and public perception of capabilities (35:17) Common misconceptions people have about AI (36:22) How Rachel uses AI in her business (44:09) What’s your style of prompt engineering for content creation? (46:01) How AI will change the way we use a computer in the next year? (49:34) Bing launch and how companies launch AI products (54:15) AI safety and restraint (1:00:11) Alpaca and LLaMA (1:04:16) Rachel’s favorite products in AI (1:05:24) Would Rachel get a Neuralink implant? (1:07:55) AI hopes and fears TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @rachel_l_woods (Rachel) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

This episode explores the groundbreaking advancements in AGI from recent releases of two Chinese reasoning models: DeepSeek's R1 and Moonshot AI's Kimmy. The discussion delves into the methods, comparative analysis, and implications of these models, particularly focusing on the diverse reinforcement learning techniques employed. Despite computation constraints, these models have achieved significant performance, suggesting a paradigm shift in AI development strategies. The episode also covers the broader strategic dynamics, economic, and policy implications surrounding these developments in China and the West. The conversation highlights the importance of hands-on interaction with these models for a deeper understanding and comprehensive learning experience. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00) Introduction (05:44) The R1 Model: A Deep Dive (10:05) Reinforcement Learning and Emergent Behaviors (Part 1) (16:56) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (19:36) Reinforcement Learning and Emergent Behaviors (Part 2) (29:14) Challenges and Future Directions (Part 1) (31:55) Sponsors: Shopify | Vanta (35:11) Challenges and Future Directions (Part 2) (43:00) Productizing the R1 Model (01:00:20) The Remarkable Output of Language Models (01:00:34) Exploring R1's Creative Writing Capabilities (01:03:55) Tiny Stories and Learning Order in Small Models (01:08:34) Censorship and Strategic Questions (01:11:36) Key Takeaways and Future Implications (01:14:17) Comparing Approaches: R1 and Kimmy (01:27:19) The Path to Superhuman Performance (01:33:42) Strategic Dynamics and Policy Responses (01:46:50) Final Thoughts and Call to Action (01:48:04) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing

In this intriguing episode, Professor Angela Zhang discusses the complex landscape of China's technology sector and regulation. The conversation explores China's approach to AI, the evolution of its tech giants, and the interplay between government and private enterprises. Zhang emphasizes the importance of firsthand experience in understanding China and highlights key insights from her book, 'Highwire,' which delves into China's regulatory strategies and policies. The dialogue also touches on global perceptions, the ongoing US-China tech rivalry, and the broader implications of regulatory actions in both nations. This episode sheds light on the dynamic and often opaque world of Chinese tech governance, offering a balanced and nuanced perspective. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing

In this episode of The Cognitive Revolution, Nathan delves into the fascinating world of AI-generated research ideas with Stanford PhD student Chenglei Si. They discuss a groundbreaking study that pits AI against human researchers in generating novel AI research concepts. Learn about the surprising results that show AI-generated ideas scoring higher on novelty and excitement, and explore the implications for the future of AI research and development. Join us for an insightful conversation that challenges our understanding of AI capabilities and their potential impact on scientific discovery. Link to the research paper being discussed: https://arxiv.org/abs/2409.04109 Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:05:30) Introducing Chenglei Si (00:06:22) Path to Automating Research (00:07:58) Notable AI Research Projects (00:15:26) Evaluating Research Ideas (Part 1) (00:19:39) Sponsors: Shopify | Notion (00:22:33) Evaluating Research Ideas (Part 2) (00:25:49) Research Setup and Design (00:29:38) AI Prompting and Idea Generation (00:34:40) Diversity vs. Quality of Ideas (Part 1) (00:34:40) Sponsors: Brave | Oracle (00:36:44) Diversity vs. Quality of Ideas (Part 2) (00:42:05) Inference Scaling and Execution (00:45:04) Anonymizing and Evaluating Ideas (00:53:22) Headline Results and Analysis (00:58:45) Observations and Insights (01:09:02) Novelty Indicators and Deception (01:11:59) Top AI-Generated Ideas (01:14:41) Next Steps and Future Directions (01:20:43) Expectations for the Future (01:23:14) Outro

Join Nathan Labenz and Erik Torenberg as they analyze the last month in AI advancements. Nathan takes us through the meaningful updates to his Scouting Report (released last month, linked below), discusses highlights from recent episodes of The Cognitive Revolution, and gives us a sneak peek at upcoming interviews with Google researchers. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (01:00) How does the AI Scouting Report hold up a few weeks later? (03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape (10:25) The universal LLM jailbreak and adversarial examples (12:53) Human performance is much more variable than AI performance (14:45) Sponsors: NetSuite | Omneky (16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses?  (20:05) Is GPT-4 getting worse or better? (22:00) Getting explicit about what good looks like (24:00) Prompting best practices are very accessible (26:35) Ghostwriting - and the art of the hook (28:05) Live Players: Which companies have say so over how the future goes? (31:10) Upcoming guests from Google AI (35:40) Possible post-transformer architectures LINKS: SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E 3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/jonathan-gpt-swift/ X: @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.  Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

In this episode of The Cognitive Revolution, Nathan welcomes back Zvi Mowshowitz for an in-depth discussion on the latest developments in AI over the past six months. They explore Ilya's new superintelligence-focused startup, analyze OpenAI's O1 model, and debate the impact of Claude's computer use capabilities. The conversation covers emerging partnerships in big tech, regulatory changes, and the recent OpenAI profit-sharing drama. Zvi offers unique insights on AI safety, politics, and strategic analysis that you won't find elsewhere. Join us for this thought-provoking episode that challenges our understanding of the rapidly evolving AI landscape. Check out "Don't Worry About the Vase" Blog: https://thezvi.substack.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:03) About the Episode (00:02:57) Catching Up (00:04:00) Ilya's New Company (00:06:10) GPT-4 and Scaling (00:11:49) User Report: GPT-4 (Part 1) (00:18:11) Sponsors: Shopify | Notion (00:21:06) User Report: GPT-4 (Part 2) (00:24:25) Magic: The Gathering (Part 1) (00:32:34) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:34:58) Magic: The Gathering (Part 2) (00:35:59) Humanity's Last Exam (00:41:29) Computer Use (00:47:42) Industry Landscape (00:55:42) Why is Gemini Third? (01:04:32) Voice Mode (01:09:41) Alliances and Coupling (01:16:31) Regulation (01:24:58) Machines of Loving Grace (01:33:23) Taiwan and Chips (01:41:13) SB 1047 Veto (02:00:07) Arc AGI Prize (02:02:23) Deepfakes and UBI (02:09:06) Trump and AI (02:26:31) AI Manhattan Project (02:32:05) Virtue Ethics (02:38:40) Closing Thoughts (02:40:37) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

In this episode, Nathan sits down with Jonathan Frankle, Chief Scientist, and Abhi Venigalla, Research Scientist of MosaicML. They chat about Mosaic’s custom LLMs, the customers seeking Mosaic out and what their journeys and use cases look like, and exciting developments in Mosaic’s research: including their new inference platform, as well as Mosaic’s MPT-7B-65k+ storywriter model. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics The Cognitive Revolution is a part of the Turpentine podcast network. To learn more: www.turpentine.co TIMESTAMPS: (00:00) Episode Preview (06:04) Mosaic’s business model (07:28) Who uses Mosaic’s custom LLMs? What does their data look like? (09:55)Mosaic’s use cases for custom LLMs (12:47) How much extraction and summarization was done by humans pre-LLMs? (15:28) Sponsor: Omneky (21:50) The journeys of Mosaic’s customers and would a Wendy’s LLM know about a Big Mac? (25:46) The curriculum model and fine-tuning (29:10) Language models in the life sciences (33:20) How raw can data be before it becomes a problem? (35:44) Using the output of bulk pre-training process vs additional after training (38:30) Redteaming as a service (39:40) Mosaic’s inference platform (41:53) Spending one cent on 20,000 tokens, how is that cent distributed? (46:00)) Selling compute on a dedicated capacity basis (47:30) Oracle and AWS (49:50) The storywriter model and 65,000 token window (54:35) The transition from finite parameters into infinite attention matrix LINKS: MosaicML: https://www.mosaicml.com/ MPT-7B Storywriter Model: https://huggingface.co/mosaicml/mpt-7b-storywriter TWITTER: @jefrankle (Jonathan) @abhi_venigalla (Abhi) @MosaicML (Mosaic) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Music Credit: MusicLM

In this episode, Nathan Labenz sits down with Hayk Martiros, VP of Autonomy at Skydio. Martiros leads the autonomy team, which holds the state of the art in complex autonomous flight. Skydio is the largest drone developer in the US, and recently raised $230M to expand its US manufacturing 10-fold, bringing its valuation to $2.2 billion. In this discussion, Hayk and Nathan discuss why Skydio will not weaponize its drones, Skydio’s systems and AI approach, and the considerations of choosing an autonomous system over a human agent.  We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: SymForce: https://github.com/symforce-org/symforce End-to-End Learning of Geometry and Context for Deep Stereo Regression (Skydio’s 2017 paper): https://arxiv.org/pdf/1703.04309 TIMESTAMPS: (00:00) Episode Preview (01:12) Nathan’s episode intro (07:44) Hayk’s story (11:21) What is Skydio? (14:59) Sponsor: Omneky (16:56) The core driver of Skydio’s business (20:21) Skydio’s AI approach (23:56) Updating the voltage 30,000 times per second (24:52) How is the Skydio system built? (34:07) The loops in the Skydio system (36:00) SymForce, Skydio’s open source library and Hayk’s creation (41:06) Writing symbolic expressions as a roboticist  (42:14) Writing an expression for a toy race car (47:58) Skydio neural networks (51:29) Going from designed systems to end-to-end systems (58:17) How much does a Skydio drone and dock cost to install? (01:00:19) The cost savings of using a Skydio drone (01:02:59) Are $1 drone missions in the consumer’s future? (01:06:22) Vertical integration vs platform (01:09:29) The advantages and disadvantages of drones (01:11:17) Running LLMs on a drone (01:14:36) Power consumption going to compute vs mechanics (01:18:26) Hayk’s predictions for consumer autonomous systems (01:21:51) Standards for choosing autonomous systems over humans (01:25:23) Skydio’s societal impact (01:28:34) Universal basic income (01:30:27) Skydio drone usage in defense (01:34:34) The Ukraine-Russia conflict (01:38:02) Hayk’s experience with the Nagorno-Karabakh conflict TWITTER: @SkydioHQ (Skydio) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. MUSIC CREDIT: MusicLM

Nathan explores the future of food production with Rajat Bhageria, founder and CEO of Chef Robotics. In this episode of The Cognitive Revolution, we delve into how AI and robotics are revolutionizing food assembly, potentially reshaping the entire food industry. Discover insights on imitation learning, data flywheel effects, and the vision of accessible, customizable meals produced by robotic kitchens. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Listen on Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Listen on Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 - History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:40) Chef Robotics (00:04:09) Food Manufacturing (00:06:52) Food assembly (00:11:08) Setting up a robot (00:14:00) Onboarding process (00:18:08) Sponsors: Oracle | Brave (00:20:16) Self fine-tuning (00:22:59) Variation in the human powered setting (00:29:53) Safety constraints (00:32:15) Portfolio of customers (00:33:43) Sponsors: Omneky | Squad (00:35:30) Evolution of the AI strategy (00:40:14) Generative AI in robotics (00:43:27) Eurekas and bootstrapping (00:45:43) Time to onboard a new ingredient (00:47:15) Inner loops of the system (00:49:17) How controlled does the environment have to be? (00:52:51) Compute, Energy (00:54:12) Reliability (00:59:52) Current challenges (01:02:47) Humanoid robots (01:06:42) Business model (01:07:58) Future vision (01:11:51) Ghost kitchens and kitchenless houses (01:14:35) Final message (01:15:49) Outro

In this episode, Nathan sits down with Swyx of Latent Space to chat about AI engineers and tools to check out, competitive dynamics between OpenAI, other foundation model providers, and developers, and if Swyx would wear an AI Horcrux. We also learn that Nathan lived in the same dorm as Mark Zuckerberg back in his college days (and was a late adopter to Facebook…). If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/ We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00) Episode Preview (00:00:49) AI Nathan’s intro (00:03:14) What is an AI engineer? (00:05:56) What backgrounds do AI engineers typically have? (00:15:51) Sponsors: Netsuite | Omneky (00:17:13) Swyx’s Discord AI project (00:20:41) Key tools for AI engineers (00:23:42) HumanLoop, Guardrails, Langchain (00:27:01) Criteria for identifying capable AI engineers when hiring (00:30:59) Skepticism around AI being a fad and doubts about contributing to AI (00:34:03) AI Engineer Conference speaker lineup (00:41:14) AI agents and two years to AGI (00:46:04) Expectations and disagreement around what AI agent capabilities will work soon (00:50:12) Swyx’s OpenAI thesis (00:53:03) AI safety considerations and the role of AI engineers (00:56:24) Disagreement on whether AI will soon be able to generate code pull requests (01:01:07) AI helping non-technical people to code (01:01:49) Multi-modal Chat-GPT and the future implications (01:03:33) Nathan living in the same dorm as Mark Zuckerberg (01:04:44) Competitive dynamics between OpenAI and other AI model developers (01:05:39) Play.ht vs ElevenLabs (01:09:20) The tension between platforms and developers building on top of them (01:11:40) The best thing startups can do to compete with foundation model providers (01:16:26) User identity/authentication services like Login with OpenAI (01:19:20) Google vs the other live players (01:20:46) AI Horcruxes / Pendants (01:22:05) The concept of an AI app bundle for consumers and developers

In this episode, Nathan sits down with Itamar Friedman, CEO of Codium AI, the company on the mission to create the code integrity paradigm. They discuss harnessing LLMs for code integrity, task decomposition, workflow engineering, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api X/SOCIAL: @labenz (Nathan) @itamar_mar (Itamar) @CodiumAI (Sodium) LINKS: Codium: https://www.codium.ai/ Cognitive Revolution Feed: https://cognitiverevolution.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00:00) Episode Preview (00:06:32) The evolution of AI in software development: beyond code generation (00:09:51) The shift towards code integrity and its impact (00:14:23) Unveiling Alpha Codium: A leap in AI-assisted code integrity (00:16:53) The broader impact of AI on software development processes (00:17:11) Sponsor break: Oraclel | Omneky (00:18:52) The future of AI in coding: enhancements, testing, and more (00:24:41) AI's role in enhancing code quality and developer efficiency (00:43:38) Exploring the challenges of large codebases (00:44:03) The impact of LLM context growth on code understanding (00:45:19) Innovative approaches to data retention and context computation (00:46:08) Deep dive into repo analysis and future directions (00:42:31) Personal experiences and the quest for efficient code management (00:48:26) Dynamic graph strategies and future features in IDEs (00:49:10) From code testing to advanced flow engineering: a new paradigm (00:52:37) Unveiling Alpha Codium: A leap in coding challenge solutions (01:07:31) Reflecting on workflows (01:23:30) Final thoughts and recommendations for AI enthusiasts The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: vivian@turpentine.co

In this episode, Flo Crivello, founder of Lindy AI, joins Nathan to chat about Biden’s executive order, and the state of AI safety. They discuss Flo’s thoughts on the executive order, building AGI kill switches, self driving cars, and more. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Netsuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. RECOMMENDED PODCAST:  Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff TIMESTAMPS: (00:00) Episode Preview (00:06:42) The natural order of technological progress (00:07:00) Self driving cars (00:10:57) Where is Flo accelerationist? (00:12:34) Artificial intelligence as a new form of life (00:17:08) - Sponsors: Oracle | Omneky (00:18:05) Silicon-based intelligence vs carbon-based intelligence (00:24:36) Executive Order (00:29:32) How would a GPU kill switch work? (00:31:24) “Let’s not regulate model development, but applications” (00:32:08) - Sponsor: Netsuite (00:36:00) GPT-4 is the most critical component for AGI (00:38:00) AGI in 2-8 years (00:39:26) Eureka moment from a general system (00:48:00) AI research with China (00:52:00) Does AI have subjective experience? The Mu response This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu

In this illuminating episode of The Cognitive Revolution, host Nathan Labenz speaks with Jack Rae, principal research scientist at Google DeepMind and technical lead on Google's thinking and inference time scaling work. They explore the technical breakthroughs behind Google's Gemini 2.5 Pro model, discussing why reasoning techniques are suddenly working so effectively across the industry and whether these advances represent true breakthroughs or incremental progress. The conversation delves into critical questions about the relationship between reasoning and agency, the role of human data in shaping model behavior, and the roadmap from current capabilities to AGI, providing listeners with an insider's perspective on the trajectory of AI development. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (05:09) Introduction and Welcome (07:28) RL for Reasoning (10:46) Research Time Management (13:41) Convergence in Model Development (18:31) RL on Smaller Models (Part 1) (20:01) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (22:35) RL on Smaller Models (Part 2) (23:30) Sculpting Cognitive Behaviors (25:05) Language Switching Behavior (28:02) Sharing Chain of Thought (32:03) RL on Chain of Thought (Part 1) (33:46) Sponsors: NetSuite (35:19) RL on Chain of Thought (Part 2) (35:26) Eliciting Human Reasoning (39:27) Reasoning vs. Agency (40:17) Understanding Model Reasoning (44:29) Reasoning in Latent Space (47:54) Interpretability Challenges (51:36) Platonic Model Hypothesis (56:05) Roadmap to AGI (01:00:57) Multimodal Integration (01:04:38) System Card Questions (01:07:51) Long Context Capabilities (01:13:49) Outro

In this crosspost from the 80,000 Hours podcast, host Rob Wiblin interviews Nick Joseph, Head of Training at Anthropic, about the company's responsible scaling policy for AI development. The episode delves into Anthropic's approach to AI safety, the growing trend of voluntary commitments from top AI labs, and the need for public scrutiny of frontier model development. The conversation also covers AI safety career advice, with a reminder that 80,000 Hours offers free career advising sessions for listeners. Join us for an insightful discussion on the future of AI and its societal implications. Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:04:31) Intro and Nick's background (00:08:37) Model training and scaling laws (00:13:10) Nick's role at Anthropic (00:16:49) Responsible Scaling Policies overview (Part 1) (00:18:00) Sponsors: Weights & Biases Weave | 80,000 Hours (00:20:39) Responsible Scaling Policies overview (Part 2) (00:25:24) AI Safety Levels framework (00:30:33) Benefits of RSPs (Part 1) (00:33:15) Sponsors: Omneky (00:33:38) Benefits of RSPs (Part 2) (00:36:32) Concerns about RSPs (00:47:33) Sandbagging and evaluation challenges (00:54:46) Critiques of RSPs (01:03:11) Trust and accountability (01:12:03) Conservative vs. aggressive approaches (01:17:43) Capabilities vs. safety research (01:23:47) Working at Anthropic (01:35:14) Nick's career journey (01:45:12) Hiring at Anthropic (01:52:06) Concerns about AI capabilities work (02:03:38) Anthropic office locations (02:08:46) Pressure and stakes at Anthropic (02:18:09) Overrated and underrated AI applications (02:35:57) Closing remarks (02:38:33) Sponsors: Outro

Join us in a deep dive with Allan Dafoe, Director of Frontier Safety and Governance at Google DeepMind. Allan sheds light on the challenges of evaluating AI capabilities, structural risks, and the future of AI governance. Discover how AI technologies can transform sectors like education, healthcare, and sustainability, alongside the potential risks and necessary safety measures. This episode provides a comprehensive look at the intersection of technology, safety, and governance in the rapidly evolving AI landscape. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing

We've looked forward to today's episode since we launched the show! Andreas Stuhlmuller and Jungwon Byun are the co-founders of Ought, a product-driven research lab that develops mechanisms for delegating open-ended thinking to advanced machine learning systems. Their flagship product, Elicit (elicit.org), is an AI research assistant that helps researchers accelerate time-consuming workflows, starting with literature review. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS REFERENCED IN EPISODE: Ought: https://ought.org/ Elicit: https://elicit.org/ TIMESTAMPS: (0:00) Preview (2:00) Nathan introduces the founders of Ought (4:20) Why doesn't AI serve better reasoning? (6:55) What limits the current paradigm (8:40) Reflections on the last six years of Ought’s research experiments of "composable thinking" (13:10) Error elimination mechanism is a shared challenge between human and AI systems (16:45) Sponsor: Omneky (18:00) Interpretability by construction product philosophy (25:00) Nathan’s personal experience using Elicit as a research assistant (30:00) Explicit concerns about model reasonings, and the importance of going a step further (36:00) What customers of OpenAI Foundry should consider (43:15) Evaluation challenges (48:15) Embeddings challenges (51:00) Vision for a knowledge work assembly line corporate paradigm (56:00) Ought's short-term approach to building: Understanding human ways of teaching the model to be more helpful (59:00) Wishful thinking versus real helpfulness (1:03:00) What's next for Elicit: expansion and new workflows (1:17:00) Zapier for reasoning (1:23:00) What are the most fundamental "magic questions" for all domains? (1:31:43) Significant impact of GPT4 (1:36:00) How people are using Elicit (1:44:00) AI Uncertainty and reason for hope (1:48:00) 3 lightning-round questions TWITTER: @CogRev_Podcast @jungofthewon @stuhlmueller @labenz (Nathan) @eriktorenberg (Erik) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing Nathan's original Mamba Deep Dive Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58 Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566 X/SOCIAL: @labenz (Nathan) SPONSORS: ORACLE | OMNEKY | BRAVE | ON DECK | SQUAD Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) - Episode Start (00:01:14) - Nathan and Jason’s Bet (00:04:51) - U-Mamba (00:15:10) - Sponsors: Oracle | Omneky (00:06:08) - Swin U-Mamba (00:18:59) - Vision Mamba (00:24:30 - VMamba (00:27:26) - VM-UNet (00:30:37) - Sponsors: Brave | On Deck (00:35:15) - SegMamba (00:36:59) - Vivim (00:37:31) - Mamba Morph (00:39:01) - Graph Mamba  (00:43:15) - Long Mamba (00:59:54) - Evo and StripedHyena The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: vivian@turpentine.co 

We're joined by John Hayes, CEO and Cofounder of Ghost, a self-driving car startup using multimodal LLMs to solve the autonomous driving problem, that OpenAI just invested $5 million into. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @ghosthayes (John) @GhostAutonomy @CogRev_Podcast TIMESTAMPS: 00:00:00) - Introduction to John Hayes and Ghost Autonomy's partnership with OpenAI (00:04:30) - The journey to founding Ghost, and how multimodal LLMs will change self-driving cars (00:05:03) - John's background founding Pure Storage and moving into autonomy (00:13:24) - Overview of different self-driving technology stacks (Lidar vs cameras) (00:14:03) - Sponsors: Shopify | Omneky (00:25:39) - Different approaches to how we know self-driving cars work well enough for public deployment (00:32:21) - Sponsors: Netsuite | Oracle (00:34:24) - Current state of robotaxis and China (00:39:47) - Where Ghost fits into the autonomous driving landscape and their tech stack (00:50:51) - Affordable radar systems (00:51:54) - Ghost’s approach to interpretability (00:53:27) - Using LLMs for driving (00:54:59) - Partnership with OpenAI and how Ghost’s unique LLM solution to the self-driving problem (00:57:40) - GPS’ unreliability which can be solved by multimodal approach (01:02:31) - Hallucination is the best part of LLMs (01:04:09) - Using maps as extended memory and storage for driving data (01:09:20) - Ghost business model and the user experience (01:16:37) - OpenAI as currently the only provider of advanced multimodal models (01:24:17) - How self-driving cars should address fear and standing up for the technology (01:29:30) - AI: China and the US, and why China is being pushed towards self-driving (01:31:39) - Regulators in the US are responsive to consumers (01:32:26) - VC subsidization of self-driving (01:33:25) - John’s widest angle outlook on the AI revolution

Nathan and Erik sit down with Neal Khosla, founder of Curai Health, a venture-backed virtual care startup using AI to provide low-cost primary healthcare. Prior to his current role at Curai, Neal was a machine learning researcher at Google and Stanford. In this episode, they discuss the current state of AI in medicine, what the future patient experience may look like, and how developments in AI healthcare may interact with different regulatory and social forces across the globe.  We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics FEEDBACK  We'd love to hear your feedback or answer any listener questions live on an upcoming episode. DM @labenz on Twitter or email us at Info@turpentine.co with "TCR" in the subject line. We'd appreciate it immensely if you left us a review on Apple Podcasts or a rating on Spotify! TIMESTAMPS (00:00) Preview (04:32) The future of AI in medicine (12:50) Patient experience in AI-driven medicine and the current state of AI in medicine (15:04) Sponsor: Omneky (20:34) Building the LLM architecture for medicine (25:25) Current state of the art for AI in medicine (28:54) Evaluating LLM performance in medicine (31:49) Benchmarking LLMs in medicine (39:17) Using the Socratic method in training LLMs (43:57) Multimodal systems and deploying multiple models in medicine  (51:30) The future of LLM creation and usage (59:47) The interaction of AI medicine with social and regulatory forces (01:11:00) AI adoption in countries with centralized healthcare systems (01:13:37) How should we regulate the usage of AI in medicine? (01:16:57) AI-first systems in medicine (01:18:19) Is there an obligation to deploy AI in medicine in its current state? (01:20:48) Neal’s favorite AI products (01:22:21) Would Neal get a Neuralink implant? (01:24:54) AI hopes and fears TWITTER: @CogRev_Podcast @nealkhosla (Neal) @labenz (Nathan) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

In this episode of The Cognitive Revolution, Nathan explores the groundbreaking paper on obfuscated activations with 3 members from the research team - Luke Bailey, Eric Jenner, and Scott Emmons. The team discusses how their work challenges latent-based defenses in AI systems, demonstrating methods to bypass safety mechanisms while maintaining harmful behaviors. Join us for an in-depth technical conversation about AI safety, interpretability, and the ongoing challenge of creating robust defense systems. Do check out the "Obfuscated Activations Bypass LLM Latent-Space Defenses" paper here: https://obfuscated-activations.github.io/ Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution RECOMMENDED PODCAST: Check out Modern Relationships where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov. Apple: https://podcasts.apple.com/us/podcast/id1786227593 Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg YouTube: https://www.youtube.com/@ModernRelationshipsPod CHAPTERS: (00:00:00) Teaser (00:00:46) About the Episode (00:05:11) Latent Space Defenses (00:08:41) Sleeper Agents (00:15:06) Three Case Studies (Part 1) (00:17:02) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (00:19:42) Three Case Studies (Part 2) (00:24:09) SQL Generation (00:26:17) Understanding Defenses (00:32:52) Out-of-Distribution Detection (Part 1) (00:35:37) Sponsors: Shopify | Vanta (00:38:52) Out-of-Distribution Detection (Part 2) (00:45:13) Loss Function Weighting (00:57:49) Who Moves Last? (01:11:41) High-Level Triggers (01:25:33) Open Source vs. Access (01:38:57) Internalizing Reasoning (01:53:07) Representing Concepts (02:06:38) Final Thoughts (02:09:33) Outro

In this episode of the Cognitive Revolution, founder Anton Osika and AI engineer Isaak Sundeman from Lovable.dev, discuss their AI coding platform that allows users to describe software in natural language and have it built by AI. They delve into the nuances of using AI for full-stack engineering and the future of human coding. During the episode, they demonstrate building a product comparison app, discussing the integration of AI, backend functionalities, and handling complex API interactions. They also talk about the challenges and opportunities in UI design, the role of AI in improving user experiences, and the potential future impacts of AI on software development. The conversation touches on the phenomenal growth and scaling of Lovable.dev, their strategies for managing context and dependencies in large codebases, and their vision and roadmap for the future of AI-powered application development. Checkout lovable here: http://lovable.dev SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:56) About the Episode (03:57) Introduction and Guest Welcome (04:21) Overview of Lovable.dev (04:53) Building a Product Comparison App (05:19) Starting the Coding Process (05:46) Defining the App's Functionality (08:21) Setting Up the Backend (13:20) Future of Software and AI (Part 1) (17:40) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (20:20) Future of Software and AI (Part 2) (23:44) Challenges in AI Development (Part 1) (32:48) Sponsors: Shopify (34:07) Challenges in AI Development (Part 2) (39:08) Integrating External APIs (54:01) Helping Out and Initial Fixes (54:18) Progress with Documentation and API Updates (55:21) AI Analysis and Product Comparison (57:33) Building AI Applications: Challenges and Solutions (59:02) Understanding AI Agency and User Experience (01:24:27) Scaling and User Growth (01:29:03) Future Directions and Hiring (01:30:55) Final Thoughts and Advice (01:32:06) Outro PRODUCED BY: http://aipodcast.ing

This 20-min episode comes from our friend Nathaniel Whittemore's excellent daily podcast The AI Breakdown Podcast. This episode aired on June 1, 2023, and covers the latest developments from OpenAI, including new features, a cybersecurity grant program, and their new process rewards model for trading. We hope you enjoy it as much as we do. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics SPONSOR: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Subscribe to The AI Breakdown podcast: https://pod.link/1680633614 Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown

In this episode, Nathan does an emergency pod deep dive into Mamba, a new state space model architecture. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00:00) - Episode Preview (00:03:15) - Inventing something better than the transformer (00:05:17) - Examination of human cognition (00:15:44) - Sponsor: Shopify (00:27:00) - Weaknesses of the transformer (00:30:16) - Sponsor: Netsuite | Omneky (00:33:40) - Giving AI memory (00:39:32) - State Space Model Revolution (00:55:00) - SRAM and High Bandwidth Memory (01:36:16) - Block State and Hyena models (02:04:00) - Advancing AI safety and interpretability This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

In this special crossover episode of The Cognitive Revolution, Nathan introduces a conversation from The Inside View featuring Owain Evans, AI alignment researcher at UC Berkeley's Center for Human Compatible AI. Evans and host Michael Trazzi delve into critical AI safety topics, including situational awareness and out-of-context reasoning. Discover Evans' groundbreaking work on the reversal curse and connecting the dots, exploring how large language models process and infer information. This timely discussion highlights the importance of situational awareness in AI systems, particularly in light of recent advancements in AI capabilities. Don't miss this insightful exploration of the evolving relationship between human and artificial intelligence. Check out "The Inside View" Podcast here: https://theinsideview.ai/ Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive. LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr. Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:04:10) Intro (00:05:09) Owain Evans' Research (00:06:36) Situational Awareness (00:09:07) Measuring Situational Awareness (00:14:29) Claude's Situational Awareness (00:19:06) Sponsors: Shopify | LMNT (00:22:01) Needle in a Haystack (00:26:26) Concrete Examples of Tasks (00:34:51) Sponsors: Notion | Oracle (00:37:29) Anti-Imitation Tasks (00:50:03) GPT-4 Base Model Results (01:01:48) Benchmark Saturation (01:07:23) Future Research Directions (01:12:01) Out-of-Context Reasoning (01:27:29) Safety Implications (01:36:24) Scaling and Reasoning (01:44:28) Mixture of Functions (01:54:12) Research Style and Taste (02:08:51) Capabilities and Downsides (02:18:56) Reception and Impact (02:25:30) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk

Anton Troynikov of Chroma and Flo Crivello of Lindy AI join The Cognitive Revolution cohosts Nathan Labenz and Erik Torenberg to debate the issues raised in the AI open letter, which advocates for a 6-month pause on AI system trainings. This episode was recorded on March 31st and was first released as a Moment of Zen episode (airing April 1). Subscribe to Moment of Zen for more timely debates like this one! Also, check out the debut of Erik's new long-form interview podcast Upstream, whose guests in the first two episodes were Balaji Srinivasan and Marc Andreessen. This coming season will feature interviews with Ezra Klein, David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics LINKS REFERENCED IN EPISODE:  Open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/ Scott Aronson blog post: https://scottaaronson.blog/ TIMESTAMPS: (0:00) Preview of debate (3:10) Introduction from Nathan and explanation of the AI open letter (8:50) Anton’s skepticism of the open letter (12:14) Flo’s skepticism of the open letter (16:35) Nathan’s support for the open letter (22:52) Sponsor: Omneky (28:00) Differences between Flo and Anton’s positions (34:00) GPT4 is still dangerous (42:30) Luddites/“Pausers” are on the wrong side of history (47:44) Why not pause for 6 months? (56:30) Anton and Flo debate robotics (1:04:30) What we’re all scared of with AI (1:27:45) Is there an asymmetric risk with pausing or not pausing? TWITTER: @CogRev_Podcast @atroyn (Anton) @labenz (Nathan) @eriktorenberg (Erik) @altimor (Flo) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/ Thank you to Graham Bessellieu for production.

In today's conversation, Nathan joins Rob Wiblin, host of The 80,000 Hours Podcast to discuss why we need more AI scouts, OpenAI's safety record, and redteaming frontier models. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @robertwiblin (Robert) @CogRev_Podcast LINKS: 80,000 Hours Episode Show Notes: https://80000hours.org/podcast/episodes/nathan-labenz-openai-red-team-safety/ TIMESTAMPS: (00:00:00) - Episode Preview (00:05:12) - Rob’s intro (00:10:50) - Interview begins (00:15:50) - Intro toThe Cognitive Revolution excerpt (00:19:13) - Excerpt from The Cognitive Revolution: Nathan’s narrative (01:22:10) - Why it’s hard to imagine a much better game board (01:28:14) - What OpenAI has been doing right (01:40:12) - Arms racing and China (01:46:10) - OpenAI’s single-minded focus on AGI (01:56:55) - Transparency about capabilities (02:05:56) - Benefits of releasing models (02:17:14) - Was it ok to release GPT-4? (02:35:31) - Why no statement from the OpenAI board (02:55:59) - Ezra Klein on the OpenAI story (03:16:59) - The upside of AI merits taking some risk (03:31:44) - Meta and open source (03:42:26) - Nathan’s journey into the AI world (03:48:18) - Rob’s outro

Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker). This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00) Intro (03:29) Assembling the founders of Anthropic, Scale AI, and AI Fund (04:45) Predictions for AGI (08:21) Navigating AI innovation amidst regulation (16:15) Global AI competition and the urgency of Innovation (24:34) Empowering future generations

For anyone who discovered this show on Twitter, Riley (@goodside) likely needs no introduction – after all, he spent most of 2022 posting his explorations of OpenAI's text-davinci-002, and quickly became one of the must-follow accounts in AI. Riley Goodside is the world's first Staff Prompt Engineer at Scale AI, and is an expert in prompting large language models and integrating them into AI-powered applications. Few have spent as much time on the language model frontier, so I hope you enjoy this unique conversation with Riley Goodside. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics TIMESTAMPS: (0:00) Preview of the episode (05:13) Riley's unique background (11:24) Riley's original narrow moat (15:07) Sponsors: Omneky (17:02) LLMs can take on ncreasingly complex instructions (27:41) Language models can do math (30:05) Models can learn from context (37:29) Fine-tune models for tasks (38:47) Automate instruction following (44:34) Large language models are alien text prediction (52:27) Avoid mode collapse by framing (59:05) Composing AI capabilities like Lego bricks (1:00:37) Language models solve tasks (1:05:37) GPT-3 solves real-world tasks (1:15:03) GPT-4's amazing capabilities (1:17:03) Multimodal abilities unlock possibilities (1:25:03) Compare models for best task fit (1:26:24) Compare models using trial and error (1:36:15) AI and the future of work (1:42:29) GPT-4 can provide second opinions (1:45:06) AI safety discussion (1:50:20) AI permeates society cautiously (1:55:26) The AI revolution underway TWITTER: @CogRev_Podcast @Goodside (Riley) @scale_AI (Scale) @labenz (Nathan) SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/