The Cognitive Revolution: Recent Episodes
Erik Torenberg, Nathan Labenz
A weekly podcast where hosts Erik Torenberg and Nathan Labenz interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years.
In this episode, Trey Kollmer, WGA Writer and Co-Executive of the show Ghosts, returns to the show to discuss updates to the Hollywood Strikes, including news on SAG-AFTRA and WGA. Trey and Nathan chat why actors are joining the strikes, how AI will change acting as a profession, Trey’s views on reasoning and how he’s experimenting with GPT-4, and much, much more.
📣 CALL FOR FEEDBACK: To borrow from a meme… we're in the podcast arena trying stuff. Some will work. Some won't. But we're always learning.
http://bit.ly/TCRFeedback
Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co.
TIMESTAMPS: (00:04:01) Hollywood and AI: updates on SAG-AFTRA and the WGA (00:15:20) Sponsors: NetSuite | Omneky (00:18:56) Studio approach to copyright and compensation with generative AI (00:22:17) Hollywood receptiveness to using AI and protections guild members are asking for (00:24:05) How much potential is there in fine-tuning models on writing Hollywood scripts? (00:24:56) Models implementing gradient descent in the weights (00:29:14) How Nathan uses models to write for the podcast (00:34:15) Generating and mining jokes in the writer’s room (00:35:18) Generating polarizing material (00:40:18) Untraining models (00:44:20) AI writing tools and writer perception of them (00:46:34) Context length and pooling layers (00:51:11) Microsoft China (00:52:09) Chat-GPT’s system prompt: steering the model in the direction you want (01:00:02) Actors’ strike (01:02:20) Background actor rights (01:05:45) Using 1 million DALL-E images to create an AI short film (01:09:11) Deepfakes (01:10:29) Speculation on outcomes for the actor’s strike (01:12:51) The future where anyone can be a reasonable synthetic actor (01:17:33) Trey’s take on reasoning and why Hollywood should be more open to AI (01:16:20) New generative choose your own adventure content (01:25:49) A monk’s experience with Chat-GPT (01:28:56) Outdatedness of stochastic parrot notion; reasoning and synthesis (01:32:05) Adversarial attacks (01:36:14) Model vs human susceptibility to adversarial attacks because of human robustness (01:39:20) Trey and Nathan’s reasoning experiments (01:47:30) Performance jumping with abstraction (01:49:22) Language model self-delegation (01:51:04) NVIDIA’s margins compared to TSMC and ASML (02:07:35) Adding an AI layer and competing with incumbents (02:09:22) How sustainable is the demand for an AI friend? (02:13:10) Rewind AI (02:19:27) Big tech vs old school studios (02:14:52) Dramatic ironies from the picketing lines (02:21:38) AI development moments that feel like a movie (02:26:34) CEO of Inflection’s views on misuse being a greater threat than the AI itself
X/SOCIAL: @treyko (Trey) @labenz (Nathan) @eriktorenberg @CogRev_Podcast
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music Credit: GoogleLM
In this episode, Nathan sits down with Paige Bailey, Lead Product Manager of Generative Models at Google Deepmind. In this conversation, they discuss what it's like to be a PM for an LLM as opposed to an app, defining ideal LLM behaviour, and reasoning - how do you distinguish real abilities vs pattern matching? If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
TIMESTAMPS: (00:00) Episode Preview (00:01:15) Introducing Paige Bailey (00:04:21) Paige’s background at Google Brain and the Deepmind merger (00:07:00) PM for a LLM vs being a PM for an app (00:11:21) The development timeline and compute budget of PaLM-2 (00:14:30) Paige’s role in the PaLM 2 project (00:15:30) Sponsors: Netsuite | Omneky (00:17:26) Defining desired capabilities for PaLM-2 (00:19:17) The amount of work that went into elevating PaLM 2 from PaLM 1 (00:20:28) Has Google lost its ability to ship? (00:24:240) Paige's "eureka" moment seeing GitHub Copilot capabilities (00:27:47) Competing PaLM 2 with other models (00:32:20) Grokking and the predictability of emergent capabilities (00:37:30) Citizen scientists and the multilingual capabilities of PaLM 2 (00:39:29) Distinguishing real reasoning vs pattern matching (00:45:51) Products using PaLM-2 that people should try (00:50:35) Most exciting AI projects that you can try out (00:52:29) Curriculum learning and successor to the transformer
LINKS: PaLM 2: g.co/palm2 Duet AI for developers: https://cloud.google.com/blog/products/application-development/introducing-duet-ai-for-developers Avenging Polayni’s Revenge: https://www.youtube.com/watch?v=BmyB-4S9QuY
X/TWITTER: @DynamicWebPaige (Paige) @labenz (Nathan) @eriktorenberg @CogRev_Podcast
SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music Credit: GoogleLM
Join Nathan Labenz and Erik Torenberg as they analyze the latest developments from OpenAI on GPT 3.5, compare GPT to other live player models like Llama2, and discuss the state of AI in coding, education, and healthcare. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDED PODCAST: @TurpentineVC Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators. For audio lovers, listen wherever you get your podcasts: https://link.chtbl.com/TurpentineVC
TIMESTAMPS: (00:00) Episode Preview (00:01:00) GPT 3.5 Turbo (00:06:36) Llama 2 vs GPT (00:11:24) How much inference is needed to double compute costs? (00:13:40) OpenAI’s moat (00:14:41) OpenAI’s privacy consideration for data (00:16:06) Sponsor: Netsuite | Omneky (00:17:46) Encouraging the usage of instructions during fine-tuning (00:19:19) Live player consideration of AI safety (00:22:35) Da Vinci: new completions fine tuneable model (00:24:59) Chat-GPT usage in decline (00:30:03) Getting on demand tutoring on ML papers (00:31:00) Code, education, and healthcare (00:31:42) AI applications in coding (00:38:12) AI revolution n education (00:42:35) AI revolution in healthcare (00:52:17) Call for feedback
LINKS: Replit episode with Tyler Angert: https://www.youtube.com/watch?v=uEMN51ko7mk Replit episode with VP of AI, Michele Catasta: https://www.youtube.com/watch?v=u4l6GgFaJmQ AI Revolution in Education with Khan Academy's Director of Engineering, Shawn Jansepar: https://www.youtube.com/watch?v=ati_ACj1Dic&feature=youtu.be Google's Multimodal Med-PaLM with Vivek Natarajan and Tao Tu: https://www.youtube.com/watch?v=2RMpqheYKlw&t=289s
X: @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast
SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Vivek Natarajan and Tao Tu of Google’s Med-PaLM, diving into how they used one of the world’s largest medical datasets ever compiled to develop Med-PaLM M, an AI agent specialized in medical tasks. In this episode, they discuss: Med-PaLM M's “clinically superhuman” abilities and limitations, the rigorous testing and validation that went into the model, and their vision for AI to take over repetitive clerical tasks and allow doctors to focus on patients.
TIMESTAMPS: (00:00) Episode Preview (00:00:56) Introducing Vivek Natarajan and Tao Tu (00:04:18) The story of Google’s Medical AI research progress (00:07:11) Multi-modal Med-PaLM (00:10:32) Genomic data - how do you represent it? (00:11:13) Google’s Deep Variant (00:14:44) The successes and failures behind the incredible pace of progress (00:15:02) Sponsors: Netsuite | Omneky (00:21:54) Google’s research culture and assembling an interdisciplinary team (00:31:36) Google’s Pathways (00:33:40) Med-PaLM M's architecture (00:37:28) Working with 3 different model sizes and what you learn (00:46:56) Data and compute required for Med-PaLM M (00:49:38) Med-PaLM M's cycle time (00:54:56) Is a bridge or adapter structure worth implementing? (01:00:09) Can we create an AI doctor? (01:02:39) Emergent capabilities like identifying tuberculosis (01:09:37) Reactions to these emergent capabilities (01:11:13) Moving towards clinical trials and real-world testing (01:13:01) Regulatory and safety considerations (01:15:03) AI safety in the healthcare domain (01:17:00) Potential to transform healthcare access worldwide
LINKS: Med-PaLM: https://sites.research.google/med-palm/ Med-PaLM M paper: https://arxiv.org/abs/2307.14334 Our earlier conversation with Vivek Natarajan on Med-PaLM: https://www.youtube.com/watch?v=nPBd7i5tnEE
X/TWITTER:
@vivnat (Vivek) @taotu831 (Tao) @labenz (Nathan) @eriktorenberg @CogRev_Podcast
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Jon Noronha, co-founder of Gamma. Gamma is a new medium for presenting ideas, allowing you to focus on your ideas and receive beautiful, engaging content without the formatting work. In this episode, Jon and Nathan discuss the journey of building Gamma, how to coax AI to do things well, and the opportunity for AI A/B testing. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
TIMESTAMPS: (00:00:00) - Preview (00:01:23) - Nathan introduces Jon Noronha (00:06:36) - Intro - Jon Noronha introduces himself and Gamma (00:09:36) - Gamma's origin story: building the "anti-PowerPoint" pre-GPT-3 (00:13:15) - From using AI for onboarding to generating near-complete presentations. (00:15:11) - Sponsors: Netsuite | Omneky (00:18:01) - If Notion and Canva had a baby (00:23:35) - Searching for the right structure for AI, landing on HTML (00:28:16) - Degrees of freedom - developing a constrained vocabulary of semantic blocks (00:29:30) - Choice of model(s) – weighing cost, speed, and quality tradeoffs (00:35:18) - Editing UI - getting AI to edit slides per user command (00:38:04) - UI for gathering training data - following Midjourney's example (00:40:00) AI A/B Testing: a big opportunity space (00:43:22) - Image generation models - Baseten and Gamma's deployment of it (00:45:37) - Pacing feature development - Trying to stay ahead of innovations like 3D, video, voice etc. (00:47:45) Image generation for slidedecks and AI involvement (00:50:29) Gamma's main building priorities and AI generated websites (00:52:34) - Competing with giants like Microsoft and Google (00:55:04) - Enterprise AI shipping challenges - Startups pioneer new patterns; giants will eventually follow. (00:57:45) - Simplifying complexity - will models smooth over the complexity of bloated product suites? (00:59:22) - Conclusion and final thoughts
X/TWITTER:
@thatsjonsense (Jon) @labenz (Nathan) @eriktorenberg @CogRev_Podcast
LINKS:
Gamma: https://gamma.app/
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Shawn Jansepar, Director of Engineering at Khan Academy, to discuss their GPT-4 powered Socratic tutor, Khanmigo. In this conversation, Shawn and Nathan chat about Khan Academy’s collaboration with OpenAI and how they helped fine-tune GPT-4, how Khan Academy leveraged GPT-4 to build Khanmigo, and the impact of providing access to an AI tutor to any student. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
TIMESTAMPS: (00:00) Episode Preview: Education 10 years from now (04:42) Khan Academy’s early access partnership with OpenAI (06:31) Khanmigo: journey from Chrome extension to AI tutor (11:36) GPT-4’s ability to be Socratic vs 3.5 (15:05) Sponsors: Netsuite | Omneky (16:40) Integrating Khan Academy’s Pedagogy into AI (20:06) The future of education 10 years from now (22:37) Khan Academy’s models (27:20) Demo-driven development process (31:16) Sculpting the behaviour of a Socratic tutor model (35:59) Khan Academy’s contribution to GPT-4’s fine-tuning and RLHF (38:41) Being data-informed vs data-driven as a practice (42:10) Incurring tech debt to get ahead of the curve (45:28) The boundary for what an AI can/can’t t tutor (49:30) Identifying when the user is confused and avoiding AI hallucinations (53:54) Khanmigo’s development patterns (59:11) Making Khanmigo jailbreak resistant (01:01:50) Delivering personalized education with AI (01:04:08) How Shawn and his team are thinking about AI education (01:05:33) Khanmigo’s future multimodal interactivity (01:08:42) Evaluating Khanmigo’s efficacy for student learning (01:11:41) How widely is Khanmigo deployed today and what is the future for universal public access? (01:05:11) Distribution through teachers and districts (01:16:30) What are the reactions from teachers and education institutions to AI? (01:18:15) Khanmigo’s pricing model (01:19:03) The future roadmap for Khanmigo (01:20:45) How will the AI tutor change the world at large?
LINKS: Khanmigo: khan.co/khanmigo23 Benjamin Bloom’s 2-Sigma Problem: https://web.mit.edu/5.95/www/readings/bloom-two-sigma.pdf
X/TWITTER: @shawnjan8 (Shawn) @labenz (Nathan) @eriktorenberg @CogRev_Podcast
SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Join Nathan Labenz and Erik Torenberg as they analyze the last month in AI advancements. Nathan takes us through the meaningful updates to his Scouting Report (released last month, linked below), discusses highlights from recent episodes of The Cognitive Revolution, and gives us a sneak peek at upcoming interviews with Google researchers. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDED PODCAST: Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators. Listen wherever you get your podcasts: https://link.chtbl.com/TurpentineVC
TIMESTAMPS: (01:00) How does the AI Scouting Report hold up a few weeks later? (03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape (10:25) The universal LLM jailbreak and adversarial examples (12:53) Human performance is much more variable than AI performance (14:45) Sponsors: NetSuite | Omneky (16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses? (20:05) Is GPT-4 getting worse or better? (22:00) Getting explicit about what good looks like (24:00) Prompting best practices are very accessible (26:35) Ghostwriting - and the art of the hook (28:05) Live Players: Which companies have say so over how the future goes? (31:10) Upcoming guests from Google AI (35:40) Possible post-transformer architectures
LINKS: SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E 3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s . Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/jonathan-gpt-swift/
X: @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast
SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Replit’s VP of AI, Michele Catasta. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Michele and Nathan discuss Replit's state of AI development report, advantages when it comes to AI development, and the company's custom models. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDED PODCAST: Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators. https://link.chtbl.com/TurpentineVC
TIMESTAMPS: (00:00) Episode Preview (00:00:57) Introduction (04:44) What is artificial developer intelligence? (15:05) Sponsors: Netsuite | Omneky (16:58) Michele's background at Google & decision to join Replit (19:16) Startups vs incumbents (24:42) Whether Replit identifies as an e/acc company (26:37) Staying apolitical on AI while being responsible (30:36) The rise of LangChain and polarized reactions (35:14) Estimates on developer productivity gains from AI assistance (2x-10x) (38:35) Democratizing software development through easy customization (44:02) AI generating disposable single-use software (51:33) Optimism about humanity's ability to handle transformative AI (55:01) The need for nuanced AI safety discussions (56:14) Replit's data advantage from user code execution (01:04:31) Replit's approach to training custom AI models (01:08:51) The value of both open source and commercial models (01:13:18) Michele’s highlights from being a Google researcher (01:15:47) World knowledge needs in AI development (01:20:37) Replit’s approach to AI safety (01:24:28) The advantage of having a commercial model (01:25:54) The costs of serving AI features to millions of users (01:28:49) Modeling cost per user with AI workloads (01:30:50) Pushing AI inference to the edge (01:32:18) Ghostwriter integrating more deeply into Replit's IDE (01:33:37) Replit as a potential "substrate for AGI"
LINKS: https://replit.com/ Replit's State of AI Development Report: https://blog.replit.com/ai-on-replit
X: @pirroh (Michele) @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast
SPONSORS: NetSuite | Omneky - NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform, head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. - Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
In this episode, Nathan sits down with Tyler Angert, Product Designer at Replit, to discuss the future of software development. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Tyler and Nathan discuss how Replit is leveraging AI to enhance its current product, bot-bot interactions, the design and ethical considerations around AI agents, and more. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
TIMESTAMPS: (00:00) Episode Preview (01:10) Nathan’s Intro (09:24) Tyler's role at Replit (11:37) Replit as the "perfect substrate for AGI" (14:55) Sponsor: Netsuite | Omneky (15:45) Defining AGI (19:26) How AI agents might interact with Replit (23:20) Replit's "virtual developer" product (31:11) Current state of Replit's AI features like Ghostwriter (41:48) Measuring productivity boost from AI coding tools (45:29) Potential for massive developer productivity gains from AI (48:34) Technical gaps still remaining to achieve advanced AI agents (51:45) Core AI breakthroughs have already occurred (57:35) Timeline for functional AI agents interacting online (01:01:20) Safety considerations for powerful AI agents on Replit (01:08:47) Ethical considerations around AI and consciousness (01:20:36) What constitutes consciousness in an AI system (01:26:30) Should AI systems have rights and protections? (01:30:32) Being polite to AI systems (01:31:59) Advice for beginners looking to leverage AI (01:36:58) Using AI with a Neuralink brain implant (01:43:02) Hopes and fears about AI's impact on society
LINKS: https://replit.com/
X: @tylerangert (Tyler) @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast
SPONSORS: NetSuite | Omneky
-NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months. -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
This isn't news, it's analysis! Nathan Labenz sits down for an with Zvi Mowshowitz, the writer behind Don't Worry About the Vase to talk about the major players in AI over the last few months. In this extended conversation, Nathan and Zvi debate if AI has attained the intelligence of a well-read college graduate (per OpenAI's Yann LeCun), a live player analysis (who to count/ who not to count), and the role of independent red teaming organizations. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. Highly recommend.
TIMESTAMPS: (00:00) Episode preview (03:15) Is AI as intelligent as a college grad? (07:45) Memories and context processing (15:45) Sponsor: NetSuite | Omneky (17:13) Is AI as intelligent as a college grad? cont'd (20:47) Strengths and weaknesses of AI vs human (31:05) OpenAI Superalignment (37:23) The relationship between OpenAI and Anthropic (44:31) Anthropic's security recommendations and adversarial attacks (50:50) Is OpenAI using a constitutional AI approach? (01:01:26) Context and stochastic parrots (01:10) Is more context better? (01:15:29) Should Nathan work at Anthropic? (01:21:35) Google DeepMind's RT-2 (01:27:47) Multi-modal Med-PaLM (01:31:50) Speculating about Gato (01:35:10) Skepticism about Med-PaLM usage in radiology (01:41:37) Llama 2 - what is going on at Meta?? (01:51:14) Llama 2 vs other models (01:55:29) Who are the live players? (02:01:38) China's AI developments (02:02:41) Character AI and Inflection (02:05:26) Replit as the perfect substrate for AGI (02:10) AI girlfriends (02:18:53) AI safety: The White House (02:25:43) Bottlenecks to progress (02:35:27) Can new players influence AI policy? (02:39:00) Liabilities (02:47:54) Independent red teaming organizations (02:57:18) Mechanistic interpretability
LINKS Zvi's blog: https://thezvi.wordpress.com/ Google's RT-2: https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action Gato: https://www.deepmind.com/publications/a-generalist-agent Llama 2: https://ai.meta.com/llama/ Adversarial attacks paper: https://arxiv.org/abs/2307.15043
X: @labenz (Nathan) @thezvi (Zvi) @eriktorenberg (Erik) @cogrev_podcast
SPONSORS: NetSuite | Omneky -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.
-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
Arthur Conmy sits down with Nathan Labenz for an accessible deep dive into the state of interpretability research online today. They discuss how pioneering researchers have painstakingly worked to isolate the sub-circuits within transformers that are responsible for different aspects of AI capabilities. Arthur also introduces us to a new ACDC approach that he and his co-authors have taken to automating some of the most time-consuming parts of this work. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co
TIMESTAMPS: (00:00) Episode Preview (04:40) What attracted Arthur to mechanistic interpretability? (07:49) LLM information processing: General Understanding vs Stochastic Parrot Paradigm (14:00) ACDC paper: https://arxiv.org/abs/2304.14997 (14:45) Sponsors: NetSuite | Omneky (24:30) Putting together data sets (32:39) How to intervene in LLMs network activity (36:00) Setting metrics to evaluate the production of correct completions (44:20) The future of the mechanistic interpretability research (50:00) Extracting upstream activations in the ACDC project and evaluating impact on downstream components. (56:00) Anthropic research findings (01:08:00) 3-Step process of the ACDC approach (01:22:00) Setting a threshold and validation (01:27:00) Goal of the approach (01:32:00) Compute requirements (01:35:30) Scaling laws for mechanistic interpretability (01:40:00) Accessibility of this research for casual enthusiasts (01:46:00) Emergence discourse (01:56:00) Path to AI safety
LINKS: https://arthurconmy.github.io/
X: @labenz (Nathan) @arthurconmy (Arthur) @cogrev_podcast
SPONSORS: NetSuite | Omneky -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (Code http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.
-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Nathan Labenz sits down with Dr. Ronen Dar, CTO and co-founder of Run:ai, an Israel-based company that helps enterprises train and deploy AI models by optimizing GPU usage. The discussion covers how chip makers can meet the soaring demands, geopolitical fears, to the best practices companies can secure compute capacity. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDATION: The AI Scouting Report Playlist Parts 1-3: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81ee
TIMESTAMPS: (00:00) Episode Preview (00:51) Introduction to Dr. Ronen Dar (03:30) Run:ai's technology and what differentiates it from other solutions (06:00) Today's market compared to when Dr. Ronen started five years ago (13:40)Run:ai on market competitors like mosaicML (14:55) Sponsors: NetSuite | Omneky (22:00) The process and best practices by which companies secure compute capacity (25:00) Dr. Ronen explains the GPU shortage (31:50) GPU solutions (36:00) Relative pricing across major providers (41:00) What other chip makers are going to be relevant? (49:00) Global outlook for chip production (52:45) Worldview around the US-China AI race (58:00) Can controls on hardware actually control access to AI?
LINKS: https://www.run.ai/
SOCIAL MEDIA: @labenz (Nathan) @ronen_dar @runailabs (Run:ai) @cogrev_podcast
SPONSORS: NetSuite | Omneky -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform -> NetSuite: http://netsuite.com/cognitive and defer payments of a FULL NetSuite implementation for six months.
-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Head over to YouTube to watch Part 2 of The AI Scouting Report (https://www.youtube.com/watch?v=ovm4MbQ4G9E), supported by slides and visual aides. In Part 2, Nathan Labenz builds on Part 1: AI Fundamental and delves into recent trends and practical applications for AI. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90-minute installments. Listener comments on Part 1: "Incredible summary! I’ve watched probably 20 videos like this and I’ve always been left with unanswered questions." "This is a really excellent overview! Enjoyed going through this and looking forward to episode 2. Thank you for sharing it on here for free!" "Best 90 minutes this old PhD physicist has spent in a long time!" LINKS: Part 1: https://youtu.be/0hvtiVQ_LqQ Part 2: https://www.youtube.com/watch?v=ovm4MbQ4G9E Part 3 released later this week!
Questions or topics you want us to review on the podcast? Email TCR@turpentine.co The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co
TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
Nathan Labenz interviews Div Garg, founder of MULTI·ON, the world's first personal AI agent and life copilot. Div talks about the product strategy and roadmap for the MULTI·ON browser, their natural language approach to skills, and the steps they are taking to ensure user safety. Div explains how the platform uses a critic model to detect the success or failure of tasks, and how it can be used to book flights, order food, and more. Div also talks about the future of memory systems, such as the user profile feature, and how it can be used to improve the user experience. The Cognitive Revolution is part of the Turpentine podcast network. Learn more at turpentine.co Have your AI questions answered on an episode by emailing TCR@turpentine.co Send your friends our 90 min AI Scouting Report with visual aides! The AI Scouting Report Part 1: The Fundamentals is on YouTube at https://www.youtube.com/watch?v=0hvtiVQ_LqQ . Part II is coming next week.
TIMESTAMPS: (00:00) Episode preview (06:42) AI agents applied to everyday life. (12:03) AI-driven automation with browser extension. (15:02) Sponsor: Omneky (18:17) AI-driven automation of web tasks. (23:57) Task automation and planning. (29:43) Automate task completion with user validation. (34:45) Lifelong learning agent with high-level skills (40:19) Guiding users to create skills safely. (46:53) AI assistant to simplify lives. (53:14) Unlock parallelism with AI agents.
LINKS: MULTI·ON: https://www.multion.ai/ Div Garg; https://divyanshgarg.com/
TWITTER: @labenz (Nathan) @DivGarg9 @eriktorenberg (Erik) @cogrev_podcast
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music: GoogleLM
Nathan Labenz sits down with Zvi Mowshowitz, the writer behind Don't Worry About the Vase. Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. In this episode, we cover his AI safety worldview, an overview of the AI discourse, and who really matters in the AI debates. Do you have questions you want us to answer, topic requests, or guest suggestions for upcoming episodes? Email us at TCR@turpentine.co
Also, be sure to check out our recent release on YouTube: The AI Scouting Report Part 1: The Fundamentals TIMESTAMPS: (00:00) Episode Preview (05:00) Zvi’s Introduction to AI (07:04) Weekly 10,000+ words / Weekly newsletter (12:34) Language models (18:25) AI Worldview (27:30) Probably of Due (33:10) Inspirations for Content (39:00) Audience for Writings (45:25) Impactful figures’ impact (48:55) Path of the river (55:39) Different camps in AI discourse (01:13:55) Acceleration Front Argument (01:20:08) Large Language Models Today (01:27:00) Spendings in AI (01:36:03) Principles / Virtue Ethicism (01:43:30) Human vs Non-human Universe (01:47:32) AI Safety & “Doomers” (02:02:10) Expectations of Human/AI Relationship (02:10:30) Future of Online Laws and Ethics (02:19:10) What do we do next? (02:34:50) Sources for learning (02:42:08) Conclusion
LINKS: Don't Worry About the Vase: https://thezvi.substack.com/
TWITTER: @labenz (Nathan) @theZvi (Zvi) @eriktorenberg (Erik) @cogrev_podcast
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
Head to a special YouTube presentation with visual aides (https://youtu.be/0hvtiVQ_LqQ), where Nathan Labenz synthesizes the core fundamentals of AI as simply, clearly, and literally as possible. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. This special episode is in part brought to you by Athena. You can use Nathan’s referral link (http://athenago.me/nathan-labenz) for a free first month of Athena services for qualified customers.
Questions or topics you want us to review for Part 2? Email TCR@turpentine.co The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co
TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
In this episode, Nathan Labenz sits down with Hayk Martiros, VP of Autonomy at Skydio. Martiros leads the autonomy team, which holds the state of the art in complex autonomous flight. Skydio is the largest drone developer in the US, and recently raised $230M to expand its US manufacturing 10-fold, bringing its valuation to $2.2 billion. In this discussion, Hayk and Nathan discuss why Skydio will not weaponize its drones, Skydio’s systems and AI approach, and the considerations of choosing an autonomous system over a human agent.
LINKS: SymForce: https://github.com/symforce-org/symforce End-to-End Learning of Geometry and Context for Deep Stereo Regression (Skydio’s 2017 paper): https://arxiv.org/pdf/1703.04309
TIMESTAMPS: (00:00) Episode Preview (01:12) Nathan’s episode intro (07:44) Hayk’s story (11:21) What is Skydio? (14:59) Sponsor: Omneky (16:56) The core driver of Skydio’s business (20:21) Skydio’s AI approach (23:56) Updating the voltage 30,000 times per second (24:52) How is the Skydio system built? (34:07) The loops in the Skydio system (36:00) SymForce, Skydio’s open source library and Hayk’s creation (41:06) Writing symbolic expressions as a roboticist (42:14) Writing an expression for a toy race car (47:58) Skydio neural networks (51:29) Going from designed systems to end-to-end systems (58:17) How much does a Skydio drone and dock cost to install? (01:00:19) The cost savings of using a Skydio drone (01:02:59) Are $1 drone missions in the consumer’s future? (01:06:22) Vertical integration vs platform (01:09:29) The advantages and disadvantages of drones (01:11:17) Running LLMs on a drone (01:14:36) Power consumption going to compute vs mechanics (01:18:26) Hayk’s predictions for consumer autonomous systems (01:21:51) Standards for choosing autonomous systems over humans (01:25:23) Skydio’s societal impact (01:28:34) Universal basic income (01:30:27) Skydio drone usage in defense (01:34:34) The Ukraine-Russia conflict (01:38:02) Hayk’s experience with the Nagorno-Karabakh conflict
TWITTER: @SkydioHQ (Skydio) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
[Bonus Episode] Latent.space hosts, Alessio and Swyx, sit down with Linus Lee of Notion AI to discuss Linus’ experience starting the AI/UX community, prompt engineering at Notion, and designing AI interfaces and agents. The latent.space podcast aims to be the first place where AI engineers hear about the latest AI news and technology trends. We’ve had several guests in common – including Shreya Rajpal of Guardrails, Jonathan & Abhi from the recently acquired for $1.3B MosaicML, and also Riley Goodside from Scale AI – and also explored similar themes, including the question of which AI companies have durable business moats, and the flurry of experimentation going into AI agents right now. We recommend checking them out! Keep up to date with Latent.space here:
Website: https://www.latent.space/
Spotify: https://open.spotify.com/show/2p7zZVwVF6Yk0Zsb4QmT7t?si=95fb033e3c014975
Apple Podcasts: https://podcasts.apple.com/us/podcast/latent-space-the-ai-engineer-podcast-codegen-agents/id1674008350
Youtube: https://www.youtube.com/@LatentSpace-podcast
Timestamps * [00:05:52] Starting the AI / UX community * [00:12:23]] Most knowledge work is not text generation * [00:18:43] Finding the right constraints and interface for AI * [00:21:27] Linus' journey to working at Notion * [00:25:51] The importance of notations and interfaces * [00:28:29] Setting interface defaults and standards * [00:34:58] The challenges of designing AI agents * [00:42:00] Notion deep dive: “Blocks”, AI, and more * [00:53:22] Prompt engineering at Notion * [01:04:22] Lightning Round
Nathan Labenz sits down with Lili Yu, a researcher of Meta AI to discuss the paper she authored: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. In this conversation, they discuss the architecture and breakthroughs of their research, and the opportunity to eliminate the need for tokenization. The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: www.turpentine.co
LINK: MEGABYTE Paper: https://arxiv.org/pdf/2305.07185.pdf
TIMESTAMPS: (00:00) Episode preview (07:41) Takeaways from Lili Yu's paper: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers (17:00) Architecture (24:59) Embeddings (27:43) Different local models (34:23) Encoder model (36:35) Transformer Architecture (48:10) Choosing patch size (01:08) What happens when you scale up? (01:19:20) Big picture for Meta AI (01:22:57) Responsible AI (01:27:02) China and AI
TWITTER: @labenz (Nathan) @liliyu_lili (Lili) @eriktorenberg (Erik) @cogrev_podcast
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM:
Ziming Lu is a Physics PhD student at MIT and IAIFI, advised by Prof. Max Tegmark. Ziming’s research is at the intersection of AI and physics. Today’s discussion goes in-depth on Lu’s paper “Seeing is Believing” where he presents Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable. The ability to see modules visually can complement current mechanistic interpretability strategies. The Cognitive Revolution is a part of the Turpentine podcast network. To learn more: Turpentine.co
Watch this episode on YouTube to see research figures and graphics: https://www.youtube.com/watch?v=VKxwlxb2XWw
Links: Seeing is Believing, authors: Ziming Lu, Eric Gan, and Max Tegmark https://arxiv.org/pdf/2305.08746.pdf Ziming Lu: https://kindxiaoming.github.io/
TIMESTAMPS: (00:00) Episode preview (01:16) Nathan introduces Ziming Lu and his research (04:50) What motivated Ziming's research into neural networks and modularity (08:06) Key Visuals of "Seeing is Believing" (08:44) Biology analogy & paper overview (15:07) Sponsor: Omneky (26:08) Research precedents (30:00) Locality vs modularity (37:40) Shoutout Tiny Stories : Episode 33 (39:00) Quantization Model of Neuro Scaling. (1:00:00) How can this work impact mechanistic interpretability strategies (1:27:00) Training (1:46:30) Downscaling large-scale models
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
Part 2 of Nathan's conversation with Tanishq Mathew Abraham focuses on Tanishq's work with virtual biopsy technology enabled by deep learning. This unique technology has the potential to address a number of important biomedical challenges; in particular, qOBM could help during live tumor and cancer removal surgeries. Tanishq, a 19-year-old UC Davis grad and one of the youngest people in the world to receive a Ph.D, with a degree in biomedical engineering, is the founder of the Medical AI Research Center (MedARC). In case you haven’t yet listened to part 1, check it out! That episode goes deep on Tanishq’s first published paper: Reconstructions of the Mind’s Eye, which encompasses breakthrough research on reconstructing visual perceptions from fMRI scans into images.
The Cognitive Revolution is a part of the Turpentine podcast network. To learn more: Turpentine.co
TIMESTAMPS: (00:00) Episode Preview (03:26) Introducing Tanishq’s second paper presenting an AI-enabled biopsy (06:39) Diagnostic applications of this unique slide-free and label-free technology (qOBM) (13:06) Leveraging deep learning, specifically generative adversarial networks (GANs) (14:55) Sponsor: Omneky (15:42) Framework for model (16:22) Challenges of medical data sets (20:11) Challenges of unpaired image to image translation, addressed with a CycleGAN architecture (22:19) What didn’t work (25:44) Breaking down GAN frameworks (34:30) Simplifying data to better with the CycleGAN (36:02) Factors for errors and confusing the model (39:00) Compute and training requirements (41:35) How this technology can scale in the near term and improve patient care (45:53) Tanishq’s relationships with EleutherAI and Stability AI (47:08) The future-looking focus of MedArc and unexplored opportunities (49:00) Developments in Medical AI field and interesting applications (55:11) Early education and AI (58:00) Would Tanishq get a neuralink? (1:00:00) Tanishq’s hopes and fears for AI
LINKS: Paper: Label- and slide-free tissue histology using 3D epi-mode quantitative phase imaging and virtual H&E staining https://arxiv.org/pdf/2306.00548.pdf Authors: Tanishq Mathew Abraham, Paloma Casteleiro Costa, Caroline Filan, Zhe Guang, Zhaobin Zhang, Stewart Neill, Jeffrey J. Olson, Richard Levenson, Francisco E. Robles
TWITTER: @iScienceLuvr (Tanishq) @MedARC_AI (MedARC) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
In this episode, Nathan sits down with Tanishq Mathew Abraham, 19-year-old UC Davis grad and one of the youngest people in the world to receive a Ph.D, with a degree in biomedical engineering. Tanishq is the founder of the Medical AI Research Center (MedARC), and with his teammates, recently published a paper: Reconstructions of the Mind's Eye, which encompasses their breakthrough research on reconstructing visual perceptions from fMRI scans into images. In this episode, Nathan and Tanishq talk about the technology behind the fMRI-to-image project, developing the model, and future applications for this research. Part 2 with Tanishq will be released as the next episode. The Cognitive Revolution is a part of the Turpentine podcast network. To learn more: Turpentine.co
TIMESTAMPS: (00:00) Episode Preview (05:43) The MindEye Project (09:06) Resemblance between AI reconstruction of mind's eye and visual presented (10:00) What is a voxel and which regions of the brain were studied? (10:23) What would the raw data of a voxel be? (11:44) Is there a time dimension to voxels? (15:00) Sponsor: Omneky (17:50) Goals for the MindEye project (25:57) What is the starting point of the model? (31:15) Aligning the model: reconstruction vs retrieval (40:34) Would doing a full end-to-end training be fine for the reconstruction? (42:15) The role of a limited data set (43:09) Training separate models per subject (45:07) Generalizability with a limited dataset (47:20) Mapping from one high-dimensional space to another (50:47) Stable Diffusion VAE encoding (1:00:50) How long does it take to train the model? (1:03:14) How similar or different are the subjects and their individual models? (1:05:59) The future of this research: custom models for your brain? (1:07:34) How much does this research contribute to brain research and wearables? (1:11:15) Fuzzing data and future research applications
LINKS: MedARC: medarc.ai MindEye Paper: https://www.researchgate.net/publication/371136623_Reconstructing_the_Mind's_Eye_fMRI-to-Image_with_Contrastive_Learning_and_Diffusion_Priors
MP3 of this episode: https://chrt.fm/track/993DGA/traffic.megaphone.fm/RINTP1584997572.mp3?updated=1687271014
TWITTER: @iScienceLuvr (Tanishq) @MedARC_AI (MedARC) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT: MusicLM
In this episode, Nathan sits down with Jonathan Frankle, Chief Scientist, and Abhi Venigalla, Research Scientist of MosaicML. They chat about Mosaic’s custom LLMs, the customers seeking Mosaic out and what their journeys and use cases look like, and exciting developments in Mosaic’s research: including their new inference platform, as well as Mosaic’s MPT-7B-65k+ storywriter model. The Cognitive Revolution is a part of the Turpentine podcast network. To learn more: www.turpentine.co
TIMESTAMPS: (00:00) Episode Preview (06:04) Mosaic’s business model (07:28) Who uses Mosaic’s custom LLMs? What does their data look like? (09:55)Mosaic’s use cases for custom LLMs (12:47) How much extraction and summarization was done by humans pre-LLMs? (15:28) Sponsor: Omneky (21:50) The journeys of Mosaic’s customers and would a Wendy’s LLM know about a Big Mac? (25:46) The curriculum model and fine-tuning (29:10) Language models in the life sciences (33:20) How raw can data be before it becomes a problem? (35:44) Using the output of bulk pre-training process vs additional after training (38:30) Redteaming as a service (39:40) Mosaic’s inference platform (41:53) Spending one cent on 20,000 tokens, how is that cent distributed? (46:00)) Selling compute on a dedicated capacity basis (47:30) Oracle and AWS (49:50) The storywriter model and 65,000 token window (54:35) The transition from finite parameters into infinite attention matrix
LINKS: MosaicML: https://www.mosaicml.com/ MPT-7B Storywriter Model: https://huggingface.co/mosaicml/mpt-7b-storywriter
TWITTER: @jefrankle (Jonathan) @abhi_venigalla (Abhi) @MosaicML (Mosaic) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM
In this episode, Nathan Labenz and Erik Torenberg host a discussion between Emad Mostaque, founder of Stability AI, and Sam Lessin, GP of Slow Ventures and former VP Product at Facebook. These influential technology thinkers tackle topics pertinent to evaluating whether AI is a good investment for venture capital. They talk about the attention and information economy, SaaS markets, how AI-created entertainment will impact society and our relationships, and AI disruption of highly-regulated industries. The Cognitive Revolution is a part of the Turpentine podcast network. Learn more at www.turpentine.co
LINK FOR NATHAN'S LIVE EVENT IN SAN FRANCISCO: Friday June 16th: Why AI with Athena: https://v4p9mjmurpv.typeform.com/to/llRcJSF9
RECOMMENDED PODCAST: Media Empires from Turpentine: https://link.chtbl.com/mediaempires A new podcast where Erik Torenberg interviews influential media creators, podcasters, newsletter writers, and media entrepreneurs to learn exactly how they built their empires. Check out the first episode with Austin Rief, CEO of Morning Brew.
TIMESTAMP: (00:00) Episode Preview (01:17) Nathan explains why we hosted a conversation with Emad and Sam (08:25) Discussion kicks off: AI as an extender rather than a deck shuffler (12:01) Is AI a disruptive or sustaining innovation? (14:22) What is intelligence? (16:00) The attention and information economy (21:56) Storytelling, the stock market, and the economy (23:23) Sponsor: Omneky (23:50) AI in the media industry, Hollywood, and distribution (29:10) Startups vs incumbents (30:30) Disrupting highly-regulated industries (32:30) AI in education: an AI tutor for every child (35:15) AI as StackOverflow 2.0 for engineers (37:23) Regulatory Arbitrage (40:06) The oracle problem in AI (42:00) Apple as the weakest BigTech player in AI (44:30) AI in communities and the future of social media (46:55) Replika on Valentine’s Day and AI-generated porn (53:50) How does the market for inference shape up? Inference vs. cloud (55:08) Price of primary care in US in the next decade (55:38) What are the most likely incumbents to be disrupted? (56:55) Will BigTech continue to opensource? (58:56) Marriage rate in US in the future given AI (01:00:24) Can any AI leader sustain high gross margins in the future? (01:02:04) Stability’s business model
TWITTER: @EMostaque (Emad) @Lessin (Sam) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Download this episode as an mp3: https://chrt.fm/track/993DGA/traffic.megaphone.fm/RINTP2126380296.mp3?updated=1686676812 Music Credit: MusicLM
In this episode, Nathan sits down with Joshua Browder of DoNotPay, the world’s first robot lawyer. They chat about the current state of AI use in law, what policymakers should consider in regulating AI, and the ethics of robo-lawyers for consumer use.
The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co
RECOMMENDED PODCAST: Media Empires from Turpentine: https://link.chtbl.com/mediaempires A new podcast where Erik Torenberg interviews influential media creators, podcasters, newsletter writers, and media entrepreneurs to learn exactly how they built their empires. Check out the first episode with Austin Rief, CEO of Morning Brew.
TIMESTAMPS: (00:00) Episode Preview (03:46) Joshua Browder and the story of DoNotPay (04:50) The value incurred through an AI lawyer (07:17) What are the legal and financial injustices that motivates Joshua’s work? (12:46) How does the AI negotiate with a Comcast chat agent? The future for DoNotPay (16:28) Consumer security (21:08) The ethics of DoNotPay (22:27) Should AI need to disclose that it’s AI? (24:47) How much human intervention is necessary in AI tooling? (27:15) Where does the burden of proof lie for AI regulation and ethics? (31:47) Advice to policymakers (35:45) AI Liability (38:05) AI Arms Race (43:55) Productive bot interactions (45:18) AI-powered arbitration (49:28) How the consumer experience might change two years from now (51:45) AI Superapps (56:06) Moats in AI (57:11) How much money does DoNotPay save people today? (01:00:58) Consumer and enterprise timelines given AI (01:06:53) What will AI replace? (01:09:34) Impact of AI in different industries (01:12:35) The legal field’s view of AI (01:19:38) Deflationary factors in running DoNotPay (01:30:08) What are non-obvious ways to save money? (01:33:51) Joshua’s favorite AI tools (01:34:52) Would Joshua get a Neuralink implant? (01:35:57) AI hopes and fears
LINKS: https://donotpay.com/
TWITTER: @jbrowder1 (Joshua) @DoNotPay (DoNotPay) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik)
SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
NEWSLETTER: More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com
People have long been imagining AI assistants. Flo Crivello (founder of Teamflow) is turning that dream into a reality with the ambitious project Lindy. Flo sits down with Nathan on Lindy's announcement day to talk about this unique moment in AI, Lindy's capabilities, single-use apps, and how he sees the global impact that AI-powered employees can have on the future of work.
Anyone who mentions "The Cognitive Revolution" when signing up for the Lindy beta will get priority access.
(0:00) Preview
(1:05) Sponsor: Omneky
(4:50) Flo demos Lindy
(9:21) Security and user experience
(11:55) How this AI moment compares to the Industrial Revolution and single use apps
(15:00) The dream AI assistant (19:54) Competition and advantages of startups
(24:28) Cost vs Quality
(31:19) How Lindy uses user data
(32:37) Context and data injection
(28:11) Comfort with ambiguity
(43:10) Use of guardrails and trust concerns
(47:26) AI safety and edge cases
(49:16) Impact on labor markets
(50:27) Economic resilience
(52:09) Future of work
(55:49) Rapid fire questions
*Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack
Websites:
lindy.ai mention "The Cognitive Revolution" when you sign up for the waitlist to get priority access
thecognitiverevolution.ai
Twitter:
@CogRev_Podcast
@labenz (Nathan)
@Altimor (Flo)
How will GPT4 change the world? How will US-China 'racing dynamics' play out and what are the implications for AI safety? Nathan Labenz was invited to record a special "emergency" episode of ChinaTalk podcast this week to discuss the implications GPT4 will have for policy, economics, and society. Thanks to Jordan Schneider of ChinaTalk, and fellow "AI justice league" guests Zvi Mowshowitz of 'Don't Worry About the Vase' and Matthew Mittelsteadt of Mercatus.
(0:00) Intro
(2:09) GPT-4 emergency podcast
(9:26) GPT-4 use cases
(22:51) What GPT-4 can and can’t do
(35:50) AI safety
(45:38) OpenAI v. Anthropic
(48:54) Governments’ role in AI
(55:50) AI will improve physical health and healthcare the most
(59:19) Facebook’s LLaMA model
(01:05:55) VR/AR
(01:08:59) Concerns with GPT4
(01:15:26) GPT-5 and GPT-6
(01:18:45) Optimism in the AI revolution
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.
Twitter:
@CogRev_Podcast
@labenz (Nathan)
@jordanschnyc (Jordan)
Websites:
cognitivervolution.ai
We talked to Aravind Srinivas about competing with the tech giants, Perplexity's product philosophy and obsession with maximizing value delivered to the user per unit time, and the features that makes Perplexity unique.
(0:00) Preview
(1:31) Introduction & Context
(08:06) Aravind’s vision for Perplexity as the world’s most truth-centric company
(9:29) Raising the average IQ of the world
(12:00) Aravind’s favorite tech entrepreneur
(15:12) “Anthropics” - Building your own model vs user experience
(33:00) Why is perplexity free
(43:00) Talking shop: Perplexity’s tech stack and speed
(1:06:00) Perplexity’s stance on guardrails on search
(1:19:48) Forecasting weakly general AGI: The four criteria
(1:28:00) Aravind’s perspective on OpenAI and the future of AGI
(1:39:00) The Cognitive Revolution’s rapid fire questions: Neuralink implant? Most used AI tools? AI hopes and fears?
Twitter handles:
@CogRev_Podcast
@AravSrinivas (Aravind)
@labenz (Nathan)
@eriktorenberg (Erik)
Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/
References & Shownotes:
Flamingo: https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
Decision Transformer Paper: https://arxiv.org/abs/2106.01345
Aravind on TalkRL Podcast: https://www.talkrl.com/episodes/aravind-srinivas-2
Weakly General AGI Criteria: https://www.metaculus.com/questions/3479/date-weakly-general-ai-is-publicly-known/
(00:00) Preview (01:17) Sponsor (01:35) Intro (05:50) Convergence of AI techniques (07:33) Evolution of BLIP to BLIP-2 (08:12) How BLIP-2 unlocked multimodal functionality(12:43) The size, training dynamics, and optimization function of BLIP (20:15) Practical/Business applications of BLIP (29:43) Efficiency of BLIP-2 compared to other models (41:52) Two-stage pre-training (47:11) Architecture of Blip-2’s connector model (58:52) Language models as the executive function of the brain (01:07:32) Vision for an ultimate multimodal system and democratized pre-training for models (01:12:59) Useful AI tools in these researchers’ day-to-day (01:14:56) Upcoming projects
*Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Twitter:
@CogRev_Podcast
@atroyn (Junna Li)
@DongxuLi_(Dongxu Li)
@labenz (Nathan)
@eriktorenberg (Erik)
Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/
Websites:
Cognitivervolution.ai
huggingface.co/spaces/Salesforce/BLIP
huggingface.co/spaces/Salesforce/BLIP2
Show Notes:
-
Original BLIP demo
-
BLIP 2 demo
-
BLIP is the #18 most highly-cited paper in AI
-
Image captioning comparison tool
-
Understanding images with AI - for use in language models and image generation
-
Image Aesthetics - Product & Model Reviews
(0:00) Preview
(1:17) Sponsor
(4:00) Anton breaks down the advantages of vector databases
(4:45) How embeddings have created an AI-native way to represent data
(11:50) Anton identifies the watershed moment and step changes in AI
(12:55) Open AI’s pricing
(18:50) How chroma works
(33:04) Stable Attribution and systematic bias
(36:48) How latent diffusion models work
(51:26) How AI is like the early days of aviation
(56:01) How Disney inspired the release of Stable Attribution
(59:53):Why noise can lead to generalization
(1:01:04) Nathan’s KPI for The Cognitive Revolution
(1:01:59) Other use cases for embedding
(1:03: 19) Anton touches on the applications for biotech
(1:04:35) Anton on doomerism hysteria and what actually worries him
(1:11:43) - Nathan sums up a plausible doomer scenario
(1:20:17)What AI tools does Anton use and why?
(1:22:55) Anton’s hopes
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.*
Twitter:
@CogRev_Podcast
@atroyn (Anton)
@labenz (Nathan)
@eriktorenberg (Erik)
Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/
Websites:
cognitivervolution.ai
trychroma.com/
omneky.com
Show Notes & references:
-https://same.energy/ (Beta)
-Wright Brothers Bio (https://www.amazon.com/Wright-Brothers-David-McCullough/dp/1476728755)
-Ajeya Cotra article in Less Wrong (https://www.lesswrong.com/posts/pRkFkzwKZ2zfa3R6H/without-specific-countermeasures-the-easiest-path-to)
(0:00) Preview of the debate
(2:23) Sponsor
(3:10) Flo’s take on the AI moment and AGI
(5:45) Amjad’s take on the AI moment
(8:03) Antonio's skepticism about transhumanism
(9:10) Human tendencies color the debate about agency
(11:25) The inflection point is a jump in generality
(13:14) AI's effect on coding
(16:57) Weakness in current models
(19:18) Bounties and the future of work
(21:48) Antonio's skepticism around bounties
(25:00) Who will capture value, incumbents or startups?
(27:26) "All knowledge work will be automated in 20 years"
(30:10) Who will be the biggest beneficiaries of this shift?
(31:50) What AI companies should VCs invest in?
(32:26) Sponsor
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data, to generate personalized experiences at scale.
Twitter:
@CogRev_Podcast
@amasad (Amjad)
@antoniogm (Antonio)
@altimor (Flo)
@dwr (Dan)
@eriktorenberg (Erik)
@labenz (Nathan)
Subscribe to our Substack: https://cognitiverevolution.substack.com/
Websites:
cognitivervolution.ai
replit.com
teamflowhq.com
omneky.com
Show Notes & references:
Eliezer Yudkowsky: https://www.lesswrong.com/posts/FKNtgZrGYwgsz3nHT/bankless-podcast-159-we-re-all-gonna-die-with-eliezer
Paul Christiano: https://paulfchristiano.com/
AI Feedback: https://www.anthropic.com/constitutional.pdf
(01:08) Sponsor
(01:37) Introducing Eugenia
(03:25) Replika’s controversial choice to limit erotic roleplay functionality
(04:25) Eugenia's vision for Replika
(05:58) Augmented Reality is the Ultimate Modality
(07:52) Using Replika
(13:11) Profound stories about virtual assistants
(15:55) Eugenia on why Replika is more than just a painkiller or vitamin
(28:50) Replika's business model and profitability
(34:12) Users want their Replika to surprise them
(36:12) Why ChatGPT is not a conversational model
(49:26) Eugenia's prediction for the "next Iphone of personal AI"
(1:03:00) Eugenia’s AI tools/stack
(1:15:00) Eugenia comes back to discuss Erotic Roleplay controversy
(1:18:00) Replika’s first reaction to users ERP
(1: 22:00) How the product evolved from 90% scripts & retrieval models
(1:24:00) The definitive focus for Replika to stay in a PG13 zone
(1:26:00) “Normal” evolution given sci-fi depictions of AI romances
(1:30:00) Current AI ethics on sexuality
(1:37:07) Response to journalists misportrayal
(1:40:29) Sponsor
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.
Twitter:
@CogRev_Podcast
@eriktorenberg (Erik)
@labenz (Nathan)
@ekuyda (Eugenia)
Websites:
cognitivervolution.ai
https://replika.ai/
00:00 Coming Up
01:00 The Cognitive Revolution
01:20 Sponsor
01:39 Intro
02:09 Nathan’s path to AI
04:27 Founding Waymark
06:56 The future of AI is just starting
10:00 AI dramatically enhances human capabilities
10:50 Why we started The Cognitive Revolution and what to expect
14:55 Which guests will appear on the show and topics that will be discussed
18:59 Being replaced by an AI host
20:42 Unpacking the future of AI with “no new breakthroughs”
32:21 What’s underhyped and overhyped
43:46 The dangers of AI
44:51 Applying AI safely
52:19 Losing faith in technology
53:38 A new AI ecology
55:14 Facebook, Google and Open AI
58:00 Upside and downside case for AI
58:18 Sam Altman’s case for AI
01:09:25 Starting an AI company
01:18:22 Closing
01:18:46 Sponsor
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.
Twitter:
@CogRev_Podcast
@eriktorenberg (Erik)
@labenz (Nathan)
Websites:
cognitivervolution.ai
waymark.com
00:00 Intro
00:23 Suhail’s path to AI
09:03 Suhail’s vision for Playground
14:04 Suhail’s cancellation on Twitter
15:12 AI artists are artists
16:31 Non-AI artists feel threatened by AI
22:53 Suhail on defensibility at AI companies
26:36 Playground’s product roadmap
31:07 Suhail on good design
32:01 Latent space
40:10 Building Playground with lessons learned from Mighty
49:59 Monitoring led to 2x improvement in the product
51:59 How people use Playground
59:52 AI is having it’s mobile moment
01:11:18 Finding, investing and building durable AI companies
01:18:12 Suhail’s kid’s best friends may be AI characters
01:19:26 AI religion
01:20:22 Conclusion
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.
Twitter:
@CogRev_Podcast
@eriktorenberg (Erik)
@suhail (Suhail)
@labenz (Nathan)
Websites:
playgroundai.com
mixpanel.com
waymark.com