#192 - ChatGPT Pro, Amazon Nova, GenFM, Llama 3.3, Genie 2

Our 192nd episode with a summary and discussion of last week's* big AI news!

*and sometimes last last week's

Note: this one was recorded on 12/04 , so the news is a bit outdated...

Hosted by Andrey Kurenkov (twitter.com/andrey_kurenkov) and Jeremie Harris (twitter.com/jeremiecharris).

Feel free to email us your questions and feedback at contact@lastweekinai.comand/or hello@gladstone.ai

Read out our text newsletter and comment on the podcast at lastweekin.ai.

Sponsors:

•
The Generator - (babson.edu/thegenerator) An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

• The AI safety book “ (amazon.com/Uncontrollable-Threat-Artificial-Su…)Uncontrollable" (amazon.com/Uncontrollable-Threat-Artificial-Su…) which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today! (amazon.com/Uncontrollable-Threat-Artificial-Su…)

In this episode:

• OpenAI launches a $200 ChatGPT Pro subscription with advanced capabilities, while Amazon unveils cost-effective Nova multimodal models at the re:Invent conference.

• Meta releases LLAMA 3.3 70B model, showing significant gains through post-training techniques, and Alibaba introduces QWQ, a reasoning model rivaling OpenAI's O1.

• Amazon collaborates with Anthropic on a massive AI supercomputer project, and Black Forest Labs eyes a $200 million funding round for growth in AI tools.

• New research from DeepMind's Genie 2 generates interactive 3D worlds from text and images, progressing AI's understanding of world models and interactive environments.

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form (forms.gle/VmZDCzSBfeACe1Ke9).

Timestamps + Links:

• (00:00:00) Intro / Banter

• (00:02:34) Sponsor Break

• Tools & Apps

• (00:04:19) OpenAI confirms new $200 monthly subscription, which includes its o1 reasoning model (techcrunch.com/2024/12/05/openai-confirms-its-…)

• (00:10:40) Amazon announces Nova, a new family of multimodal AI models (techcrunch.com/2024/12/03/amazon-announces-nov…)

• (00:17:13) ElevenLabs launches GenFM to turn user content into AI-powered podcasts (testingcatalog.com/elevenlabs-launches-genfm-t…)

• (00:20:21) Google’s new generative AI video model is now available (theverge.com/2024/12/4/24312938/google-veo-gen…)

• Applications & Business

• (00:23:56) Elon Musk files for injunction to halt OpenAI’s transition to a for-profit (techcrunch.com/2024/11/30/elon-musk-files-for-…)

• (00:29:40) Amazon Is Building a Mega AI Supercomputer With Anthropic (wired.com/story/amazon-reinvent-anthropic-supe…)

• (00:34:15) It Sounds an Awful Lot Like OpenAI Is Adding Ads to ChatGPT (futurism.com/the-byte/openai-weighs-ads-chatgpt)

• (00:38:23) A16z in Talks to Lead $200 Million Round in Black Forest Labs, Startup Behind AI Images on Grok (bloomberg.com/news/articles/2024-11-26/a16z-in…)

• (00:41:10) Bezos Backs AI Chipmaker Vying With Nvidia at $2.6 Billion Value (bnnbloomberg.ca/business/technology/2024/12/02…)

• Projects & Open Source

• (00:45:25) Meta unveils a new, more efficient Llama model (techcrunch.com/2024/12/06/meta-unveils-a-new-m…)

• (00:50:00) Alibaba releases an ‘open’ challenger to OpenAI’s o1 reasoning model (techcrunch.com/2024/11/27/alibaba-releases-an-…)

• (00:55:21) DeMo: Decoupled Momentum Optimization (arxiv.org/abs/2411.19870)

• (00:57:01) PRIME Intellect Releases INTELLECT-1 (Instruct + Base): The First 10B Parameter Language Model Collaboratively Trained Across the Globe (marktechpost.com/2024/11/29/prime-intellect-re…)

• (01:03:03) Tencent Launches HunyuanVideo, an Open-Source AI Video Model (maginative.com/article/tencent-launches-hunyua…)

• Research & Advancements

• (01:09:23) DeepMind’s Genie 2 can generate interactive worlds that look like video games (techcrunch.com/2024/12/04/deepminds-genie-2-ca…)

• (01:16:43) Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding (arxiv.org/abs/2411.04282)

• (01:20:40) Densing Law of LLMs (arxiv.org/abs/2412.04315)

• (01:25:59) Monet: Mixture of Monosemantic Experts for Transformers (arxiv.org/abs/2412.04139)

• Policy & Safety

• (01:30:56) Commerce Strengthens Export Controls to Restrict China’s Capability to Produce Advanced Semiconductors for Military Applications (bis.gov/press-release/commerce-strengthens-exp…)

• (01:37:33) China retaliates against latest US chip restrictions (ft.com/content/eca9a562-ffc7-4989-bbf6-7349974…)

• (01:40:52) OpenAI Is Working With Anduril to Supply the US Military With AI (wired.com/story/openai-anduril-defense)

• (01:43:24) On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback (arxiv.org/abs/2411.02306)

• (01:47:52) AI Safety Researcher Quits OpenAI, Saying Its Trajectory Alarms Her (futurism.com/the-byte/openai-safety-researcher…)

• (01:51:52) Meta Claims AI Content Was Less than 1% of Election Misinformation (petapixel.com/2024/12/03/meta-claims-ai-conten…)

• (01:55:05) Outro

See Privacy Policy at art19.com/privacy and California Privacy Notice at art19.com/privacy#do-not-sell-my-info.