#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

Our 163rd episode with a summary and discussion of last week's big AI news!

Note: apology for this one coming out a few days late, got delayed in editing it -Andrey

Read out our text newsletter and comment on the podcast at lastweekin.ai

Email us your questions and feedback at contact@lastweekin.aiand/or hello@gladstone.ai

Timestamps + links:

• Intro / Banter

• Tools & Apps

• (00:02:16) Meta releases Llama 3, claims it’s among the best open models available (techcrunch.com/2024/04/18/meta-releases-llama-…)

• (00:14:01) Elon Musk’s xAI Unveils Grok-1.5 Vision, Beats OpenAI’s GPT-4V (analyticsindiamag.com/elon-musks-xai-unveils-g…)

• (00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus (venturebeat.com/ai/reka-releases-reka-core-its…)

• (00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model (txt.cohere.com/compass-beta)

• (00:23:48) Amazon Music’s Maestro lets listeners make AI playlists (theverge.com/2024/4/16/24132129/amazon-music-m…)

• (00:24:36) Snap plans to add watermarks to images created with its AI-powered tools (techcrunch.com/2024/04/17/snap-plans-to-add-wa…)

• Applications & Business

• (00:25:52) Boston Dynamics unveils new Atlas robot for commercial use (nbcnews.com/news/weird-news/boston-dynamics-un…)

• (00:30:32) TSMC’s $65 billion bet still leaves US missing piece of chip puzzle (arstechnica.com/gadgets/2024/04/tsmcs-65-billi…)

• (00:36:30) U.S. blacklists Intel's and Nvidia's key partner in China — three other Chinese firms also included in the blacklist for helping the military (tomshardware.com/tech-industry/semiconductors/…)

• (00:38:37) Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train (tomshardware.com/tech-industry/artificial-inte…)

• (00:40:22) Dr. Andrew Ng appointed to Amazon’s Board of Directors (aboutamazon.com/news/company-news/dr-andrew-ng…)

• (00:41:55) Collaborative Robotics Locks Up $100M, Latest Robot Startup To Raise Big (news.crunchbase.com/robotics/startup-collabora…)

• Projects & Open Source

• (00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models (docs.google.com/document/d/1_x7RzO0YTpLPaigeix…)

• (00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community (huggingface.co/blog/idefics2)

• Research & Advancements

• (00:51:21) RHO-1: Not All Tokens Are What You Need (arxiv.org/abs/2404.07965)

• (00:57:21) Scaling Laws for Fine-Grained Mixture of Experts (arxiv.org/abs/2402.07871v1)

• (01:03:20) Chinchilla Scaling: A replication attempt (arxiv.org/abs/2404.10102)

• (01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans (livescience.com/technology/electronics/china-d…)

• (01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments (arxiv.org/abs/2404.07972v1)

• Policy & Safety

• (01:13:44) U.S. Commerce Secretary Gina Raimondo Announces Expansion of U.S. AI Safety Institute Leadership Team (commerce.gov/news/press-releases/2024/04/us-co…)

• (01:17:18) NSA Publishes Guidance for Strengthening AI System Security (nsa.gov/Press-Room/Press-Releases-Statements/P…)

• (01:19:19) Foundational Challenges in Assuring Alignment and Safety of Large Language Models (llm-safety-challenges.github.io/challenges_llm…)

• (01:24:11) Former OpenAI Board Member Calls for Audits of Top AI Companies (bloomberg.com/news/articles/2024-04-16/former-…)

• (01:27:35) SoA survey reveals a third of translators and quarter of illustrators losing work to AI (www2.societyofauthors.org/2024/04/11/soa-surve…)

• Synthetic Media & Art

• (01:30:25) Medium bans AI-generated content from its paid Partner Program (bleepingcomputer.com/news/technology/medium-ba…)

See Privacy Policy at art19.com/privacy and California Privacy Notice at art19.com/privacy#do-not-sell-my-info.