Godmother of AI unveils World Labs

PLUS: AI builds open-world games

Welcome, AI enthusiasts.

Fei-Fei Li, known as the “Godmother of AI,” just launched a startup to create AI that understands and generates 3D worlds.

With a fresh $230M in funding, could this spatial intelligence push AI beyond language models and revolutionize AR/VR, robotics, and more? Let’s get into it…

In today’s AI rundown:

  • World Labs aims to create 3D worlds with AI

  • AI creates open-world video games from text

  • Prompt tips and tricks for OpenAI’s new o1

  • OpenAI o1 is smarter than most humans

  • 6 new AI tools & 4 new AI jobs

  • More AI & tech news

Read time: 4 minutes

LATEST DEVELOPMENTS

WORLD LABS

Image source: World Labs

The Rundown: Fei-Fei Li, renowned AI researcher known as the “Godmother of AI”, has launched World Labs, a spatial intelligence company developing AI models capable of understanding and generating 3D environments.

The details:

  • World Labs is pioneering "Large World Models" (LWMs) to perceive, generate, and interact with 3D worlds, incorporating physics and semantics beyond 2D imagery.

  • Co-founded by Li, Justin Johnson, Christoph Lassner, and Ben Mildenhall, the startup has secured over $230 million in funding from high-profile investors, including Andreessen Horowitz.

  • Initial applications focus on creating and editing virtual 3D spaces for creative professionals and general users.

  • The team aims to bridge the gap between AI's current text-based understanding and the complex spatial relationships of the real world.

Why it matters: Right now, AI relies heavily on text descriptions provided by humans. But figuring out spatial intelligence and moving AI beyond LLMs and language could greatly impact and accelerate the development of intelligent AR/VR, robotics, architecture, game design, and much more.

TOGETHER WITH DEFINED.AI

The Rundown: Defined.ai provides the most diverse and ethically-sourced marketplace for AI training data, allowing businesses to create smarter, more cost-effective AI solutions at scale.

Defined.ai delivers:

  • Customizable, bias-free datasets that adhere to strict privacy and ethical standards

  • Industry-specific data for sectors including insurance, banking, and retail

  • Instant access to pre-built datasets to accelerate your AI projects

Claim your 5 free hours of data today, exclusively for The Rundown readers!

TENCENT

Image source: GameGen-O

The Rundown: Tencent just unveiled GameGen-O, a groundbreaking AI model capable of generating open-world video game content from text prompts and allowing interactive gameplay simulation.

The details:

  • GameGen-O can create diverse game elements like characters, environments, actions, and events from simple text prompts.

  • It also allows for interactive control of the generated video game content it creates to build worlds that gamers can interact with.

  • The AI model was trained on OGameData, a new dataset of over 4,000 hours of high-quality video game footage and uses a two-stage training process: foundation pretraining and instruction tuning.

  • The training data segments were annotated by GPT-4o for validation purposes.

Why it matters: Following the impressive accomplishments of Google’s GameNGen, Tencent’s GameGen-O raises the stakes for AI-generated video games. This technology will dramatically reduce the time and cost of building open-world games, leading to higher quality games created by smaller teams of game developers.

AI TRAINING

The Rundown: OpenAI's latest release, o1, unlocks new reasoning capabilities, but there’s a catch: prompts should be fundamentally different than the way you prompt GPT-3 and GPT-4, due to the new Chain-of-Thought (CoT) architecture.

Here’s our top tips:

  1. Log into ChatGPT (paid subscription required) and select o1-preview or o1-mini from the model dropdown.

  2. Keep your prompts simple and direct, avoiding Chain-of-Thought instructions.

  3. Use XML tags for clarity and test with challenging questions or philosophical queries.

  4. Analyze its thinking process by clicking on the "thinking" indicator after each response to understand the model's reasoning path.

Pro tip: Experiment with different query types to fully grasp o1's advanced reasoning abilities and check out OpenAI’s new ‘Advice on prompting‘ guide.

PRESENTED BY ASSEMBLYAI

The Rundown: AssemblyAI delivers the most accurate speech-to-text model with advanced audio intelligence – allowing teams to build beyond transcription and transform words into actionable insights.

AssemblyAI offers:

  • Top performance rankings across major industry benchmarks

  • Fully-featured speech understanding models

  • Comprehensive developer docs and reliable SDKs

Sign up today and get $50 in free credits.

AI RESEARCH

Image source: TrackingAI.org

The Rundown: OpenAI’s latest model, “o1”, has reportedly scored an IQ of around 120 on the Norway Mensa IQ test, potentially marking the first time an AI model has surpassed the average human IQ.

The details:

  • o1 correctly answered 25 out of 35 questions on the Norway Mensa IQ test.

  • It demonstrated proficiency in solving complex visual and logical puzzles, both on publicly available tests and new, unpublished questions.

  • This performance suggests the improvement is not due to the questions being in the training data.

  • While OpenAI hasn't officially confirmed these results, ChatGPT Plus members can test o1-preview themselves using the model dropdown inside ChatGPT.

Why it matters: If confirmed, these results would indicate that OpenAI has achieved Stage 2 performance on their 5-tier roadmap towards AGI. This milestone suggests the model can stop, think, and reason about problems to arrive at correct answers more frequently — a crucial prerequisite for Stage 3 (AI agents).

NEW TOOLS & JOBS

  • 🎬 Runway Gen-3 Video-to-Video - Video style transfer with the Gen-3 AI video generation model

  • 🎵 Suno Cover - Reimagine the music you love with AI covers

  • 👩‍🎤 HeyGen Avatar 3.0 - AI-generated avatars with emotions and tones that match your message

  • 📊 Infography - Convert blogs into engaging infographics

  • 🚀 FlutterFlow - Quickly generate code and styles for app development

  • 📞 AIPhone - Translates and transcribes live calls seamlessly

QUICK HITS

Runway released Gen-3 Alpha Video to Video, allowing users to transform input videos with AI-generated styles and prompts across all paid plans.

Meta (Facebook) admitted to scraping public data from all Australian adult users to train AI models, without offering an opt-out option available to EU users.

Google AI Studio launched a new model comparison feature, allowing users to easily compare outputs from different AI models and parameter settings.

Researchers developed “g1”, an AI system using Llama-3.1 on Groq hardware that implements reasoning chains to solve complex problems similar to OpenAI’s new o1 model.

A new AI chatbot using GPT-4 Turbo successfully reduced belief in conspiracy theories among users, with effects lasting for months after brief interactions.

Montana State University is developing AI methods using neural symbolic regression to help farmers maximize crop yields through precision agriculture.

Researchers are developing AI-piloted drone swarms to detect and extinguish wildfires, with teams of up to 30 autonomous aircraft working collectively to prevent fire spread.

THAT’S A WRAP

SPONSOR US

Get your product in front of over 650k+ AI enthusiasts

Our newsletter is read by thousands of tech executives, investors, engineers, managers, and business owners around the world. Get in touch today.

FEEDBACK

How would you rate today's newsletter?

Vote below to help us improve the newsletter for you.

Login or Subscribe to participate in polls.

If you have specific feedback or anything interesting you’d like to share, please let us know by replying to this email.

Reply

or to participate.