- The Rundown AI
- Posts
- 🤖 ChatGPT can now see, hear, and speak!
🤖 ChatGPT can now see, hear, and speak!
PLUS: Amazon's shocking Anthropic investment
Rowan Cheung
September 26, 2023
Sign Up | Advertise | Tools | View Online
Welcome, AI enthusiasts.
ChatGPT is officially multimodal, allowing it to see, hear, speak, and interact with users in brand-new ways.
This may be the most significant day in AI since GPT-4. Let’s get into it.
In today’s AI rundown:
🔥 ChatGPT goes multimodal with voice and images
⚡️ Amazon bets $4B on AI startup Anthropic
🛠️ 8 New AI tools
🎥 Embed text in video with Pika Labs
🤖 3 Quick AI updates
Read time: 4 minutes
LATEST DEVELOPMENTS
OPENAI
Image source: OpenAI
The Rundown: OpenAI just shook up the world, announcing multimodal capabilities for ChatGPT. The new capabilities allow the chatbot to see (understand images), hear (understand speech), and speak when interacting with users.
Speak with ChatGPT:
Leveraging Whisper, users will be able to use voice to engage in a back-and-forth conversation.
The text-to-speech model has five different voice options for chats, created in collaboration with professional voice actors (demo).
Chat with images:
ChatGPT's language reasoning skills can now understand images, photographs, screenshots, and text documents.
Users can discuss multiple images or use the new drawing tool to guide the assistant (demo).
Additional notes:
The new text-to-speech model is already being used in Spotify's Voice Translation feature pilot for translating podcast audio.
OpenAI is gradually enabling voice and images over the next two weeks for Plus and Enterprise users.
Voice will be coming to both iOS and Android, and images will be available on all platforms.
Why it matters: The multimodal breakthrough is a massive step forward for LLMs — with OpenAI beating Google to the punch before the launch of Gemini. Better yet, we’re all finally getting the Siri we all wished for.
TOGETHER WITH ARCHIVE
The Rundown: Navigating user-generated content (UGC) from platforms like Instagram & TikTok is now a breeze with Archive.
Utilize Archive to:
Curate content effortlessly using AI-driven search.
Seamlessly manage and automate influencer collaborations.
Scale your campaigns with unmatched efficiency.
Access comprehensive UGC management tools.
Step into the future of social commerce. Click here to get started with Archive in under 5 minutes!
AMAZON
Image source: Anthropic
The Rundown: Amazon reportedly plans to invest as much as $4 billion for a MINORITY stake in generative AI startup Anthropic in a massive move to boost its presence in the space.
The details:
Anthropic will shift its operations to AWS and use its chips to run models, providing needed computing power.
In return, Amazon gains a key AI partner amid criticism that it's lagging against rivals in generative AI.
The deal could be AWS' largest startup investment ever, showing its appetite for AI.
Our thoughts: Doubters said AWS was stuck in reactive mode on AI — but backing ChatGPT competitor Anthropic obliterates that notion. Amazon is now the newest challenger joining the AI race.
TRENDING TOOLS
📱 AppyHigh Prime- The world's 1st generative AI app bundle (link)
⚡ FireCut AI- Your lightning-fast AI video editor (link)
🎙️ Dubbing by Wondercraft AI- Dub your content in minutes and preserve voice and emotion (link)
📝 Copy AI- Generate content, such as blog headlines, emails, and social media posts using AI (link)
📹 Pictory- Automatically create short, branded videos from long-form content (link)
💼 Taplio- All-in-one AI-powered tool for creating, managing, and growing your personal brand on LinkedIn (link)
🕸️ 10Web: Build or recreate any website in minutes with the power of AI (link)
🕵️♀️ Fine-Tuner.ai- Build your own tailored AI agents without technical skills or coding (link)
Browse the most popular tools ever featured with our tool database.
AI TRAINING
Last week, we featured a tutorial on how to make your own illusion art, like the images going viral across social media.
And yesterday, we wrote about AI platform Pika Labs bringing a similar feature to video!
Learn how to embed text in videos with the simple steps below:
Step 1: Head to Pika.Art and join the platform’s beta and Discord.
Step 2: Navigate to one of the #generate channels and begin with the command “/encrypt_text”. Type in the text you’d like embedded in the video in the ‘message’ section and the subject of the video in the ‘prompt.’
For the example below: /encrypt text Prompt: Crashing waves on a beautiful Caribbean beach Message: The Rundown
Step 3: Your video will generate directly in the Discord channel — tweak the prompt as needed, it may take a few tries to get a great output.
Happy creating!
QUICK HITS
⚡ Insights from OpenAI and Zapier at ZapConnect (sponsor)
Join Sam Altman, Co-founder and CEO of OpenAI, and Wade Foster, Co-founder and CEO of Zapier, for a fireside chat on Sept. 28 about AI, entrepreneurship, and much more at ZapConnect.
Getty Images just launched its own AI art tool, trained on its massive stock image library. Getty touts built-in guardrails like blocking depicting public figures to prevent misuse — and aims to give commercial clients more confidence in AI visuals via licensing protections.
Open Souls demoed its complex conversational AI models last week, simulating a mock zoom firing call between two AIs. The company aims to create conversational AI models that “autonomously think and behave like real people,” including feelings, personalities, and internal complexity.
Check out the wild demonstration here.
SPONSOR US
🦾 Get your product in front of over 300k+ AI enthusiasts
Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world. Learn more or get in touch today.
THAT’S A WRAP
Keep an eye out and click the star emoji hidden somewhere in today’s email for a free entry into our future giveaway (details announced soon).
Additionally, you’ll get another free entry for every subscriber who joins our newsletter using your unique link: https://www.therundown.ai/subscribe?ref=PLACEHOLDER
You can track how many referrals you’ve made here. Happy hunting!
If you have anything interesting to share, please reach out to us by sending us a DM on Twitter: @rowancheung & @therundownai
How was today's newsletter?Feedback helps us improve! |
❤️ Rundown review of the day
Reply