⚡️ Habitat for Robots

PLUS: Lenovo collaborates with Nvidia for advanced AI strategy

Good morning. While the rest of the world is busy building chatbots, Meta seems to have been pursuing AI agents that can communicate and assist humans in both digital and physical environments. Let’s dive right in.

Today’s Highlights:

  • ByteDance and Tsinghua University debut SALMONN

  • Lenovo collaborates with Nvidia for advanced AI strategy

  • Humane gears up to release AI pin featuring 'Trust Light'

DEEP DIVE

The Future of Human-Robot Collaboration

Meta unveils Habitat 3, a robust simulator advancing AI research into human-robot collaborations within virtually woven 3D environments. The platform enables efficient interaction between humans and AI in real-time through a sophisticated virtual interface. It also bolsters the development of realistic and varied human avatars that cross the barriers of indoor navigation and manipulation of objects.

Meta’s objective behind Habitat 3.0 is establishing a solid groundwork for high-scale training which would be pivotal in everyday tasks, such as tidying up a living room or preparing a delicious meal in the kitchen.

But how exactly will they benchmark these capabilities?

  • By devising two types of interactive tasks - social navigation (where a robot identifies an avatar and follows it) and social rearrangement (where a robot collaborates with the avatar to tidy up a room).

  • As Facebook AI Research (FAIR) research points out, the social rearrangement experiments show not only an improvement in work efficiency with unseen avatar partners but also better collaborative space management in social navigation tasks.

Additionally, data enthusiasts have something to be excited about too. Alongside Habitat 3.0, Meta promises to deliver the Habitat Synthetic Scenes Dataset (HSSD-200), an artist-authored 3D database enumerating over 18,000 objects across 466 semantic categories in 211 scenes.

Thinking about the bigger picture? This all fits in with Meta's vision for a metaverse—a melding of digital spaces and virtually-enhanced physical reality.

PUNCHLINES

Together We Stand: Emergence Capital pumps $500M into GPU reseller Together.

Picasso Playlists: YouTube Music's new feature lets you create custom AI-generated playlist art.

Put a Pin in It: Humane is set to release its innovative AI pin, equipped with GPT-4 and a 'Trust Light' feature.

Breaking Bad: Molecular science VR startup Nanome launches MARA, an AI copilot for chemists working in biopharma research.

A Perplexing Investment: VC firm IVP leads investment in AI startup Perplexity—valuing it at $500M.

TLDR

ByteDance and Tsinghua University debut SALMONN: Researchers from ByteDance and Tsinghua University unveil SALMONN, an artificial intelligence system capable of processing and understanding diverse audio inputs like speech, sounds, and music. Web demo can be accessed on Hugging Face.

Google developing ads for its genAI search: Google confirms it is creating new ad formats for its generative AI search experience. Mainly relying on its ad revenue, Google plans to introduce these formats indigenous to its Search Generative Experience (SGE). This includes presenting sponsored ads in search results, aiming for a seamless search-to-ad transition.

Lenovo announces hybrid enterprise AI strategy and Nvidia tie-up: Lenovo is integrating public, private, and personal AI models into its hybrid enterprise AI strategy. A collaboration with Nvidia will advance this vision, with hardware integration optimized to run Nvidia's AI Enterprise solutions. Lenovo also plans to integrate AI aids into its devices and introduce new sustainability and digital workspace services.

FaceFusion advances deepfake creation: Open-source tool FaceFusion streamlines face swapping and restoration in videos, democratizing the creation of deepfakes. Promising simplicity, speed, and realistic results, its auto-detection feature allows seamless face swaps—enhancing efficiency and user experience.

TRENDING TOOLS

🔽 Stack AI: Enhance your AI capabilities with the power of middle-layer AI

📊 Dashboards by Equals: Transform spreadsheets into comprehensive dashboards instantly

📲 Context SDK: Boost app conversions with real-time user context

📚 Hexofy: Capture and analyze data from any webpage intelligently

🔒 Secureframe: Experience automated security compliance for your business

That’s all for today—if you have any questions or something interesting to share, please reply to this email. We’d love to hear from you!

P.S. If you want to sign up for the Supercharged newsletter or share it with a friend, you can find us here.

Reply

or to participate.