Nvidia’s New World Models 🌎, Microsoft’s $3B AI Investment 💰, Large Multimodal Model Explainability 🌐

Nvidia has released a new suite of World Models based on its Cosmos tokenization scheme. These have extremely powerful physics understanding ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ 

Sign Up |Advertise|View Online TLDR TLDR AI 2025-01-08 🚀 Headlines & Launches Nvidia's New World Models (34 minute read) Nvidia has released a new suite of World Models based on its Cosmos tokenization scheme. These have extremely powerful physics understanding and are on the Hugging Face platform. They seem to primarily be useful for robotics and industrial applications, but have the ability to create videos in other domains. Microsoft's $3B AI Investment (2 minute read) Microsoft plans to invest $3 billion to expand its artificial intelligence and cloud services in India. 🧠 Research & Innovation DMesh++ (12 minute read) The next version of fully differentiable geometric mesh representation is now available. It has a number of improvements that make it suitable for learning and shape representation. Agents (34 minute read) This post explores Agents what they are used for, where they fail, and where they will be successful. It also talks through planning and execution pipelines. Large Multimodal Model Explainability (5 minute read) This project improves the interpretability of large multimodal models by visualizing concepts and connecting them to input-output behavior. 🧑‍💻 Engineering & Resources Reach millions of tech professionals reading TLDR (Sponsor) Grab the attention of software developers, AI/ML engineers, executives and other tech professionals reading TLDR every day. TLDR offers 10 interest-based newsletters to help you reach your target audience. Learn more about running your first campaign with us. Picotron Tutorial for Distributed Training (GitHub Repo) This tutorial from the Hugging Face team, which includes video lectures, walks through the process of building a distributed training codebase from scratch. It includes exercises and helpful code documentation. Quantifying Inductive Bias (GitHub Repo) Meta has released tools to measure and analyze inductive bias in machine learning models that offer insights into model generalization and robustness. Video LLMs with Real-time Interactions (GitHub Repo) Dispider enables real-time interactions with streaming videos, unlike traditional offline video LLMs that process the entire video before responding. 🎁 Miscellaneous AI will be dead in five years (3 minute read) AI's success could render it less discussed in five years as it becomes an integral part of everyday technology and business solutions. The term may evolve, with current AI being redefined, much like how big data has become ubiquitous. Machine learning will become the main focus as AI transforms into standard functionality. You Must See How Far AI Video Has Come (10 minute read) Google DeepMind's Veo 2 sets a new benchmark in AI video generation, surpassing competitors with its quality, consistency, and prompt accuracy. The rise of deep fakes blurs reality, fostering creativity but undermining trust in visual content. There is concern over losing cultural continuity and the ability to discern reality as technological advancements accelerate. Beyond The Hype: AI, Innovation And Rational Investment In 2025 (6 minute read) Valuable AI companies are predicted to have strong growth in 2024 while many hyped ventures may falter. Vertical integration and buy-and-build strategies are expected to rise, capitalizing on markets needing technology streamlining. A shift towards emerging, capacity-constrained managers will contrast with the decline of overfunded growth companies from 2020-2021. ⚡ Quick Links Improving RAG accuracy with semantic reranking (Sponsor) RAG accuracy improves when you can feed the LLM more relevant documents. Learn how semantic reranking can improve text search and RAG pipelines in this technical blog by Elastic. Experimental Gemini Thinking Model (GitHub File) Google has quietly pushed a new thinking model, likely similar to o1 style reasoning, to its AI studio. Instagram to replace AR filters with AI-generated videos (2 minute read) Meta will discontinue Instagram's Spark AR filters by January 2025, shifting focus to AI-based filters called Movie Gen. A new, uncensored AI video model may spark a new AI hobbyist movement (5 minute read) Tencent's open-weight AI model, HunyuanVideo, enables local, uncensored video synthesis, offering a potentially transformative tool like Stable Diffusion. Love TLDR? Tell your friends and get rewards! Share your referral link below with friends to get free TLDR swag! https://refer.tldr.tech/0b6a6dc1/2 Track your referrals here. Want to advertise in TLDR? 📰 If your company is interested in reaching an audience of AI professionals and decision makers, you may want to advertise with us. Want to work at TLDR? 💼 Apply here or send a friend's resume to jobs@tldr.tech and get $1k if we hire them! If you have any comments or feedback, just respond to this email! Thanks for reading, Andrew Tan & Andrew Carr If you don't want to receive future editions of TLDR AI, please unsubscribe from TLDR AI or manage all of your TLDR newsletter subscriptions.