DoorDash’s Agent Control Plane 🚦, OpenAI Shreds Analytics Costs 💸, SQL on Video 🎥

DoorDash built a centralized Agent Gateway that gives AI agents governed access to MCP tools, handling identity, authorization, credentials ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ 

Sign Up |Advertise|View Online TLDR TLDR Data 2026-08-03 📱 Deep Dives How DoorDash Built a Centralized Gateway for AI Agent-Tool Access (13 minute read) DoorDash built a centralized Agent Gateway that gives AI agents governed access to MCP tools, handling identity, authorization, credentials, filtering, observability, and rate limits. It now supports 200+ MCP servers and millions of weekly calls while improving security, reliability, and control. Parting the Clouds: The Rise of Disaggregated Systems (47 minute video) Cloud databases are increasingly separating stateless compute from shared storage to improve elasticity, failover, and pay-per-use economics. The tradeoff is remote I/O latency and bandwidth, so systems such as Aurora, AlloyDB, DSQL, PolarDB, and TaurusDB lean on buffering, prefetching, pushdown, RDMA/CXL, and careful log/storage design. Leveraging Data Assets features in Airflow 3.0 to optimise resource utilization by more than 30% (11 minute read) Halodoc migrated Airflow workloads from polling sensors and synchronous Redshift loads to Airflow 3.x Assets and deferrable operators. Across 160 DAGs, the team reduced worker CPU from 26.1% to 7.71% and worker memory from 49.2% to 30.8%, while also lowering scheduler load and reducing Redshift table-locking errors by about 38%. 🚀 Opinions & Advice OpenAI Just Made Analytics 10x Cheaper (6 minute read) OpenAI's cheaper GPT 5.6 Luna shifts agentic analytics toward small, fast models paired with low-latency analytical databases, delivering highly accurate SQL answers for under half a cent while making frequent evals far more affordable. The advantage now comes less from using the smartest model and more from strong business context, rigorous model-agnostic evals, and a responsive data platform. Beyond Happy Path Engineering: Databases (18 minute read) Production databases fail at the edges: stale replica reads, ambiguous commits, deadlocks, and live migrations can break flows that pass the happy-path tests. The practical takeaway is to enforce invariants at the database boundary with guarded writes, constraints, short transactions, idempotent retries, and explicit recovery procedures. Kafka's Broken Promise: There is No Goldilocks Log (7 minute read) Kafka's partitioned stream model is a poor fit for router-style workloads with millions of independently keyed ordered logs. OpenData Log is built in Rust on object storage and SlateDB. It uses segmented LSM storage, key-based scans, metadata-only splits, and read replicas to support high-cardinality log routing more cheaply. 💻 Launches & Tools Asynchronous I/O in DuckDB: Work, Thread, Work (12 minute read) DuckDB is adding asynchronous I/O so worker threads stop blocking on S3-backed Parquet and CSV reads. The design separates async and worker pools, adds read-ahead and memory governance, and shows some large performance wins: TPC-H Q6 on 22 GB Parquet fell from 8.23s to 2.84s, while a large CSV scan time improved by nearly 20x. Video Needs a Knowledge Base (6 minute read) Video is difficult to use because it can be stored and watched but not queried, forcing manual review or repeated AI processing. CreativAI's platform structures footage once into a searchable knowledge base for fast queries across robotics, logistics, safety, compliance, and physical AI use cases. Xberg (GitHub Repo) Xberg is an open-source engine that extracts text, tables, metadata, and structured data from 101 formats, including PDFs, images, audio, video, URLs, archives, and code. Its Rust core supports 15 languages plus OCR, transcription, embeddings, structured extraction, and deployment through libraries, CLI, REST, MCP, Docker, or Helm. 🎁 Miscellaneous PGSimCity (Tool) PGSimCity is an interactive educational simulator that represents a PostgreSQL database as a 3D city. You can adjust workload settings or trigger scenarios such as checkpoint storms, cache thrashing, autovacuum blockages, lock pile-ups, and replication lag to see how PostgreSQL's internal systems affect performance. Data lessons from inside Meta (Shridhar Iyer) (12 minute read) Meta's data platform evolved into a strongly typed, unified stack with centralized catalog, taxonomy, lineage, and policy layers. Its scale lessons: one truncated debug column saved millions of dollars, core tables serving 40–50% of the warehouse required versioning rather than deletion, and AI-readiness starts with reusable workflow primitives. Crowdsourced taxonomy verification: A feedback-driven framework for refining knowledge graph relationships via online search interactions (6 minute read) Grab treats knowledge-graph relationships as hypotheses that can be validated with live search behavior. Candidate parent, child, and sibling relationships are injected into suggestions, then clicks, dwell time, scrolls, and conversions are aggregated into confidence scores that promote or prune taxonomy edges. ⚡ Quick Links Postgres Index Types Explained: B-tree, GIN, BRIN, and Operators (5 minute read) A practical refresher on matching Postgres index types to equality, range, array, JSONB, text-search, and append-only time-series access patterns. Microsoft almost gave away the keys to everyone's Azure Cosmos DBs (2 minute read) A sharp reminder that managed NoSQL platforms can still expose master keys, so cloud secret posture and key rotation assumptions need regular review. Love TLDR? Tell your friends and get rewards! Share your referral link below with friends to get free TLDR swag! https://sparklp.co/32815a84/11 Track your referrals here. Want to advertise in TLDR? 📰 If your company is interested in reaching an audience of data engineering professionals and decision makers, you may want to advertise with us. Want to work at TLDR? 💼 Apply here, create your own role or send a friend's resume to jobs@tldr.tech and get $1k if we hire them! TLDR is one of Inc.'s Best Bootstrapped businesses of 2025. If you have any comments or feedback, just respond to this email! Thanks for reading, Joel Van Veluwen, Tzu-Ruey Ching & Remi Turpaud Manage your subscriptions to our other newsletters on tech, startups, and programming. Or if TLDR Data isn't for you, please unsubscribe.