The Hallway Track
Engineering Insights

Bypassing the Multimodal Tax: Hybrid RAG, SQL RRF & UI Telemetry - Abed Matini, Ogilvy

AI Engineer · Jun 28, 2026 · Engineering Insights

A backend dev demos a framework-free hybrid RAG system using SQL RRF and live telemetry to cut multimodal token costs.

“as soon as we upload these documents, we going to basically lose some of our tokens that we supposed to have only for processing these documents without even asking a question”

An Ogilvy backend developer presents a conference talk on building a framework-free hybrid RAG chatbot that uses SQL reciprocal rank fusion and live telemetry to avoid the token overhead of uploading documents to LLMs. The talk demos an HR FAQ assistant over an employee handbook, but offers a practitioner technique rather than a major industry signal.

RAG hybrid-search token-optimization chatbot SQL-RRF

Watch / read the original source →