The Hallway Track

embeddings

14 tracked signals on embeddings.

Introducing EmbeddingGemma 2: An open model for natively multimodal embeddings

Google Developers (Google I/O) · Oct 06, 2026

Google releases EmbeddingGemma 2, a sub-billion open model unifying text, image, video, and audio embeddings on-device.

“a picture of a cat, the word cat, and the sound of a cat are all mapped close to each other in a shared high-dimensional embedding space”
EmbeddingGemma 2

Simon Willison · Oct 06, 2026

Google releases EmbeddingGemma 2 under Apache 2.0, enabling portable open-weight embeddings

“I don't think it makes sense to use a closed, proprietary, hosted-only model.”
Per-Layer Embeddings (PLE) in Gemma 4 explained

Google Developers (Google I/O) · Sep 25, 2026

Gemma 4's per-layer embeddings boost model performance without increasing compute parameters

“It's a very nice way to increase the performance of the model without actually increasing parameters because these parameters are stored on flash storage.”
Building an End-to-End Enterprise AI Platform on Azure

Microsoft Developer (Build) · Aug 24, 2026

Microsoft's CAF-aligned Azure AI landing zone delivers enterprise RAG at millions-of-documents scale

“The result is a grounded response traceable to enterprise data, not a hallucination.”
Don't classify. Hallucinate!

Simon Willison · Aug 14, 2026

Use LLM-hallucinated tags plus vector embeddings to match against large existing vocabularies

llm 0.33

Simon Willison · Aug 22, 2026

llm 0.33 adds composable templates, per-call embedding keys, and reasoning summary options