Stop routing docstrings to 70B models with on-device AI on Snapdragon | BRKSP90
On-device AI on Snapdragon can offload lightweight tasks from large cloud models to cut token costs.
“if you want to predict the future, you have to go and create it”
A Qualcomm software strategy lead opened a sparsely-attended Build session on using on-device AI on Snapdragon to avoid routing simple tasks like docstrings to large cloud models. The transcript captured is almost entirely improvised intro filler with no concrete benchmarks, product details, or announcements, so the substantive signal is minimal.