78% Wanted This AI Feature. Almost Nobody Used It - Supriya Subudhi, Bumble
78% of Bumble users wanted AI photo feedback, but almost nobody used it after release
“a positive AB test result is just the beginning. This is not the end.”
A Bumble PM found that 78% of users said they wanted AI-powered dating profile photo advice, but adoption was negligible once released — illustrating a core trap in AI product development where stated user demand doesn't translate to actual engagement. The talk outlines five reasons AB testing for AI features is uniquely unreliable compared to traditional product experiments. This is a practical cautionary signal for teams shipping consumer-facing generative AI features based on survey demand.