How to Evaluate Recommendation Systems: CTR, CVR, Diversity and Novelty
Recommendation systems need core metrics: CTR for appeal, CVR for value, diversity and novelty vs drift, coverage for long-tail; offline iterates, online A/B.
Sep 28, 2026
Recommendation systems need core metrics: CTR for appeal, CVR for value, diversity and novelty vs drift, coverage for long-tail; offline iterates, online A/B.
Filter bubbles come from a three-way loop, not algorithms alone. Five fixes: hybrid recall, diversity re-ranking, exploration, user control, and monitoring.
Collaborative filtering: UserCF for content platforms, ItemCF for stable e-commerce. A 5-dimension comparison, co-occurrence and content-vector blending.
Recommendation ROI comes from scenarios, not one big model. We rank eight high-ROI e-commerce scenarios by rollout difficulty, with data and metrics for each.
Recommendation placement design: pick the page, content, and attention share. Match each slot to page intent and measure cannibalization to confirm real gains.
Cold start is not one problem but four: new users, new items, a new system, and a new scenario. This guide lists the fix for each, plus acceptance metrics.
Choosing an ecommerce recommendation system starts with the goal, not the tech: compare in-house, licensed and SaaS routes on cost, data scale and team fit.
Do not merge search and recommendation. Share the data and recall base, split ranking and strategy, then roll out in four phases with clear engineering metrics.
Search serves active intent; recommendation pushes. Unify them and you beat 1+1 with three mechanisms, four rollout steps, and one metric that proves it.
How personalized recommendation algorithms evolved: collaborative filtering, matrix factorization and deep learning, explained with metrics and rollout tiers.
Learn how recommendation systems use retrieval, ranking, and re-ranking to narrow millions of candidates into relevant results under tight latency limits.
Unifying e-commerce search and recommendations: one data layer, shared algorithms, an 8-week rollout plan, and case results of +61% search conversion lift.
See how the Tengence recommendation system lifts e-commerce CTR, CVR and GMV with real-time personalization, hybrid algorithms and a recall-to-rerank pipeline.
WeCom