type
status
date
slug
summary
tags
category
icon
password
Created time
Oct 8, 2023 06:01 PM
In the fast-paced domain of internet technology, three pillars stand tall as the heart of most online companies - Search, Recommendation, and Advertising, colloquially referred to as the “Search-Ad-Recommend” trio. The leading tech giants have honed their systems in these realms into colossal structures, each integrating a myriad of models, algorithms, and strategies. Understanding the distinctions among them at a single glance can be daunting. However, every complex question has a kernel of simplicity. Delving into the intricacies without grasping the fundamental objective of each would be unwise. It's imperative to step back and understand the core problems these three aim to solve, to gradually unravel the intricacies encompassed within each.

Core Distinctions:

  • Advertising: When a company builds an advertising system, the commercial goal is straightforward – address the revenue generation. Hence, the algorithms in advertising aim directly at boosting the company’s revenue.
  • Recommendation: While the end goal of recommendation algorithms is also revenue augmentation, the immediate objective is enhancing user engagement. Increased engagement paves the way for more advertising inventory, subsequently driving up the revenue.
  • Search: The crux of search algorithms revolves around the user-inputted search terms. Despite the rising emphasis on personalized results, the essence of personalization in recommendation algorithms serves only as a supplement to search algorithms. Efficiently fetching information around the search terms remains the fundamental objective of search algorithms.
The core problems being tackled bring forth the first algorithmic distinction among the trio - different optimization goals.

Optimization Objectives Divergence:

  • Advertising: Unified across companies, the estimation goals for advertising algorithms are the Click-Through Rate (CTR) and Conversion Rate (CVR), closely tied to the current product form of performance-based advertising.
  • Recommendation: The estimation objectives here diverge, with video platforms leaning towards predicting watch duration, news platforms predicting CTR, and e-commerce platforms estimating average order value, all of which relate closely to user engagement.
  • Search: The estimation objectives in search vary again since, unlike advertising and recommendation, search inherently has a “correct answer” to a certain extent, emphasizing on recalling these correct answers.
Broadly speaking, advertising algorithms aim for “more precise estimation,” recommendation algorithms strive for “better overall ranking,” and search algorithms seek to “search more comprehensively.”

Differences in Algorithm Model Design:

The different optimization objectives naturally lead to diverging focuses in their algorithm model designs:
  • Advertising: Precision in predicting CTR and CVR for accurate bidding is crucial, leading to rigorous calibration requirements in advertising algorithms.
  • Recommendation: The results are often presented as a list, demanding a broader view, often encompassing list-level or page-level algorithms to optimize the overall effect.
  • Search: The emphasis is on understanding search terms and the content, necessitating the heavy application of NLP models for better semantic understanding of user queries.

Explorations and Exploitations in Recommendation Systems:

Supplementary strategies and algorithm differences come into play, encompassing pacing, bidding, budget control, and ads allocation in advertising systems, exploratory attempts at long-tail content in recommendation systems, and a heavy focus on semantic understanding in search systems.

The Pain Points at System Level:

  • Advertising Algorithms: Achieving global profit maximization through the synergistic operation of various modules is a monumental challenge, with the complexity often reaching unmanageable levels.
  • Recommendation Algorithms: The eternal struggle lies in balancing short-term and long-term benefits, a puzzle every recommendation algorithm engineer dreams of solving.
  • Search Algorithms: The focus is placed heavily on understanding the content of search terms and items, with the comprehension of multimodal content like images and videos often being the bottleneck in improving search effectiveness.
In conclusion, navigating the nuances of Search, Recommendation, and Advertising algorithms is akin to unraveling the threads of a complex tapestry. Each has its unique set of challenges, objectives, and solutions, reflecting the multifaceted nature of the digital world we are intertwined with. Through a deeper understanding and continuous refinement of these core algorithms, we inch closer to creating a more responsive, user-centric, and profitable online ecosystem.

Let me know your thoughts below 👇
 
Excellent life advices from Kevin Kelly with my own editorials (7min read)Why writing blogs? or why should you write? (3min read)
  • Twikoo
  • WebMention