Levelling Up Contextual Advertising: Smartology's Leap to Large Language Models

Technology
10/10/2024
By Dr. Claudiu Mihăilă, PhD

Levelling Up Contextual Advertising: Smartology's Leap to Large Language Models

At Smartology, we're committed to delivering highly relevant, brand-safe contextual advertising without compromising user privacy. For years, our sophisticated matching engine relied on manually crafted ontologies and then powerful topic modelling techniques. These served us well, enabling us to analyse publisher content and advertiser campaigns to find relevant matches. However, as the digital landscape evolved, we recognised the need for a more nuanced and adaptable approach. That's why we've transitioned to a cutting-edge system powered by Large Language Models (LLMs).

Our initial ontology was a structured representation of knowledge, meticulously categorising publisher content and advertiser campaigns into pre-defined categories and subcategories. This hierarchical structure allowed for straightforward matching. However, this approach proved inflexible. The ontology struggled to adapt to the rapidly evolving landscape of online content and the emergence of new topics and sub-topics. Furthermore, assigning content to pre-defined categories often felt artificial and lacked the granularity necessary for truly relevant ad placement. The result was occasionally mismatched ads and a limited ability to ensure optimal topic diversity within ad placements for a given publisher. Finally, maintaining and updating the ontology became a resource-intensive process.

To overcome these limitations, we transitioned to a topic modelling-based approach. This system worked by identifying key topics within publisher content and advertiser creatives. Instead of relying on pre-defined categories, topic models allowed us to automatically identify the underlying topics present in each piece of content. This resulted in a more nuanced and granular understanding of the content, leading to a significant improvement in ad relevance. While effective, it also had limitations. Its reliance on keyword frequency and statistical co-occurrence meant it sometimes struggled with nuanced semantic understanding. This occasionally resulted in less-than-perfect ad matches, potentially impacting advertiser ROI. The topic diversity offered by these methods also lacked the richness and granularity we desired. For example, an article about "sustainable living" might be categorised broadly, missing the subtle distinctions between eco-friendly fashion, green energy solutions, or ethical food production. This could lead to less relevant ad placements for advertisers targeting specific niches within the broader topic.

Enter LLMs. Our new system leverages the power of LLMs to achieve a significantly improved level of semantic understanding. Unlike topic modelling, which relies on statistical patterns, LLMs analyse the meaning and context of text, capturing the subtle nuances that often elude simpler methods. This enables us to create far more precise profiles for both publisher content and advertiser campaigns. For example, an LLM can differentiate between an article discussing "climate change" in the context of scientific research and one discussing it in the context of political debate, allowing for much more targeted ad placement.

The benefits are immediately apparent. Firstly, match quality has dramatically improved. LLMs allow for a far more precise understanding of the content, resulting in more relevant ad placements and a higher click-through rate for our clients. This translates directly to better ROI on their advertising spend.

Secondly, we've seen a substantial improvement in topic diversity. The richness of LLM understanding allows us to identify a much wider range of topics and subtopics within the content. This ensures that advertisers can reach their target audience with greater precision, even within highly specific niches. For instance, an advertiser specialising in organic cotton clothing can now confidently target articles discussing sustainable fashion, ethical sourcing, or fair trade practices – all with greater accuracy than previously possible.

Finally, and perhaps most importantly, our improved system enhances brand safety. By leveraging the advanced semantic understanding of LLMs, we can more effectively identify and avoid potentially risky content. This reduces the risk of negative brand associations for our clients, protecting their reputations and ensuring a positive advertising experience for users. The LLMs are trained on vast datasets that include information about potentially harmful or inappropriate content, allowing our system to flag and prevent problematic ad placements with increased accuracy.

The transition to LLMs represents a significant leap forward in our commitment to delivering superior contextual advertising. It's a testament to Smartology's dedication to innovation and our unwavering focus on providing our clients with the most effective and responsible advertising solutions available. We're continuously refining our LLM-powered system, leveraging the latest advancements in AI to further enhance match quality, topic diversity, and brand safety, ensuring Smartology remains at the forefront of the contextual advertising revolution.