Website crawler launched: insight in what visitors see
by Damian Wantzing
The website crawler is a new feature in the Copernica Marketing Suite that allows you to automatically import the content of your website into Copernica, making it available in your marketing environment. The website crawler periodically visits all pages of your website and automatically collects data such as titles, meta information, availability messages, and structured data. You can then use this page content directly in mailings, follow-up actions, and campaigns.
The website crawler collects content directly from your website and operates completely autonomously. This way, product and content information stays automatically up to date in Copernica without you needing to synchronize it manually.
When used together with the Website Tracker, it provides even more insight. The website tracker shows which pages someone visits, while the website crawler records exactly what content is on those pages. Together, they provide a complete picture of both the behavior and interests of your visitors.
What does the website crawler do?
- Automatically crawls your website (via a sitemap if you have one, or by discovering pages on its own).
- Collects page titles, meta tags, structured data (such as ld+json), and dynamic content like dataLayers.
- Makes the collected data immediately available in your templates and follow-up actions via Smarty variables.
We’re here to help
Do you have questions or suggestions about these new updates, or do you often run into specific issues yourself? Feel free to contact our supportteam.