// glossary entry
Crawling budget refers to the number of URLs that Googlebot crawls on a site within a given period. For small sites, the budget is usually not an issue, it becomes relevant when there are several thousand URLs, such as with large online stores or highly faceted catalogs. Google reduces the budget if there are many error pages, slow response times, or duplicate content. At Waterproof Web Wizard, we manage crawling for large sites through sitemap prioritization, parameter handling, and robots.txt, ensuring that important pages receive the crawling they need for up-to-date indexing.
// synonyms
// further reading
Pillar Pages sind das SEO-Prinzip, mit dem man ein komplettes Thema dominieren kann, ein umfassender Hub-Artikel verlinkt mit thematisch passenden Cluster-Artikeln. Wir zeigen dir, wie Pillar Pages aufgebaut sind, welche Themen sich dafür eignen und wie du aus vorhandenem Content ein Pillar-Cluster machst.
Read moreIf a term in this glossary isn't entirely clear in the context of your project, or if you want to know whether the concept is relevant to your situation—just ask us. The initial consultation is free and non-binding.
