Google imposes severe penalties on certain SEO techniques, especially those that disrupt the market. To be considered White Hat, all disruptive SEO methods must comply with Google’s policies and guidelines. Despite their effectiveness, some techniques are deemed unacceptable by Google. One such technique is cloaking. Cloaking involves presenting different content to users and bots (Google search crawlers). This method manipulates page rankings by showing keyword-rich content to Google bots while delivering user-centric content to visitors. It is a form of spamdexing, combining spamming and indexing.
Cloaking: An SEO Technique to Avoid
Google imposes severe penalties on certain SEO techniques, especially those that disrupt the market. To be considered White Hat, all disruptive SEO methods must comply with Google’s policies and guidelines. Despite their effectiveness, some techniques are deemed unacceptable by Google. One such technique is cloaking.
Cloaking involves presenting different content to users and bots (Google search crawlers). This method manipulates page rankings by showing keyword-rich content to Google bots while delivering user-centric content to visitors. It is a form of spamdexing, combining spamming and indexing.
Types of Cloaking
User-Agent Cloaking
A user agent is a software program that helps users retrieve website information on their operating system. When a query is entered, the browser sends a cloaking script or code to the server. This code differentiates between user agents searching for the webpage. If the user is a Google bot, a specific page rich in keywords is served to enhance the page’s rank. If it is a regular visitor, a different page is served. In this type, crawlers are identified by examining the user agent header field of the HTTP request.
IP Cloaking
Different pages are served to users based on their IP address. If the IP addresses are associated with Google search crawlers, a keyword-rich page is served to improve ranks. If the user’s IP address is different, another page is served.
Verifying Googlebot Requests
Google Search Central recommends verifying whether a crawler claiming to be Googlebot is genuine by using reverse and forward DNS lookups rather than relying on a hard-coded public IP allowlist.
- Run a reverse DNS lookup on the accessing IP address from your logs using the host command.
- Verify that the domain name is either googlebot.com or google.com.
- Run a forward DNS lookup on the domain name retrieved in step 1 and verify that it resolves to the same original IP address.
Advantages of IP Cloaking
The original article notes that IP-based content variation can be used to show competitors different information when they research a website. Using content variation to deceive search engines, however, is the behavior search-engine policies prohibit.
Other Types of Cloaking
JavaScript Cloaking
JavaScript-enabled browsers of users are served one page, and those without JavaScript enabled are served different pages.
Hidden Texts or Links
Another cloaking method is not serving different pages to users and bots but hiding the text. Text, images, or videos are made invisible to users while remaining on the page and readable by Google bots.
Google’s Stance on Hidden Text and Links
Google Search Central states that hiding text or links to manipulate ranking systems violates its guidelines.
- Using white text on a white background
- Placing text behind an image
- Using CSS to position text off-screen
- Setting the font size to 0
- Hiding a link by linking only one small character, such as a hyphen in a paragraph
In the past, some website owners benefited by hiding text when search engines used simpler text-matching algorithms to rank pages. Modern search systems evaluate hidden content and manipulative presentation far more aggressively.
Accessibility and Non-Deceptive Hidden Text
Not all hidden text is deceptive. Descriptive fallbacks and accessibility content can be legitimate when they provide users equivalent information rather than attempting to manipulate search engines.
Tips to Make Your Site Accessible
- Images: Use the alt attribute to provide descriptive text explaining the image.
- JavaScript: Provide equivalent fallback content where appropriate and ensure it matches the visible experience.
- Videos: Include descriptive text about the video and consider providing transcripts.
Detecting Cloaking
One approach to detecting cloaking is to compare content fetched with a crawler request against content fetched with a normal browser request. Large unexplained differences can indicate cloaking, although dynamic or frequently updated pages can create false positives.
Detection Using HITS and HOTs
The article describes another comparison method that collects multiple copies of a URL and compares the terms returned to crawler and browser requests. Large differences beyond a chosen threshold may be flagged, but no simple method can guarantee how a search engine will classify every implementation.
Dynamic Serving vs. Cloaking
Dynamic serving is not automatically cloaking. The key distinction is whether content variations serve legitimate user or device needs versus intentionally deceiving search engines by presenting materially different ranking-focused content.