A Standard for Robot Exclusion

Friday, December 3, 2010

Status of this document

This document represents a consensus on 30 June 1994 on the robots mailing list (robots-request@nexor.co.uk), between the majority of robot authors and other people with an interest in robots. It has also been open for discussion on the Technical World Wide Web mailing list (www-talk@info.cern.ch). This document is based on a previous working draft under the same title.
It is not an official standard backed by a standards body, or owned by any commercial organisation. It is not enforced by anybody, and there no guarantee that all current and future robots will use it. Consider it a common facility the majority of robot authors offer the WWW community to protect WWW server against unwanted accesses by their robots.
The latest version of this document can be found on http://www.robotstxt.org/wc/robots.html.

Introduction

WWW Robots (also called wanderers or spiders) are programs that traverse many pages in the World Wide Web by recursively retrieving linked pages. For more information see the robots page.
In 1993 and 1994 there have been occasions where robots have visited WWW servers where they weren't welcome for various reasons. Sometimes these reasons were robot specific, e.g. certain robots swamped servers with rapid-fire requests, or retrieved the same files repeatedly. In other situations robots traversed parts of WWW servers that weren't suitable, e.g. very deep virtual trees, duplicated information, temporary information, or cgi-scripts with side-effects (such as voting).
These incidents indicated the need for established mechanisms for WWW servers to indicate to robots which parts of their server should not be accessed. This standard addresses this need with an operational solution.

The Method

The method used to exclude robots from a server is to create a file on the server which specifies an access policy for robots. This file must be accessible via HTTP on the local URL "/robots.txt". The contents of this file are specified below.
This approach was chosen because it can be easily implemented on any existing WWW server, and a robot can find the access policy with only a single document retrieval.
A possible drawback of this single-file approach is that only a server administrator can maintain such a list, not the individual document maintainers on the server. This can be resolved by a local process to construct the single file from a number of others, but if, or how, this is done is outside of the scope of this document.
The choice of the URL was motivated by several criteria:
  • The filename should fit in file naming restrictions of all common operating systems.
  • The filename extension should not require extra server configuration.
  • The filename should indicate the purpose of the file and be easy to remember.
  • The likelihood of a clash with existing files should be minimal.

The Format

The format and semantics of the "/robots.txt" file are as follows:
The file consists of one or more records separated by one or more blank lines (terminated by CR,CR/NL, or NL). Each record contains lines of the form ":". The field name is case insensitive.
Comments can be included in file using UNIX bourne shell conventions: the '#' character is used to indicate that preceding space (if any) and the remainder of the line up to the line termination is discarded. Lines containing only a comment are discarded completely, and therefore do not indicate a record boundary.
The record starts with one or more User-agent lines, followed by one or more Disallow lines, as detailed below. Unrecognised headers are ignored.
User-agent
The value of this field is the name of the robot the record is describing access policy for.
If more than one User-agent field is present the record describes an identical access policy for more than one robot. At least one field needs to be present per record.
The robot should be liberal in interpreting this field. A case insensitive substring match of the name without version information is recommended.
If the value is '*', the record describes the default access policy for any robot that has not matched any of the other records. It is not allowed to have multiple such records in the "/robots.txt" file.
Disallow
The value of this field specifies a partial URL that is not to be visited. This can be a full path, or a partial path; any URL that starts with this value will not be retrieved. For example, Disallow: /help disallows both /help.html and /help/index.html, whereas Disallow: /help/ would disallow /help/index.html but allow /help.html.
Any empty value, indicates that all URLs can be retrieved. At least one Disallow field needs to be present in a record.
The presence of an empty "/robots.txt" file has no explicit associated semantics, it will be treated as if it was not present, i.e. all robots will consider themselves welcome.

Examples

The following example "/robots.txt" file specifies that no robots should visit any URL starting with "/cyberworld/map/" or "/tmp/", or /foo.html:
# robots.txt for http://www.example.com/
User-agent: *
rworld/map/ # This is an infinite virtual URL space Disallow: /tmp
Disallow: /cyb e/ # these will soon disappear
Disallow: /foo.html
This example "/robots.txt" file specifies that no robots should visit any URL starting with "/cyberworld/map/", except the robot called "cybermapper":
# robots.txt for http://www.example.com/
User-agent: *
rworld/map/ # This is an infinite virtual URL space # Cybermapper
Disallow: /cyb e knows where to go. User-agent: cybermapper
Disallow:
This example indicates that no robots should visit this site further:
# go away
User-agent: *
Disallow: /

Example Code

Although it is not part of this specification, some example code in Perl is available in norobots.pl. It is a bit more flexible in its parsing than this document specificies, and is provided as-is, without warranty.

Note: This code is no longer available. Instead I recommend using the robots exclusion code in the Perl libwww-perl5 library, available from CPAN in the LWP directory. 

20 Essential Blog Directories to Submit Your Blog to

Gaining exposure for your blog is critical to building a following, readership, and revenue. Besides the basic SEO steps of adding compelling and keyword friendly titles, URL structure and descriptions (along with the basic WordPress SEO plugins) basic link building for blogs begins with listing them in blog directories.
Personally, I love launching a new blog, or adding one to an existing site, and watching the high valued links roll in. And as we know, BLOG = Better Listings On Google.
There are many paths to consider when building links to your site or blog such as link baiting or blogroll link swapping, but few are as easy to implement and cost effective as submitting to blog directories – and good link juice is essential to a healthy growing blog.
link juice
Let us take a look at 20 popular directories worthy of your consideration.
1. Best of the Web Blog Search La Crem de la Crem, Best of the Web’s Blog Directory is very selective and only lists aged and valuable blogs. A link from here is majestic and well deserved.
2. Bloggeries has the best categories and subcategories home page on the internet. The layout is clear and concise, and readers are able to find what they are looking for in a snap!
I am really liking what Rob is doing with Bloggeries and this is bound to be one of the premier Blog Directories on the web.
3. EatonWeb Blog Directory is a real jewel with many aged inbound links and a blog rating system. You may have to pay a fee for your blog to be reviewed, but like Yahoo, the review fee is well worth the few dollars.
4. OnToplist.com is a free human-edited blog directory where you submit the RSS feed of your blog. You can also set up your own micro-directory (blog ranking) and compile a list of your favorite blogs in one place. OnToplist is also a social network that allows you and other bloggers to get in touch and promote your blog by attracting more readers.
5. Blogged.com is an interesting mix of a blog directory and a Google News type site which fuels its news feed from the blogs listed on the site. Blogged.com is very impressive and is free to list your blog.
6. One of the most selective Blog Directories on the web (and WordPress powered), Blog Search Engine is owned by Performancing’s parent company and serves search results powered by IceRocket.
7. Blog Catalog features a vast directory of categories, from academic to writing, while offering the ability to search by country, language, or user. It has a no frills design, but offers convenient member access through simple blog registration.
8. Globe of Blogs has too many features to list. In order to be listed on the site, the blog must not be commercial. The site may appear to be busy, but I like the features of being able to search by title, author, or subject. Narrowing the search becomes easier on this blog.
9. The ultimate directory of British blogs connotes all things British. It is not directed by location, but by the culture! It is asked that bloggers be genuinely “britished.” Being listed in this blog reaches readers all the way across the pond!
10. Blog Universe is the perfect place to promote your video or podcast themed blog. Its layout is easy to navigate. Although the content is limited, it is an all around good directory site worthy of submission.
11. Bigger Blogs is a relatively new blog directory with only a few blogs registered. The blog is intertwined with a business directory. The blog section is difficult to find, and it is located through a link on the right side of the business directory page. However, the benefit is that the earlier you are accepted on a blog directory, the more exposure your blog will obtain. In addition, a back link is indeed a back link, so this can help with your search engine placement.
12. Upon visiting Bloggernity, you find a crisp, clean, and easy to navigate site. Scrolling down, you find the new blogs. As there is little advertising on the home page, it is pleasant to the eye of the reader as well.
13. Bloggapedia has an interesting and eye catching homepage. Readers are easily connected to the top blogs and newest posts. Innovative categories and a colorful design make this blog directory a hit.
14. Spillbean is a well-designed blog directory site with categories such as health, society, internet, and personal. The site is aesthetically pleasing, but there are not many listings yet.
15. Blogging Fusion is a blog with over sixty categories. These categories include photo blogs and family focused blogs. Blogging Fusion has an good amount of blog listings within the directory, and it also has visitor stats available.
16. Blogflux is not only a tool for bloggers, but a directory that has the listings in alphabetic order. The blog listings are organized and clear. It is definitely an effective blog directory in which to be listed.
17. The blogs on the top listings of Bloglisting are fun, colourful, and catch the attention of the reader. Bloglisting displays the page ranking blogs, which is a helpful tool when determining with whom you want to exchange links.
18. Blogio may be a small blog directory with few listings, but it worthy of a submission. Despite its small size, there are quality blogs and a solid ability to search on this site.
19. Blog Explosion claims to be the largest blog promoter on the internet. They have a vast directory but do not seem to have direct links. However, the listing in the directory can still show up in SERP’s, so keep this in mind.
20. Super Blog Directory is a great site that offers tools to posters that others do not. You can see the latest submitted links and blogs on the site, which is a perk that draws traffic into the directory.
The above listings are a glimpse inside the large and vast world of blog directories and the valuable inbound links that your can build for your blog and your business.
There are countless more directories at your disposal, which are always just a Google, Yahoo, Live or Ask.com search away.
What blog directories do you suggest? Leave a comment below :)

Social Media’s Direct Influence on Search Engine Ranking

Social media marketing is becoming more of an accepted part of the online marketing mix because of its ability to drive website traffic and inbound links to sites. Techniques like link baiting, Digg-baiting, and submitting sites to bookmarking or social voting services like Del.icio.us, Digg, StumbleUpon and Reddit have been known to achieve both short and long term value to the sites targeted by such campaigns.
Sometimes however, the short term effects can outweigh the long term effects, and if a social media campaign does not end up with a lot of external links which help with search engine rankings, the end result can be criticism. Complaints about social media marketing such as “none of the links point to the homepage”, “the traffic is worthless”, or “it’s just the flavor of the month” are tremendously overshadowed and cast aside by some new developments in the major search engines.
Social media marketing has a direct effect on search engine rankings and engines are using social voting systems and bookmarking trends to determine quality sites.
In an effort to open the eyes of the search and online marketing community to the importance of social media in the online marketing mix, I am going to discuss :
  • Current trends with Google and Yahoo giving higher ranking to sites or content based upon social media voting.
  • Ways search engines can use Bookmarking and Social News service to better their results.Patents the two search engines have filed which support the expansion of these trends.
  • Steps you can take for basic social media marketing which will help with your current & future search rankings.

Social Media Reviews & Stats Driving Top Search Results


Google Ranking Videos in First Page Results
Social media voting and user views are currently taking a direct effect on Google’s page one search engine results. Google Universal Search melds the Google Web, Image, Video, News, Blog and other vertical search results into one page of relevant information.
At Search Engine Strategies San Jose, Sherwood Stranieri of Catalyst Online looked at the Google results for Criss Angel, the popular illusionist. When currently performing a search on Google for Criss Angel, 4 of the top 10 search results are video results which are housed at YouTube and MetaCafe.
If you compare the traditional SEO stats for the videos, you’ll see that the pages with the highest PageRank or incoming links are not ranked first:
  1. YouTube Criss Angel Video : PageRank 3, 120 inbound links
  2. YouTube Criss Angel Video 2 : PageRank 3, 246 inbound links
  3. Metacafe Criss Angel Video : PageRank 5, 340 inbound links
  4. Metacafe Criss Angel Video 2 : PageRank 4, 214 inbound links
However, if you look at the social video variables of views and comments, those rankings make much more sense:
  1. YouTube Criss Angel Video : 5.4million views, 10k comments
  2. YouTube Criss Angel Video 2 : 2.3 million views, 4k comments
  3. Metacafe Criss Angel Video : 17 million views, 416 comments
  4. Metacafe Criss Angel Video 2 : 3 million views, 478 comments
Comments are playing a very important factor in the ranking of these videos, as are views. User generated comments, essentially reviews of the media, have a direct impact on Google first page rankings. If your business uses successful viral web video for its marketing, then comments will naturally come. In addition, this can also work against a brand’s image; just do a search on Google for ‘mentos’.
Note : Even if your business does not use video uploads to YouTube or other media outlets to market your brand or services, keep in mind that the use of comments as a ranking algorithm may not always be limited to video. More and more sites are implementing user comments as a form of feedback, communication and community building. Google could easily determine that quality comments on news sites or blogs can make a difference in search engine results; which is even more reason to get your readers to contribute.
Yahoo Ranking Restaurants & Hotels By Reviews
For a more concrete example of how social media comments, reviews and rankings are currently influencing search engine results, let’s take a look at local business searches on Yahoo Search and its use of Restaurant & Hotel Shortcuts.
Yahoo Local prides itself on search relevancy based upon social media participation, and the Restaurants Shortcut on Yahoo Search is reflective of this.
As an example, when a search is performed on Yahoo for ‘Tampa Restaurants‘ a Shortcut is served with links to restaurant categories, neighborhoods and restaurants ranked by the number of user ratings & reviews.
Yahoo Tampa Restaurants
As you can see, Bern’s Steak House is ranked #1 on this Yahoo Search because it has the most user ratings. Essentially, if their competition wanted to overtake the top position, they could easily do so via social media marketing : incentivizing or motivating their customer base to rate and write reviews about their restaurant and services in their Yahoo Local profile. For example, Charley’s Steak House needs only 22 ratings to top Bern’s in the Tampa results. If I were their marketing manager, I would take full initiative to do so and rank #1 on not only Yahoo, but also Google which aggregates business reviews from different local social sites including CitySearch, AOL and TripAdvisor.
Google Tampa Restaurants

Social Bookmarks and Voting’s Influence on Search Rankings


What Social Media Can Bring to Search
The examples of Yahoo user reviewed restaurant searches or the ranking of videos in Google search are current uses of social media’s measurrestaurantsable variables of reviews, ratings, comments and/or video plays being a critical part of these searches, but social media goes far beyond restaurants and videos.
Monitoring social bookmarking services like Del.icio.us, StumbleUpon and Ma.gnolia can help search engines in multiple ways by:
  • Indexing Sites Faster : Humans bookmark sites launched by their friends or colleagues before a search engine bot can find them.
  • Deeper Indexing : Many pages bookmarked are deep into sites and sometimes not as easily linked to by others, found via bad or nonexistent site navigation or linked to from external pages.
  • Defining Quality : If someone takes the time to bookmark a site, it usually has some quality to it.
  • Measuring Quality : Essentially if more users bookmark a page, the more quality and relevance that site has. A site with multiple bookmarks across multiple bookmarking services by multiple users is much more of an authority than a site with only several bookmarks by the same user.
  • External Meta Data : Users who bookmark sites tag them with keywords and descriptions which add an honest and unbiased definition which is created by the public and not the owner of the site.
  • Co Citation : Social bookmarking sites tend to categorize sites and pages based upon the tags used by humans to describe the site; therefore search algortihms can classify these sites with their peers.
In addition, by indexing the social measurement variables such as commenting and votes at Digg, Reddit, Netscape and various niche oriented (all of those Pligg powered hubs), search engine algorithms can also benefit from social news sharing sites by:
  • Number of Votes : Similar to the number of bookmarks, the more votes a page receives on Digg or Reddit, the more useful that information usually is. If the same page receives multiple votes across multiple social news voting sites, the higher quality the site.
  • Categorization : Like Co Citation, categorization can help define the subject of a site, therefore better helping the engine address searcher intent.
  • Commenting : The number of comments can be compared to the number of votes, the higher the comment to voting ratio, the more relevant the news story or site was to the user; therefore, more relevant to the searcher.
  • Relevant Sites : Techmeme and Netscape (and hopefully soon Digg) suggest relevant pages and sites to the stories which make their ‘popular’ categorical pages via intra-linking or blog index monitoring. Engines can learn from these projects to help users find alternative or relevant selections in their search results.
To the best of my knowledge, no search engines are currently implementing all of these theories into their current algorithms, but we cannot overlook that Google has been a partner of Digg for years, Microsoft will soon be, Yahoo owns Del.icio.us and AOL runs Netscape. These social services also offer API’s and are completely open to search spidering, which makes these variables mentioned above available to search engines for the taking.

Patents : Search Engines Using Social Media


In order to gather a more definitive scenario of how the major search engines will take advantage of social media metrics to serve more relevant results to the end user, I spoke with Bill Slawski of SEObytheSEA about patent applications filed by Google and Yahoo and Bill supplied the following :
Yahoo Social Media & Search Patents
1. Search using graph colorization and personalized bookmark processing
In a search processing system, identifying input authority weights for a plurality of pages, wherein an input authority weight represents a user’s weight of a page in terms of interest; distributing a page’s input authority weight over one or more pages that are linked in a graph to the page; and using a resulting authority weight for a page in effecting a search result list. The search result list might comprise one or more of reordering search hits and highlighting search hits.
This can be applied to a single user, or to a social network of users. See the section starting with: [0122] Application to Personalization
2. Systems and methods for collaborative tag suggestions
Discusses services like Flickr, del.icio.us, and Yahoo’s My Web 2.0, and a “goodness” measure to find the best tags to annotate different pages and objects (such as images and videos).
The suggested collaborative tags can be selected by a user to annotate content items found in a corpus of documents (e.g., the World Wide Web). As used herein, the term “annotation” refers generally to any descriptive and/or evaluative metadata related to a Web object (e.g., a Web page or site) that is collected from a user and thereafter stored in association with that user or object. Annotations may include various fields of metadata, such as a rating (which may be favorable or unfavorable) of the document, a list of keywords identifying a topic (or topics) of the document, a free-text description of the document, and/or other fields. An annotation may advantageously be collected from a user of the corpus and stored in association with an identifier of the user who created the annotation and an identifier of the document (or other content item) to which it relates.
3. Search engine with augmented relevance ranking by community participation
Shows aspects of a personalized Yahoo Search based upon user tagging and annotation of web pages, and trusted social networks. Trust ratings may be given to users of the social network, and may be used in a dual Trustrank system that provides a Trustrank value for pages and domains based upon the reputation of people bookmarking, visiting, saving, tagging, and annotating those pages.
4. * Search systems and methods with integration of user annotations

These appear to be related to Yahoo’s “My Web” pages, which allow people to bookmark and annotate pages. The abstract of the third patent application listed:
Computer systems and methods incorporate user annotations (metadata) regarding various pages or sites, including annotations by a querying user and by members of a trust network defined for the querying user into search and browsing of a corpus such as the World Wide Web. A trust network is defined for each user, and annotations by any member of a first user’s trust network are made visible to the first user during search and/or browsing of the corpus. Users can also limit searches to content annotated by members of their trust networks or by members of a community selected by the user.
Personalized information may be treated in a manner similar to other information comprising a content item for indexing, searching and ranking purposes. For example, personalized information such as annotations and tags may be treated similar to anchortext from a web page. Personalized information, like anchortext, includes descriptive text, but is created by individuals other than the author of a content item. Furthermore, personalized information provides descriptions, opinions and alternate forms of references (including spelling and word form variations) that might not be found in the original content item.
6. Interestingness ranking of media objects
An “interestingness” score might be created for images on Flickr, based upon user actions related to that image,quantity of user entered and edited metadata, access patterns for the pictures, time, system settings, and the relationship of the user to the poster of the image.
[0038] The quantity of user-entered metadata may include, for example, parameters such as the number of tags, comments and/or annotations assigned to the media object, and/or the number of users who have added the media object to their favorites/bookmarks. (Adding an audio media object to a user’s favorites may include adding the media object to a user’s playlist.) Alternatively or in addition to those parameters, the quantity of user-entered metadata may be user-related and include, for example, the number of users who have added tags, comments and/or annotations to the media object, and/or added the media object to their favorites/bookmarks.
Google Social Media & Search Patents
7. Methods and systems for personalized network searching
Describes how a person’s bookmarks and annotations for those bookmarks (and perhaps ratings based upon those bookmarks) may be used to rerank pages for personalized search. Bookmarks can also be shared:
In one embodiment, a user may share or overlay bookmarks. For example in one embodiment, a user is able to open up their bookmarks for others to view. In another embodiment, a user is able to aggregate other users’ bookmarks into their own set of bookmarks (either via copying or via an overlaid reference semantics). Such a feature may prove useful for community building (e.g., “Add this group’s bookmarks to your favorites” when joining a new mailing list). In one such embodiment, the bookmark indicators in results pages distinguish between those pages explicitly bookmarked by the user from those gathered by others. Given a canonical URL through which to reference another individual/organization’s bookmarks, the service provider can derive a sense of the popularity of a person’s links and weight those bookmarks correspondingly (a la PageRank applied to the subgraph of bookmark interlinks).
[0069] One embodiment of the present invention fosters community and relationship building. In one embodiment, the search engine is able to recognize clusters or pairs of users having similar interests. Such an embodiment is able to suggest other users with which to network.
8. Information retrieval based on historical data
[0114] According to an implementation consistent with the principles of the invention, user maintained or generated data may be used to generate (or alter) a score associated with a document. For example, search engine 125 may monitor data maintained or generated by a user, such as “bookmarks,” “favorites,” or other types of data that may provide some indication of documents favored by, or of interest to, the user. Search engine 125 may obtain this data either directly (e.g., via a browser assistant) or indirectly (e.g., via a browser). Search engine 125 may then analyze over time a number of bookmarks/favorites to which a document is associated to determine the importance of the document.
[0115] Search engine 125 may also analyze upward and downward trends to add or remove the document (or more specifically, a path to the document) from the bookmarks/favorites lists, the rate at which the document is added to or removed from the bookmarks/favorites lists, and/or whether the document is added to, deleted from, or accessed through the bookmarks/favorites lists. If a number of users are adding a particular document to their bookmarks/favorites lists or often accessing the document through such lists over time, this may be considered an indication that the document is relatively important. On the other hand, if a number of users are decreasingly accessing a document indicated in their bookmarks/favorites list or are increasingly deleting/replacing the path to such document from their lists, this may be taken as an indication that the document is outdated, unpopular, etc. Search engine 125 may then score the documents accordingly.
9. Methods and systems for improving a search ranking using article information
Systems and methods that improve client-side searching are described. In one aspect, a system and method for receiving a search query, determining a relevant article associated with the search query, and determining a ranking score for the relevant article based at least in part on client-side behavior data associated with the relevant article is described.
Many different aspects of user behavior are viewed in this document to determine a ranking score for articles, such as how often the article is accessed, or printed, or how far someone scrolls down a page. Bookmarking activity is described in this section:
[0044] Block 211 is followed by block 212, in which book-marking data associated with an article is determined. Book-marking information may comprise, for example, information about book marking of an internet URL, book marking within a text article to other portions of the same article or of a separate article, how many bookmarks are connected with a particular article, the textual content of the book mark associated with the article, or any other information relating to book marks associated with the article or article.
Annotations from users may be helpful in coming up with an “interestingness” ranking that determines whether placemarks are shown for certain locations on Google Maps or Google Earth.
Decentralized Web Annotation : Describes a way of allowing people to annotate Webpages from within their blogposts. Might be something we may see someday at Blogger.

Implementing Social Media Marketing into a Search Marketing or Link Building Campaign


The above information proves that social media attributes have a direct effect on search engine ranking. Here are some basic social media marketing techniques and resources on social media marketing from Search Engine Journal and other informative blogs.
Link Building : As we have discussed above, social media marketing plays an essential role in current and future search engine rankings, from bookmarks to link building. Oh yes, why link building? Because the site profile pages on these social sites usually pass link juice (especially Netscape) and also get highly indexed in search engines themselves; especially for longtail terms.
For more information on Link Building via blogs, social news sites and bookmarking see:
Local Reviews : If your business has a storefront like a restaurant, hotel or specialty boutique would, motivate customers to rate your services on Yahoo Local, CitySearch, TripAdvisor and other business rating services. As shown above, having more reviews that your competition will help achieve top search rankings.
For more information on enhancing your search visibility with reviews and ratings please see:
Submit to StumbleUpon : StumbleUpon encourages site owners to submit their own sites and pages for the StumbleUpon community to rate and review. If they don’t like your site, you won’t get much traffic. But if the community does like it, expect thousands upon thousands of users to visit and review your site themselves.
For more information on StumbleUpon please see:
Submit to Digg, Netscape and Reddit : If you have a good piece of content which is attractive to these communities, submit the story yourself, ask a friend, or a top user in these communites. But do this sparsely, too many submitals of your own stuff or useless information can lead to you or your site being banned by these services.
For more information on marketing via these sites see:
Please feel free to share your thoughts on social media’s influence on search engine rankings in the comments below.

Google Instant Preview: The Visual Aspect of SEO

Earlier this month, Google added a new feature to their Search experience: Google Instant Preview. The feature, explained in detail on the official Google Blog, accelerates the search process and adds a visual aspect to the SEO job description. In order to activate Instant Preview, users must click on the magnifying glass nestled within each search result. Once activated, a graphical preview flips up when the cursor hovers over any part of a search result.
Like many of Google’s enhancements to the Search process, the arrival of Instant Preview affects the SEO industry. Many web marketers were tempted to dismiss Instant Preview’s SEO influences after reading that the change would not influence algorithmic SERPs. Sure, the rankings of your client won’t change, but what if your #1 ranking doesn’t appeal to users visually? Instant Preview encourages conversations and integration between SEO and Web Designers for maximum return on search engine marketing efforts.

SEO without an Algorithm


An important element to each preview returned is the text highlighted, emboldening the keywords from the search query; a golden opportunity to impress searchers and ensure a click-through. This concept is similar to well-crafted meta-descriptions: Optimized copy won’t influence the algorithmic results directly, but the right keyword usage can lead to increased traffic and visitors.
As mentioned earlier, Instant Preview adds a visual dynamic to the SEO process. How do your landing pages appear in Google’s preview? It’s important to note that Previews do not include Flash graphics. As you can see in the example with a search for “YouTube”, pages loaded with Flash are unappealing and may cost you visitors.
The wall between the Search Optimization Department and Web Designers is slowly crumbling due to changes like Instant Preview. With so much of search decision-making fueled by the look and feel of a site, SEO has a voice in webpage design, at least when forming landing pages.

Changes in Web Marketing


The introduction of Instant Preview is the latest in a long line of Google efforts to organize the way the internet works. If you want traffic, you have to play their game. Instant Preview brings sweeping changes to those sites hoping to profit off pop-ups or windowless Flash Ads. The Google Webmaster Blog explains:
Try to avoid interstitial pages, ad pop-ups, or other elements that interfere with your content. In some cases, these distracting elements may be picked up in the preview of your page, making the screenshots less attractive.
Additionally, Google is picking up valuable seconds in terms of Average Time on Site, and in the process, building trust in the Google search process. Instant Preview affords users the ability to quickly interact with a page and determine its usefulness while never leaving the safe haven of Google’s search results; a notion that contributes to overall brand loyalty to the search giant. Tricky? Maybe. Smart? Absolutely.