“No manual intervention” says a Google Fellow of Quality…

July 9th, 2008 Ryan Smith Posted in The Industry | No Comments »

Amit Singhal, a Google Fellow in charge of their Search Quality Group, just posted a killer entry on the official Google Blog describing their IR philosophy.  The first thing that jumps out at the casual SEO reading this is emphasized in bold below:

We work very hard to keep our system simple without compromising on the quality of results. This is an ongoing effort, and a worthy one. We make about ten ranking changes every week and simplicity is a big consideration in launching every change. Our engineers understand exactly why a page was ranked the way it was for a given query. This simple understandable system has allowed us innovate quickly, and it shows. The “keep it simple” philosophy has served us well.

Their philosophy, says Singhal, breaks down to essentially three fairly obvious points:

  1. Best locally relevant results served globally.
  2. Keep it simple.
  3. No manual intervention.

Brilliant.  Sounds essentially like Ron Paul’s foreign policy, except for this one little problem:

The second reason we have a principle against manually adjusting our results is that often a broken query is just a symptom of a potential improvement to be made to our ranking algorithm. Improving the underlying algorithm not only improves that one query, it improves an entire class of queries, and often for all languages. I should add, however, that there are clear written policies for websites recommended by Google, and we do take action on sites that are in violation of our policies [emphasis added] or for a small number of other reasons (e.g. legal requirements, child porn, viruses/malware, etc).

Ah, etc., formally known as the good old et cetera, ancient Rome’s own version of the Yadda, Yadda, a meaningless catch-all to let your audience know that you know that there’s more relevant details than you can explicitly state for whatever reason.  We all do it, and I don’t fault Amit for doing it here.  I think he’s speaking from the depths of his beFellowed heart about Google’s best intentions.  However, I think the message is pretty clear if you squint a bit to see it.  If you can’t see it, maybe you can hear it.  Take it Freddy…

Weeeee wiiiiillllll… Weeeee wiiiiillllll… EDIT YOU!

*boom, boom, clap*

Amit’s blog posts, and any of his other for that matter, are certainly ones to keep an eye on.  As he said:

Stay tuned for my followup post, where I will discuss in detail the technologies behind our ranking and show examples of several state-of-the-art ranking techniques in action.

Judging by some of the other numerous and scholarly titles he’s put out, it’s a safe bet his upcoming Google blog posts will be at least as informative as Rand Fishkin’s excellent analysis of the Google patent application or even fellow Fellow Jeff Dean’s detailed speech on Google’s data center architecture at the I/O Conference.  We’re watching you, bro… ever-fascinated with just what you’ll do for/to us next.

And remember kids, practice safe serving.  Always use a unique IP.

(Shout out to Matt Cutts for the heads-up on this via Twitter.)


Sitemap URL Redirecting

January 18th, 2008 Ryan Smith Posted in Howtos | No Comments »

I recently encountered an issue where a client with a web server cluster was having difficulty keeping every node’s copy of their sitemap up-to-date, and wanted to know if all the search engines’ sitemap bots would follow a 301 redirect on the sitemap itself to a master server with a different domain than the site for which the sitemap is authored.

I doubted that we could trust that redirects on sitemaps would necessarily be followed by every service which supports them. I asked Google’s Matt Cutts about it, and he offered the following suggestions:

Read the rest of this entry »


Automated Keyword Research - 2007 Vegas PubCon

December 6th, 2007 Ryan Smith Posted in Presentations | No Comments »

Here is the PowerPoint stack for my presentation on Automated Keyword Research in the Organic Keyword Research panel at 2007 WebmasterWorld conference in Las Vegas.

Search Ranking Acquisition:

Anonymizer Web Harvesting Proxy Service

Yahoo Search API

Windows Live Search API

Google SOAP Search API tombstone and function reference for legacy API key holders

Keyword Search Volume Estimations:

KeywordDiscovery API

WordTracker API

WordsFinder Traffic Estimator API

Google Trends API coming soon

Microsoft adCenter Keyword Research API beta signup email

Search Term Extraction:

Yahoo Term Extraction API and PHP tutorial

WordsFinder Keyword Extractor API

ClickTracks Pro 6+ Reporting API

Average Click-Thru Rate (CTR) of Search Engine Result Pages (SERP’s):

Cornell University Eye-Tracking Study

EyeTools heat map study of Google SERP

CTR analysis of leaked AOL search database


How to properly 301 Redirect URL’s with Apache, IIS, PHP, ASP and ColdFusion

September 20th, 2007 Ryan Smith Posted in Howtos | No Comments »

Properly translating your search-unfriendly URL’s into search-lovable ones, or just scrambling up your information architecture (or “IA”, which is essentially a site’s navigational structure, with respect to the way content is organized) into something more delicious to bots and humans alike should be a straightforward process. Many of us had to learn this process from trial-and-error (trial by fire more like it) or, if you were lucky, from popular SEO folklore.

Read the rest of this entry »


Customize Your Site Search Results with BeyondSiteSearch

August 20th, 2007 Ryan Smith Posted in Open Source Projects | No Comments »

As a compliment to Alex’s presentation on site search optimization at the 2005 Vegas PubCon, I developed a free site search tool called BeyondSiteSearch which allows a webmaster to customize site search results which can help optimize a site’s usability and conversion rate. Considering we’ve had over 800 downloads since the PubCon release, I’d say it’s been filling the niche rather brilliantly so far. Here’s an excerpt of the custom result instructions to give you some idea of how it works:

Read the rest of this entry »


f1rs+ p0s+!

August 12th, 2007 Ryan Smith Posted in Site News | 1 Comment »

Hi, I’m Ryan Smith, Lead Systems Architect at Beyond Ink and regular WebmasterWorld PubCon attendee.  Welcome to HackingSearch.com!

On this blog we will explore the technical aspects of SEO/SEM, particularly from a tools development and open source programming perspective, as well as ongoing SEO research.  We will also occasionally grok the deeper meaning of Search as this sleeping giant of an industry slowly awakens, and meander down the many side streets of my own personal projects.

Thanks for stopping by!