Abandoned by Google! Googlebot, Wherefore Art Thou Googlebot?
As a search engine optimization specialist I often optimize existing web pages for small business clients, upload them to the site and see pages re-indexed by Google within a week. This only happens with existing business sites that have been online for a few years. Google seems to be updating their index as often as every other week at this point and older established sites that are already indexed seem to be re- crawled on that twice a month schedule on a fairly routine basis.
Two clients that hired me for recent work saw their rankings shoot to the top for a newly targeted search phrase in a weekend when I did optimization on a Thursday and they were ranked instantly by Saturday. Now keep in mind that this doesn't happen for everyone, only those that have been online for some period and already have significant content that simply needs tweaking and proper title and metatag information added. They usually have relatively good existing PageRank and do well for other RELEVANT search phrases already. I offer that warning only to avoid instilling false hopes in anyone hoping to achieve the same instant ranking boost overnight.
Those clients that do succeed in this way are often thrilled with the results accomplished in such short order. I'd love to be able to offer that type of ranking boosts to everyone, but some are more equal than others when it comes to easy, inexpensive SEO tune-ups that rev up your rankings overnight. Your mileage may vary.
WHY DO NEW SITES SUFFER?
What is going on with newer sites that don't get crawled for months? I've got a client, a newer attorney directory that offers tons of great information in the form of articles on specific areas of law, links to incredibly valuable and relevant legal sites and over 600,000 attorneys listed by practice area and state. Yet the site has not been re-crawled by Google for over 3 months! Now this would not be such a big issue for many sites, but this site is relatively new and we've optimized all the titles, tags & page text, created a complete site map and placed links to all these resources on the front page.
I know that the site is not being crawled because Google's cached copy of the front page shows it before we did the work four months ago, without the new links and without title tags. We've submitted the site by hand, (manually) once a month for three months via the Google Add URL page. http://www.google.com/addurl.html When the hand submission failed to get it re-indexed for four months, we submitted the sitemap page, which has not been crawled at all. Google shows only ONE page on this site, when in fact it has thousands of pages, a sitemap and dozens static pages!
Part of the problem is that this site must be dynamic, since a database of over 632,000 attorneys must be accessed, retrieved and served for any of those law firms searched for to be returned to the site visitor. Google warns owners of dynamic sites that Googlebot may not crawl dynamically generated pages with "?"" question marks in the URL. This is to avoid crashing the server with too many concurrent page requests from Google's spider. http://www.google.com/webmasters/2.html#A1
The solution to this dynamic URL problem has been discussed widely in search engine forums and solutions have been bandied about including software provided by SEO's, URL re-write techniques for dynamic pages on APACHE servers http://www.alistapart.com/articles/urls/ and PHP pages http://www.stargeek.com/php-seo.php to generate search engine friendly URL's. Others recommend simply adding static HTML sitemap pages as alternatives for the search engine spiders. In this instance the client's developer simply said "I can't do that (PHP solution) on this server". So we resorted to putting up the static HTML sitemap pages with hard-coded
URLS to the main 54 pages of the site at http://lawfirm411.com/Law-Firm-411-sitemap.html This should get at least those fifty pages crawled by Googlebot, but Googles' spider appears not to be crawling this site at all. How do we know this? See for yourself by using the following query in the search box at Google: allinurl:www.lawfirm411.com where the result page shows ONE page in the results. If you try that query on your own site (replace your own domain name for lawfirm411.com), you'll see the results lists ALL your pages.
The site home page was crawled by Google four months ago, when they took their "Cached Snapshot" of the page. You can see this by visiting the Google cached page here: http://126.96.36.199/search?sourceid=navclient&;ie=UTF-8&q=cache:www.lawfirm411.com where the date of this snapshot is "Apr 20, 2004 07:42:19 GMT" and they haven't been back since. The page in that snapshot has none of the newly added links, an outdated title tag, and old content.
This problem is not unique to this site. One client we worked with two years ago had a dynamically generated, framed site! Those two site structures have always given search engines trouble. Their site was not crawled at all and only the front page showed up. Our solution was to create a second domain (owned by the client), which had static HTML pages that precisely mirrored the content of the client's framed, dynamically generated site. Guess what happened after Googlebot crawled the static site? Google indexed the framed site in full and then banned the static site from the index! Not an approach we advocate, but the one that worked for this client.
We're still searching for ways to get Googlebot back to LawFirm411.com before creating that new static site, but decided to share this odd experience with the SEO community before going to any extremes. Google provides over 70% of most search engine referred traffic to ALL of our clients and we realized we can't site idly by and see a major client languish because Googlebot didn't like what it found at the client site on the first visit four months ago. This issue dogs newer sites in other places as well. The Open Directory Project has also become notoriously slow in adding new sites to the directory and in this case, has not picked up this site even after 6 regular monthly submissions. The web playing field may have begun tilting toward older, established sites and away from new ones.
Mike Banks Valentine is the SEO for http://www.lawfirm411.com
Contact him at http://www.seoptimism.com/SEO_Contact.htm
Improve Your Small Business Online at our Ecommerce Tutorial
3 Steps to Better Content: Power up Your SEO with Audience Understanding Search Engine Journal
How Important Are Backlinks for SEO? Search Engine Journal
The 7 Most Important Things I've Learned About SEO This Year Search Engine Journal
3 Reasons Why You Need to Integrate CRO with SEO Search Engine Journal
How Important Is an H1 Tag for SEO? Search Engine Journal
5 Things You Should Know Before Buying SEO Software Search Engine Journal
SEO: What Google's New Passage Indexing Means for Ecommerce Practical Ecommerce
SEO in a Nutshell: Understanding, Credibility & Deliverability Search Engine Journal
How to Strengthen Your SEO Strategy to Improve Visibility and Sales CoFounder Magazine
How to Leverage Keyword Mapping for SEO Success Search Engine Journal
What short-term rental managers need to know about SEO Short Term Rentalz
5 Tips for Hyper-Optimizing Your SEO Business 2 Community
How to Use Microsoft Bing Site Explorer for SEO Search Engine Journal
Google Answers Question About Passages SEO Search Engine Journal
How CRO Can Help Tie Your SEO Efforts to the Bottom Line Search Engine Journal
Hidden SEO Spam Link Injections on WordPress Sites Security Boulevard
What passage indexing and natural language processing mean for the future of SEO - Search Engine Land
Why It’s Time to Retire Black, White & Gray Hats in SEO Search Engine Journal
Content regulation. UK's National Cyber Force. Stone Panda's spoor. Printers, SEO for extortion. Through a glass and darkly. - The CyberWire
Content regulation. UK's National Cyber Force. Stone Panda's spoor. Printers, SEO for extortion. Through a glass and darkly. The CyberWire
5 SEO Quick Fixes for Ecommerce Sites Search Engine Journal
How to look for SEO keywords? | Marketing Mentor | advantagenews.com AdVantageNEWS.com
Digital Future Report Reveals Majority of Marketers Are “in Denial” About SEO Performance Gap - MarTech Series
Digital Future Report Reveals Majority of Marketers Are “in Denial” About SEO Performance Gap MarTech Series
Video: Elie Orgel on using data to create pages that get links Search Engine Land
Global Search Engine Optimisation (SEO) Software Market 2020-2025 Detailed Analysis on Key Segments, Revenue Generation and Top Companies WordStream, Moz, SEO Book, LinkResearchTools, SpyFu etc. - Cheshire Media
Global Search Engine Optimisation (SEO) Software Market 2020-2025 Detailed Analysis on Key Segments, Revenue Generation and Top Companies WordStream, Moz, SEO Book, LinkResearchTools, SpyFu etc. Cheshire Media
3 Ways to Use Chrome DevTools for SEO Troubleshooting Search Engine Journal
The Under-Utilized SEO Strategy: Mission-Driven Content Marketing Business 2 Community
Search Engine Optimization Seo Tools Market begins to take bite out of Versioned Long Term Growth 2027 - Eurowire
Search Engine Optimization Seo Tools Market begins to take bite out of Versioned Long Term Growth 2027 Eurowire
Does paid traffic help in SEO and increase website ranking? Best in Australia
The Best SEO Companies of 2020, According to DesignRush Yahoo Finance
Know How Search Engine Optimization SEO Tools Market Market is demanded globally by Top manufacturers - Eurowire
Know How Search Engine Optimization SEO Tools Market Market is demanded globally by Top manufacturers Eurowire
The Future Of Digital Marketing In Singapore: Media Mojo GlobeNewswire
Latest Trending Report on Search Engine Optimization (SEO) Tools Market 2020 with high CAGR In Coming Years with Focusing Key players like Yoast SEO, SEMRush, Siteliner, Ahrefs, Bonus Tool - TechnoWeekly
Latest Trending Report on Search Engine Optimization (SEO) Tools Market 2020 with high CAGR In Coming Years with Focusing Key players like Yoast SEO, SEMRush, Siteliner, Ahrefs, Bonus Tool TechnoWeekly
10 Coding, SEO & More Courses on Sale Right Now That Will Turn You into a Pro Developer - Gadget Hacks
10 Coding, SEO & More Courses on Sale Right Now That Will Turn You into a Pro Developer Gadget Hacks
Australian SEO and Web Hosting Business Announces Expansion of Their Services To Become A Full Digital Marketing Agency - Press Release - Digital Journal
Australian SEO and Web Hosting Business Announces Expansion of Their Services To Become A Full Digital Marketing Agency - Press Release Digital Journal
Search Engine Optimization Market Share 2020 Industry Dynamics, Growth Forecast, Top Key Players – , SEMrush(US), SEO Book(Greece), Moz(US), Ahrefs(Singapore), AWR Cloud(US), com, LinkResearchTools(Austria), SpyFu(US), DeepCrawl(UK), WordStream(US), Searchmetrics Essentials(Slovakia), Majestic(UK) - Cheshire Media
Search Engine Optimization Market Share 2020 Industry Dynamics, Growth Forecast, Top Key Players – , SEMrush(US), SEO Book(Greece), Moz(US), Ahrefs(Singapore), AWR Cloud(US), com, LinkResearchTools(Austria), SpyFu(US), DeepCrawl(UK), WordStream(US), Searchmetrics Essentials(Slovakia), Majestic(UK) Cheshire Media
Buy Your New Holiday SEO T-Shirts Now Search Engine Journal
Don’t miss Search Marketing Expo online December 8-9 Search Engine Land
How to Run an SEO A/B Test Business 2 Community
Apex Digi tech Offers Quality SEO Marketing that Grows Local businesses' Google ranking - MENAFN.COM
Increase Your Search Visibility with 3 Twitter SEO Tips Business 2 Community
Local SEO Tools & Software Market Emerging Trends, Strong Application Scope, Size, Status, Analysis and Forecast to 2025 - AlgosOnline
Local SEO Tools & Software Market Emerging Trends, Strong Application Scope, Size, Status, Analysis and Forecast to 2025 AlgosOnline
Miami Seo Expert Trading U
7 Tips on How to Optimise Crawl Budget for SEO Promotion World
Core Web Vitals: Are Your Clients’ Sites Ready for Google’s New Ranking Signal? - Search Engine Journal
Core Web Vitals: Are Your Clients’ Sites Ready for Google’s New Ranking Signal? Search Engine Journal
Search Engine Optimization (SEO) Tools Industry Market to Witness Huge Growth by 2028 | Ahrefs, KWFinder - Eurowire
Search Engine Optimization (SEO) Tools Industry Market to Witness Huge Growth by 2028 | Ahrefs, KWFinder Eurowire
5 ways to modernize your CRE brokerage - Sacramento Business Journal Sacramento Business Journal
Global Search Engine Optimisation (SEO) Software Market Top Manufacturers: WordStream, Moz, SEO Book, LinkResearchTools, SpyFu etc. - TechnoWeekly
Global Search Engine Optimisation (SEO) Software Market Top Manufacturers: WordStream, Moz, SEO Book, LinkResearchTools, SpyFu etc. TechnoWeekly
What Google’s Quality Rater Guidelines Tell Us About UX Search Engine Journal
Search Engine Optimisation (SEO) Software Market Industry Share, Market Types, Business Providers and Future Forecasts to 2025 - Express Journal
Search Engine Optimisation (SEO) Software Market Industry Share, Market Types, Business Providers and Future Forecasts to 2025 Express Journal
SEO 101: Get Your SEO Guide for Beginners [EBOOK] Search Engine Journal
How K-drama’s Park Seo-joon uses his millions to do good South China Morning Post
Students from Asia share their military experiences and inspiration to serve their countries - Ke Alakai
Students from Asia share their military experiences and inspiration to serve their countries Ke Alakai
New ‘Google Search Central’ site consolidates SEO resources, replaces ‘Google Webmasters’ - 9to5Google
New ‘Google Search Central’ site consolidates SEO resources, replaces ‘Google Webmasters’ 9to5Google
Search Engine Journal Is Hiring a Managing Editor Search Engine Journal
SEO: Back To Basics Forbes
Video Marketing: How to build your business and SEO goals Irish Tech News
The 10 Commandments Of SEO Forbes
Data-Backed Ways to Optimize for Google Featured Snippets Search Engine Journal
How to Plan Your Enterprise SEO Strategy Search Engine Journal
SEO tips to improve your online presence Standard-Times
SEO in 2020: What Basics You Need to Know to Be Successful Search Engine Journal
Study: Comparing the data from 8 SEO tools Search Engine Land
SEO and Google Ads aren’t just web magic. Businesses need to know them. This training can make them all clear - The Next Web
SEO and Google Ads aren’t just web magic. Businesses need to know them. This training can make them all clear The Next Web
20 Things I Learned From 20 Years of Working in the SEO Industry Search Engine Journal
5 Simple SEO Tips to Help Generate Business Leads PR News - For Smart Communicators
Google SEO Mythbusting: Is More Content Better? Search Engine Journal
You're Likely Missing Out on Google Traffic. Boost Your SEO with This Budget-Friendly Tool. - Entrepreneur
You're Likely Missing Out on Google Traffic. Boost Your SEO with This Budget-Friendly Tool. Entrepreneur
Customers Want Fast Results? The Hybrid Approach for SEO Agencies Search Engine Journal
SEO: 5 Tips to Convert Visitors to Buyers Practical Ecommerce
SEO for CEOs - Search Engine Optimization Unmasked for CEOs
If you're like most other CEOs, the term "search engine optimization" will mean very little. Either that or it means expense! But it doesn't have to be that way? If you feel like you're standing in a dark room handing money to strangers to get you in the search engines, then this article is for you.
Top 5 Search Engine Optimization Mistakes
There are a lot of ways to promote your website and, unfortunately, a lot of these methods are mistakes. Here is a list of some of the more common mistakes (often referred to as Black Hat SEO) that you should steer well clear of.
10 Quick Ways To Kick-Start Your Profit Pulling Keywords
First, you must realize that targeting the right keywords or phrases is the 'key' to making any kind of profit from your site. Choosing the 'right' keywords (the exact keyword or phrase surfers type into the search engines to find your site or product) can make or break your online venture.
Search Engine Success & The Google-Vision Secret
Want to know the secret to great search engine listings? Ignore Google.No, I'm not crazy.
Linking for Traffic not Positioning!
With more and more experts and search engine enthusiastsclaiming the right way and the wrong way to handle linkswapping, link exchanging or reciprocal linking! You can tell something is important when there is more thanone name for it! GRIN! There are also two schools of thought on the reasons linkswapping. The first reason for link swapping has always been to carryfavour with Search engine rankings.
Possibly The Biggest Misconception About Ranking Well In The Search Engines
Onpage search engine optimization are things that you can change ON your webpage.* Title tag* Header tags* Bolding, Italicizing, Underlining* Alt image tags* Meta Tags* Etc.
Banned from Google and Wondering Why?
There are those that get on the computer one night and find that all of their Web pages have disappeared from Google. While, others are still in the search engine index, but don't rank high for nothing, not even for their Web site's name.
Simple Way to Get High Pagerank
Everyone knows that if your website has a high Google Pagerank, you have all chances to reach good search engine positions, to get serious partners, or simply get more money selling text links.But how to get a high Pagerank? (Let's clarify: saying 'high Pagerank', we mean at least PR6)Of course there are many different ways.
Google Bring Deskbar Search To Windows Desktop. Now Any Website Can Take Advantage Of This
Google's premier of desktop search proves that the desktop is an extremely valuable marketing real estate. Google, which holds about 75% of the Internet search market, just introduced "Deskbar" - a small desktop application that allows users to search Google directly from their desktops.
Submit Your WebSite: Add Your URL to Web Directories & Search Engines
Why get into Search engines and directories?Increase backlinks of your webiste. If your website is listed in Directories then your website can get traffic from directries and search engines counting that backlinks for ranking of your website.
Google Tests Expanded Search To Include Printed Works
Google Labs is currently testing Google Print, which returns results from within scanned printed books along with Google's standard web search results. The searcher doesn't have to do anything special - the printed work results are already included in the Google database.
The Search Engine Optimization Secret that Everybody Ignores
Search engine optimization is a very critical task in the success of any website.In recent times search engines seem to have complicated this task further by their frequent changes in rules.
The 7 Points of Do-It-Yourself SEO
Ever felt intimidated at the convoluted, jargon-ridden information about Internet marketing for small businesses available on the Net? Ever been horrified by the huge fees the experts charge, putting search engine optimization beyond your own means? Ever thought: What exactly is search engine optimization anyway, and can I do it myself?The answer is: Yes, you can! The basics of search engine optimisation in applied web marketing are simple. It's all to do with the keyword content of your text copy, and can be summarised in seven points.
Top 10 Little Used SEO Strategies
There are millions of web sites trying to get listed in the top 20 to 30 spots on the major search engines. That's a lot of competition! So if you're having a hard time getting those spots, maybe you should try some little used but effective seo strategies to get those prized listings.
7 Search Engine Optimization Mistakes and Solutions
To many websites, webmasters discover that major sources of website traffic come from search engines. Therefore, they are all keen on gaining top search engine placements through search engine optimization.
Valid HTML code is crucial to Search Engine Optimization
Why valid HTML code is crucial to your web site's search engine optimization efforts and subsequent high rankings:Many webmasters and newcomers to web page design overlook a crucial aspect of web site promotion: the validity of the HTML code.What is valid HTML code?Most web pages are written in HTML, and as for every language, HTML has its own grammar, vocabulary and syntax, and each document written in HTML is supposed to follow these rules.
7 Steps to Highly Relevant, Search Engine Friendly, and People Useful Web Site Content
The task is to build a Content Rich Search Friendly and People Friendly Web Site Quickly. These 7 Steps will show you how with about 10 Hours work you can build over 50 pages of rich, Search Engine relevant content for your web SiteStep 1 - What is Your Web Site's Main ThemeThis is a Fairly easy step.
SEOing A Flash Intro
IntroductionWhy does a FLASH intro need SEO? Flash, the great SE killer, is basically nonspiderable, although there are reports of the opposite. In this way, the intro creates a solid, non-permeable barrier between the website and the external world.
Creating Search Engine Friendly Web Sites
With tons of competition and copycats online, you need a trustworthy search engine expert to help you tackle the competition and outdo your competitors in internet sales. There are many ways to go about killing the competition online and as long as it is honest work by your search engine guy, your web site will reap profits from it.
SEO Help: Dont Try to Fool the Search Engines
Writing articles is all the rage these days on the web. Or should I say getting other people to write articles for you, joining membership sites that provide "private label" rights -- that is all the rage.
|home | site map|