What To Do When Spiders Don’t Visit Your Site
Topics: search engine spiders, search engines, internet marketing, online business, web marketing
It sometimes happens that a search engine spider don’t visit your site even after you submit it manually. Take a look at your site’s log files. Look at the hostnames of the sites that visit your site. You should see something that looks like this: googlebot.com. This is Google’s bot or spider. If you do not see this in your log files then the Googlebot is not visiting your site.
To get listed in Google you need the Googlebot to visit your site. The best way to do this is to get links from web sites that rate high in Google. Go to google and search a few keywords related to the subject of your web site, see what comes up. Now try the same keywords and include, “add your url” and “submit your site”. As an example, if you sell vitamins search Google for, “vitamins add your url” and “vitamins submit your site”.
This will bring up web sites that want to exchanges links and are highly rated by Google for keywords related to your web site. Read the instructions on their links page, add their information to your links directory and then add your information to their links page. When a spider visits a site one of the things it does is read through the sites link pages to find new sites to visit. When the Googlebot does this it will find the link to your site and hopefully visit it. Exchange links with several sites this way and keep looking for the Googlebot to show up in your log files. If it does not show up in another three weeks you need to re-submit it.
Sometimes your site can get listed on a search engine, but then taken down for some unknown reason. In either case, re-submitting isn’t overly difficult. There are some guidelines you should follow in order to guarantee results. We’ll be going over where you can submit sites, how to submit sites and how to re-submit sites.
Automatic submission software is necessary for submitting to the thousands of lesser search engines, but do not try it with the major search engines. No automatic submission software will replace manual submission for the major search engines.
Where you should manually submit your site
Most of the search engines traffic comes from the three major search engines Google, Yahoo! and MSN. The major search engines are the most important places to get listed. These three provide results for many other search engines, and if you are listed on these three, your site will be listed on many others too. Rankings are not always the same on other search engines, this is because the algorithm is different but the index is the same. Most web sites get into Google, Yahoo and MSN by getting spidered from other sites. If you’re already linked from another sites, Google, MSN and Yahoo’s spiders will eventually find you. It is still a good idea to submit to them by hand once. It is easy to do and does not take long. Submitting your web site multiple times has no effect. Before you submit your site make sure it does not appear on the search engine you are submitting to. There are hundreds of different search engines which you can submit your site to. We’ll go over a few of the
most popular ones here.
Google www.google.com has a well-deserved reputation as the top choice for those searching the web, it is used by millions of people each day. Two things you need to do to rate well in Google is to make sure that your site is full of useful, unique content and relevant sites that link back to you.
Yahoo Search Engine search.yahoo.com is easy to use and has great features, you can use the tabs above the search box on the Yahoo home page to search images, Yellow Page listings or Yahoo Shopping. Yahoo is easy to submit to.
MSN Search is now Live Search beta.search.msn.com Search offers users the ability to search for specific types of information using search tabs that include Web, news, images, music, desktop, local, and Microsoft Encarta.
The Open Directory Project www.dmoz.org Open Directory Project (ODP), is a large, categorized directory of web sites, which is staffed by volunteers. Getting your site listed can take a very long time. Every web site and page that is added to the directory has to be manually reviewed before it is included and they pride themselves on being highly selective. DMOZ’s will only include your site if it has unique content.
Lycos: www.lycos.com search engine and web portal centered around broadband content. This is an easy to use search engine with lots of the same features Google has. You don’t have to manually submit sites here, if you have good content and good links pointing to you spider will find you. It is fast and easy to submit to.
AllTheWeb
Search results on AlltheWeb are provided by Yahoo!. To be listed with AlltheWeb you need to be listed with Yahoo! AllTheWeb is a popular search engine with quite a few features.
AltaVista
Search results on AltaVista are powered by Yahoo!. To be listed with AltaVista you need to be listed with Yahoo! AltaVista is not as popular as it once was, it still receives many of visitors.
AOL Search
AOL Search provides listings that come from Google’s index. The same search on Google and AOL Search will have close to the same results. To be listed with AOL you need to be listed with Google.
Submitting advice
Submitting you site to the search engines is easy. You should submit your site not just to the well-known search engines, but also to the smaller ones. The more your site is listed, the more visitors you will get. Go to the search engine’s site, click on “Submit a site” and then fill out the necessary info about your site. Here are some things you should keep in mind.
1. Don’t submit your site if all the pages aren’t complete. Search engines don’t like incomplete sites. It is pointless to fill out the form for submission if your site isn’t completely finished.
2. Make your description as brief but comprehensive as possible. People who are looking at your submission don’t have time to read through a big, long description.
3. Make sure the details in your description are relevant, interesting and accurate. If yours site is about shoes make your description about the shoes on your site.
4. People are reading your submissions and approving them. The description is intended to give people a statement of what can be found in the site, and not to promote it. Don’t brag too much, be modest.
How to Re-submit sites
Before you try to re-submit a site, take the following into consideration.
1. Has it been at least a three weeks since you originally submitted?
1. What kind of links do you have pointing to your site? Are they links from sites relevant to the subject of your site?
2. Was your site pulled because it had content on it that was inappropriate? If this is the case you need to change your content before you re-submit or it will only get pulled again.
To re-submit your site, all you have to do is follow the same process as you did when you submitted the site before.
Sign up for the Web Success Weekly Email. Lean simple, step by step methods to get your business online and making money, the easy way: websuccess.info Harvey Lew Robinson:
websuccess.info
Previous Articles Highlighter:
Tanzanite History And Information, What You Need To Know! (1)
Just try finding one of these today! These tanzanites were mined mostly in the D shaft of Merelani Hill, just outside of Arusha, Tanzania. This area has since been depleted and new shafts have been opened.
Black Hats And White Hats -- It's Not A Western Movie, It's SEO! (2)
And, many of the larger search engines, like Google, Microsoft's Live, and Yahoo!, stopped publishing their ranking methods. In addition, many search engines frequently change their methods so that what works one day might not work the next.
Finding A Perfect Wealth Formula In Online Marketing (3)
This traffic flow increases according to the content and delivery mechanism of your site and your efforts are successful once your trademark is established in the e marketing domain. Branding becomes easy if it is based on particular skills that you have or resources you possess.
Looking Good In Print And On The Web - Guerrilla Style (4)
5. Create bullets and lists. Use bullets and numbered paragraphs to break up copy and to highlight and emphasize points. Numbered lists are used when priority matters, and bullets indicate that each point is of equal weight.
Affilliate Link Cloaking And How It Helps To Optimize You Business (5)
Any hacker hasn't been able to break through this system, as they are unaware that the cloaked id url is not your real one. Tom Williamsen is an affiliate marketer and Ad Tracking Expert.
Internet Marketing Customers: Why It Is Wise To Avoid Them (6)
Now you can start to figure out a way to reach those same customers with your own "spin" on the same product or service. You can also look at consumer Web sites that either review or feature consumer products and services.
What Can You Do To Get The Most Out Of Affiliate Marketing? (7)
However, you will not want to submit the same articles that you have on your site to these directories. You will want different variations of the articles to be used in the directories.
Are You Running Different Ad Tracking Campaigns? (8)
To track your ad campaign success you could purchase some ad tracking software. This ad tracking software would enable you to see exactly what methods are working for you and what methods are not.
How To Fix CSS Float Issues (9)
There's nothing wrong with using negative margin property, but not when there's a better solution for it, such as using floats. If you apply Float to those images then they'll align in one row, then you can continue to add more images using the float property and you wouldn't have to worry about whether they'd line up or not because the float property will recognize that there's too many elements on this line and it will push the images to the next line.
Are You Using An Ad Tracker To Track Your Affiliate Sales? (10)
Another great feature of an affiliate tracking software is the fact that through this software, you will be able to see exactly where your hits are coming from and the exact amount of your sales.
Do You Know The Benefits Of Ad Tracking? (11)
So all you would have to responsible for would be the initial cost of the software. So, when deciding whether the benefits of ad tracking would outweigh the initial purchase of the software, you should keep all these factors in mind.
Free Links To Your Blog: Enhance Your Blogging Efforts (12)
Quality of the links is equally important. It is always favorable that the links are coming from similar blogs related and relevant to your blog content. You could be a quick comic relief, a blog that nurtures humor subtly, relevant to the current topics and discussions apart from the serious contemporary articles.
Have You Seen These 4 Blogging Tips (13)
When you start out choose a theme for your blog that you have an interest in. Maybe it is an area that you have knowledge in from work or a hobby.
Quick Site Indexing By Major Search Engines (14)
Doing so will help your site as a whole get noticed quicker by search engines. Set up a blog today and watch how quickly and effortlessly your site gets listed on search engines!
Are You Familiar With Keyword Tracking? (15)
If its not used enough then you are not getting maximum exposure for your product or website. But, if its used too much then the site could look extremely spammy which could turn potential customers away.
A Smart Internet Marketer's Secret Weapon: EBay (16)
Remember that your business will only be limited by your imagination and vision. The bigger you see the possibilities of using eBay for starting and growing your business, the bigger you can become in a relatively short time.
Ad Tracking Is Essential To Run A Successful Online Business (17)
You can see if your ad is working or not. The software tracks the customer behavior and gives you the result. You can know which type of advertisements attracts more customers.
Advise For Email Marketing Success (18)
Who do you want to reach? You have to have clear, well defined goals before you start. This can save you a lot of time and effort later.
Search Engine Spiders And Your Robots.txt File (19)
The robots.txt file By defining a few rules, you can tell robots to not crawl certain directories or files, within your site. Web sites do not absolutely have to have a robots.txt file, they can get along just fine without one.
Starting A Business: Advertising And Marketing (20)
There are lot of effective media that can be utilized for your advertising and marketing. Television, broadcast and print media, are some of these example that can contribute for your progress as you are starting business of your choice.
Newer Articles Highlighter:
Building A Highly-targeted Opt In List: When Money Lies Beneath The Lists (1)
Just imagine how these people value their opt in list. If this is the case, then it must be really something, right? So, for people who are not yet aware of the importance of building a highly targeted opt in list and would like to know how to build them, here are some tips that could be very useful.
The Real Do's And Don'ts Of List Building (2)
Soon enough they will ignore your messages. Building your opt-in mailing list is cheaper than in sending direct mails. Printing, envelopes and paper used as material further add up to the cost.
Home Staging-Will It Really Help Me Sell My Home? (3)
Hose off the siding and knock down the cobwebs. Once you have improved the looks of the outside of your home, you need to take stock of what you have on the inside.
10 Amazing Ways To Jump Start Your Business And Your Sales (4)
You can trade leads, share marketing info, sell package deals, and might even be able to team up later on down the line. Also you can give them free access to your program or product and ask them to write a review on it for you to put on your website.
The Best Support A New Internet Marketer Can Receive (5)
While starting an internet business can be a daunting task when first beginning, experienced internet marketers lurk at many internet forums to offer helpful advice and knowledge to make the learning curve as short as possible.
The Internet Business Candy And How To Profit From It! (6)
Don't believe it?! Well.... This is not my saying, infact, this is the great author cum sales person-Zig Ziglar's prediction. One thing that I can say is in this regards is that, don't ignore his prophecy, trust me, Internet has immense scope and with proper dedication, you can earn thousands of dollars from your home-based Internet business.
How To Get The Googlebot To Visit Your Site (7)
To get listed in Google you need for the Googlebot to visit your site. To find out if this is happening take a look at your site's log files.
Outsourcing Your At-Home Internet Business (8)
All you need to do is come up with the list of tasks your at-home Internet business requires of you, and post them as projects on any one of the several good outsourcing websites on the Internet -- such as elance, rentacoder or scriptlance.
When To Consider A Dedicated Server (9)
If you use a shared web service, you're allotted a certain amount of bandwidth every month. Each host has a different way of dealing with the situation if you go over that amount of traffic.
Things You Should Know About Pay Per Click Advertising (10)
When targeting keywords that youll use, try to think like your customer. What do you think they are going input into the search query to get to you? Also, use specific keywords or key phrases.
Some Basic Tips On Opt-in List Building (11)
It is advisable to put it on all the pages. Then make sure that it is strategically positioned, meaning it has to be easily located by the visitors. The upper right hand corner of the page would be a good position.
JV Giveaways Will Build Your List Fast! (12)
Topics: list-building, JV giveaways Here's an awesome way to build your list, just by giving things away! Have you ever subscribed to a JV Giveaway? This is where marketers give away a free gift in return for your contact information.
Search Engine Optimization And Massive Website Traffic (13)
Anchor text is the clickable text - usually coloured or highlighted blue - which you can click to be taken to another page or website. Once again, you have to make sure your website comes out as relevant.
How To Choose A Web Hosting Company (14)
For this reason you must have a long term vision of what you want to do with your site and what you need from your hosting company to do it with.
Internet Marketing Tools That Really Work (15)
It might be interesting and fun to do, but before you rush out to become a jack-of-all-trades, consider this: Even if you have the skills to do all these things, do you have the time?
Outsourcing Article Marketing: The Easy Way To Make Money Writing Articles (16)
Luckily, there is an easy way to write articles and benefit from all the article marketing goodness we described earlier. It's easy, takes virtually none of your time, and can be done for pennies on the dollar.
Web Hosting On A Budget (17)
If you require broader services from your host, you may need to consider dedicated hosting. However, unlike shared hosting providers, dedicated server hosts are only responsible for hosting services although some provide additional support services at a cost.
Affordable Website Design (18)
Topics: website design, affordable custom web design, affordable web design, affordable web design company Web design services are an essential commodity in today's arena of computers and technology. Businesses always need new websites developed and updated from time to time.
How To Promote To Your Niche (19)
You can network, build relationships, learn and grow your business through online communities. But if you spam these loyal and tight knit groups, you had better be ready to run for cover.
Google, SEO, And Quality Links (20)
This they did by the introduction of the PR band, a small line atop one's browser fittingly entitled with the word "PageRank." The pagerank band scaled from a low of zero (PR0) to a high of ten (PR10).