Finally, we introduced our NaijaWeb site to Google yesterday. It was funny.
I submitted the website to the search engine and in 10 minutes (!) the homepage was indexed and listed in the search with site:naijaweb.net, as if Google had been just waiting for the “permission” to crawl (it was not allowed to do it due to the robots.txt earlier).
Then something went wrong in the site map, after I had submitted it to GWT (Google Webmaster Tools), and we were changing and repairing it on the fly. Every time something was changed online, I refreshed the page in the GWT and new results were shown every 1-2 minutes. I think, the Google crawler was just hanging out together with us to get the proper site map and go finally...
Anyway, we managed the first step: there are more than 120 crawled pages today, yeah!
|# 15 03 2014 at 18:12 0|