Google Robot.txt file - Webmaster Forums - Webmaster forum for HTML, PHP, ASP, CSS and more
Webmaster Forums - Webmaster forum for HTML, PHP, ASP, CSS and more
Go Back   Webmaster Forums - Webmaster forum for HTML, PHP, ASP, CSS and more > Webmaster Tech > Tutorials and Guides

WebmasterForums.com is the premier Forum on the internet. Registered Users do not see the above ads.
Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old 06-08-2016, 05:49 AM   #1 (permalink)
Junior Member
 
Join Date: Jun 2016
Posts: 1
Default Google Robot.txt file

Hello Friends,

i am aditi and i need help for Google robot.txt file update.
How can i am edit coding into this file?
How i am saying Google follow and nofollow web site pages?

By aditi,
Top search seo- mobile seo services
aditiseo is offline   Reply With Quote
Sponsored Links
Advertisement
 
Old 07-06-2016, 03:20 PM   #2 (permalink)
Regular User
 
Join Date: Jul 2016
Location: Bangalore
Posts: 19
Default Re: Google Robot.txt file

in robot.txt file you disallow any page which have dublicate content.
formate of robot.txt file

User-agent: *
Disallow: /testimonial.html
Disallow: /about-us.html
advanceins is offline   Reply With Quote
Old 01-23-2017, 07:14 PM   #3 (permalink)
Junior Member
 
virtfanxyr's Avatar
 
Join Date: Jan 2017
Location: virtual fantasy
Posts: 1
Default Re: Google Robot.txt file

some bot-s can ignore 'robot.txt' file !

Last edited by virtfanxyr; 01-23-2017 at 07:29 PM.
virtfanxyr is offline   Reply With Quote
Old 02-02-2017, 02:48 AM   #4 (permalink)
Junior Member
 
RH-Calvin's Avatar
 
Join Date: Jun 2013
Posts: 3
Default Re: Google Robot.txt file

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
RH-Calvin is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



» Advertisement

» Advertisement

» Affiliates
Web Hosting
Online Backup Reviews
Marketing Find
Merchant Select
SiteMap Builder
Host Compare

» Advertisement

» Sports Network
Paintball Forum
Football Forum
Hockey Forum
Golf Forum
Boxing Forum
Lacrosse Forum
Baseball Forum
SnowBoarding Forum
Soccer Forum
MMA Forum


All times are GMT -4. The time now is 11:27 AM.


Powered by vBulletin® Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.3.2
vBulletin Security provided by vBSecurity v2.2.2 (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
Webmaster Forums
Web Hosting | Chicago Web Hosting | Web Hosting