Competitor Analysis Robots.txt Generator

Home

About Us

Free Quote

Web Tools

Articles

Link Exchange

Our Services

	Competitor Keyword Analysis
	Competitor Pay-Per-Click Analysis
	Competitor Search Engine Analysis
	Competitor Affiliate Analysis
	Competitor Link Analysis
	Competitor HTML Analysis
	Competitor Trade Directory Analysis
	Competitor PR Strategy Analysis
	Keyword Conversion Analysis
	Software Development
	Web Site Design
	Covert Business Analysis T
	Web Marketing Consultation

Free Quote >>

Web tools

	Backlink Summary Report
	Site Popularity Analyzer
	Keyword Density Analyzer
	Related Keyword Search
	Link Cloaker
	Meta Tag Scanner
	Meta Tag Generator
	Web Page Snooper
	Web Page Size Checker
	HTTP Header View
	Browser Look Up
	Robots.txt Generator
	Screen Size Tester
	HTML Color Chart
	Conversion Track
	Who Is
	Domain Inspect
	Word Counter
	Pay Per Click Calculator
	BandWidth Test Speed

Resource Link

WPA Resource Link

Web Tools

Robots.txt Generator

8) { print("

"); print("

"); print(""); print(""); print(""); print(""); print(""); print(""); print(""); print(""); if(isset($disallow) && !strcmp($disallow,"none")) { print(""); print(""); print(""); print(""); } else { print(""); print(""); print(""); print(""); if($exptb1!=-1) { print(""); print(""); print(""); print(""); } if($exptb2!=-1) { print(""); print(""); print(""); print(""); } if(!empty($dir1)) { print(""); print(""); print(""); print(""); } if(!empty($dir2)) { print(""); print(""); print(""); print(""); } if(!empty($dir3)) { print(""); print(""); print(""); print(""); } } print(""); print(""); print(""); print("

Just copy the text bellow, create a new .txt file called robots.txt, paste the above text in it and upload it to the root your server ! That's all there is, be careful with editing, because a mistake can ban your site to the search engines for a long time.

-- Start Robots.txt File --

#Robots.txt file created by http://www.webpositionadvisor.com

#For domain: ".$url."

# No robot will spider the domain

User-agent: *

Disallow: /

All robots will spider the domain

User-agent: *

Disallow:

#Disallow: ".$exptb1."

User-agent: ". $exptb1."

Disallow: /

#Disallow: ".$exptb2."

User-agent: ". $exptb2."

Disallow: /

#Disallow directory: ".$dir1."

User-agent: *

Disallow: ".$dir1."

#Disallow directory: ".$dir2."

User-agent: *

Disallow: ".$dir2."

#Disallow directory: ".$dir3."

User-agent: *

Disallow: ".$dir3."

-- End Robots.txt File--

Generate another robots file

"); } else { ?>

This tool allows you to create a robots.txt file for your domain the file needs to be placed in the ROOT of your domain. This means it must be were your index page is. Every site practically needs a robots.txt file, the search engines use it to index your site, and you can specify whether the robots do or don't spider your site, or parts of it. So in general it's always good to have a file like that, and you can start creating one simply filling out the form below!

Your URL:

Allow all bots or none :

All

None (If None push the generate button)

Except :

And except :

In the next fields, a / can ban your site to the engines !

Disalow directory :		Example: \ cgi-bin \
Disalow directory :		Example: \ images \
Disalow directory :		Example: \ temp \

Other Related Tools

	Meta Tag Generator
This tool generates the properly formatted META tags that you can copy/paste into your pages.

Target Analyst Benefits

	No software to install
	Manage multiple sites
	Track PPC campaigns
	Website navigation analysis
	View visitor behavior
	Increase conversions
	E-commerce analysis
	Instant results
	Identify your bounce rate
	Includes 18 cool web tools