Jump to content



Recommended Posts

I've been browsing through my webstats and found that bots are searching for the page robots.txt in order to scan my site. I was on other sites like google/paypal, and say that they have robots.txt pages and i was wondering what mine should consist of, have any of you got this file that i could upload to my site.

Link to comment
Share on other sites

  • 4 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...