 |
|
|
|
|
|
|
|
|
2007-02-21, 07:23 PM
|
#1 |
|
My wife is not a doobie to be passed around! On our wedding day I promised to bogart her for life!
Join Date: Jun 2006
Location: Bay Area,Ca
Posts: 276
|
Removing url's from site
I have wanted to remove some content from my site. When I delete a gallery from my site, even if I put the url in my robot text file it comes up as a broken link when I check googles webmaster tools. They then say my site has problems? What am I doing wrong, should this be?
My robot text file looks like this User-Agent: * Disallow: http://www.exampleurl.com ???? |
|
|
|
2007-02-22, 02:46 AM
|
#2 |
|
Kids are great, Appu. You can teach them to hate the things you hate and they practically raise themselves now-a-days, you know, with the internet and all
Join Date: Jan 2005
Location: Denmark
Posts: 199
   |
You can use urls in the robots.txt just folders within your root. Seacrh at google for robots.txt just at the first result page you will find some very good explanations how to use the robots.txt
|
|
|
|
|
2007-02-22, 02:28 PM
|
#3 |
|
My wife is not a doobie to be passed around! On our wedding day I promised to bogart her for life!
Join Date: Jun 2006
Location: Bay Area,Ca
Posts: 276
|
Thanks, I was reading that I have my robot.txt file the same place where my pages are for my site. Thats, the root right?
I read some postings a while back about placing subfolders in your image folder is that correct? I have all my images in the image folder,but now my sites a little bigger, its a mess. Its hard to have to scroll though all my images. |
|
|
|
|
2007-02-22, 02:36 PM
|
#4 |
|
Kids are great, Appu. You can teach them to hate the things you hate and they practically raise themselves now-a-days, you know, with the internet and all
Join Date: Jan 2005
Location: Denmark
Posts: 199
|
I just noticed I have forgotten to type some important info, I do not mean You can user I mean You can't use
 small mistake, but important oneAnyhow, yes, the robot.txt file must be in the root of your server, means there where usually the main and first index.html appears. No clue what do you mean reagrding the image folder, as images could be placed in any folder under the root folder.... |
|
|
|
|
2007-02-22, 02:51 PM
|
#5 |
|
My wife is not a doobie to be passed around! On our wedding day I promised to bogart her for life!
Join Date: Jun 2006
Location: Bay Area,Ca
Posts: 276
|
O wow I didnt know that you could place images in any folder, I thought it had to be in the "images" folder like your home page must be titled "index" so I guess that anwsers my question.
Robot.txt Seems to be set up right. I read the article you were referring too just now. I can access it from http://www.myurl.com/robots.txt I guess it just takes a few times for the report to go through on google webmaster tools. I have noticed just recently it will not report a new craw of my site until about 3-4 days after the fact. |
|
|
|
|
2007-02-22, 03:07 PM
|
#6 |
|
The Original Greenguy (Est'd 1996) & AVN HOF Member - I Crop Pics For Thumbs In My Sleep
Join Date: Feb 2003
Location: Blasdell, NY (shithole suburb south of Buffalo)
Posts: 41,929
|
If you remove a page & it's showing up as a legit 404 or 403, you can remove the link thru Google's URL Removal Tool & that will get it off the list of bad links/pages in their webmaster area (usually takes 2-4 weeks)
|
|
|
|
|
2007-02-22, 07:02 PM
|
#7 |
|
My wife is not a doobie to be passed around! On our wedding day I promised to bogart her for life!
Join Date: Jun 2006
Location: Bay Area,Ca
Posts: 276
|
Thanks Greenie,
I am working on being more organized. wow 2-4 weeks seems like a long time. |
|
|
|
|
2007-02-23, 12:15 AM
|
#8 |
|
The Original Greenguy (Est'd 1996) & AVN HOF Member - I Crop Pics For Thumbs In My Sleep
Join Date: Feb 2003
Location: Blasdell, NY (shithole suburb south of Buffalo)
Posts: 41,929
|
Google does have a lot of links
 |
|
|
|
 |
|
|
Linear Mode
