Gooruze

First VisitRegister with GooruzeLog in to Gooruze
 
   
 

anonymous
We had a few questions that we needed to get answers to in order to proceed with a plan for the SEO Site Map planning on our end.

In regards to the robots.txt file and it referencing the sitemap XML file, does anyone know if that reference needs to be an absolute path or does it need to be a relative path?

Also, the way our system works, all sites share a single robots.txt file, which is why this is important for us to understand. The path we take to get this implemented will be dependent on whether we can make this work using a single robots.txt file with absolute paths or not.

Thanks in advance
Know a little? Give an answerKnow a lot? Write an article Report
 
 

Answers

 
 

Re: XML Sitemaps

palbertus
Vote:

November 2007

Take care to have uptodate robots and sitemap files on your siteroot, and you may also use Google webmaster tools to check and optimise these files.

Here's an example of an robots.txt file :

# robots.txt for http:/www.yourdomain.com/

Sitemap: http://www.yourdomain.com/sitemap.xml

User-agent: *
Disallow:

User-agent: *
Disallow: /cgi-bin/
Disallow: /Scripts/
Disallow: /webalizer/

 --------------------------------------------------------------------------------------------
And an example of sitemap.xml (with absolute links !)
<?xml version="1.0" encoding="UTF-8"?>
<urlset
      xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
      xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
      xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
            http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">

<url>
  <loc>http://www.yourdomaincom/index.html</loc>
  <lastmod>2007-11-28T17:49:18+01:00</lastmod>
  <priority>1.0</priority>
  <changefreq>monthly</changefreq>
</url>
<url>
  <loc>http://www.yourdomain.com/fr/xxxx.html</loc>
  <lastmod>2007-02-28T00:00:00+01:00</lastmod>
  <priority>0.9</priority>
  <changefreq>monthly</changefreq>
</url>
<url>
  <loc>http://www.yourdomain.com/fr/xxxx.html</loc>
  <lastmod>2007-02-28T00:00:00+01:00</lastmod>
  <priority>0.8</priority>
  <changefreq>monthly</changefreq>
</url>
</urlset>
Reply Reply Report

Re: XML Sitemaps

BrianChappell
3.00 (Average) Vote: OK OK OK OK OK

November 2007

I always like to use absolute paths for everything on my website.

I dug this up

He explains he uses an absolute path.
Reply Reply Report

Re: XML Sitemaps

danlondon
2.00 (Poor) Vote: Neutral Neutral Neutral Neutral Neutral

November 2007

good find.
Reply Reply Report

Re: XML Sitemaps

Al-Scillitani
Vote:

November 2007

I do not know the answer for sure, so I woulld rather not guess.  However, this link to Google Sitemap and sitemaps.org instructions may help

http://googlewebmastercentral.blogspot.com/2007/04/whats-new-with-sitemapsorg.html

http://www.sitemaps.org/protocol.php

 

Reply Reply Report
 
 

Invite someone to Gooruze

Home | Read News | Post News | Read Articles | Write Articles | Q & A | Groups | Activity | Members | More

Privacy Policy | House Rules | About Us | Contact Us | House Blog | FAQ | Advertise With Us

© Copyright 2007 Gooruze ™ | Built by Market United