Cool, Geek, Software

Google XML Sitemaps and WordPress Multisite

Update August 13th, 2011: I’ve switched over and am giving a new plugin a try. It’s called Better WordPress Google XML Sitemaps (with sitemapindex and Multi-site support) and so far so good.

What really convinced me to look at this one is that the guys at WP Engine added it to their Curated Plugins list. If they are giving this a try then that’s really all justification I need.

Update July 23rd, 2011: These instructions still work for the newer 3.2.5 version as well. While this simple modification is useful, I plan to switch the to the 4.0 beta.

Update: Arne has posted an early test version on the WordPress support forums here. At this stage it’s not yet ready for release. If you would like to test that version, you can support Arne’s effort by downloading and reporting any issues to him on that thread.

I’m lazy and have not yet tried the early release version. :-)

——————————————————–

WordPress 3.0′s Multisite feature is cool and useful. The Google (XML) Sitemaps Generator plugin is also cool and useful. Unfortunately Arne Brachhold’s excellent plugin does not work with multisite blogs.

If you activate the plugin on a multisite enabled WordPress install, you get this error message.

Which is a shame, but it did not take me a long time to find a work around. My setup is using multisite with sub-domains and with the Domain Mapping plugin. These instructions are for the 3.2.4 version of the plugin.

1. Modify the plugin

Edit the file wp-content/plugins/google-sitemap-generator/sitemap.php and comment out lines 53 to 58 to look like this

//Check for 3.0 multisite, NOT supported yet!
// if((defined('WP_ALLOW_MULTISITE') && WP_ALLOW_MULTISITE) || (function_exists('is_multisite') && is_multisite())) {
//      if(function_exists('is_super_admin') && is_super_admin()) {
//              add_action('admin_notices',  array('GoogleSitemapGeneratorLoader', 'AddMultisiteWarning'));
//      }
//
//      return;
// }

You can delete these lines, but I prefer to comment them out.  All this does is prevent the plugin from detecting the multisite setup and not becoming active.

2. Get your rewrite rules ready

In your blog’s .htaccess file add these lines above your WordPress rules

RewriteRule ^sitemap.xml sitemap-%{SERVER_NAME}.xml [L]
RewriteRule ^sitemap.xml.gz sitemap-%{SERVER_NAME}.xml.gz [L]

This will come in handy later.

3. Activate the plugin and set these options

Now on each of your sites in your WordPress network, activate the Google (XML) Sitemap plugin. Do not Network Activate it.

Now got to your XML-Sitemap options page and for “Location of your sitemap file” select Custom location.

In the custom location change your change the file name sitemap.xml to sitemap-yourblogservername.xml. My server name is blog.dembowski.net so I’m using sitemap-blog.dembowski.net.xml. Save the options.

Look in your WordPress installation’s root and check if you have sitemap.xml or sitemap.xml.gz. If you do then delete them both.

Now at the top of that options page, click on “rebuild the sitemap manually” and confirm that your new sitemap-yourblogservername.xml has been created.

4. Test and confirm that this worked

Now test two things. Start by pointing your browser to http://yourblogservername/sitemap.xml and then http://yourblogservername/sitemap-yourblogservername.xml. If you setup your .htaccess rewrite rules correctly, then both URLs should work.

Load up your WordPress generated robots.txt file via http://yourblogservername/robots.txt and look at the Sitemap line. Mine reads like this

User-agent: *
Disallow:

Sitemap: http://blog.dembowski.net/sitemap-blog.dembowski.net.xml.gz

I have that rewrite rule in case the default location for the sitemap is used.  When you load the sitemap via the normal location, the rewite rule sends it to the correct location. The second gziped sitemap URL is fine.

There should be no real sitemap.xml or sitemap.xml.gz files in your blog’s root directory. Instead, each sitemap file should have your virtual WordPress network names instead.

5. Rinse and repeat

Repeat this process for each site in your WordPress Network and you can continue to use this sitemap plugin. You will need to activate the plugin in each of your sites and change sitemap.xml to include the site name just as I outline in step 3.

6. The caveat

If this works for you, great! But if it doesn’t, please don’t bug Arne. If and when he makes his plugin multisite compatible, then it will be probably a better solution than this one. I’m not seeing any PHP errors or warning in my log files, but there may be reasons why this is not a good idea.

Also, when you modify your copy of a plugin in the WordPress plugin repository and that plugin is updated you will lose your edits from step 1 when you update the plugin.

In the meanwhile, I can continue to use this excellent plugin.

Standard

83 thoughts on “Google XML Sitemaps and WordPress Multisite

  1. Hello and thanks for this wonderful tutorial. Can you please tell me how to use this plugin with multisite @ directory. I’m not using it @ sub-domain. hence, the above re-write rules are not working.

    • Abhinav,

      You are entirely welcome.

      I have not tried a directory install, and that sounds like a tough one.

      Each blog in it’s own directory would use the same sitemap. What you would need is a combined sitemap for each of your sites i.e. http://yoursite.com/blog1/ http://yoursite.com/blog2/ etc.

      I don’t think there is a graceful work around for a directory based site with this plugin. It would need Arne to recode it and make it multisite aware.

      Before I fixed this problem with my installation, I was successfully using this plugin:

      http://wordpress.org/extend/plugins/xml-sitemap-feed/

      I preferred Arne’s plugin but that one worked as well. Give it a try, from the documentation it looks like it may work.

      Good luck.

        • It’s odd! But I can click the link and go to the right page. AND, this site is mainly in Chinese but it’s hosted in U.S. with a free host plan. Maybe FREE is the reason.
          Anyway, that’s not important because the rules is here and anyone can see it.

      • I found the problem.

        Occasionally, this link could not be opened right because I use WPSC to cache the page and compression functionally is enabled. Sometimes, the .gz file is not handled properly. Sorry for that!
        But you could just use the code I provide above.

  2. Alan says:

    This worked perfectly. Thank you, you have saved me so much time and I was getting a headache trying to find a plugin that could do this.

    I hope Arne can get his plugin updated soon, but for now this is just what I needed.

    Thanks Again

    • Jan Dembowski says:

      You’re welcome.

      Thinking about Abhinav’s problem re directory multisite, blanket multisite support maybe problematic.

      Subdomain multisite should be a quick check and adjustment, but there may be more to it than I am aware of.

  3. Jan,

    Thank you for posting this!

    Had to play around with the subdomain url because I’m on cloud servers but aside from that your instructions are excellent and the plugin works flawlessly.

    Cheers!

    JAG

  4. Pingback: Google XML Sitemaps与WordPress 多站点(Multisite) « 不存在的空间

  5. Pingback: WordPress 3.0 multisite: cómo instalarlo (I)

  6. Pingback: WordPress 3.0 multisite: cómo instalarlo (I) « GermanJose

  7. Pingback: Soluzione compatibilità di Google XML Sitemap con Wordpress Multi sito | Solo Wordpress

  8. Jan, thanks a lot! It’s realy works!
    I made it on my web(multi)site, and it works correctly. Any php errors or other bugs.

    Thanks again!

  9. Pingback: Google XML Sitemaps pour Wordpress 3, Wp-Mu et BuddyPress | Blog SEO & Référencement, himselfprod

  10. Pingback: Google XML Sitemaps+wordpress3.0 | エゾスタイル

  11. Oliver says:

    There is a more elegant way for networks. You can activate the plugin for network and edit the function GetXmlPath in sitemap-core.php

    	function GetXmlPath($forceAuto=false) {
    		if(!$forceAuto && $this->GetOption("b_location_mode")=="manual") {
    			$xml_path = $this->GetOption("b_filename_manual");
    		} else {
    			$xml_path = $this->GetHomePath()  . $this->GetOption("b_filename");
    		}
    		if((defined('WP_ALLOW_MULTISITE') && WP_ALLOW_MULTISITE) || (function_exists('is_multisite') && is_multisite())) {
    			return str_replace('sitemap.xml', 'sitemaps/sitemap.'.$_SERVER['HTTP_HOST'].'.xml', $xml_path);
    		}
    		return $xml_path;
    	}
    

    Create a directory in your root path called “sitemaps” and chmod it to 777. Add this to your .htaccess:

    RewriteRule ^sitemap.xml sitemaps/sitemap.%{SERVER_NAME}.xml [L]
    RewriteRule ^sitemap.xml.gz sitemaps/sitemap.%{SERVER_NAME}.xml.gz [L]
    

    Thats it! The sitemaps will be generated in the sitemap directory.

    • Jan Dembowski says:

      Oliver,

      That is a better way to do it and I considered making those changes.

      However, my PHP is less than reliable so I kept it as simple for me as I could. Hopefully Arne’s solution will be more elegant than my hack. :-)

    • Ivan says:

      Error loading stylesheet: An unknown error has occurred (805303f4)http://www.mysite.net/wp-content/plugins/google-sitemap-generator/sitemap.xsl

      i did all like you described and still getting errors while creating sitemap for my subdomains?!?!

      • Ivan,

        It should work. Try loading the sitemap.xsl file directly and see if there is some problem with retrieving that file. You may see an error in your web server’s error_log file.

        • Ivan says:

          i can load sitemap.xsl just fine, i can even access to rootdomain sitemap the only problem is when i try to access to subdomain’s sitemap

    • Hi Oliver,
      Have you tried those changes yourself.When I activate plugin for network the error message pops up as said in this article.
      “Google XML Sitemaps is not multisite compatible.
      Unfortunately the Google XML Sitemaps plugin was not tested with the multisite feature of WordPress 3.0 yet. The plugin will not be active until you disable the multisite mode. Otherwise go to active plugins and deactivate the Google XML Sitemaps plugin to make this message disappear.”

      So it seems plugin can’t me made active using network activate mode.

      • Anjan,

        The changes Oliver discussed were for after the multi-site check was disabled.

        You still need to comment out the checks from lines 53 to 58 at the top of this blog post.

  12. Pingback: Google XML Sitemaps Plugin unter Wordpress 3 Multisite nutzen - wp-contentpluginsgoogle-sitemap-generator , sitemapphp , htaccess, Sitemap - Servervoice der Technik Blog

  13. Pingback: マルチサイトでGoogle (XML) Sitemaps Generator for WordPressを使う » サイトのブログ

  14. NTB says:

    I think that the .htaccess rewrite rule should be more strict

    With your example the url for sitemap.xml.gz is redirected to to sitemap.xml

    I suggest using:

    RewriteRule ^sitemap.xml$ sitemaps/sitemap.%{SERVER_NAME}.xml [L]
    RewriteRule ^sitemap.xml.gz$ sitemaps/sitemap.%{SERVER_NAME}.xml.gz [L]
    
    • NTB,

      The inclusion of the EOL $ character is not a bad idea, and does make it a more specific match in the rewrite rules. I left it as is because it works for me.

      Also I prefer to have the sitemaps in the blog root directory. Just my preference, I’m sure you’ll set it as you see fit.

  15. Pingback: Google XML Sitemaps plugin on multi-blog by wordpress 3.0 » labs.daruyanagi.net

  16. Hello, thks for the great hack.

    After the process, I had both sitemaps, the old and the new one.

    After delete the oldest, I check my robots.txt, as you sugested, but I only have “User-agent: *” and “Disallow:” terms. Should it have too a “new sitemap path”, havent it?

    I made a .htacess hack putting the RewriteRule above de # BEGIN WordPress line. Sorry for may poor php skill :-)

    Thks again.
    Alexandre

  17. Jan -

    What do you do if you’ve got the multisite blog installed in the root directory? There is no directory for the main blog so what would you use for the $1 variable?

    • Here’s a follow up question – what if you’re using another sitemap generator for the rest of your site which also leaves a sitemap.xml file in the root directory? It needs to be placed in another subdirectory and that would probably be a prudent measure unless you only run wordpress on your domain.

      • Michael,

        What do you do if you’ve got the multisite blog installed in the root directory?

        I think you’ve lost me there.

        This is a simple solution for using Arne’s plugin for with a multisite install using sub-domains. A sub-domain install is supposed to be in the root directory.

        Even if you don’t have an active blog at your-root.com you will have blog1.your-root.com, blog2.your-root.com, etc.

        The rewrite rule will make sure that is the default blog1.your-root.com/sitemap.xml, blog2.your-root.com/sitemap.xml, etc. will serve the correct sitemap for the correct blog.

        what if you’re using another sitemap generator for the rest of your site which also leaves a sitemap.xml file in the root directory?

        You could put the sitemap.xml somewhere else and delete the sitemap rewite rules.

  18. Pingback: WordPress 3.0 Multisite – tips&tweaks | WP Tuts

  19. OJ says:

    Hi,
    What do you do with the old sitemap you have submitted under Google’s webmaster’s tool? Do you delete it or what?

    Now I have two, the old one and the newly created after making your modifications. Is this going to affect my index or perhaps, my ranking?

    Thanks :)

    • I just checked my Google Webmaster tools for this site and the other in my WordPress network. I’m still getting crawled and my indexing doesn’t seem to have changed. Nice to see that the rewrite rules are working. :-)

      I don’t think you’ll suffer any penalty with Google. Since I’ve done this I still get the same amount of traffic.

  20. Pingback: Wordpress Multisite con sudominios en hosting compartido | Prog man in a prog world

  21. Pingback: Google Sitemap Generator y WordPress 3.0 Multisite

  22. Pingback: Google Sitemap Generator y WordPress 3.0 Multisite | Todo bit

  23. Thanks for this great tutorial.

    It’s even more elegant, to create a subdirectory for each set of sitemaps.
    So the RewriteRules would look like:

    RewriteRule ^sitemap.xml.gz sitemaps/%{SERVER_NAME}/sitemap.xml.gz [L]
    RewriteRule ^sitemap.xml sitemaps/%{SERVER_NAME}/sitemap.xml [L]

    As mentioned before in exact this order, gz first, then the one without. Otherwise the first rule catches them all.

    The third step is spare to edit for each blog, if you replace the following into sitemap-core.php in function GetXmlPath, line 1386:

    			return $this->GetHomePath()  . $this->GetOption("b_filename");
    

    with this:

    			$dir = $this->GetHomePath() . 'sitemaps/'.trailingslashit($_SERVER['HTTP_HOST']);
    			if(!file_exists($dir)) {
    				mkdir($dir);
    				clearstatcache();
    				sleep(1);
    			}
    			return $dir . $this->GetOption("b_filename");
    

    This will automatically create a subdir for each blog containing the sitemaps therefor.

    Step 4 is also spare, if you don’t use a physical robots.txt, but the WordPress virtual one instead. You only need to check “Add the sitemap to the virtual robots.txt” in the XML Sitemap options and are done with your hand work.

    • Markus,

      I’m glad you liked the post. I’ve added some formatting to your comment so that readers can see more clearly what you are refering to.

      Your edits would have been a more elegant solution: fortunately Arne is working on a version of his plugin that visualizes the sitemap.xml files.

      No more real files, it’s a more dynamic solution. Of course, this may mean more CPU time but I’m confident that the next release will be worth the wait.

  24. Pingback: Delicious Bookmarks for September 3rd through September 4th « Lâmôlabs

  25. Pingback: Google XML Sitemap plugin on multi-blog by wordpress 3.0 » daruyanagi.net

  26. Robert says:

    Thanks for the tutorial. I also use a subdomain network with domain mapping, but the generated xml file has the original domain in the tags instead of the mapped domain. For example:

    Network: network.com
    Site: site.network.com
    http://www.betterdomain.com is mapped to site.network.com

    In the generated sitemap I’m getting this:

      http://site.network.com/
      2010-10-04T12:21:55+00:00
      daily
      1.0
    

    I need it to be this instead:

      http://www.betterdomain.com/
      2010-10-04T12:21:55+00:00
      daily
      1.0
    

    Any ideas? Thanks.

      • I think either the .htaccess rules are not working (and you are getting a different file than you intended) or the domain mapping is not setup correctly.

        When the sitemap.xml is generated, does it actually create a file called sitemap-www.betterdomain.com.xml?

      • Robert says:

        Thanks for the response. Yes, when the files are generated they use the correct names I assigned in the respective “Custom location” sections, and they are including all the correct url entries. The only problem is the loc tags in each url entry include the original domain instead of the mapped primary domain. (I didn’t specify earlier, but in my example the “www.betterdomain.com” is set to be the Primary domain.)

        As for domain mapping, the site is working correctly. i.e., I am able to access my site from either domain with it redirecting to the primary domain.

        What should I do so that the Primary domain is used in the url entries of the xml file?

      • Since I’m lazy to make all the changes, I finally decided to try out the beta version from Arne at the post you mentioned. Lastest version was 4.0b2 released two days ago. Unfortunately it doesn’t seem to work with subdomains. I’m waiting for Arne’s reponse now. If it turns out to be true, I’ll have to go for the difficult way in your post, it isn’t too hard to follow though, since you explained everything clearly enough.

  27. Pingback: サブドメイン運用のGoogle XML Sitemapsプラグインのマルチサイト対応方法 - web.londoner25.net

  28. Felix says:

    hello, i followed the steps, but i found that all sub-directory blog share the same site.
    Am i doing something wrong?
    Anyone can help?

    Thanks,
    Felix

  29. I went through all the steps, got the same robot.txt file that you got with the gz on the end, but my links to test it still don’t work with or without the gz on the end.

    Any idea what I could have done wrong?

    I’m not getting the incompatibility error message anymore on my dashboard for the plugin. It appears that my sitemap was manually rebuilt successfully.

    I have my custom locations set as follows:
    /home/digang/public_html/angeladigiovanni.com/sitemap.xml
    http://angeladigiovanni.com/sitemap-angeladigiovanni.com.xml

    I commented out the lines in the plugin file with /* */.

    I put my rewrite rules in the .htaccess file at the top, looking like this:

    RewriteRule ^sitemap.xml sitemap-%{SERVER_NAME}.xml [L]
    RewriteRule ^sitemap.xml.gz sitemap-%{SERVER_NAME}.xml.gz [L]
    
    RewriteEngine On
    RewriteBase /
    
    RewriteRule ^index\.php$ - [L]
    
    # uploaded files
    RewriteRule ^files/(.+) wp-includes/ms-files.php?file=$1 [L]
    
    RewriteCond %{REQUEST_FILENAME} -f [OR]
    RewriteCond %{REQUEST_FILENAME} -d
    RewriteRule ^ - [L]
    RewriteRule . index.php [L]
    
    

    Yet I can’t get those test links to work.

    Any thoughts?

    Thanks in advance!
    Angela

    • Angela,

      That looks like that should work, but when I visit your web site I also get a ’404 Page not found’ error.

      Try something: copy the sitemap-angeladigiovanni.com.xml to test.xml and see if you can load that in your web browser.

  30. Pingback: The Great WordPress Multisite Experiment of 2011 | Oikos

  31. Pingback: The Great WordPress Multisite Experiment of 2011 | Oikos

  32. Pingback: » WP3.0のマルチサイトでGoogleXMLSitemapプラグインを使う

  33. We were not able to find a plugin for XMS sitemap after we upgraded to the WP Multisite functionality.

    We patiently followed all the steps mentioned here and this tutorial finally did the trick for us.

    It was very helpful.

  34. I followed all the step but still can’t get it to work. I am sure it is me. Are there any other oprion or other plugins for multi site WP sitemaps?

    Thanks in advance – John

  35. asma says:

    every thing is working fine but look the sitemap is not working without full domain name (www) fun portal

    and working fine with fun portal

    now plz tell me that how can i view my sitemap with both urls with (www) and without (www)

    my google webmaster tool is not accepting my sitemap becoz i add my domian there without (www)

    • That’s a tough one. This trick depends on you modifying your .htaccess file as well as having your Apache virtual servers setup correctly. It sounds as if that second part is not correct.

      The only advice I can offer is to consider switching to another Sitemap plugin. The one I’ve put into the update on top just works without any changes or .htaccess updates.

  36. Pingback: 在wordpress mu中使用Google XML Sitemaps - ORZ部落閣

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>