Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Where can I get real good unlimited XML sitemaps and imagessitemaps (from a generator) for DNNWhere can I get real good unlimited XML sitemaps and imagessitemaps (from a generator) for DNN
Previous
 
Next
New Post
1/28/2016 3:04 AM
 
Tony Henrich wrote:

Maybe you have pages which are standalone and have no links them from anywhere on your site.

 

Thanks! I always thought web spiders (indexing robots) generated all possible URL strings, like a password cracker? And see if they can find a corresponding web page? Must be done though with huge data centers and millions of computers.  
 
New Post
1/28/2016 4:35 AM
 
That's not how they work. In principle the spider starts with url. It reads that page and looks for links. It then pulls down all those pages and looks for more links. That way the spider eventually finds every page on the entire internet so long as there is some chain of links back to its original start page.

The converse is that if a page is not linked to a part of the internet the spider knows about then it can never be found! (At least not by this technique.)

IMO the only reasons to 'submit a site to google (et al) are a) there are no external links to it b) you believe that submitting it will get it picked up faster than the natural crawl process

IMO the only reasons to have a site map are a) your site does not link all of its pages (Tony's point above) b) you believe that site maps are picked up quicker than the natural links process

Best wishes,
- Richard
Agile Development Consultant, Practitioner, and Trainer
www.dynamisys.co.uk
 
Previous
 
Next
HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Where can I get real good unlimited XML sitemaps and imagessitemaps (from a generator) for DNNWhere can I get real good unlimited XML sitemaps and imagessitemaps (from a generator) for DNN


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out