# Domain:[www.ancestry.mx] # # This file should reside in the root directory ancestry.XX/robots.txt # # Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for all bots # Disallow: disallow if directive matches first part of requested path # User-agent: * Disallow: /search/searchwidget.aspx Disallow: /browse/bookview.aspx Disallow: /Browse/BookView.aspx Disallow: /Browse/bookview.aspx Disallow: /Browse/print_b.aspx Disallow: /browse/print_b.aspx Disallow: /browse/print_u.aspx Disallow: /Browse/print_u.aspx Disallow: /browse/save_u.aspx Disallow: /Browse/save_u.aspx Disallow: /browse/view.aspx Disallow: /Browse/view.aspx Disallow: /iexec?htx=View Disallow: /iexec?htx=view Disallow: /iexec/?htx=View Disallow: /iexec/?htx=view Disallow: /iexec/Default.aspx?htx=view Disallow: /iexec/Default.aspx?htx=View Disallow: /promo/* Disallow: /security/* Disallow: /cs/standards/* Disallow: /HomeRedirect.aspx* ## Robots.txt additions - formerly on secure subdomain. Added for post migration ## and subdomain consolidation. User-agent: sogou spider Disallow: /secure/ User-agent: * Allow: /secure/Subscribe/Gift Disallow: /secure/register/* Disallow: /secure/security/forgotpassword.aspx Disallow: /secure/register/guestregistration.aspx Disallow: /secure/subscribe/controls/thawte.html ##Additional exclusion for one-off page that should not be served or displayed in ##search User-agent: * Disallow: /secure/FamilySearch/ReviewNgTemplate ##Robots.txt additions - trees migration User-agent: * Disallow: /family-tree/Frozone/AJAX/Command.ashx Disallow: /family-tree/pt/person.aspx Disallow: /family-tree/owt/altparent.aspx Disallow: /family-tree/*/mergefamilyupdate* ##Robots.txt updates for Merlin migration User-agent: * Disallow: /wiz