Google Warning: Indexed though blocked by robots.txt - Ecommerce Forums
Results 1 to 2 of 2

Thread: Google Warning: Indexed though blocked by robots.txt

  1. #1

    Google Warning: Indexed though blocked by robots.txt

    Anyone else get this notification warning about their robots.txt file? i have disallow: / on a number of urls but it seems that google is ignoring it. I remember years ago Marc helped everyone with their robots.txt file. Seems that Google now wants metatags instead: "Indexed, though blocked by robots.txt: The page was indexed, despite being blocked by robots.txt (Google always respects robots.txt, but this doesn't help if someone else links to it). This is marked as a warning because we're not sure if you intended to block the page from search results. If you do want to block this page,robots.txt is not the correct mechanism to avoid being indexed. To avoid being indexed you should either use 'noindex' or prohibit anonymous access to the page using auth. You can use the robots.txt tester to determine which rule is blocking this page. Because of the robots.txt, any snippet shown for the page will probably be sub-optimal. If you do not want to block this page, update your robots.txt file to unblock your page."

    Some examples of my affected files are:
    [COLOR=rgba(0, 0, 0, 0.87)]/reviewhelpful.asp?
    [/COLOR][COLOR=rgba(0, 0, 0, 0.87)]/ReviewsList.asp?
    [/COLOR][COLOR=rgba(0, 0, 0, 0.87)]/shoppingcart.asp
    [/COLOR][COLOR=rgba(0, 0, 0, 0.87)]/EmailaFriend.asp?

    Not sure what to do.
    Last edited by reigny; 03-13-2019 at 09:55 AM.

  2. #2
    have not seen this.... yet

Similar Threads

  1. New Google Search Console Warning about Robots.txt
    By Mike R in forum Site Performance
    Replies: 3
    Last Post: 08-08-2018, 10:23 AM
  2. Google PLA warning on images
    By Birdsafe in forum Ecommerce Industry
    Replies: 1
    Last Post: 06-30-2016, 11:39 AM
  3. Replies: 3
    Last Post: 08-25-2014, 11:16 AM
  4. Need Robots.txt help with Google Shopping
    By BabyBeauandBelle in forum Search Engine Optimization
    Replies: 15
    Last Post: 02-01-2014, 11:42 AM
  5. Number of pages indexed by google suddenly more than doubled!
    By dtran09 in forum Search Engine Optimization
    Replies: 6
    Last Post: 06-06-2013, 08:49 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •