Posted: August 07, 2019 at 11:14 AM Quote #243382
i have checked the robots.txt file following directories are still in disallowed

how it is crawled...?

google recomends to set meta tag as " <meta name="robots" content="noindex">
where to find these files ?

URL  Last crawled  05-Aug-19  05-Aug-19  05-Aug-19  05-Aug-19  05-Aug-19  05-Aug-19  05-Aug-19
This post/answer is useful
This post/answer is not useful

Please login or register
to vote for this post.

(click on this box to dismiss)