The robots.txt file is utilised to limit search engine crawlers from accessing sections of your site. Even though the file is extremely beneficial, It is also an easy method to inadvertently block crawlers. How well-known/dependable/authoritative are the basis domains that happen to be linking to the internet site? If https://www.youtube.com/watch?v=EVeTP0aV8gY