To do so, you need to enter your wp-admin<\/a>. By now, you probably are more than familiar with the WordPress Admin Panel.<\/p>\n Now that you are in the Admin Panel, go to Settings<\/strong> – > Reading<\/strong>.<\/p>\n At the bottom of the page, you\u2019ll see an option, saying “Search Engine Visibility”<\/strong>. On the right, there is a checkbox, followed by “Discourage search engine from indexing this site<\/strong>“.<\/p>\n If you want to make sure, you are visible to Google, you first need to make sure that the box is not <\/strong>checked.<\/p>\n <\/p>\n Robots.txt is a file that webmasters create to communicate with web crawlers. Although this file communicates with other web robots, not only with crawlers, for now we\u2019ll focus on its function to interact with search engines.<\/p>\n The file is really straightforward and comprehensible. You can see it, the way the crawlers are seeing it, by entering https:\/\/yoursite.com\/robots.txt<\/em>. But in order to edit it, of course, you\u2019ll have to access your website\u2019s files.<\/p>\n The robots.txt <\/strong>file has the following elements:<\/p>\n User-Agent:<\/strong><\/p>\n This element is, in a way, talks directly to a specific bot, or to all of them, at once. If you want to Allow or Disallow only Google\u2019s Web Crawler to visit a specific page or your website as a whole, you need to address the bot directly.<\/p>\n Meaning, in your robots.txt <\/strong>file, you\u2019ll have to start with:<\/p>\n User-Agent: Googlebot<\/em><\/strong><\/p>\n <\/p>\n <\/p>\n After you\u2019ve given the restrictions and rights to this bot, you can again write User-Agent and give other limits to the Bingbot. But you also can address all of the web bots simultaneously, by simply writing an * in the place of the name of the specific bot.<\/p>\n User-Agent<\/strong>: *<\/p>\n Allow<\/strong>:<\/p>\n When allowing, you can yet again write the name of the specific page, or just put an asterisk (*), thus allowing the specified bot (or all of them at once) to crawl wherever they want.<\/p>\n Disallow<\/strong>:<\/p>\n I hope, you\u2019ve taken care of your cybersecurity<\/a> by using a strong password<\/a>. Yet, I would highly recommend you to disallow bots to crawl your wp-admin page, or other admin panel entering the page, if you are using another CMS. This is for security.<\/p>\n Still, you may want some pages to stay hidden from the crawlers. To achieve that, you should just write their URLs after Disallow. Bear in mind, that you should do this one page at a time.<\/p>\n Disallow: \/page1\/<\/p>\n Disallow: \/page2\/<\/p>\n And so on.<\/p>\n Sitemap:\u00a0<\/strong>A sitemap is another file, it helps web crawlers to understand the structure of your website. Thus, makes the crawling easier and no \u2018orphan pages\u2019 are left behind. In the robots.txt<\/strong> file, we are directing the web crawler to the sitemap, in order to facilitate their work.<\/p>\n <\/p>\n Google Search Console is merely a set of tools for webmasters that are allowing webmasters to perform a vast number of actions in order to facilitate Google\u2019s bot in his not-light endeavor of crawling the web.<\/p>\n Once you verify the ownership of your website(by adding an HTML file to your website\u2019s directory), you have the ability to:<\/p>\nRobots.txt<\/h2>\n
\n
![\"\"](\"\/wp-content\/uploads\/2018\/03\/wordpress2-e1549528440116.jpg\")
<\/p>\nGoogle Search Console<\/h2>\n
![\"\"](\"\/wp-content\/uploads\/2018\/03\/wordpress.jpg\")
<\/p>\n