By default, most content in Drupal can be crawled by search engine bots and indexed (even if they don't have friendly urls or are assigned to any site menus).
If your site has the "Metatag" module installed, and your user role has sufficient permissions, you can prevent search engines from indexing individual pages.
To do so, while editing content, scroll down to the bottom of the edit form.
- Click on the "Meta tags" tab to reveal the available metatag settings (as demonstrated in the attached screenshot).
- Expand the "Advanced Tags" section.
- Check all checkboxes with "Prevent or Block search engines ...." as indicated in screenshot below.
- Be sure to click save after setting all the checkboxes.