---
metadata:
  - name: generator
    content: Diplodoc Platform v5.54.2
alternate:
  - https://yandex.com.tr/support/webmaster/en/adding-site/indexing-prohibition.md
  - https://yandex.com.tr/support/webmaster/tr/adding-site/indexing-prohibition.md
  - href: en/adding-site/indexing-prohibition.md
    type: text/markdown
    title: Markdown version
  - href: ../llms.txt
    type: text/markdown
    title: llms.txt
---
> **Documentation Index:** Fetch the complete configuration index at https://yandex.com.tr/support/webmaster/en/llms.txt


# How do I prohibit indexing of the site or pages?

You can use the `robots.txt` file, HTML markup or authorization on the site to hide the site content from indexing.

## Prohibit indexing of a website, section, or a page {#full-site}

If some pages or sections of the site shouldn't be indexed (for example, the ones that contain technical or confidential information), use the following methods to restrict access to them:

- In the `robots.txt` file, specify the [Disallow](https://yandex.com.tr/support/webmaster/en/robot-workings/allow-disallow.md) directive.
- Specify the `robots` meta tag with the `noindex` or `none` directive in the HTML code of the site pages. To learn more, see [Configuring the rules for loading and indexing pages](https://yandex.com.tr/support/webmaster/en/controlling-robot/metatags.md#meta-robots).
- Use authorization on the site. We recommend this method to hide the home page from indexing. If the home page is prohibited in the `robots.txt` file but there are links leading to it from other sites, the page can be included in the search results.
    
    {% note info %}
    
    To prevent unauthorized users from accessing restricted pages, configure the server’s HTTP response code for such pages to 404 Not Found, 403 Forbidden, or 410 Gone.
    
    {% endnote %}
    

## Prohibit indexing of part of the page text {#content}

There are several ways to hide part of the text from indexing:

- Add the `noindex` element in the HTML code of the page. For example:
    
    ```html
    <noindex>text that shouldn't be indexed</noindex>
    ```
    
    The element is not sensitive to nesting — it can be located anywhere in the HTML code of the page. If there is no closing tag on the page, the entire contents of the page is considered hidden. Don't create multiple nested `noindex` tags because markup will ignore everything after the first closing tag.
    
    You can use the tag in the following format if necessary for making the site code [valid](http://validator.w3.org/):
    
    ```html
    <!--noindex-->text that should not be indexed<!--/noindex-->
    ```
    
- Add the `noscript` element in the HTML code of the page. For example:
    
    ```html
    <noscript>text that shouldn't be indexed</noscript>
    ```
    
    The `noscript` element, just like `noindex`, prohibits indexing but hides the site's content from the user if their browser supports JavaScript.
    
    {% note info %}
    
    JavaScript is supported by all popular browsers if this feature is not specifically disabled by the user.
    
    {% endnote %}
    
    You can view the report on JavaScript support in [Yandex Metrica](https://yandex.com/support/metrica/technologies/javascript.html).
    

## Hide a link on a page from indexing {#link}


{% list tabs %}

- Hide certain types of links

  We recommend using the `rel` attribute. Attribute values indicate various link types, which help the search engine better recognize website contents.
  - `rel="ugc"`. Use it if there's a forum on your website or an opportunity for visitors to leave feedback and you aren't sure about the quality of links that they provide.
  - `rel="sponsored"`. Use it if the link is related to advertising or points to an ad placement or a placement under the terms and conditions of a partner program with another website.
  - `rel="nofollow"`. Use it to prevent the robot from following the link regardless of its type.
  
  You can combine multiple values. Example:
  
  ```html
  <a href="url" rel="nofollow,sponsored">link text</a>
  or
  <a href="url" rel="nofollow sponsored">link text</a>
  ```
  
  Values of the `rel` attribute are perceived by the robot as a recommendation to ignore the link.
  

- Hide all links on the page

  To hide all links on the page from indexing, in the HTML code of the page, specify the `robots` meta tag with the [nofollow](https://yandex.com.tr/support/webmaster/en/controlling-robot/metatags.md#sup) directive. The robot will not follow links when crawling the site, but it can find out about them from other sources. For example, on other pages or sites.

{% endlist %}


When using any of the listed instructions, the link can be processed by the robot and displayed in Yandex Webmaster as [internal](https://yandex.com.tr/support/webmaster/en/site-indexing/links-to-website.md) or [external](https://yandex.com.tr/support/webmaster/en/site-indexing/external-links.md). The display or absence of the link in Yandex Webmaster doesn't mean that the search algorithms take it into account.

### Learn more

- [How do I remove pages from the search?](https://yandex.com.tr/support/webmaster/en/yandex-indexing/removing-from-index.md)


<div class="cut-button">

{% cut "Contact support" %}




<div style="padding: 15px;
      margin: 10px 0;
      background: #FFFFFF;
      border-radius: 10px;
      border: 1px solid var(--yc-color-line-generic);">
  <iframe style="background: #FFFFFF;"
        height="700"
        width="100%"
        frameborder="0"
        src="https://forms.yandex.com.tr/surveys/2426/?&iframe=1&lang=tr">
  </iframe>
</div>


{% endcut %}

</div>


<!-- source: en/_includes/footer.md -->
<div width="100%" align="center" class="main-footer"> 
<br><br><br>
You can also go to 
<br><br>





[![](../_assets/logo/logo-pic.svg)](https://webmaster.yandex.com.tr/) [![](../_assets/logo/logo-en.svg)](https://webmaster.yandex.com.tr/)


</div>


<!-- source: en/_includes/styles/footer-style.md -->

<!-- endsource: en/_includes/styles/footer-style.md -->
<!-- endsource: en/_includes/footer.md -->

<!-- source: en/_includes/cut-button-style.md -->

<!-- endsource: en/_includes/cut-button-style.md -->

<!-- source: en/_includes/remove-3lvl-minitoc.md -->

<!-- endsource: en/_includes/remove-3lvl-minitoc.md -->