• optional

    • SeoMetaRobots (optional)

    Owned by Marta Siewierska-Stańczak
    Last updated: Sept 07, 2023 by Dariusz Matoga
    3 min read

    https://github.com/magesuite/seo-meta-robots

    The module allows increased control over the robot's meta tag.

     

    Installation

    This module is optional.

    composer require "creativestyle/magesuite-seo-meta-robots" ^1.0.0

    Admin settings

    Admin settings can be found in Stores -> Configuration -> MageSuite -> SEO in Meta Robots tab.

    Name

    Value

    Comment

    Name

    Value

    Comment

    URL rules

     

    Described below

    NOINDEX on category pagination

    Yes/No

    Default value: No

    When enabled only first page of a category will have INDEX,FOLLOW robots tag. All others will receive NOINDEX,FOLLOW

    Make customer specific pages non-indexable

    Yes/No

    Default value: Yes

    When enabled all pages under URLs contains "checkout/*" and "customer/*" will receive NOINDEX,FOLLOW

    Noindex Url Params (comma separated)

     

    Set robots tag to noindex if URL contains above param

    URLs list

    Textarea must be filled with one rule per line of text using the following format:

    URL_EXPRESSION;ROBOTS_TAG

    Where:
    URL_EXPRESSION - URL expression that will be matched against the current site URL (see more in URLs matching section):
    ROBOTS_TAG - one of:

    • INDEX_FOLLOW

    • INDEX_NOFOLLOW

    • NOINDEX_FOLLOW

    • NOINDEX_NOFOLLOW

    Example textarea input:

    de_de/women.html*;NOINDEX_NOFOLLOW kontakt.html;INDEX_NOFOLLOW

    URLs matching

    When multiple rules can be matched to the current site, the URL value of the first one will be taken into account.

    URLs can contain an asterisk * sign that will be matched to any string, Examples of rules with expected results:

    Site Url

    Expression

    Will be matched

    Site Url

    Expression

    Will be matched

    de_de/women.html

    de_de/*

    Yes

    de_de/women.html

    de_de/man.html

    No

    de_de/women.html

    */women.html

    Yes

    de_de/women.html

    women.html

    No

    de_de/women.html

    de_de/women.html

    Yes

    Products, categories and CMS pages

    Products, categories and CMS page contains a new attribute that allows setting the value of the Robots Meta tag on them.
    It can be done while editing them in the admin panel in the Search Engine Optimization section of the edit form.

     

    Backend

    Customer-specific pages

    All customer-specific pages will have NOINDEX,NOFOLLOW, configuration for these pages can be done using a di.xml file. Example:

    Modules, Controllers and Actions

    Robot tags can also be set for whole modules, controllers or actions. It can be done using a di.xml file. Example:

     

    Frontend

    There is no frontend functionality for this module.