Why is an online store on 1C-Bitrix not indexed?
If products or categories of an online store on 1C-Bitrix do not appear in Yandex and Google, first determine the scale of the problem. One URL may be closed with a meta tag, an entire section may be lost due to CNC or internal links, and thousands of cards may be considered duplicates due to filters, sorting, and sales offers.
It’s not worth starting with a massive rewrite of texts or re-submitting a sitemap. Indexing requires consistent verification: the search robot must receive the canonical URL with the code 200, see independent content on it, find the page using a regular link and not confuse it with dozens of technical copies.
Short answer: take one URL each for product, category, filter and pagination. For each, check the HTTP code,
robots.txt,meta robots, canonical, presence in the sitemap, internal links and status in Google Search Console and Yandex Webmaster. This way you can distinguish technical blocking from duplicates and insufficient page value.
This instruction responds to a problematic information request. If you need a complete analysis of the project, semantics and catalog templates, it refers to SEO audit of an online store on 1C-Bitrix.
First, determine what exactly is not indexed
Collect a sample of 10-20 addresses, rather than checking just the home page.
| URL type | Example | What the test helps you find |
|---|---|---|
| Category | /catalog/obuv/ |
Section accessibility, text, products and metadata template |
| Product card | /catalog/obuv/model-123/ |
Product status, canonical, trade offers and micro markup |
| Filter | /catalog/obuv/filter/color-is-black/apply/ |
Useful landing or technical take |
| Sorting | /catalog/obuv/?sort=price |
GET parameters and canonicalization |
| Pagination | /catalog/obuv/?PAGEN_1=2 |
Availability of products deeper than the first page |
| Old CNC | /catalog/old-section/product/ |
Redirect after structure change |
After sampling, divide the problem into one of the scenarios:
- The URL is not bypassed. The robot is blocking
robots.txt, authorization, WAF, CDN or server error. - The URL is crawled but excluded. Search sees
noindex, another canonical, redirect or double. - The URL is accessible but not indexed. The page is poorly differentiated from others, has no internal links or does not provide independent value.
- The URL was in the search and disappeared. The structure, template, canonical, product status or indexing rules have changed.
These scenarios require different fixes. Sitemap will not remove noindex, and the new text will not help the page that responds with the code 302 or indicates canonical to another category.
Reason 1. The page is blocked from being crawled or indexed
Check three independent levels:
- directives
Disallowfor Googlebot and Yandex inrobots.txt; <meta name="robots" content="noindex">in HTML;- title
X-Robots-Tagin the HTTP response.
Additionally, make sure that the directory is accessible without cookies, authorization, or running custom JavaScript. CDN or WAF can serve to a regular browser 200, and to the search robot - 403, captcha or simplified captcha.
For initial header checking, use:
curl -I https://example.ru/catalog/category/product/The command shows the response code, redirect and part of the service headers. It does not replace search engine tools: in Google use URL checking, in Yandex - “Page Indexing Analysis”. Yandex separately warns that technical accessibility does not guarantee the inclusion of a URL in the search.
A common mistake with filters
Sometimes the developer closes robots.txt all URLs with parameters, and then puts canonical or noindex. The robot cannot re-read the closed page and see these instructions. Therefore, first they draw up a map of parameters and decide which filters are needed in the search and which are technical.
Reason 2. Incorrect response codes and redirect chains
The product page should give 200 OK. Removed product - conscious 404/410, a relevant replacement or a saved card with a clear status. Can't be returned 200 for the “product not found” message: this is a soft 404.
Frequent errors of Bitrix projects:
- the component shows the error page, but the server leaves
200; - after changing the symbolic code, a chain of two or three redirects occurs;
- HTTP transitions to HTTPS via an intermediate address;
- URLs without a slash and with a slash open as different pages;
- the region parameter changes the address and creates several versions of one card;
- a non-existent section opens a generic directory template.
Make a table of old and new URLs. If the address is changed permanently, use one server 301 to the nearest relevant page. Do not redirect all removed products to the main page: this does not help the user and may be perceived as an irrelevant replacement.
Reason 3: Canonical is pointing to the wrong page
Canonical is a strong signal of preferred URL, but not an absolute command. Google and Yandex may choose a different address if the signals contradict each other.
For a canonical product card, the following must be performed simultaneously:
- page responds
200; rel="canonical"points to its primary absolute HTTPS address;- this address is in the sitemap;
- internal links lead to it;
- other versions do not receive stronger signals;
- the content of the canonical page is accessible to the robot.
Errors occur when a template puts one canonical on the entire section, does not take CNC into account, or takes the address from the request along with UTM tags. The other extreme is self-canonical on every sort and every parameter. This tag communicates that all technical copies are independent.
Do not direct all sales offer cards to a category. If an offer doesn't need to have its own page, it's best not to create an indexable URL for it. If a separate URL is needed, it must have distinct characteristics, accessibility, and user meaning.
Reason 4. Filters, sortings and parameters create duplicates
The online store quickly has thousands of combinations:
/catalog/chairs/?color=black
/catalog/chairs/?sort=price
/catalog/chairs/filter/color-is-black/apply/
/catalog/chairs/?utm_source=partnerNot every combination deserves a search page. The indexed filter must match real demand, show enough products, have a stable URL, and be usefully differentiated from the original category.
Working model:
| URL type | Solution |
|---|---|
| Category with independent demand | Index, add to sitemap and internal navigation |
| Selected SEO filter | Index by whitelist, set your own metadata and description |
| Sorting, list type, number of products | Do not count as a separate landing; consolidate signals |
| UTM and advertising parameters | Do not include in the sitemap, provide links within the site without tags |
| Empty filter combination | Do not index or add to internal navigation |
| Combination with one product without request | Typically not created as a search landing page |
Yandex reports duplicates and GET parameters in Webmaster. Google recommends that canonical, sitemap, and internal links be consistent. The solution cannot be built only on robots.txt: already found duplicates may remain in the index without the ability to re-read the canonical.
Reason 5: Products are only available through search or JavaScript
Google analyzes the connections between store pages. The category should lead to subcategories and cards with regular links <a href="...">. A robot typically does not enter a query into the search bar or click filters the same way as a user.
Problems arise when:
- cards are loaded only after an AJAX request;
- infinite scroll does not have separate pagination URLs;
- transition made by handler
onclick, andhrefabsent; - the mobile version hides part of the catalog and links;
- the product can only be found through internal search;
- the category exists in the sitemap, but no page leads to it.
Check the original or rendered HTML. Product links should be accessible without manual interaction. For an endless feed, keep the crawlable pagination even if the user sees the “Show more” button.
Reason 6. Sitemap contains the wrong addresses
A sitemap helps communicate preferred URLs, but does not guarantee indexing. The map should only contain pages that the site really wants to show up in search.
Check if:
- all urls respond
200without redirect; - canonical matches the address in the sitemap;
- no sorting, service parameters, search results and empty filters;
- no pages with
noindex; - a single HTTPS host is used;
- date
lastmodchanges only with a meaningful update; - individual catalog cards do not exceed the technical limitations of the format;
- Removed products are promptly excluded.
Resubmitting the same sitemap several times a day does not speed up indexing. Fix page signals first, then update lastmod and send important URLs for re-crawling.
Reason 7. Categories and cards are not different from each other
A technically accessible page may not be indexed if search does not see its own value.
Useful for the category:
- clear H1 and brief explanation of the assortment;
- products corresponding to the section title;
- available subcategories and selected filters;
- terms of delivery, payment or selection, if different;
- unique title and description;
- links to important child sections.
For a product card, the characteristics of a specific model, photographs, availability, options, compatibility, delivery, warranty and answers to selection questions are important. A copy of the manufacturer's description does not make the page unique just because the store's name is added to the title.
There is no need to write long SEO text for each product. It is more useful to fill out structured characteristics and provide information that helps make a decision.
Reason 8: SEO data templates are configured formally
1C-Bitrix allows you to set SEO data templates for sections and information block elements. This is convenient for a large catalog, but the wrong template scales the error to thousands of pages.
Check separately:
- browser title;
- description;
- H1 pages;
- alt and image title;
- inheriting values from a section;
- variables that can be empty;
- identical headings for offers of the same product;
- correspondence of the template to the actual content of the card.
Template Buy {=this.Name} does not solve the problem if dozens of sentences have the same name and differ only in a hidden property. First, define the search entity: model, category, brand series or specific offer.
Diagnostics in 60 minutes
Step 1: Collect control URLs
Take two categories, three products, one filter, one pagination and one remote address. Record the publication date and expected status of each URL.
Step 2: Check the server response
Look at the code, redirects and X-Robots-Tag. Repeat the check with the mobile User-Agent and, if possible, from the server logs for Googlebot and YandexBot.
Step 3: Check the HTML
Find robots, canonical, H1, title, description and links to cards. Make sure JavaScript doesn't replace canonical after loading.
Step 4. Check sitemap and internal links
The canonical URL must be in the sitemap and receive links from the category. Technical copies should not be used on menus, breadcrumbs or cards.
Step 5: Open search bars
In Google Search Console, look at the selected canonical, last crawl date, and rendered HTML. In Yandex Webmaster, check accessibility, excluded pages, duplicates and URL status.
Step 6. Compare the page with duplicates
Check the versions with and without slashes, HTTP/HTTPS, parameters, region, sorting, print version and sales offer URL.
Step 7: Assign one fix
Do not change robots, canonical, CNC and text at the same time. Assign a cause, fix it on a test set, test the result, and then scale the change.
Patch Matrix
| Symptom | Probable Cause | First action |
|---|---|---|
| "Blocked by robots.txt" | Path or parameter closed | Check the rule for a specific robot and URL |
| "Excluded by noindex tag" | Meta tag or HTTP header | Find source noindex in a template or component |
| Google chose another canonical | Conflicting signals or close take | Check canonical, sitemap and internal links |
| "Crawled but not indexed" | Duplicate, weak value or low priority | Compare content, links and demand, don't resend URLs blindly |
| In the sorting index instead of category | Technical URLs get more links | Fix internal links and canonicalization |
| Only the first page of a category is indexed | No crawlable pagination | Add separate URLs and regular links |
| Old products remain in search | Invalid status or sitemap | Select 301, 404/410 or save a useful card |
| New products don't arrive for a long time | No links or map updates | Add to category, sitemap and check lastmod |
What not to do
- Open all smart filter combinations for indexing.
- Close the entire directory in
robots.txtto remove multiple duplicates. - Place canonical of all products on the main page or category.
- Return
200for non-existent cards. - Send one URL to be crawled every day without changing the reason.
- Generate a unique title, leaving the same empty content.
- Change CNC without a card
301from old addresses. - Remove cards for temporarily unavailable products automatically.
When do you need a full Bitrix SEO audit?
A spot check is sufficient if the problem relates to one pattern and the cause is reproducible. A full audit is needed when:
- the index contains more technical URLs than products and categories;
- canonical depends on settings or region;
- after changing the CNC, part of the traffic was lost;
- the catalog consists of several information blocks and sources;
- exchange with 1C regularly creates, deletes or renames products;
- search bars show several different exclusion reasons;
- fixing one template can affect thousands of URLs.
In such a project, they first build a map of page types and indexing rules, then check the templates on a test sample. For evaluation you can use SEO consulting for 1C-Bitrix. If components, exchange or performance need to be improved, that's a task development and support on 1C-Bitrix.
Products or categories are not included in the search?
We'll check directory templates, canonicals, filters, sitemaps and internal links, then create a priority fix plan.
FAQ
Does a sitemap guarantee indexing of products?
No. The sitemap tells search the preferred URLs, but does not override noindex, response errors, duplicates and page quality assessment. Google explicitly calls a sitemap a hint, not a guarantee of indexing.
Do I need to index Bitrix smart filter pages?
Only selected combinations with independent demand, stable assortment and unique content. Sorts, empty combinations and technical parameters should not usually become separate landings.
Is it possible to put canonical all filters on a category?
For technical options, this is a possible part of the solution, but canonical must be consistent with internal links and sitemap. If the filter is an independent SEO page, canonical on the category will exclude it from competition for its own query.
Why is the card in the sitemap, but Google doesn’t index it?
Check the selected Google canonical, internal links, similarities to other cards, and actual content. Presence in the sitemap does not mean that the URL will be selected for display.
What to do with temporarily unavailable goods?
If the item returns and the page is useful, save 200, explain the status and suggest analogues. If a product is permanently deleted, select the relevant one 301 or correct 404/410 depending on the availability of a full replacement.
How quickly will the page return to search after correction?
There is no exact date. After the change, the search engine needs to crawl and process the URL again. An important page that has been corrected can be re-crawled, but the outcome depends on the frequency of crawls, page quality, and the consistency of site signals.
Does 1C-Bitrix as a CMS affect indexing?
A search engine does not rank a site higher or lower just because of the CMS. The result is affected by the final response codes, HTML, speed, duplicates, links and content. Bitrix features are important because they determine how these elements are formed in a specific project.
Useful on the topic
- SEO audit of an online store on 1C-Bitrix
- Development and support of websites on 1C-Bitrix
- 1C-Bitrix or WordPress: what to choose
- X-case online store case on 1C-Bitrix
- Case of transferring a corporate website to 1C-Bitrix
Sources
- Google Search Central: how to specify canonical
- Google Search Central: How to Create and Submit a Sitemap
- Google Search Central: online store structure
- Yandex Webmaster: page indexing analysis
- Yandex Webmaster: why duplicates are bad
- Yandex Webmaster: canonical page address
- 1C-Bitrix: setting up SEO data for the catalog
