# Google Merchant Crawler

Since Google’s recent updates, issues may occur in the **Merchant Center** when processing product images.

Merchants may receive error messages stating that images cannot be processed, even though the image URLs are valid.

The reason: Google now requires that the **file extension of an image URL** (e.g., .jpg) must match the actual **Content-Type** returned by the server.

In smoxy, the URL path remains unchanged during **WebP/AVIF conversion**, but the actual image format is switched.

Additionally, Google has announced that the **AVIF format is no longer supported**.

As a result, Merchant Center may reject images if the file extension and Content-Type do not match.

## Solution in smoxy

To ensure that Google crawlers always receive the correct format, you need to create a **Conditional Rule** in smoxy that disables image conversion for the affected Google crawlers.

### Create a new rule

1. Log in to smoxy hub and go to the desired Site
2. Navigate to Conditional Rules and click Add conditional rule<br>

   <figure><img src="https://3000458937-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FNMHyPzupwEpnnrhQdgfe%2Fuploads%2F8b4u0bsV4QrLotPlKOTC%2FBildschirmfoto%202025-08-26%20um%2011.24.24.png?alt=media&#x26;token=daff4591-b747-4e7c-8833-b0d24f49ea74" alt=""><figcaption></figcaption></figure>
3. Use a clear name, for example:

   Disable AVIF/WebP for Google Crawler
4. Add conditions (OR logic):

   * User-Agent contains Storebot-Google
   * User-Agent contains GoogleOther
   * User-Agent contains Googlebot-Image

   <figure><img src="https://3000458937-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FNMHyPzupwEpnnrhQdgfe%2Fuploads%2FJTlFKYuhxZsphBKvatWP%2FBildschirmfoto%202025-08-28%20um%2009.12.51.png?alt=media&#x26;token=87af08dc-5909-482f-a67e-958a97d0505f" alt=""><figcaption></figcaption></figure>
5. Add settings\
   Next, add the two settings `Convert to AVIF` and `Convert to WebP` and make sure both toggles are disabled. This overrides the conversion rules in smoxy for these two User-Agents only.

<figure><img src="https://3000458937-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FNMHyPzupwEpnnrhQdgfe%2Fuploads%2FXmHWHTLfERThxOPzFpqs%2FBildschirmfoto%202025-08-26%20um%2011.27.13.png?alt=media&#x26;token=a6c4be1d-1ff9-4b4f-9a60-05400fa9f26d" alt=""><figcaption></figcaption></figure>

1. Create and activate the rule

## Background: What did Google change?

* **AVIF support removed:** Images in the AVIF format are no longer accepted by Google Merchant Center.
* **Stricter validation of file extension and Content-Type:** If a URL ends with .jpg, it must return Content-Type: image/jpeg.

  Any mismatch (e.g., .jpg URL → image/webp) will result in image processing errors.

### Sources

* Google crawler documentation (including GoogleOther & Storebot-Google):

  [developers.google.com – Common Crawlers](https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers?hl=en#user_agent_version)
* Merchant Center image specification:

  [support.google.com – Product data requirements](https://support.google.com/merchants/answer/6324350#Format)

## Note on other CDNs

This is **not a smoxy-specific issue**, but a general change in Google’s Merchant Center behavior.

If you are using **additional CDNs or image optimization services** (e.g., **Cloudflare**, **BunnyCDN**, **Cloudinary**, **Akamai**), you must also disable conversion to **WebP** or **AVIF** there.

Otherwise, Google may still receive the wrong format and reject images — even if the correct rule is already configured in smoxy.