Skip to content

Latest commit

 

History

History
34 lines (24 loc) · 1.24 KB

htmlLimitedBots.mdx

File metadata and controls

34 lines (24 loc) · 1.24 KB
title description
htmlLimitedBots
Specify a list of user agents that should receive blocking metadata.

The htmlLimitedBots config allows you to specify a list of user agents that should receive blocking metadata instead of streaming metadata.

import type { NextConfig } from 'next'

const config: NextConfig = {
  htmlLimitedBots: 'MySpecialBot|MyAnotherSpecialBot|SimpleCrawler',
}

export default config
module.exports = {
  htmlLimitedBots: 'MySpecialBot|MyAnotherSpecialBot|SimpleCrawler',
}

Default list

Next.js includes a default list of HTML limited bots.

Specifying a htmlLimitedBots config will override the Next.js' default list, allowing you full control over what user agents should opt into this behavior. However, this is advanced behavior, and the default should be sufficient for most cases.

Version History

Version Changes
15.2.0 htmlLimitedBots option introduced.