# The Sacramento Bee content is made available for your personal, non-commercial # use subject to our Terms of Service here: # https://www.mcclatchy.com/terms-of-service # Use of any device, tool, or process designed to data mine or scrape the content # using automated means is prohibited without prior written permission from # The Sacramento Bee. Prohibited uses include but are not limited to: # (1) text and data mining activities # (2) the development of any software, machine learning, artificial intelligence (AI), # and/or large language models (LLMs); # (3) creating or providing archived or cached data sets containing our content to others; and/or # (4) any commercial purposes. # Global allow for Mediapartners - this is used by Google to place ads in content, # not indexing purposes. User-agent: Mediapartners-Google Disallow: # Throttles to decrease load User-agent: Yandex Crawl-delay: 3 User-agent: Baiduspider Crawl-delay: 3 User-agent: bingbot Crawl-delay: 2 User-agent: Slurp Crawl-delay: 2 User-agent: FacebookBot Crawl-delay: 3 # Story blocks for selected bots User-agent: anthropic-ai Disallow: /*.html User-agent: ChatGPT-User Disallow: /*.html User-agent: Claude-SearchBot Disallow: /*.html User-agent: Claude-Web Disallow: /*.html User-agent: ClaudeBot Disallow: /*.html User-agent: Google-Extended Disallow: /*.html User-agent: GPTBot Disallow: /*.html User-agent: OAI-SearchBot Disallow: /*.html User-agent: Perplexity-ai Disallow: /*.html User-agent: Perplexity-User Disallow: /*.html User-agent: PerplexityBot Disallow: /*.html User-agent: archive.org_bot Disallow: /*.html User-agent: ia_archiver Disallow: /*.html User-agent: ia_archiver-web.archive.org Disallow: /*.html # Complete blocks of uninteresting bots User-agent: A6-Indexer Disallow: / User-agent: AddSearchBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: Andibot Disallow: / User-agent: ankiro.com Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: bigsur.ai Disallow: / User-agent: BLP_bbot Disallow: / User-agent: Brightbot 1.0 Disallow: / User-agent: Buck Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGLM-Spider Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: coccocbot-web Disallow: / User-agent: cohere-ai Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: Cotoyogi Disallow: / User-agent: crawler4j Disallow: / User-agent: Crawlspace Disallow: / User-agent: dataprovider Disallow: / User-agent: Datenbank Crawler Disallow: / User-agent: Diffbot Disallow: / User-agent: EasouSpider Disallow: / User-agent: Echobot Bot Disallow: / User-agent: EchoboxBot Disallow: / User-agent: ecoResearch Disallow: / User-agent: FirecrawlAgent Disallow: / User-agent: Grok Disallow: / User-agent: GrokBot Disallow: / User-agent: GrokBot/1.0 Disallow: / User-agent: Grok-DeepSearch/1.0 Disallow: / User-agent: Genieo Disallow: / User-agent: https://hada.news Disallow: / User-agent: iaskspider/2.0 Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: img2dataset Disallow: / User-agent: JenkersBot Disallow: / User-agent: Jetslide Disallow: / User-agent: Kangaroo Bot Disallow: / User-agent: KunatoCrawler Disallow: / User-agent: legistorm.com Disallow: / User-agent: LivelapBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Magus Bot Disallow: / User-agent: MauiBot Disallow: / User-agent: MAZBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: MistralAI-User Disallow: / User-agent: MistralAI-User/1.0 Disallow: / User-agent: Mojeek Disallow: / User-agent: MojeekBot Disallow: / User-agent: MyCentralAIScraperBot Disallow: / User-agent: news-please Disallow: / User-agent: NewsNow Disallow: / User-agent: Netvibes Disallow: / User-agent: nlcrawler Disallow: / User-agent: NovaAct Disallow: / User-agent: Omgilibot Disallow: / User-agent: omgili Disallow: / User-agent: Oracle Secure Enterprise Search Disallow: / User-agent: panscient.com Disallow: / User-agent: PetalBot Disallow: / User-agent: PanguBot Disallow: / User-agent: Poseidon Research Crawler Disallow: / User-agent: Primalbot Disallow: / User-agent: Riddler Disallow: / User-agent: QuillBot Disallow: / User-agent: quillbot.com Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: SBIntuitionsBot Disallow: / User-agent: Scrapy Disallow: / User-agent: SeekportBot Disallow: / User-agent: Seekr Disallow: / User-agent: SeekrBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: SeznamHomepageCrawler Disallow: / User-agent: Sidetrade indexer bot Disallow: / User-agent: Spinn3r Disallow: / User-agent: TaraGroup Intelligent Bot Disallow: / User-agent: Thinkbot Disallow: / User-agent: Timpibot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Verity Disallow: / User-agent: Verity/1.1 Disallow: / User-agent: ViennaTinyBot Disallow: / User-agent: voxgov.com Disallow: / User-agent: webintegration.at Disallow: / User-agent: WebVac Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: WebZip Disallow: / User-agent: WRTNBot Disallow: / User-agent: xAI Disallow: / User-agent: xAI-Grok/1.0 Disallow: / User-agent: yacy Disallow: / User-agent: yacybot Disallow: / User-agent: YouBot Disallow: / # Prevent bots from wasting crawl budget on template/non-content pages User-Agent: * Disallow: /search Disallow: /web Disallow: /mrcontent Disallow: /webapi-public Disallow: /adperfect Disallow: /*amp.html?* Disallow: *.ece* Allow: *.ece*.pdf # Block indexing of specific sections/content at the market's request User-Agent: * Disallow: /actkanye-contest-rules Disallow: /advertise/advertorial Disallow: /advertise/advertorial/garybrown Disallow: /advertise/advertorial/reno-spotlight Disallow: /advertise/circulars Disallow: /advertise/classifieds Disallow: /advertise/legal-notices Disallow: /advertise/masters-club-ad Disallow: /advertise/sponsored-content/mcgeorge Disallow: /advertise/sponsored-content/sponsored-posts Disallow: /advertise/sponsored-content/sutter-health Disallow: /advertise/welcome Disallow: /advertise/welcome/welcome-page-lg Disallow: /advertise/welcome/welcome-page-md Disallow: /advertise/welcome/welcome-page-sm Disallow: /advertise/welcome/welcome-page-xs Disallow: /customer-service/404 Disallow: /customer-service/410 Disallow: /customer-service/standard-plus Disallow: /customer-service/subscription/special-offers/offer-a Disallow: /customer-service/subscription/special-offers/offer-b Disallow: /customer-service/subscription/special-offers/offer-c Disallow: /mobile/m-top-stories Disallow: /site-services/contests-promotions/actboo-contest-rules Disallow: /site-services/contests-promotions/grocery-giveaway-rules Disallow: /site-services/links Disallow: /site-services/marketing Disallow: /site-services/marketing/bee-events Disallow: /site-services/marketing/california-pets Disallow: /site-services/marketing/careers Disallow: /site-services/marketing/scoopy Disallow: /site-services/marketing/sutter Disallow: /site-services/newsletters/capitol-and-breaking-news Disallow: /site-services/newsletters/Nightly_Sports_Report Disallow: /site-services/newsletters/sac-moms-club Disallow: /site-services/newsletters/sacpaws Disallow: /site-services/newsletters/sacramento-connect Disallow: /site-services/newsletters/sports-breaking-news Disallow: /site-services/newsletters/sports-newsletter Disallow: /site-services/newsletters/state-worker-and-capitol-alerts Disallow: /site-services/newsletters/the-take Disallow: /site-services/plus Disallow: /site-services/promos Disallow: /apartments Disallow: /entertainment/ent-columns-blogs Disallow: /entertainment/ent-columns-blogs/video-break Disallow: /entertainment/living/family/teen-talk Disallow: /entertainment/living/helping-others/gloria-glyer Disallow: /entertainment/living/home-garden/debbie-arrington Disallow: /entertainment/living/home-garden/edible-gardening Disallow: /entertainment/living/home-garden/garden-detective Disallow: /entertainment/living/travel/sam-mcmanis Disallow: /entertainment/living/travel/travel-troubleshooter Disallow: /entertainment/snapshots Disallow: /food-drink/appetizers Disallow: /food-drink/beer/beer-run Disallow: /food-drink/food-science Disallow: /food-drink/chris-macias Disallow: /food-drink/restaurants/carla-meyer Disallow: /insider Disallow: /news/business/biz-columns-blogs Disallow: /news/business/biz-columns-blogs/bob-shallit Disallow: /news/business/biz-columns-blogs/cathie-anderson Disallow: /news/business/personal-finance/claudia-buck Disallow: /news/investigations/cps Disallow: /news/investigations/lobbying-influence Disallow: /news/local/health-and-medicine/ask-emily Disallow: /news/local/health-and-medicine/healthy-choices Disallow: /news/politics-government/election/california-elections/candidate-match Disallow: /news/politics-government/election/california-elections/poligraph Disallow: /news/politics-government/election/election-results Disallow: /news/politics-government/politics-columns-blogs/dan-walters Disallow: /news/politics-government/national-politics Disallow: /opinion/opn-columns-blogs Disallow: /opinion/opn-columns-blogs/dan-morain Disallow: /opinion/opn-columns-blogs/erika-d-smith Disallow: /opinion/opn-columns-blogs/foon-rhee Disallow: /opinion/opn-columns-blogs/joyce-terhaar Disallow: /opinion/opn-columns-blogs/mariel-garza Disallow: /opinion/opn-columns-blogs/shawn-hubler Disallow: /opinion/the-conversation Disallow: /opinion/op-ed/bruce-maiman Disallow: /opinion/op-ed/david-mas-masumoto Disallow: /opinion/op-ed/markos-kounalakis Disallow: /opinion/op-ed/soapbox Disallow: /opinion/op-ed/stephanie-taylor Disallow: /opinion/op-ed/susan-sward Disallow: /homes/home-sellers Disallow: /site-services/databases/crimemapper Disallow: /site-services/databases/homesales Disallow: /site-services/databases/food-inspection Disallow: /sports/nba/sacramento-kings/kings-blog Disallow: /sports/spt-columns-blogs/ailene-voisin Disallow: /sports/spt-columns-blogs/andy-furillo/ Disallow: /sports/spt-columns-blogs/leading-off Disallow: /sports/golf/senior-open-golfers Disallow: /sports/outdoors/hunting-fishing/fishing-line Disallow: /sports/ski Disallow: /sports/sports-on-the-air Disallow: /entertainment/books Disallow: /entertainment/holidays Disallow: /entertainment/living/fashion Disallow: /entertainment/living/health-fitness Disallow: /entertainment/living/health-fitness/Bike-hike Disallow: /entertainment/living/religion Disallow: /entertainment/movies-news-reviews Disallow: /entertainment/music-news-reviews Disallow: /entertainment/tv Disallow: /food-drink/restaurants/allen-pierleoni Disallow: /food-drink/wine/dunne-on-wine Disallow: /news/business/technology Disallow: /news/news-services Disallow: /news/politics-government/politics-columns-blogs Disallow: /opinion/op-ed/ben-boychuk Disallow: /opinion/op-ed/bill-whalen Disallow: /sports/mlb/oakland-as Disallow: /sports/mlb/san-francisco-giants Disallow: /sports/college/mens-basketball Disallow: /sports/spt-columns-blogs Disallow: /sports/spt-columns-blogs/hometown-report Disallow: /sports/nfl/super-bowl Disallow: /sports/outdoors/hunting-fishing Disallow: /sports/wnba Disallow: /news/local/city-arena Disallow: /sports/high-school/scores-stats Disallow: /entertainment/living/liv-columns-blogs Disallow: /site-services/tablets Disallow: /news/state/california/water-and-drought/delta Disallow: /site-services/social-media Disallow: /entertainment/tv/listings Disallow: /news/investigations/seniors-aging Disallow: /news/investigations/ucd-neurosurgery Disallow: /news/investigations/wildlife-investigation Disallow: /news/local/crime/crime-map Disallow: /opinion/water-crisis Disallow: /entertainment/casino Disallow: /entertainment/living/family Disallow: /site-services/testing/contest-test Disallow: /site-services/testing/example-section Disallow: /site-services/testing/faq-test Disallow: /site-services/testing/sample-section Disallow: /homes Disallow: /sports/other-sports Disallow: /news/local/news-columns-blogs Disallow: /entertainment/living/helping-others Allow: /homes/new-home-guide Allow: /sports/nfl/oakland-raiders Allow: /sports/nfl/san-francisco-49ers Allow: /sports/other-sports/river-cats Allow: /news/local/news-columns-blogs/city-beat Allow: /news/local/news-columns-blogs/marcos-breton Allow: /entertainment/living/helping-others/book-of-dreams Allow: /customer-service/subscription/special-offers/digital Allow: /site-services/marketing/senior-resources Allow: /sports/nba/sacramento-kings # Sitemap files Sitemap: https://www.sacbee.com/sitemap/story/update.xml Sitemap: https://www.sacbee.com/sitemap/story/archive.xml Sitemap: https://www.sacbee.com/sitemap/story/googlenews.xml Sitemap: https://www.sacbee.com/sitemap/blogpost/update.xml Sitemap: https://www.sacbee.com/sitemap/blogpost/archive.xml Sitemap: https://www.sacbee.com/sitemap/section/archive.xml Sitemap: https://www.sacbee.com/sitemap/topic/archive.xml Sitemap: https://www.sacbee.com/careers-education/sitemap_index.xml Sitemap: https://www.sacbee.com/sitemap/video/archive.xml Sitemap: https://www.sacbee.com/sitemap/video/update.xml