# robots.txt for https://mrp-net.co.jp # 株式会社エムアールピー コーポレートサイト # ------------------------------------------------------------ # 全クローラ共通ルール # ------------------------------------------------------------ User-agent: * Allow: / # フォーム処理系（確認・送信・完了ページ）はクロール不要 Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks # 一時アップロードディレクトリ・エラーページ Disallow: /contact_temp_uploads/ Disallow: /error # AI利用方針の宣言（IETF draft: Content Signals） # 注: Content-Signal は robots.txt ではなく HTTP レスポンスヘッダーとして # 送出する仕様のため、.htaccess の Header set で配信している。 # （参考値）Content-Signal: ai-train=yes, search=yes, ai-retrieval=yes # ------------------------------------------------------------ # AIクローラ（AI検索での可視性のため許可） # 注: 個別 User-agent ブロックは * のルールを継承しないため、 # フォーム処理系などの除外を各グループに明示する必要がある。 # また、複数 User-agent を連記したグループは一部パーサで # 誤解釈される事例があるため、クローラごとに独立して記述する。 # 対象: OpenAI（GPTBot / OAI-SearchBot / ChatGPT-User）/ # Anthropic（ClaudeBot / anthropic-ai）/ Perplexity（PerplexityBot）/ # Google（Google-Extended / GoogleOther。検索順位には影響しない）/ # Apple（Applebot-Extended）/ Amazon（Amazonbot）/ # Meta（FacebookBot。主にOGPプレビュー用。AI学習用途は別クローラ） # ------------------------------------------------------------ User-agent: GPTBot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: OAI-SearchBot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: ChatGPT-User Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: ClaudeBot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: anthropic-ai Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: PerplexityBot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: Google-Extended Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: GoogleOther Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: Applebot-Extended Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: Amazonbot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error User-agent: FacebookBot Allow: / Disallow: /contact_form/contact_confirm Disallow: /contact_form/contact_send Disallow: /contact_form/contact_thanks Disallow: /partner_form/partner_confirm Disallow: /partner_form/partner_send Disallow: /partner_form/partner_thanks Disallow: /contact_temp_uploads/ Disallow: /error # ------------------------------------------------------------ # AIクローラ（アグレッシブ・低価値のためブロック） # ------------------------------------------------------------ User-agent: Bytespider Disallow: / # ------------------------------------------------------------ # サイトマップ # ------------------------------------------------------------ Sitemap: https://mrp-net.co.jp/sitemap.xml