BrainVine
  • Services
    • UX-Based SEO
    • Content Development
    • Outreach & Guest Blogging
    • Online Guerilla Marketing
    • Integrated PPC
    • Social Media Management
    • Website Health Analysis
  • Blogs
  • Glossary
  • Contact
Select Page
  • #
  • A
  • B
  • C
  • D
  • E
  • F
  • G
  • H
  • I
  • J
  • K
  • L
  • M
  • N
  • O
  • P
  • Q
  • R
  • S
  • T
  • U
  • V
  • W
  • X
  • Y
  • Z

What Is Robots.txt?

A test file that tells web robots (usually search engines) which pages on your website to and to not crawl.

BACK TO GLOSSARY INDEX

Get Found. Naturally.

    GET IN TOUCH

    We are always open for a quick chat!
    We serve globally, so don't hesitate to reach out.
    Connect with us on
    f_ico twitter-50   
    hubspot
    Designed by BrainVine Biochemists