# disallow indexing of directory used for vendors user-agent: * disallow: /com_internal/ disallow: /internationalseo/ disallow: /dev/