# Crawlers Setup
User-agent: *

# Directories
Disallow:/order-online/*
Disallow:/addresses/
Disallow:/junction/select
Disallow:/users/password/new
Disallow:/users/auth/twitter