User-agent: *
Disallow: /category/
Disallow: /tag/
Disallow: /*?s=*
Disallow: /author/
Disallow: /page/

User-agent: Twitterbot
Allow: /

Sitemap: http://www.marketingautomation.tech/sitemap_index.xml