Googlebot / AdsBot-Google

Plone Support Administering Plone sites
1

I have a site for a company that has been 'bought by another'. Now it seems like they have put ' imperva.com ' in front ( which I know nothing about ) . An 'Add company' are setting up adds, but they are not 'recognized/allowed' by Google. How can I check if there is anything wrong 'on my site'. I share my robots file, I can (private) message URL to site. PS: I commented out a few things 'just be be sure' while testing.

Sitemap: {portal_url}/sitemap.xml.gz

# Define access-restrictions for robots/spiders
# http://www.robotstxt.org/wc/norobots.html

# By default we allow robots to access all areas of our site
# already accessible to anonymous users

User-agent: *
Disallow:

# Add Googlebot-specific syntax extension to exclude forms
# that are repeated for each piece of content in the site
# the wildcard is only supported by Googlebot
# http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling

User-Agent: Googlebot
# Disallow: /*?
Disallow: /*atct_album_view$
Disallow: /*folder_factories$
# Disallow: /*folder_summary_view$
Disallow: /*login_form$
Disallow: /*mail_password_form$
Disallow: /@@search
Disallow: /*search_rss$
# Disallow: /*sendto_form$
# Disallow: /*summary_view$
Disallow: /*thumbnail_view$
# Disallow: /*view$

User-agent: AdsBot-Google
Disallow:
2

There is the robots.txt report in Google's search-console ... maybe worth a check: https://search.google.com/search-console/settings/robots-txt ... you need of course register your website as search-console property first if not done yet.

3

You could also validate your robots.txt with this tool robots.txt Validator and Testing Tool | TechnicalSEO.com and simulate requests with different user-agents.

4

I dont have access to their google account (the 'Add Company' has 'taken over'), so I assume I can not check this (?) (I will have a zoom meeting tomorrow and want to make sure 'I know as much as possible before that)

5

That part seems to be OK