About our crawler

• It obeys robots.txt. A block is final — we do not work around it.
• It waits at least three seconds between requests to the same site.
• It identifies itself with a user agent that links back to this page.
• It requests listing pages only, at a low rate, outside peak hours where possible.

• The facts of the listing: price, location, size, rooms and features.
• The web addresses of the agent's photos — we link to them, we never copy or rehost them.
• A short excerpt of the description, used only for matching. Never the full text.
• A link to the agent's own listing page, shown with the agent's name every time.

If you are an estate agent and would like your listings excluded, email bot@mullion.homes from a company address. We remove the source within two working days and confirm in writing. We are also happy to take a direct data feed instead — it is better for both of us.