>

Bulk Domain, DNS & Email-Authentication Auditing: DMARC, Propagation, Blocklists & Web Vitals

Reading Time: 3 minutes

Checking one domain’s DNS, email authentication, or page speed is a two-minute job with a web tool. Checking a thousand — an agency’s client portfolio, an acquirer’s due-diligence list, a security team’s asset inventory — is a different problem those one-off tools aren’t built for. This guide consolidates the bulk versions of the four checks that come up most, drawn from our earlier tooling posts, and how to run them on a schedule so a regression pages you before a customer notices.

Email authentication: SPF, DKIM, DMARC at scale

Email deliverability lives and dies on three authentication records, and auditing them in bulk is where the real gaps surface. Per domain: resolve the SPF record and check it doesn’t exceed the ten-DNS-lookup limit that silently invalidates it (a surprisingly common failure as companies add SaaS senders); confirm the DKIM selectors publish valid public keys; and parse the DMARC record for its policy and its rua reporting address. The single most valuable output of a portfolio scan is the list of domains sitting on p=none — DMARC present but enforcing nothing, i.e. authenticated in name only and still spoofable. Those are the domains to fix first.

DNS propagation across resolvers

After a DNS change, “has it propagated?” really means “do the major public resolvers agree yet?” Querying the same record across a spread of resolvers — Google (8.8.8.8), Cloudflare (1.1.1.1), Quad9, OpenDNS, and a few regional ones — shows the rollout in progress and catches the case where one resolver serves a stale or wrong answer while others are correct. Run as a scheduled check rather than a one-off, the same query set becomes change detection: a record that shifts when nobody on your team touched it is worth an immediate alert, because unauthorized DNS changes are how domains get hijacked.

Blocklist (RBL) checks

If your mail or IP reputation matters, landing on a real-time blocklist is a silent outage — mail just stops arriving. Checking your sending IPs and domains against the major RBLs (Spamhaus, Barracuda, SpamCop, and others) on a schedule turns a “why did deliverability collapse?” investigation into an alert you received the morning it happened. Bulk-checking a full IP range at once is the difference between monitoring one server and monitoring a fleet, and it’s cheap to run daily.

Web vitals and page-speed regression

Core Web Vitals — LCP, CLS, and INP — are a ranking and UX factor, and they regress quietly: a heavy new script, an un-optimized hero image, a third-party tag added by marketing. Lighthouse is perfect for a one-off audit but painful across many URLs on a schedule; the scalable version points a scheduled scan at a URL list and returns the same metrics as JSON, so you can diff them week over week and alert on a regression instead of discovering it in a ranking drop. For the DNS/SPF/DMARC/TLS side specifically, NexGenData’s Domain Security Posture Checker returns a domain’s full security posture in one call, and the NexGenData catalog on Apify covers the rest as schedulable, pay-per-result feeds.

Wiring it into a scheduled audit

The pattern across all four checks is identical: a list of assets in, a structured result per asset out, on a schedule, diffed against the last run, alerting only on change. Store each run dated so you can see when a DMARC policy weakened, when a DNS record moved, when an IP hit a blocklist, or when LCP crept past its budget. The alert-on-change discipline is what keeps this from becoming noise — you don’t want a daily report of a thousand green rows, you want a message the morning one of them goes red.

Why bulk changes the economics

Any of these is trivial for one domain and unmanageable for a portfolio by hand. An agency onboarding a client, an acquirer running technical due diligence on a target’s whole footprint, or a security team inventorying assets all face the same wall: the manual tool doesn’t take a list. Running the checks as scheduled, list-driven feeds turns “we should audit these eventually” into a standing control that catches the SPF that broke when marketing added a sender, the DNS change nobody logged, or the deliverability drop before the client does. That shift — from occasional manual spot-check to continuous automated control — is the entire point.

Run it yourself in minutes

New users get $5 free credit (no card). Browse the full 300+ actor catalog and run any tool on pay-per-use pricing.

More from the blog