Interactive publication
Back to the catalogueMeasurementCase 05 of 05
Verified-location subset as targeting filter
Restricting delivery to a curated subset of location-verified IPs while measuring against a full-population outcome (store sales) creates a denominator mismatch that dilutes measured lift by an unknowable share — and the subset is not neutral: location-stable IPs skew fixed-line, single-family, owner-occupied, deleting exactly the dense urban geography where fine-grain targeting has the most advantage over ZIP.
Class
Case to account for
Affects
1 conversion
01
Detection
Delivery filtered on a location-quality attribute while the outcome metric counts customers regardless of that attribute.
02
Mitigation
01
Use the verified subset as a pre-registered analysis stratum, never as a targeting filter: deliver to everyone, segment delivery logs at readout
02
Report headline (full population) and stratum (verified subset) side by side; divergence is itself a finding
03
Run the stability filter at the platform or in a clean room — the measurement party should receive aggregate cell counts by stability class, never raw IPs
03
Affected conversions
IP lookupH3 (probabilistic crosswalk)
OPEN