Completed

Subsidy Incrementality (PSM)

Meituan Business Analytics Challenge2026.04Team Lead
Causal Inference
PSM
ATT
Incremental ROI
Subsidy Strategy
Business Analytics

Causal Inference · PSM · ATT · Incremental ROI · User Segmentation · Budget Reallocation

Project Overview

Subsidies are widely used as growth levers in local services, but traditional metrics such as redemption rate and apparent ROI often overestimate their true impact. In this project, I built a causal inference framework using Propensity Score Matching (PSM) to estimate how much subsidized GMV was truly incremental, identify high-response user segments, and translate the findings into a budget reallocation strategy.

Key Findings

  • Incremental ROI reached approximately 4.55 under the 7-day same-BU evaluation window.
  • Only around 26.4% of subsidized GMV was estimated to be truly incremental.
  • Approximately 73.6% of subsidized transactions appeared to cover natural demand or low-efficiency targeting.
  • Mid-activity users and lower-tier city users showed stronger marginal response to subsidies.

Methods

  • Applied Propensity Score Matching to construct comparable treatment and control groups from users receiving the same subsidy batch.
  • Validated matching quality using standardized mean differences across historical GMV, order count, same-BU spending, and active days.
  • Estimated Average Treatment Effects across 3-day, 7-day, and 14-day windows to evaluate short-term lift and persistence.
  • Decomposed apparent subsidized GMV into true incremental contribution and estimated non-incremental coverage.
  • Compared incremental ROI across user activity tiers, city levels, consumption segments, and business units.

What I Did

  • Designed the end-to-end analytical framework from problem definition, metric design, causal evaluation, segmentation, to strategy recommendation.
  • Defined decision-oriented metrics including ATT, Lift, incremental ROI, true incremental share, and estimated waste rate.
  • Built a PSM-based counterfactual logic to avoid over-crediting subsidies for users who would have purchased anyway.
  • Identified high-potential subsidy targets such as mid-activity users and lower-tier city users based on heterogeneous ROI.
  • Translated analytical findings into practical actions: user targeting, coupon structure optimization, budget reallocation, and monitoring dashboard design.

Reflection

Biggest takeaway: high redemption does not mean high incrementality. The analysis showed that the real problem was not whether subsidies worked, but whether they were allocated to the right users and business units. By moving from apparent ROI to incremental ROI, the decision shifted from “spend more” to “spend better”. This project strengthened my ability to connect causal inference with business strategy: using data not only to measure outcomes, but also to guide resource allocation decisions.