Methodology & Data Sources

Data Sources

  • NAIC MCAS 2024 (Market Conduct Annual Statement): Complaint ratios, total complaints, and justified complaint counts for 229 insurers across all 50 states + DC, from the National Association of Insurance Commissioners. This is the authoritative industry source for insurance company complaint data.
  • CMS Transparency in Coverage PUF PY2025: Claim denial rates published by the Centers for Medicare & Medicaid Services under the ACA Transparency in Coverage rule. Covers 158 health insurance issuers reporting via data.healthcare.gov.
  • CMS Medicare Advantage Analysis: Prior authorization request, denial, and appeal rates from the CMS Office of Inspector General report OEI-09-22-00380 and KFF 2023 Medicare Advantage analysis.

Coverage

PlainInsurer covers 229+ insurance companies across all major insurance lines — homeowners, auto, life, and health. Not all companies have data for all three sources; grades are calculated from whichever datasets are available for each insurer.

Grade Calculation

Grades are computed from a composite score with three components:

  1. Complaint ratio score (primary — all insurers): NAIC complaint ratio compared to the industry median. A complaint ratio of 1.0 is average; above 1.0 means more complaints than expected relative to market share. Ratios significantly above median lower the grade.
  2. Claim denial rate (health insurers only): CMS Transparency in Coverage claim denial rate compared to the health insurance industry median
  3. Prior authorization denial rate (Medicare Advantage only): Rate of prior authorization denials compared to peer plans

The composite score maps to letter grades (A through F) using a bell-curve distribution relative to the full insurer population, so grades reflect relative standing rather than absolute thresholds.

Processing Pipeline

  1. NAIC MCAS complaint data is downloaded from the NAIC's public data portal, including complaint ratios, total complaint counts, justified complaints, and market share data for each insurer by state and line of business.
  2. CMS Transparency in Coverage PUF data is downloaded from data.healthcare.gov, extracting claim denial rates, prior authorization rates, and appeals outcomes for each health insurance issuer.
  3. CMS Medicare Advantage prior authorization data is extracted from OIG reports and KFF analysis publications.
  4. Insurers are matched across all three datasets using company names, NAIC codes, and CMS issuer identifiers. Parent-subsidiary relationships are resolved to present consolidated company profiles.
  5. Composite scores are calculated for each insurer based on available data, weighted by the components described in the grade calculation methodology above.
  6. Letter grades (A through F) are assigned using a bell-curve distribution relative to the full insurer population.
  7. All data is loaded into a structured SQLite database serving insurer profiles, state pages, and comparison tools.

Data Vintage and Update Frequency

NAIC MCAS data is released annually, typically in the third quarter, covering complaints from the prior calendar year. CMS Transparency in Coverage PUF data is updated annually under ACA reporting requirements. Medicare Advantage prior authorization data is published as CMS and OIG complete their analysis cycles. PlainInsurer refreshes its database when new data releases become available from any of these sources, typically resulting in one major annual update cycle.

Accuracy Commitment

PlainInsurer reproduces NAIC and CMS data exactly as published. Complaint ratios, denial rates, and appeals outcomes are presented without editorial modification. The grading algorithm is applied consistently using transparent, documented formulas — no subjective adjustments are made for any individual insurer. When data is unavailable for a particular insurer or metric, the grade calculation uses only available components rather than estimating missing values.

Limitations

  • Complaint ratios measure formal complaints filed with state insurance regulators — they do not capture unreported customer dissatisfaction, informal disputes resolved directly with the insurer, or social media complaints.
  • A high complaint ratio may reflect large market share, complex product lines, or unusual claim types rather than inherently poor service quality. Insurers writing primarily high-value or complex policies may generate more complaints per policy.
  • Grades reflect past reporting-period data and do not predict future insurer behavior, financial stability, or claims handling performance.
  • Not all insurers have data from all three sources. Health-specific metrics (claim denial rates, prior authorization) are only available for health insurance issuers. Property and casualty insurers are graded primarily on NAIC complaint data.
  • This data does not constitute insurance, financial, or legal advice. Always verify current insurer standing with your state department of insurance or a licensed agent. PlainInsurer is not affiliated with NAIC, CMS, or any government agency.

Contact

Questions about our methodology? Contact us.

Related Federal Resources

Beyond our primary data sources, the following federal government resources provide additional context for transparency, methodology verification, and related public records: