I live in a rural coastal community in California that almost exclusively attracts people in the 55 plus age range. Their biggest disappointment is that healthcare is far below their expectations. Economic dynamics largely dictates that. The drive to decent healthcare in Santa Rosa is about 2 hours and 3-4 hours to world-class healthcare in the Bay Area. That doesn't sound that bad until a diagnostic and treatment regime requires a lot of repeat appointments.
The other consideration is early diagnosis is less likely in areas that can't support a diversity of specialists. Early diagnosis is often the difference between an inconvenient treatment and a miserable prolonged death for you or your loved ones. Same with ER capability. A long ambulance ride to an advanced center when the weather grounds choppers will put you outside the "golden hour".
On the other hand, there aren't many world-class medical centers that I would want to live near. Quality of life, cost of living, accessibility, economic opportunity, good diving, and great medical care are often conflicting requirements. I feel your pain.