It's the opposite for me, much bigger ROI on the heatpump than solar. Rural property, 10 years old, ~3,500 sq ft + basement, in Canada where summer can be above 30C (86F) and winter below -30C (-20F). Electricity costs (Canadian) 7.6 ¢/kWh off-peak and 15.8 ¢/kWh on-peak here.
I spent C$40K (about US$30k) on a ground source aka 'geothermal' heat pump to replace furnace powered by propane tank. I kept propane for on-demand hot water and whole house generator. I have no options for utilities other than electricity.
A couple of years later I spent another C$40k for a 20kW rooftop solar system, with net metering and no battery. Net metering was critical for getting any return at all. A battery is next to useless here- I generate almost all of my solar electricity in May-Oct but use the majority of it in Nov-April. Net metering lets me 'store' excess from summer and use it in winter.
Annual costs:
Before:
C$8,000+ propane (heating + hot water)
C$2,500 electricity (cooling + misc)
$10,500 total
With C$40k investment in geothermal heatpump:
C$4,500 electricity (heating + cooling + misc)
C$500 propane (hot water)
C$5,000 total.
With heatpump and then C$40k investment in rooftop solar:
C$2,000 electricity (heating + cooling + misc)
C$500 propane (hot water)
C$2,500 total.
So I'm seeing about C$8k/yr saving for C$80k investment. The heatpump saved me over $5k a year and the solar about $2,500 a year. The heatpump has pretty much paid for itself after 5 years, the solar will take at least 15 years (unless prices go way up) although should eventually see some return 15-20 years out.
In reality it might have cost even more than that to heat with propane. On the propane furnace we barely heated in winter, burned a lot of firewood to make part of the house livable. I'm trying estimate how much it would cost to heat the house to a comfortable 20C (68F) although the thermostat now with the heatpump is set to 22C (72F) in winter so there's an improvement in comfort as well as the ROI.