As others have said, typically one thermostat will control one A/C unit plus the furnace, the other thermostat controls the other A/C (only) unit. It is very common for one to not have a heat function at all. Though some you can buy a heating element and install into the A/C to give it both functions, but those typically arent controlled by a thermostat, but rather controlled by knobs on the unit itself
Like Larry-NC noted, some have a heat pump where the air will come through the ceiling, but more than likely your heat will only come from the floor using the furnace. And the furnace is only controlled by the one main living area thermostat.
And welcome to the forum