Signing means Apple okaying the software for installation. If it's not signed yes you can't use it. The device checks with Apple for authentication. When you try to downgrade using unsigned software it puts the device into recovery mode and forces you to use the latest.
Shortly after they release a new iOS, they unsign the version before.
Apple knows best. Ha ha