Hello,
shouldn't you rather say that the message is "signed" with the private key then the signature is verified with the public keys.
Transactions are not encrypted on the blockchain. they are signed and the signature can be verified with the public key of the signer