It depends on your threat model. A TPM has multiple purposes, but the most common purpose is _measured boot_. That is, a TPM will be able to detect an evil maid attack or even a modified BIOS. If your threat model includes an adversary which is able to modify firmware or software on your computer, a TPM can provide tamper-evidence to ensure that it will not go undetected.

Remote attestation is not something you will likely need to use. It is however not at all unsafe. There are no privacy issues due to a TPM's ability to sign things anonymously using [Direct Anonymous Attestation](https://en.wikipedia.org/wiki/Direct_Anonymous_Attestation). And there is no issue with access control because a TPM has no ability to control the OS or any software running on it, since it is in an unprivileged position on the LPC bus.