Quantum computer misconceptions
First, I think you misunderstand quantum computers. They are a hard and non-intiutive concept, so I don't blame you. Let me try to clear things up.
Metaphor: GPUs are exceptionally good at computations involving matrices (aka linear algebra) and therefore excel at problems that parallelize well. At any other type of problem (computing pi, for example) they are much slower than CPUs.
Quantum computers are exceptionally good at computations involving waves, and therefore excel at problems with repetitive or periodic structures. There is a surprisingly small number of things that quantum computers are good at, but it just so happens that all the public key algorithms we use today (RSA, DSA, DH, and ECC) are in this category. Generally speaking, hashes and symmetric ciphers like AES are not vulnerable to QC's.
The statement that "quantum computers are faster than binary computers" is, except for a select type of problems, wrong.
Offline Brute-force
Here the attacker has a copy of the of the hashed password(s) and is trying to guess the plaintext password(s) (aka hash pre-images). Quantum computers are not very good at breaking hashes; but if you load the hash value into the qubit register, you can use Grover's algorithm to get a sqrt(n) speedup, essentially reducing a 128-bit hash to 64 bits, a 256-bit hash to 128 bits, etc. Assuming passwords are hashed with a 256-bit hash function, you're good. So if your users chose strong passwords (aka randomly generated), then guessing is still centuries or millennia, even with a quantum computer. Assuming your users chose weak easy to guess passwords, then QC's also don't make a difference because you'll crack it in under a minute on a regular GPU rig. So quantum computers don't really make a difference for offline brute-force attacks.
Online brute-force
Here you are submitting guesses to a live login server. Since the attacker doesn't know the password hash to feed into a quantum computer, you have nothing to run Grover's on. Besides, the 5 guess-per-secand rate-limit and IP banning done by the server is the bottleneck here, not the size of your processor. So quantum computers make no difference for online brute-force attacks either.
Key-Based SSH
You specifically asked about username/password, but I'll borrow from @Trickycm's answer. If your SSH server is using RSA keys rather than passwords, then it's a different story and against a quantum adversary you get something like "weak passwords" < "RSA keys" < "32 char random passwords" (depending a bit on which symbol set you're generating passwords from, and the size of your RSA keys).