What is the reason that most websites limit to 16 characters?
I would have thought the longer the password the more difficult it makes it for someone to crack it?
Is it something to do with hash collisions?
If you are to abide by CWE-521: Weak Password Requirements. Then all passwords must have a min and max password length.
There are two reasons for limiting the password size. For one, hashing a large amount of data can cause significant resource consumption on behalf of the server and would be an easy target for Denial of Service. Especially if the server is using key stretching such as PBKDF2.
The other concerns is hash length-extension attacks or the prefixing attack against MD5. However If you are using a hash function that isn't broken, such as bcrypt or sha-256 , then this shouldn't be a concern for passwords.
IMHO 16 bytes is far too small. bcrypt has a built-in cap of 72 characters, which is probably a reasonable size for a heavy hash function. Key Stretching used by these functions creates the possibility of an Algorithmic Complexity Attack or ACA.
I think its just a standard thing. MOST individuals don't have passwords over 16 characters long and even that is quite a long password even for those with security in mind... especially on forums or websites that don't require ULTRA security.
Another important point to note is that various encryption schemes have variable length requirements. For instance, DES passwords are limited to 8 characters, MD5 passwords are limited to 16 characters, Blowfish passwords are limited to 32 characters. Since (I'd say) 95% of all sites use some form of a MD5 (sometimes salted sometimes not), the length required is 16 characters.
There are other reasons bot off the top of meh ol noggin, id say this should satisfy your thirst of knowledge!
Arbitrary implementation limit.
Maybe they only want to allocate a 17 octets buffer (16 ASCII/1-octet characters + terminating NUL).
Maybe they believe that more than having a password with 16 characters is useless or silly, because they have no understanding of passwords.
Indeed. A password with 16 random independent alphabetic characters with a uniform distribution has enough entropy. But human being are bad at randomly choosing 16 random independent alphabetic characters with a uniform distribution, and terribly bad at remembering such meaningless characters sequences, so they choose passwords that they can remember, but with less entropy per character.
What matters is only the total entropy, not the entropy per character. For example a sequence of random dictionary words, generated with a word-dice (word-dice: open a random page in a dictionary, etc.) is easier to remember than a sequence of letters obtained with a letter-dice.
Such passwords will be longer than purely random letter sequences, but they will be a lot easier to remember for equal entropy, or if you prefer they will have a lot more entropy for equal mental memory effort.
For adequate strength, these passwords made of dictionary words will probably have more than 16 characters.
IOW, this limit is stupid.
There is no formal guaranty WRT to collisions with short passwords. But the practical impact of hash collisions is non existent.