What security features do I need to have in-place to ensure that my website log-in and registration forms are secure?
CSRF - You need to have protection in place to prevent cross site request forgery - or requests to login, signup, or other actions from other sites. This can be used to trick users into performing actions they didn't intend to.
CAPTCHA on signup - It's often recommended to use a CAPTCHA on your sigh-up form to reduce automated signups. How important this is depends on your threat model.
Secure login - The login needs to happen over HTTPS to reduce the risk of the user's credentials being captured via a MiTM attack.
Cookies - While login over HTTPS should be seen as a minimum, everything else really should be over SSL as well to protect the cookies (remember Firesheep?). Though just using SSL isn't enough, you need to set the Secure flag and HttpOnly flag whenever possible.
Email Confirmation - You need to make sure that you verify a user's email address as part of the sign-up process (I'd suggest not letting them login until it's confirmed). You'll need to have this for use in password resets.
Bruteforce protection - You need to protect against an attacker bruteforcing user accounts. There are various ways to do this, locking accounts (which can be used as a DoS attack by locking out large number of users), limiting failed attempts from a given IP (either via ban, or additional CAPTCHA). There are pros and cons to each method, but it's important that you have some form of protection in place.
Secure password reset - You need to make sure that you have a secure method for resetting passwords. This one is more complicated than most people think, and is easy to get wrong (as Apple recently found). The biggest risk is that an attacker finds a way to abuse the feature to reset accounts that they don't own.
I'd strongly suggest that you read the OWSAP Authentication Cheat Sheet, it goes into detail on these and many other potential issues; and as always, when building new systems, it's a good time to take another look at the OWASP Top 10 and make sure you have taken the proper precautions.
Adding to Adam's answer I would like to say that according to OWASP Top 10 Application Security Risks–2013 the top three vulnerabilities are Injection,Flaws in Authentication mechanism/session management and XSS.
About the cookie:
If you use the cookie for the login process it is important to save the cookie information in your database (MySQL for example) so if an user makes the logout the cookie information will be deleted from database and the cookie won't be longer valid. It's is important, because if a hacker steals the cookie then he can access to your account!
Another parallel solution:
For protect your login page you can use this service Colobe
It is a free service that protects your pages by any brute force attack. Anyway Colobe requires the PHP in your server.
It is very cool because colobe is a dynamic service that learn during the time and builds a global blacklist of the botnet networks and pirate servers that generate those attacks.
N.B. Colobe is a project of mine.