Can I attack a PC via the VGA port? Is VGA one way or does it accept data from the other side?
How about HDMI or DVI?
And if so, are there known malware or PoCs to do that? or is it theoretically fantasy?
VGA and HDMI are not one-way; besides the main send-pictures functionality, there is some low-bandwidth bidirectional communication. This is how a computer can "know" that a new display was connected, and what resolution to use on that display. In the case of VGA, this was a backported feature (VGA displays from the early 1990s could not do that).
Theoretically, this could be exploited, if (and only if) there is some weakness in the receiving part (the display card and its driver). The protocol is not complex (no TCP/IP stack involved) so exploitable security holes should be rare.
Usually, a malicious display can do much more evil by simply logging a copy of everything that is displayed. For instance, I have an account in a bank, such that for online banking I "type" a password by clicking on semi-randomly located buttons. A screen logger grabs the password easily in such conditions (ironically, that system was meant to thwart keyloggers). Therefore, the usual wisdom is that if your display is malicious, then you already have bigger problems.
Note: some displays also double as a USB hub -- and weaknesses in USB protocols have been exploited (e.g. the "PS3 Jailbreak" from 2010). For common PC, the USB link is an extra plug, but these things may change. For instance, Apple computers now use the Thunderbolt interface which is fully bidirectional and uses a rather complex protocol, where security holes are quite plausible.
An alternative to infecting the computer might be to make a device that sits in the middle (between the computer and monitor) and which saves screenshots on a set interval.
VGA and DVI? I dont think so. For HDMI, there was no PoC yet, but as it can carry the Ethernet, break-in over HDMI is absolute possibility.
With new TV sets there is a new range of attacks:
This is next-generation of hacking and a new class of home and business intrusion. The next thing is to open a fridge and find a software virus in it.