It is difficult to provide a single complete answer because there are too many variables and what may work for one model/brand may not work for another. The term 'Smart TV' is also poorly defined and not all of them 'call home' - many don't even have a built in webcam or microphone.
The first question you need to ask is "What do you want/expect" from your Smart TV? This will help determine what features you need and that will help determine what options you have available. The other question you need to ask is what is the threat you are concerned about? Are you concerned about the neighbours or passes by who may overhear your conversation through that open window? What is your real concern should it be true that the vendor is recording your conversations through the microphone on the TV? Likewise with the camera.
This isn't to say you may not have real things to be concerned about, but it probably needs to be a little more than just an abstract concern. Some people, such as celebrities, politicians, secret agents and crime bosses probably have more real concern than most of us. Knowing what the individual risk is determines what level of protection/concern you need to have.
It is also important to consider the other side of the coin. Consider the perspective from the vendor. Lets say you produce a smart TV and it collects lots of data, such as recording the sound and vision in the room. Now consider they have sold 2 million of those TVs, so have data coming in from 2 million users. That is a hell of a lot of data. However, having data and being able to make use of it are two vary different things. That is a lot of processing. How you use/process the data is also worth considering. Processing a lot of audio streams to improve algorithms used in natural language processing and voice recognition is one thing, processing the streams to extract real meaning and then using that information effectively is another. All of this also comes at a high financial cost, so there has to be some real financial benefit.
All of this isn't to say there are not real concerns. As the NSA has demonstrated, processing and extracting meaningful data from large data sets is vary possible and there are some real concerns regarding what some of these vendors are doing and how they are using or even securing the data they collect. However, to what extent this is a real threat to an average individual right now is uncertain, but likely low.
We also need to balance all of this with the real potential for benefit from this data collection. Most of us would really like devices which have reliable and accurate speech recognition or smart devices which are able to work out what we want to watch, what products we are really interested in etc. What most people hate about advertising is that most of it is junk we are not interested in. If all the ads you were shown were for things you are interested in, you wouldn't mind as much. To achieve this sort of benefit, the manufacturers need data to drive the research. If we want devices which improve, we need to let the manufacturers have more data about how we use the device, where the device fails, has errors, crashes etc and we want the manufacturers to send us updates and improvements.
So, what do we do?
Select a device from the manufacturer which has the best terms and conditions. Look for one that actually has privacy statements, tells you what data they will collect, how long they will keep it, what they will use it for and how they will store it. Yes, we are trusting they are being honest, but why should we assume they won't be? What is the benefit in them being dishonest? If they have a privacy statement and reasonable terms and conditions, at least we know they have thought about it. Most of the problems with IoT devices is that the vendor simply has not considered these issues.
Depending on your setup, you will normally configure your router/modem to have a firewall which blocks all incoming connections. These are connections which are initiated from outside your network and try to connect into devices within your network. Most of the services you are likely to want have connections initiated from inside your network going out. Exceptions are things like an audio chat service which allows your friends to contact you. Connecting to things like TV streaming services are typically initiated by you and don't need to be initiated from external sources.
Look for a device which has the option to enable or disable data collection. These days, many software and operating systems have this sort of feature. You can decide to opt in or opt out. Go for a vendor who lets you make this decision.
If you are still uncomfortable, just don't connect the device to the network. I've looked at a number of 'Smart TVs' and in fact have 3 of them. However, none of them are connected to the network. This isn't because Im paranoid. The main reason is that so far, I've found the quality, reliability and usability of all of these smart tv apps to be far inferior to the equivalent functionality provided by my PVR, xbox, ps4 or chromecast. Right now, smart tvs seem to be more hype than benefit. This will change, but I can't see the quality reaching the same level as other devices for a couple of generations yet and lets face it, you tend to replace your TV less frequently than other devices, such as laptops or tablets.
We all need to be more concerned about data collection and privacy. However, we also need to be wary of becoming too paranoid. What we really want is informed consent and some guarantees about how the data will be sued, stored and eventually destroyed. The only way to get this is through our choices. Be willing to pay more for better, secure and informed choice. Be prepared to not purchase the device if we are not happy about the company's practices or the way it may use our data. Be willing to forgo convenience to ensure we have privacy and control.