Capturing such conversations via magnetic tape is usually used for simplicity relative to maintenance of chain of evidence and integrity of the interview.
First, there are people/organizations on the cutting edge, bleeding edge, and followers. Those that can afford cutting edge or bleeding edge technologies are generally the minority (say 20% of the 80/20 rule). The rest of the organizations follow past "best practices" and magnetic tape was it. Consider that many organizations still backup data to tape at some point for long-term storage. Such decision is usually based on cost. It's still cheaper to keep data on tape than on magnetic disk.
Second, taped evidence is only useful if/when its integrity can be verified. Tape is a medium that is still familiar to those in a position to make such determination. With that said, 20-30 years from down, I'd bet that storage on digital media (disk, SD card, etc) will be more widely accepted as the cost to produce tape media and players further decline.
Third, there are organizations that leverage a hybrid approach. Tape media may be used for long-term storage but the interview may be digitalized to share with other organization and entities.
In the long term, I believe that it'll be cheaper to digitalize most content. But until the cost of tape media starts to rise exponentially and the cost to maintain integrity goes way down, tape media will continue to be used.