While Powershell 2.0 compatibility can be removed via add/remove Windows components, Powershell 5.0 is integral to Windows 10. I've searched for solutions, and it doesn't seem that it can be removed. Uh yes it can be, use NTLite. It can remove more than just Powershell... hxxp://www.ntlite.com
@JWilliams you have to remove Powershell & Active Script from Windows 10 no other way around it.