Yes, you can! The Kindle app is available for Windows 8.1 and 10, and you can download it for free from the Windows Store. Once you have the app installed, you can sign in with your Amazon account and start reading your Kindle books on your PC.
If you're looking for more detailed instructions, this Amazon help page should have everything you need.