The app has improved a lot over the years, and with the rise of Game Pass, it has brought more value than ever before. Now, there will be times when downloading games from the Xbox app will be slow and annoying.
If you want to buy, manage, and play Microsoft Games on Windows without using Steam, then your best bet is to use the Xbox app.
