In 2013, my wife and I were shopping for a new car for her; we wanted a small CUV with AWD and a manual transmission, so of course we looked at Subaru, and drove the XV. We also drove a Suzuki SX/4 and a Mini Countryman All4. We liked the Mini best, but expensive. The Suzuki was a close second--largely because of it's lively suspension feel (and great visibility). In comparison, the XV was a boat, with oversoft, sluggisn suspension.
In 2016, shopping for a vehicle for myself, with similar criteria, I again looked at "Subaru, Mini, and this new Jeep Renegade. Again, I found the Subaru's ride quality reminded me of American luxo-barges of the 70s--just way too soft. The Renegade has tight suspension which definitely imparts a more sporty feeling, and makes it much more invigorating to drive. For me, it was a no-brainer.
It's unfortunate, as Subaru used to produce small, fun cars--but they've definitely succumbed to the "bigger is better" motto that rules in the US market, and moved towards cars more suited to lazy commuters than driving enthusiasts (except, of course, they still make the WRX--but no longer as a hatchback). If a soft ride that isolates you from the road is what you want, then definitely stick with the Subaru XV.