I think the big issues for the touring/baggers are cost and "lifestyle". HD has sold so many people on buying a huge expensive bagger that gets ridden from the owners' homes to the local bar and back. I find myself in a small minority of people who jump on the bike with the intention of not returning for days.
With the price of the HD CVO touring bike hitting 51k, Yamaha at 27k and Honda in the low 30K range, not a lot of people can justify that kind of money on a 2nd/3rd vehicle.