That is so reductive. Even if someone considers Brideshead Revisited a "really good bad book," as Martin Amis once declared it to be, it has a much bigger scope than that adaptation suggests. It's not a mere tale of forbidden aristocratic love.
It's interesting that you are such a big fan of Waugh's, given your apparent political beliefs. He is perhaps the modern conservative movement's favorite novelist.