I have learned to appreciate small talk more as I age, because raising my kids and being married and involved in some social groups taught me of its importance to other sorts. Plus, the more I had to deal with the mundane, the more input and experiences with daily things I acquired and so it became more interesting. Usually when I was young I avoided as much of the trivial as possible, so I didn't have anything to contribute to those discussions. (I am not using "mundane" and "trivial" as pejoratives here, I just mean the average little details of the day, things that happen or are said or are done without larger context.)
I think it was just the temporary-ness of such topics. In a day, in a month, in a year, it won't matter what someone had for breakfast, or the problem you had with your lawnmower, or what sale was happening at such-and-such store. Here today, gone tomorrow. I was interested in topics that persisted over time and endured, hence the big broad philosophical discussion, science, ideals, art, and so on. Big thoughts, big ideas. The problem is that they can also be very impersonal (depending), which is why they endure but also why some don't care or can't relate.
I have been trying to more integrate over the years, because it seems like sometimes the small things lead to the big things or provide a small snapshot of the big things that make them relatable. Most people operate in the details.
So I still can get bored sometimes if I talk to my mom / visit, but I also appreciate it because I am learning more about her life and she matters to me, even if it does tire me out. Also, I can attest that only focusing on the big stuff makes your world smaller, I end up not engaging people on a daily basis and thus slowly become isolated, which I don't like + it detaches me from the daily act of living and understanding humanity from the ground up.