The idea that the downfall of the Jedi had such an impact on Yoda is beyond the text, it is speculative. He simply appears older and wiser later on, if that's possible. He definitely seems rather tired and even more ruminative than ever. But that could be attributed to his advancing years. Wasn't he about 1000 years old?