I find that Se and Si users both tend to have fantastic memories. The difference is that Se is experience-seeking/recalling, whereas Si is fact-seeking/recalling.
Check out interviews with Bear Grylls or Anthony Bourdain (both pretty obvious Se users). They can recall their past experiences in vivid sensory detail. Si users, I think, are better at remembering dates, appointments, specific words that were said in conversations, etc. What was stated is a fact; what was smelled or tasted is an experience.
My wife is Si and she's much better at memorizing plans than me. It's like she has a photographic memory of our calendar. However, if you ask us to describe a drink we had three weeks ago, I can come up with a description faster and with more details.
So for Hannibal, I'd say he's an experience-seeker/recaller and probably an INTJ with highly-developed Se. That's the vibe I get from the books and Anthony Hopkins movies anyway. The Hannibal Rising actor seemed more ISTP.
I haven't seen the new TV series, but I'm inspired to check it out now.