How is that conjecture? Looks like a hypothesis supported by evidence to me.
It's scientific fact that regions of the brain are/become highly specialized for specific tasks. You're not seriously debating that are you? Everything else is conjecture, including your system. Personality differences ARE brain differences. The answers lie in neuroscience.
But you have already indicated that you aren't open to reason on this. Your mind is made up.