I think we want it to be cosmically perfect rather than literally perfect.
There's a cartoon I can't ever find, but it's a friend walking into another friends room and talking about how messy it is, but the friend says that within the mess is an elaborate system. Pathways and piles that are "zones", such as dirty clothes, clean clothes, trash, recycling, etc.
I like to think that INFs are like that. It's not that we need for things to be orderly, it's that we need for things to be accordin to our inner order. Like my computer desktop. I have it filled with word documents. Some are notes in class, some are short stories, some are works in progress, then I have .pdfs of stories written that I like... I have notepad documents with ideas, etc. And I have them all in an order that's familiar to me. But every now and then my computer will get pissy and shift them all to one side of my screen in alphabetical or file type order or something, for whatever reason.
So I move them all back into their nonsensical system that's emotionally familiar to me. I know that my class syllabuses are in the upper right corner, the pdfs are in the lower right corner, program shortcuts are on the left side, and there's outposts of either chronologically similar documents or documents similar in nature scattered throughout the center.
I get extremely perturbed when my order is upset. Except for every now and then that I need more space and commit to a reorganization that involves taking all of the documents on my desktop I haven't opened in a month and moving them into folders that are also arbitrarily ordered and catalogued, dating back to when I was a freshman in High School.
It's a nonsensical system of orderless order that I keep because of emotional familiarity. With nonsensical rituals of significant familiarity, and I get really bothered whenever it's messed up in some way.
I think that's what we really want. I also think that we either 1.) consider conflict to be too unsettling to enforce our systems against each other, 2.) have interests that never overlap, so we stay out of each others' ways, or 3.) have a hive mind and all want the exact same orderless system.
The INF community hasn't destroyed humanity through neverending border conflicts over these systems, so
something is keeping us peaceful