However, there are occasionally powers other than physical violence. If you are in the right position, you could potentially project power with money well enough to even deter violence against you from those who might try to take it. Violence is still the most typical and basic form of power, though.
The thing is, humans have a number of things going for them psychologically that means we can often figure out when we'd get a better deal by not being violent. Lord knows we're far from perfect, but we can do it well enough that human society has become gradually less violent over time. Technology has often helped make this feasible, but it still comes down to our judgment to actually take advantage of it and make peaceful social contracts. But don't doubt for a second that even today's social contracts are ultimately guaranteed by the threat of violence. It goes all the back to the example of the stationary bandit vs the roving bandit. Everything has just been a development of that model.