But the government license is the key thing. Without that, the church can marry you but technically can't issue an official certificate of the marriage. Or if they do, it would be just for show and not have any legal force. You may be married in the eyes of the church, but the marriage and the church's certificate would have no legal standing (no government recognition).
That's my understanding of those things, anyway.