A time has been agreed by both parties. It is a commitment each one gives to the other. When either party comes late it is like breaking their own commitment. Often it is a reflection & future portent of things to come & a peek into the character of the other person. Keep your time commitment, as it will earn you respect & protect your reputation.
Punctuality is about respecting your own commitment !