It's that once every 4 years event again. That one special day that really isn't celebrated. Imagine how awesome it would have been if the leap year day was treated as a separate entity. One day that just doesn't exist inside our system and can be celebrated as a holiday. One day that isn't defined with something like Monday.
It would be even better if the leap year date was between March and April since it'd be a great lead up to April Fool's Day. There would always be someone that's confused about how it isn't [Sunday] but still [Saturday] for some reason.
And everyone else would just act as if yesterday didn't exist. The later generations would always be confused, but they'll eventually catch on and continue the tradition.