I might be reading wrong, but you seem to be a bit OCD like myself.
I have to power wash my pavers every 2 years and add polymeric sand ($40 a bag). I really need to seal mine next time, which is a decent amount of money if you use a good quality product (~$350 for 5 gallons). That's what I call basic maintenance to make them look good. This is multi-day job for a contractor, so it's not cheap.
Now, here's where I've had issues. Frost heaving here in the Midwest shifts the pavers. Water erodes the base over time. Roots from trees push up pavers. I am anal about mine and have to "adjust" them which takes time. Paver repairs aren't cheap if you are using a contractor to do the work.
That being said, walk over to your neighbors houses and look closely. Is the edging poking up? Are there dips or raised areas? Is water pooling in spots? Etc. I'm guessing that most of the driveways have had repairs done over the years.
Again, I am just posting my experience and that of a few friends here in the area but your mileage might vary.