we now “only” work 40h

That's a deceptive estimate, as the number of employment hours worked across the household has jumped considerably higher. Two income families are the norm while children in low income households are routinely press-ganged into service - either as additional hires or as unpaid support for the primary worker (aiding parents as field workers while the field overseer turns a blind eye, for instance).

productivity went up and a lot of down times and social interaction in the past, were replaced by workload grind in a now stressful office environments.

Longer commutes, fewer public spaces and services, more haphazard schedules (more and more people working traditional "weekend" periods, particularly in retail, service, and transportation sectors), and more unreliable gig work. Absolutely.