It was more than that. The removal of beauty from public buildings was purposeful by the ruling caste. Beauty sustains a people; brutalism degrades the spirit. To rule a people first you have to weaken them.
Compare older stone or wooden churches to modern churches. Most modern churches are soulless or repellant. Beauty was once part and parcel of the public life of our people, and seeing beauty throughout their day strengthened them.