save money by eliminating costly infrastructure designed to prevent any infraction of regulations.

Because almost all people obey rules and regulations, it makes no sense to institute costly infrastructure to stop any infractions and add more red tape for almost everyone. Instead, put more resources into catching and punishing irresponsible or illegal behavior.
For example, at a government DOE contractor, employees used to be able to use a private travel agency. Everyone, especially the employee was motivated to act early to get cheaper rates, and to save money. Due to a corporate scandal we were forced to use a company travel office. We have to pay for this service, and the overloaded travel office rarely makes reservations in time to get cheap travel rates. The situation was made even worse due to the GSA Las Vegas scandal. Now DOE has to approve travel, and the process takes months