Congress currently pays a total of $328,000 in annual salaries to a House chaplain AND a Senate chaplain. Save the taxpayers some money and ask for volunteers from nearby houses of worship, or better yet make a schedule and have each member say the opening prayer on a certain day.
This is a fiscal matter, not a religious one. The prayers can continue, just at a highly reduced cost.
At the very least, combine the positions and let one person handle the duties for both houses. The private sector does it all the time.