We installed a caching plugin and it did not help. Why?
Usually because the constraint was not what caching addresses. Caching helps when the server is doing repeated expensive work to build the same page. It does not help if the delay is in the browser rendering, in third-party scripts, or on pages that cannot be cached anyway, which includes most of a logged-in or checkout experience.