The score represents how well optimized the page is for speed, but does NOT measure the actual load time. (The real load time, of course, is what users experience.) So, slow servers or connections or content from other sites (like third party ads or widgets) can kill performance even on a site that gets a great score.
FORBES: Don't Let a Slow Website Kill Your Bottom Line