David Binkley, Senior Technical Account Manager, Harte-Hanks Trillium Software
In all of the projects that I’ve been involved with over the years, I can’t ever recall seeing a requirement from the customer specifying that the overall results comply with what I feel is the final data requirement – do the results pass the “reasonable” test. Sure there have been plenty of projects where the customer has come up with target percentages or variance levels for the test cases but rarely do I recall a customer specifically asking to check if the end results appear reasonable.
The reason that I’m bringing this up is that I have seen plenty of projects where we’ve been called in late in the implementation phase or shortly after going live where the customer is in a panic and making statements to the effect that “these results don’t appear reasonable”. So is this panic a byproduct of not setting proper expectations or is it because the reality of the data’s quality has changed those expectations? I venture to say that, in most cases, it’s likely been due to both.