This is the obvious result of letting people who have zero training or education in how you "do science", do science. Science is a process with many pitfalls and ways to fail by accident, even if you genuinely wanted to do it right. Why do we expect people with zero prior experience to get it right?

Product people don't want to do real science with their "data" anyway, because then they might not get the answer they want!