Definition of statistics by BRITANNICA is-
Statistics is the science of collecting, analyzing, presenting, and interpreting data. Governmental needs for census data as well as information about a variety of economic activities provided much of the early impetus for the field of statistics. Currently the need to turn the large amounts of data available in many applied fields into useful information has stimulated both theoretical and practical developments in statistics.
Statistics is a very complex and challenging field. Most scientists we know have a moderately sophisticated understanding of statistics, many know far more of statistics than we, although some apparently less. However, most large studies consult with statisticians who are experts in statistical analysis.
I believe that statistics can be a science in the same sense as physics. The fact that it is split into two branches, frequency and Bayesian, is unsettling. There is no consensus among statisticians on some fundamental issues. This means that users of statistics must apply their own judgment - they cannot fully rely on results of research performed by statisticians in the same way that they can do it in an idealized science that I described above. Statistics does not generate intellectual material of the same kind as in historical research or art so it should try to evolve in the direction of natural sciences such as physics, in terms of consensus.
Statistical analysis is just another tool of modern science – it is part of the technology of science. And like all things, there is a wide variation in quality and understand across individuals, and what filters down to the public is generally oversimplified to the point of being wrong.
Statistics is a very complex area of science and mathematics and much of the problem is that many scientists themselves don’t understand statistics well enough, because of how they view it. Statistics is sometimes viewed as an obstacle to get to the science, but in reality its part of it.
Some people say that,
The problem is that new software packages have made it easy to apply statistical tests even in situations where understanding them is difficult, or they might not be needed at all. Many people have this notion that. Because it is so easy, many people just tack this sort of thing onto the end of papers.
The thing to keep in mind is that each statistical test looks for different aspects of the data and you have to understand what they do in order to determine if the test is appropriate and if the results will be meaningful.
So we can easily say statistcs is a science.