I write this respectfully as a member of the scientific community, myself a biomedical researcher.
To begin, "testing" is not a "scientific discipline", rather scientific disciplines employ "testing" i.e. experimentation to achieve empirical data (results) which are then subject to interpretation in order to reach a conclusion confirming or negating a predetermined theory regarding what the result will be and why.
ANYONE can perform a "test" along whatever parameters they like, with whatever precision and whatever level of repeatability, to conform or not with modern scientific standards. The first key element of performing any test is the rationale behind the test - why are you doing it? what are you trying to see/learn/discover/demonstrate? If you are not seeking to demonstrate anything, just performing the task for amusement, then it is not technically a "test" much less a scientific experiment...
The next key element is determining whether or not the endeavor will actually yield results pertinent to your rationale. If it will not, select an alternate method. Now this is important - you may not actually have a clue as to whether or not the method chosen will yield pertinent results, for indeed that can only be demonstrated empirically. You can draw up a theory regarding this by extrapolating from empirical evidence from other demonstrations, but a theory is not evidence.
So that should clear up whether or not Noss' lengthy demonstrations are "tests". As to whether or not his tests are "documented from start to finish", the videos speak for themselves. Noss does a better job of documenting than any contribution to any scientific journal on the planet. Accusing him of fraud in regard to documentation is utterly ludicrous from an objective stand-point, pure slander with no demonstrable basis whatsoever. One can say anything about anyone on the internet, I just hope that those "listening" will go to the primary source with an open mind and draw their own conclusions based on objective evidence.
But this still does not get into "tests" as a matter of "science".
I mentioned earlier the question of whether the techniques or methods employed by the tester are capable of yielding pertinent results. Many will state as a matter of course "No, hitting a knife with a hammer is not capable of yielding pertinent results regarding the durability of that knife! Any knife hit with a hammer will break!" But what evidence exists to support this? In demonstrable reality, the OPPOSITE is in fact the case, i.e. hammer impacts do NOT have the same effect on different knives, for a variety of reasons (most of which can be summarized into "knife design"). So, does this negate the objection? No, it only negates the rationale behind it and people continuing to spout that rationale can be ignored as ignorant of physical reality. And without the rationale of the objection to oppose him, Noss swings the hammer... repeatedly... over and over again. (Does anyone actually watch these videos straight through from start to finish?? Geez.)
Regarding measurement of the hammer impacts as important to proper interpretation of the data generated, that would certainly be more rigorous... but why do it? Again, you distrust the technician for objective reasons? You assume he has an agenda, that he is intentionally hitting some blades harder than others, or using harder materials for some than others, or perhaps the hammer for some knives is actually a rubber mallet painted to look like metal?
The mistake is applying a precise measurement to the technique (something Noss does NOT do) and then objecting to the technique when the data does not comply with hoped for results. If one had objective reasons for assuming that the hammer impacts performed by the technician on a variety of different knives did not average to similar amounts of stress, I can see where such measurement would be requested, but the integrity of the tests does not in itself require it, that level of precision just isn't called for. In my experiments on individual subjects (be they animals, cell cultures, etc.), many of the techniques employed for generating data involve subjective manipulation, e.g. trituration of cells in an enzymatic mixture, using an unknown/unspecified level of force. Why do I not measure this force? Because it has been demonstrated to be irrelevant to the procedure in that it cannot be measured every time with any degree of accuracy, and what truly matters is not knowing the level of force applied but rather the ability of the technician (myself, my predecessors, and those I teach the technique to) to accomplish the desired result. What is the desired result from Noss hitting the knife with a hammer? Well, when cutting into a medium such as wood, metal, or concrete, the desired result is indeed the cutting of said medium, it is NOT the failure of the knife (which is indeed the desired result when Noss finally puts a stubborn blade into a vise and performs side-impacts on the tang). And again, NOT every knife fails from this sort of (ab)use - again, for a variety of reasons which can be summarized into "design of the knife", some can handle this treatment better than others. Observe the video evidence for signs of unfair hammer impacts, or observe the medium being cut. Present these observations as data for discussion of how the knife performed at the task.
I could go into more detail regarding measurements and precision in regard to these tests but have already done so in other threads on the same topic. For my own purposes, which have yet to include hammering a knife blade through concrete, I do not require such precision and am surprised that anyone else would. I am more interested in precise measurement in comparisons of edge retention between steels (e.g. Jankerson's tests). But that is me.
On the issue of repeatability, namely the objection that Noss' tests are intrinsically unrepeatable... How so? What empirical evidence can be presented in this regard? Who has attempted to repeat these tests and can offer the same level of evidence? Okay, that is too rigorous, how about just a little bit of evidence, maybe a detailed write-up with accompanying photographs? Anyone? What about theoretical objections? Can no one else hit a knife with a hammer into wood, metal, and concrete?? If you are worried about performing the exact same techniques with exactly the same amounts of force, do not be so troubled, for it is not required! Indeed, Noss has repeated the procedure many times, and even includes repetition in each test (impact, impact, impact...). Are you concerned that unless you mimic his actions and forces exactly you will not achieve results validly comparable? Do not be so troubled, that level of precision is not required, and only through repetition of the experiment can the data generated truly be called into question.
In conclusion, Noss indeed performs "tests" (just as many others have), his tests have not been demonstrated as unrepeatable, they include sufficient measurement for rough comparative analyses between subject knives, and there is insufficient evidence to negate the integrity of the tests.
NOW, what OBJECTIVE CONCLUSIONS can be drawn from the data Noss has taken such pains to generate (at no cost to us and no profit to himself)? If you discount his method entirely (even without objective reasons for doing so), no conclusions can be drawn. End of story. If you admit the methods and evidence presented, you can discuss what caused each knife to fail in the way it did when it did, be it steel type or heat treatment or stock thickness or edge grind (all encompassed by "knife design") or a bad knot in a piece of wood or an accidental strike on the vise. The ultimate conclusion that can be drawn from a test (avoiding bad hits) is how well the design of the knife handles this particular treatment of it. How you extrapolate its performance to your own potential situations is up to you, and indeed such extrapolations can be done quite easily. But if you conclude from a single test by ANYONE that ALL similar samples will fair similarly, you are jumping to conclusions. This is data, not proof of something.
As to CRK, it sounds like his warranty is good, and his own words suggest that his marketed "hard use" knives should not be allowed to encounter substances harder than wood? So keep them away from rocks/concrete/metal/etc. and be ready to warranty them otherwise. If this restriction fits into your idea of "hard use", :thumbup:, if not then find a different tool as he suggested (jackhammer, axe, whatever). I imagine that the same is true of most makers and manufacturers (excepting Bussekin?).
I hope the OP enjoys his CRK investment to the fullest and never experiences a failure. :thumbup: