If you challenge my findings, it will hurt my profits
FTFY.
I found this publication in the British Medical Journal interesting about how evidence-based medicine is undermined by financial incentives. Science is the best institution we have for understanding the truth, but it’s far from incorruptible. It’s especially disappointing that the companies profiting from a product are in many instances the ones doing the studies to prove their safety and effectiveness. The corporate capture of the governmental agencies tasked with regulating them is also quite concerning, as is the state of academia.
All my homies love meta science
“boy i wish anyone bothered to even skim my paper to make sure i didn’t make an obvious math error”
There’s really only failing, then learning, then death
My kids have me listening to way too much Disney music lately…
if someone cared enough about my research to even replicate it let alone disprove it I’d be losing my shit
What’s it about?
I’ll find it and put it on your doorstep.
Having your findings disproven isn’t failing though right? You still added to the body of knowledge because we know more stuff. I’m not a scientist though so I could be wrong. Pseudoscientists add nothing and just do harm though.
No work is wasted if it gives a clearer picture of something. Even if you get disproven, it just means that you found one of the dark parts of the picture. Now sure, people mostly remember the ones that discover the brighter parts of the image. But the whole picture is still made of both the dark and bright parts. We don’t just need to know what works, we also need to know for sure what DOESN’T work. Or else we’ll never know the real bounds of something.
Now if you don’t mind, i’ll go back to slamming my head against analysis.
Slammed! Also cool metaphor.
Theoretically yes, but in practice, negative results don’t usually get published. People don’t want to fund negative results. Every fu ding agency is always chasing novelty, and impact. Our scientific community is actually kind of bad with actually doing science. We are lucky if we get negative results widely known these days.
I’ll keep saying it. Let’s have a journal system for negative results and replication studies. Give partial credits for it relative to journal papers with novelty.
So if you have an idea you can search there, see if someone has tried it and failed, and how they failed. You can also search a certain paper and see if people have replicated the study.
It’ll help everyone immensely.
If all is being done on the up and up, nobody’s got an agenda to push, they’re actually doing science: no. Doing an experiment, publishing results, and then having your peers replicate your experiment and be unable to reproduce your results is not failure. In the words of Adam Savage, “It’s not ‘my experiment failed,’ it’s ‘my experiment yielded data.’” But also, if one scientist gets a result and no one else does, the real thing we learn might be in finding out why.
REPEAT is a part of the scientific process.
It’s not a failure in the usual sense we think about it, no. You were still “technically wrong” in whatever hypothesis you had that was disproven. But the end result is different because theoretically everyone involved cares more about the answer being found, not necessarily that they are the one to do it.
Hell, in cases where whatever you did was later proven incorrect it’s usually that whatever you did was the most correct answer for the information we had at the time. Then new information is discovered and often someone else builds off what you did to get this new answer.
We need to push more for good science because a lot of times there is a ton of pressure to produce research and go along with the current established theories instead of being able to challenge them.
Ideally? Yes
But a modern scientific environment puts a lot of pressure to present your results better than they really are.
It damages good science a great deal
In my opinion, the obsession with being able to measure everything with numbers is the cause. And those numbers are inevitably converting d to units of money, because capitalism.
Yup, metrics kill it all
There was a rule of sorts. All metrics become goals or something like that.
“When a measure becomes a target, it ceases to be a good measure.”
This is why p-hacking and searching huge databases for anything with a correlation to a desirable (or undesirable) trait are simultaneously so prevalent, and so damaging.
over fitting, but people
*If you challenge my
feelingsprofits, I’ll sue.Have you ever seen the history of science? Left is absolutely not true to the point that we’ve had to wait for powerful scientists to die to get the progress they’ve held back entered to record.
A course I took in undergrad on the history and philosophy of science really stayed with me, and is a really helpful way of understanding how science actually works.
Karl Popper wrote the revolutionary work The Logic of Scientific Discovery, which proposed that what separated science from pseudoscience as whether the discipline actually makes predictions that can be proven wrong, and whether it changes its own rules when it observes exceptions to those rules.
Well, Thomas Kuhn came along and wrote The Structure of Scientific Revolutions, which argued that not all scientific theories were equally falsifiable. Kuhn argued that science actually tolerated a lot of anomalous observations without actually rejecting the discipline’s own paradigms or models. In Kuhn’s view, scientists performed “normal science” by accumulating knowledge under an established paradigm, including tolerating observed anomalies, until someone would have to come along and use the accumulated anomalies to actually propose something revolutionary that breaks a lot of previous models, and throws away a lot of the work that came before, in a scientific revolution. Under Kuhn’s description, science is quite resistant to criticism or falsifiability under the “normal science” periods, even if it accepts that revolutions are occasionally necessary.
The prominent example was that Mercury’s orbit didn’t quite fit Newton’s theory of gravity, and astronomers and physicists kept trying to rework the formula on the edges without actually challenging the core paradigm. For decades, astronomers simply shrugged their shoulders and said that they knew that the motion of Mercury tended to drift from the predictive model, but they didn’t have anything better to turn to, if they were to reject Newtonian gravity. It wasn’t until Einstein’s general relativity that scientists did have something better, and learning that Einstein’s theory works even when near a large gravity well was revolutionary.
Others include the phlogiston theory of combustion that persisted for a bit even after it was measured that combustion of metallic elements increased the mass of the resulting burned stuff, as if phlogiston had negative mass.
Imre Lakatos tried to bridge the ideas of Popper and Kuhn, by observing that each discipline had their own “Research Programs” that weren’t necessarily compatible with others in their own field. Quantum physics was aware of cosmology/relativity, and it didn’t much matter that these two sets of theories and research methods had different scopes, and contradicted each other at times. But each Research Program had its own “hard core” that was not subject to questioning or challenge, while most scientists did the work in the “protective belt” around that core. And even when a particular Research Program gets battered by a series of contradictory observations, it’s perfectly rational for scientists in that field to rally in defense of that hard core to see if it can be revived, at least for a time until that defense becomes untenable. In a sense, Lakatos described the fields where Kuhn’s “normal science” and “revolutionary science” actually happened, and how Popper’s falsifiability criterion fit into each space.
Paul Feyerabend also added a lot of color to these theories, too. He described the tenacity of ideas as being driven by more than simple falsifiability, but also of just how attractive of an idea it was. In his descriptions, ideas basically fought for popularity on many different metrics, and the sterile ideas of falsifiability didn’t actually account for how ideas compete in the marketplace, even among allegedly rational scientists.
So yeah, this comic is basically Karl Popper’s views. The world as a whole, though, has definitely moved on from that definition trying to demarcate between science and pseudoscience.
This doesn’t disprove their meme. What it is saying is still true. Those scientist you mention held back progress and couldn’t be “real scientists”
Could it be the phenomenon we also see in areas such as Engineering were as people get more senior most transit into more managerial positions, where the mindset is a lot more about managing appearances and stakeholders, and saying the right things at the right time to the right people rather than the far more “it is as it is” mindset of those on the technical side?
I actually started by going into Science at Uni but ended up switching to Engineering half way on my Degree (not many jobs for Experimentalist Physicists in my homeland) so never actually saw the actual Science career track from the inside through the eyes of somebody with enough professional experience to see the more subtle things about it, so I am genuinely curious if the Science career too has the phenomenon I see in Engineering of Senior people tending to be more Administrator/Manager and less Technical hence with more tendency to manage the subjective perception of reality of others to achieve personal and career goals and less of a desire for things to be as clear and as objective as possible.
Because if it is so, it would explain how many such well established older Scientists seem to be less Scientist in the sense of this meme - because they are less Scientist and have become more Administrator, and the latter has a whole different mindset.
You got it. It has been my experience as well.
I feel like there’s a term for that sort of thinking…
No True Scotsman? That could be true if the image is merely descriptive of our messy reality.
I see the image as including a prescriptive message that states an ethical ideal: a real scientist should welcome their findings challenged, even refuted, because the goal is truth. Science excels by dispelling falsehoods. That seems right. (It could use some alt text, though.)
in b4 “if by whiskey” 😄
Yeah, the right is how science unfortunately works. My professor told me that science progresses one death at a time. We argued in various papers that the terminology in our field was really messy and didn’t hold up to actual findings, but the old generation of scientists didn’t want to allow any changes. In most research fields there are a few scientists that hold a position of power and that don’t like sharing that power.
Reading Ursula Le Guin’s The Dispossessed and her idea of an anarchist world caught me off guard when she starts exploring exactly this problem in science…
Would you recommend the book?
1000%!! Over the years I’ve lent it to various people and they all loved it very much. It has been the most influential book for me regarding how I view society, capitalism and anarchism.
Saved your comment, hopefully won’t take too long before i find time to read that book :)
I’m adding that to my reading list, thanks.
The Dispossessed
You should put it near the top. lol I just told someone else to read it yesterday irl.
Not to mention all the bs around science publishing, like not publishing negative results
Yeah, my first thought when I saw this was that it was definitely not made by a scientist.
deleted by creator
To make this meme work I am assuming pseudoscience are your flat eathers, anti-vaxxers, anyone who publishes bogus papers to push an agenda. Their experiments are replicated, produce completely different results to contradict their hypothesis and these pseudoscientists simply refuse to accept the data produced after sound methods are used and verified. They end up becoming zealots about it too.A hypothesis being wrong is not bad at all but their own personalities prevent them from accepting it.
I really don’t like this “no true scotsman” flavored meme, the profit incentive destroys valuable research by limiting resources to replications of past experiments (as soon as something is profitable, you must not disprove it for a fear of retaliation from companies promoting said something), this is systemic, not an individual level problem, get rid of “bad scientists” and more will be propped up.
I do like the sentiment of the meme though, more more replication is needed.
Don’t forget about the third category: “Your research results are hurting my feelings and therefore wrong! Cancel you!”
Or “your research results will hurt my profits, this media campaign will slander your credibility. We’ll do our own research, with blackjack and hookers, and bribed results”
For example, a friend of mine ran a study that disproved a company’s study that they used to push a product. Then my friend’s company got blacklisted by the first company for all future products.
Or “my research is true because of conspiracy theories”
Fans of conspiracy theories do researches? :)
I mean that pseudoscientists often back their claims via conspiracy theories
Unfortunately negative results don’t get published as much as they should
Everyone in science I’ve ever met agrees there should be a Journal of Stuff That Didn’t Work
Meanwhile, Higher Education research be like:
- publishes good quality research on the efficacy of an advising methodology
- immediately gets ripped to shreds by professors from schools using other advising methods
- only research that gets unchallenged is stuff like “some advising is much better than no advising” or "people have different learning styles
- academic advising will never be a career due to the lack of consensus
I like to export the failing onto other people, though.
gravity doesn’t really care who tries to disprove it, they still go splat.