Compounding and compliance

Peptide research fraud and questionable studies — what to know about the integrity of the literature

10 min read · Uplevel editorial

In 2015, the Open Science Collaboration published the results of an effort to reproduce 100 studies from three top psychology journals. The original papers had all been published in peer-reviewed outlets, passed editorial and reviewer scrutiny, and entered the scientific record as established findings. The reproducibility project, which used the original study authors' materials and methods wherever possible, found that only 36 of the 100 studies replicated with statistical significance. The scientific community absorbed this finding with varying degrees of alarm, but the direction of the conclusion was not disputed: a substantial fraction of published research, even in prominent journals, does not reproduce when someone else tries it. This is not a peripheral problem in science. It is central to how the enterprise actually works, which is to say imperfectly, with self-correction mechanisms that operate more slowly than publication mechanisms and with significant variation in how rigorous any given piece of research actually is.

The peptide and longevity research literature has its own relationship with these problems, and it is worth understanding directly rather than discovering by accident.

The reproducibility crisis applies to biomedical research in ways that are particularly consequential when the research informs consumer decisions about what to put in one's body. A 2012 analysis by researchers at Bayer HealthCare attempted to replicate 67 internal target-validation studies from academic literature relevant to their drug development programs. They were able to reproduce the findings in only 20 to 25 percent of cases. An Amgen team published similar findings the same year, reporting that they could reproduce only 6 of 53 landmark cancer biology studies. These were not studies being questioned because the methods were published in fringe venues — they were studies important enough to be selected as the basis for multimillion-dollar drug development programs. The failure to reproduce was not a finding about bad scientists. It was a finding about a system: small sample sizes, statistical practices that inflate apparent effect sizes, publication bias toward positive results, and the pressure to publish findings that are clean and interesting rather than findings that are mixed and real.

Peptide research sits in an uncomfortable position within this landscape. Many peptides studied in longevity, recovery, and metabolic contexts have their evidence base concentrated in animal studies — often in rodents — where the leap to human application is substantial. Animals are not small humans. The metabolic rate differences alone mean that a dose that produces an effect in a mouse cannot be straightforwardly scaled to human use. More fundamentally, many biological processes in rodents do not map directly to human biology, and the history of drugs that worked brilliantly in animal models and failed in human trials is long enough to constitute a pattern, not an exception. When someone cites evidence for a peptide's effect and that evidence is rodent data, this is worth understanding as a specific category of evidence with specific limitations — interesting, mechanistically suggestive, and not a clinical claim.

The resveratrol controversy is the best-documented example of how contested the science in closely adjacent fields can become. David Sinclair's lab at Harvard published work in the early 2000s suggesting that resveratrol activated sirtuins — particularly SIRT1 — in ways that extended lifespan in model organisms and might translate to anti-aging effects. The findings generated enormous popular attention, a substantial supplement industry, and significant ongoing research funding. In 2010, a team at Pfizer published a paper arguing that the activation of SIRT1 by resveratrol seen in earlier studies was an artifact of the assay system — that resveratrol interacted with the fluorescent tag used in the assay rather than with SIRT1 directly, and that no activation occurred without that tag. The Sinclair lab disputed this interpretation. Further research complicated the picture: some studies found evidence for resveratrol's effects, others didn't; the mechanism was contested; the doses required to achieve effects in humans from dietary sources appeared impractically large; clinical trials produced mixed results. The field did not arrive at a clean resolution. It arrived at a situation where the original finding had been substantially complicated, a meaningful fraction of the initial claims could not be sustained in the form originally made, and yet the supplement industry built on those claims continued to grow. The resveratrol story is not a story about fraud — it's a story about how science is messier than press releases suggest, how findings that are partially wrong can generate substantial consumer markets before the full picture arrives, and how the mechanisms of scientific correction are slower and less public than the mechanisms of scientific announcement.

The peptide literature has its own retraction history. Several papers on BPC-157's effects have faced scrutiny for methodological concerns, including questions about how injury models were constructed and whether outcomes were measured in ways that could bias toward positive results. This doesn't mean BPC-157 doesn't have real effects — the animal data is substantial enough to make that unlikely — but it does mean that the most enthusiastic claims about the compound are not all equally supported, and that parsing which findings are more versus less reliable requires more than counting citations. Some of the peptide papers cited in consumer contexts were published in journals with impact factors below one, in issues that may have included dozens of papers from a single conference, where peer review may have been perfunctory. Not all peer-reviewed journals are equivalent institutions.

The marketing-funded research problem is distinct from the standard reproducibility problem and worth naming separately. The supplement and peptide industry has developed a sophisticated vocabulary for presenting commercial content as scientific evidence. The industry-funded white paper — written by researchers with commercial relationships to the compound manufacturer, published on the manufacturer's website or in a conference proceedings that carries no meaningful peer review — is a common format that can be presented in consumer contexts as equivalent to an academic study. It is not. Predatory journals — publications that accept papers for a fee with minimal or no real peer review — have proliferated rapidly over the past decade and have given the peptide and supplement industry additional venues for producing low-quality research that carries the superficial markers of academic legitimacy. A paper published in a journal called the Journal of Nutrition and Health Sciences or similar names that lack institutional recognition should be evaluated very differently from a paper published in Nature Metabolism or the New England Journal of Medicine.

The conference abstract problem is related. Abstracts presented at scientific conferences represent preliminary findings — they have typically not been peer-reviewed for the abstract itself, they represent incomplete analyses, and they carry none of the quality standards of published studies. Presenting conference abstract data as equivalent to published research is a common practice in supplement and peptide marketing. The distinction matters because abstracts often describe early results from ongoing studies that may look very different when the full data are analyzed, and because the claim "presented at the International Conference on X" has no meaningful quality implication.

The questions worth applying to any peptide research claim are not exotic or complicated. They are standard tools that any careful reader can use. Was the study peer-reviewed in a journal with genuine editorial standards — one that is indexed in PubMed or Web of Science, that has an identifiable editorial board of credentialed researchers, that publishes across a range of findings including null and mixed results? Was the study adequately powered — did it have enough participants to detect the effect size being claimed with statistical confidence, rather than running twenty participants through a study that would need two hundred? Was it a randomized controlled trial with a blinded placebo comparison, or was it an open-label observational study where subjects knew what they were taking? Was the study pre-registered — was the hypothesis and primary outcome measure specified before data collection began, rather than after, which would allow the researchers to look at multiple outcomes and then present the one that was significant as if it had been the intended primary measure? Has it been replicated by independent researchers who have no financial stake in the finding? Were funding sources transparently disclosed?

These questions are not meant to produce nihilism about the peptide evidence base. They are meant to produce calibration. There is legitimate, rigorous research behind some of the peptides in the compounded and longevity medicine conversation. The GLP-1 receptor agonist class has among the most thoroughly characterized evidence bases in modern pharmacology. Growth hormone-releasing hormone analogs have decades of research in pituitary physiology behind them. The mechanisms of action of peptides like BPC-157 and thymosin beta-4 are grounded in real biology even where the human clinical trial data is limited. The honest assessment is not that the research doesn't exist but that it sits at different points on a quality and quantity continuum, and that much of the consumer-facing communication flattens that continuum into a uniform signal of scientific support that the actual evidence does not warrant.

The posture that serves people best is one that takes mechanism seriously, evaluates study quality directly rather than by publication count, maintains appropriate skepticism about industry-funded research without dismissing the compounds that industry-funded research happens to study, and expects honest uncertainty from practitioners rather than confidence that is not warranted by the evidence. A prescribing provider who says "here is what the animal data shows, here is the human data we have and what it does and doesn't demonstrate, and here are the gaps you should understand before deciding" is operating from the right epistemic position. One who says "the research is solid" about compounds where the research is, in fact, limited to small open-label studies and rodent models is overstating the case in a way that should prompt more questions.

The peptide research literature is not a wasteland. It contains real science — some of it excellent, some of it preliminary, some of it contaminated by the incentive structures that contaminate much of commercial research. Learning to read it is the same skill as learning to read any scientific literature: slowly, skeptically, with attention to what was actually measured and what was actually claimed, and with an understanding that the headline is never the whole story. This skill is more useful in the peptide space than in almost any other corner of medicine, because the field moves faster than regulatory oversight and the consumer-facing claims run considerably ahead of the evidence that supports them. That gap will eventually close — either through more research, or through the failure of compounds that turn out not to do what was claimed. In the meantime, the reader who knows what questions to ask is less likely to be misled by the answer.

Frequently asked

Is peptide research trustworthy?+
It varies. Some peptide evidence is rigorous — the GLP-1 receptor agonist class has among the most thoroughly characterized evidence bases in modern pharmacology — while other claims rest on small open-label studies or rodent models. The literature sits at different points on a quality continuum, and study quality should be evaluated directly rather than by citation count.
Why are rodent studies a limitation for peptides?+
Animals are not small humans. Metabolic-rate differences mean a dose effective in a mouse cannot be straightforwardly scaled, and many rodent biological processes do not map directly to human biology. The history of drugs that worked in animal models and failed in human trials is long enough to be a pattern.
How can I tell if a peptide study is high quality?+
Ask whether it was peer-reviewed in a journal indexed in PubMed or Web of Science, whether it was adequately powered, whether it was a randomized blinded placebo-controlled trial, whether it was pre-registered, whether it has been independently replicated, and whether funding sources were transparently disclosed.