Selected synthetic case / actual retained answers
Hormone sampling must be interpreted in the state in which it was performed
Both tools question pituitary surgery and raise glucocorticoid resistance. OpenEvidence is more decision-focused; MontMedical keeps molecular confirmation distinct.
A selected synthetic development case, published by MontMedical. The clinical fingerprints match, but the exact prompts submitted to OpenEvidence were not independently retained. This is an editorial comparison of historical answers, not a blinded efficacy trial.
Our editorial assessment
How the retained answers rate.
OpenEvidence8.2/10
MontMedical8.2/10
Comparable overall: OpenEvidence leads on presentation; MontMedical on interpretation.
Same five criteria and weights for both systems| Criterion and weight | OpenEvidence | MontMedical |
|---|
| Diagnosis and case fit 25% | 9/10 | 9/10 |
|---|
| Interpretation of tests and experiments 25% | 8/10 | 9/10 |
|---|
| Strength of the claims 20% | 7/10 | 8/10 |
|---|
| Decisions and next steps 15% | 8/10 | 7/10 |
|---|
| Clarity and teaching 15% | 9/10 | 7/10 |
|---|
Why each criterion received its mark
Diagnosis and case fit
OpenEvidence · 9/10: Correctly raises glucocorticoid resistance and challenges the surgical interpretation.
MontMedical · 9/10: Correct provisional diagnosis linked to the non-catabolic cortisol phenotype.
Interpretation of tests and experiments
OpenEvidence · 8/10: Explains the sampling-state problem and the hormonal feedback mechanism.
MontMedical · 9/10: Precisely identifies that treated sampling cannot establish the proposed tumour localisation.
Strength of the claims
OpenEvidence · 7/10: Makes a fixed repeat-IPSS pathway sound necessary while the resistance question remains unresolved.
MontMedical · 8/10: Keeps NR3C1 confirmation and the sampling limitation distinct.
Decisions and next steps
OpenEvidence · 8/10: Directly addresses the proposed operation and requests molecular testing.
MontMedical · 7/10: Identifies genetic investigation, but the surgery and severe treatment-period deterioration are less prominent.
Clarity and teaching
OpenEvidence · 9/10: Strong decision-focused opening and a connected mechanism, with more procedural detail than needed.
MontMedical · 7/10: Organised, though long laboratory lists and detailed research figures interrupt the explanation.
AI-assisted editorial judgment of these historical texts, published by MontMedical. Read the rubric, anchors and limits. These are answer-quality scores, not measured diagnostic accuracy or patient benefit.
The actual retained wording
OpenEvidence vs MontMedical.
These are verbatim passages from the retained answers, not rewritten examples. Bold, link formatting and line breaks have been removed. Each labelled passage is contiguous; an excerpt may begin within a sentence. Our interpretation and scores are separate.
OpenEvidence
Retained 2026-09-21
Opening decision
The IPSS result cannot be relied upon as it stands, and the overall biochemical/clinical pattern raises a serious alternative diagnosis to Cushing disease — primary generalized glucocorticoid resistance (Chrousos syndrome) — that needs to be excluded before committing this woman to transsphenoidal surgery.
Next-step framing
The sampling needs to be repeated off metyrapone, with hypercortisolaemia biochemically confirmed immediately beforehand, before the result can be trusted as localizing a source.
MontMedical
Retained 2026-09-21
Leading classification
Presenting with longstanding hypertension, hyperandrogenism since her late teens, and severe mineralocorticoid excess, the biochemical hypercortisolism without catabolic stigmata supports a provisional diagnosis of primary generalized glucocorticoid resistance (Chrousos syndrome), pending confirmatory genetic testing of the glucocorticoid receptor gene (NR3C1).
Sampling interpretation
Bilateral inferior petrosal sinus sampling was performed while taking metyrapone with eucortisolemic urinary free cortisol of 142 nmol/24 h. Because diagnostic sampling requires active cortisol hypersecretion to avoid false-positive results, the central ACTH gradient cannot establish pituitary Cushing disease.
The case and the decision
Longstanding cortisol elevation occurs without the expected catabolic features, alongside androgen and mineralocorticoid findings and a preserved nocturnal nadir. A small pituitary focus is stable. Inferior petrosal sinus sampling was performed while metyrapone had normalised cortisol measurements.
The common insight
Both tools recognise that the proposed localisation cannot be interpreted apart from the treated hormonal state. Both raise primary generalised glucocorticoid resistance rather than treating a pituitary gradient as sufficient proof of a surgical tumour.
A published NR3C1 functional case illustrates that glucocorticoid resistance can mimic pituitary Cushing disease. Separately, an IPSS case during a cyclic cortisol trough falsely suggested a pituitary source. The latter supports attention to sampling state; it was not an experiment in metyrapone-treated Chrousos syndrome. [1] [2]
How the descriptions differ
OpenEvidence leads directly with why the IPSS result should not commit the patient to surgery. That is a strong decision-focused opening. MontMedical explicitly describes the resistance diagnosis as provisional pending NR3C1 confirmation and organises the supporting findings separately from the limits.
What this pair establishes
This is substantial diagnostic agreement, not evidence that OpenEvidence failed. The unresolved questions are the molecular/functional basis of the resistance hypothesis and the meaning of sampling under the documented treatment conditions. Neither a procedural drug-withdrawal timetable nor a universal repeat-sampling rule follows from these two papers alone.
Retained answer dates: MontMedical 2026-09-21; OpenEvidence 2026-09-21. Excerpt wording was checked against the retained answers; formatting was removed. These versions were selected during development. Complete original run settings and identical submitted prompts are not documented.
This article examines the MontMedical Pro beta using retained diagnostic answers.