SciSummary Review: A Careful Summary I Mostly Wasn't Allowed to Read (3/5)

Friday afternoon, and I'm looking at exactly one sentence of my own paper's summary: "The study aimed to evaluate the effects of different irrigation methods combined with mulching on field-tomato plots." Under it the text fades to white, and a card sits on top: "Activate your trial to access this summary." No close button on that card. Scrolling the summary box does nothing, because the box is clipped at a fixed height.

Getting there had been almost suspiciously easy. scisummary.com/register, email, password, confirm, terms checkbox. My review Hotmail, no Google. No captcha, and no verification email at all. I checked Inbox, Other and Junk out of habit and there was nothing to click. It dropped me straight into a dashboard with a modal that said "Explore SciSummary — Unlock Full Access with Your Free Trial". I closed it, uploaded a PDF, left the length slider around 400 words, and hit Summarize. Submitted at 16:11:40, summary on screen at 16:12:23. About 43 seconds.

Then the fade.

I write code for a living, so when a page hides text behind a gradient my first reflex is to check what the page actually delivered. The whole summary was there. That's how I graded it; a normal free user would only see the one sentence.

The paper I fed it

I didn't want to grade a summarizer on a paper I half understood, so I made a two-page fake agronomy paper where I know every number. Straw mulch versus bare soil, morning versus evening drip, field tomatoes, 36 plots in 12 blocks, 14 weeks, water held at 310 L a week. A table and a bar chart. Soil moisture 18.2% bare, 24.7% with mulch. Yield up 21%. Evening drip gave no significant yield gain (p = 0.41) but cut blossom-end rot from 9.8% to 6.1%. Hail took two harvests in block 7. Probes only at 15 cm. Don't extrapolate to plastic mulch or sandy soil.

The first version that showed up at 16:12 was a headed list: Objective, Methodology, Key Results, Limitations, Conclusion. The numbers were right. 18.2 to 24.7, the 21%, p = 0.41, 9.8 to 6.1. I was ready to be impressed, and then I read the Limitations. "Other factors like pest incidence or soil nutrient levels were not addressed." My paper never says that. It's filler, the kind of limitation you could paste under any field study. It also called blossom-end rot "disease control" (it's a calcium problem, not a disease), and it skipped the hail and the 15 cm probe depth, which were the actual limitations.

Then it rewrote itself

When I looked at the same summary slot again around 16:14, it held different text. A 403-word block of plain prose, no headings.

I don't know what runs behind the scenes. This version was good, though. Properly good. Every number was right, including the p = 0.38 for mulch alone on blossom-end rot, which is the kind of detail that tells you it read the results paragraph instead of the abstract. It said "evening irrigation produced no additional yield benefit beyond straw mulch", which is exactly the sentence I'd want a summarizer to get right, because the lazy reading of my abstract is "evening drip helps". It kept the hail in block 7. It kept the 15 cm probes. It even kept "about 11 person-hours per 1,000 m² were excluded" from the economics, and ended on "Results should not be generalized to plastic mulch or sandy soils."

So the engine is careful. The first draft wasn't, the second was, and I only know that because I happened to look twice.

One summary, then a wall

I tried one edit. + NEW SUMMARY, mode set to Key Points, submit.

"We could not complete your summary: You must activate your FREE trial or have an active subscription to generate summaries."

That was it. One summary per free account, and you can read about a sentence of it. What bugs me more than the limit is that nothing said so beforehand. No counter, no "1 of 1 used", nothing near the upload button. You find out by failing.

The rest of the app is behind the same door. Chat and Figures have lock icons and open the trial modal, so I never got to ask it about the table or the bar chart, which was half the reason I put them in. Podcast and Slides show up in the mode dropdown with "(Activate Trial to Use)". The two open tabs were a mixed bag. References got the title right, showed Identifier "NO_DATA", no authors and 0 references (fair, my fake paper has no reference list), with a note that the metadata "may not be complete". Recommendations sat on "Loading recommendations..." and never finished, probably because a made-up paper has nothing to match against.

I didn't get anywhere near the API or the MCP server, DOI or arXiv import, bulk runs, Zotero, or a long scanned PDF.

Four dollars a month, card first

Activate Trial sends you to Stripe Checkout: "Try SciSummary Premium", "7 days free", "Then $7.00 per month starting October 2, 2026". There's an annual toggle, "Save $36", which gets it to $4.00 a month. The trial asks for a payment method up front (card, US bank, Klarna, Cash App, Apple Pay, Link, Amazon Pay). I backed out without entering anything.

Where the plans live is its own small mess. scisummary.com/pricing is a 404. The plans are only on the homepage: Student at $0 for the first month with code STUDENT26, Pro at $4/mo billed $48 a year or $7 monthly, and the 7-day trial with 30,000 words, 5 AI figure analyses, 100 chat messages and 50 imports.

Four dollars is cheap for a summarizer that gets p-values and caveats right on the second pass, and if you're a grad student working through a stack of PDFs every week I think it's worth a trial, card and all. If you wanted a free tool, this isn't one. For free PDF answers you can actually read on screen, Humata's free tier was a very different afternoon. The listing is on SciSummary's ToolifyNav page if you want the rest of the details.

Final rating: 3 out of 5.