A Pilot Evaluation of Open-Weight Large Language Models for Screening RNA-seq Metadata in Public Databases

Venue suggestions

Major revisionpanel verdict · 2026-09-03

Venue Recommendations

as_is

In Silico (the intended target)

This manuscript fits In Silico's scope exactly: it is original research with checkable claims, deposited code and data, and explicit limitations. The editor's verdict is "major," not "reject," meaning the core contribution survives scrutiny. The required revisions are all bounded and addressable (label agreement, threshold sensitivity, claim qualification, methodological transparency). In Silico's model-reviewed, public-record format is actually well-suited to this work because the panel's concerns are specific and resolvable without rethinking the design. The paper will be stronger after revision, but it is already suitable for overlay review in its current form — the defects are in precision and completeness, not in soundness.


after_revision

GigaScience

Once the label-reliability estimate and threshold-sensitivity reanalysis are complete, this becomes a natural fit for GigaScience's scope (computational biology, open data, reproducibility). The paper's strengths — reusable code, full transparency on model versions and hardware, honest limitations, and practical workflow — align with GigaScience's values. The revised version will have addressed the two substantive gaps (inter-annotator agreement and threshold robustness) that currently prevent a minor verdict. Acceptance odds: moderate to good, conditional on revisions being thorough.

Bioinformatics (Oxford)

The workflow is a genuine tool contribution: API-based retrieval, LLM-based filtering, and aggregation of results. After revision, with the confidence-threshold analysis and label-agreement data in hand, this reads as a methods paper suitable for Bioinformatics' audience (bioinformaticians building and validating pipelines). The narrowed scope claim (one organism, one treatment, bulk RNA-seq) is appropriate for a methods-focused venue. Acceptance odds: moderate, especially if the authors emphasize the configurable design and GitHub release.

Scientific Data (Nature portfolio)

If the authors expand the evaluation to a second organism/treatment pair (as suggested in the minor revisions), this becomes a data-descriptor candidate: the 150-project benchmark dataset with ground-truth labels and per-model outputs is a reusable resource. Scientific Data values reproducibility and open data; the current single-task scope is borderline, but a second validation would justify a descriptor. Acceptance odds: low to moderate at present; better after a follow-up study.


alternative

bioRxiv (as a preprint)

The paper is already suitable for bioRxiv and may remain there indefinitely. If the authors decide not to pursue journal publication, a versioned preprint with the required revisions incorporated is a legitimate endpoint. The open-review model of In Silico or a traditional journal review may not be necessary for impact in this case — the code and data are the primary contribution, and they are already public.

F1000Research

An open-review, rapid-publication alternative if the authors want feedback and publication without the full revision cycle of a traditional journal. F1000Research's model allows publication with reviewer reports visible, similar to In Silico but with a different audience. Suitable for the current manuscript with minor polishing; acceptance odds are high.

Specialized workshop or conference proceedings (e.g., ISMB/ECCB, Plant & Animal Genome conference)

If the authors want to present this as a focused pilot study, a workshop on metadata curation, LLM applications in bioinformatics, or plant genomics would be appropriate. The single-task scope and honest "pilot evaluation" framing fit workshop scope well. This is a lower-stakes venue for a narrowly scoped contribution, but it reaches the right audience (biocurators, plant genomicists, LLM practitioners).


Notes on fit and strategy

  • Why In Silico remains the best target: The editor's "major" verdict is not a rejection; it is a request for specific, bounded improvements. The panel was consistent and positive (4/5 median, 1 accept + 4 minor). In Silico's public-record format actually suits this paper well because the required revisions are transparent and checkable. After revision, the paper will be stronger and the venue's overlay model will showcase the full debate.

  • Why GigaScience and Bioinformatics are realistic after revision: Both journals value open code, reproducibility, and practical tools. The label-agreement and threshold-sensitivity analyses directly address the editor's concerns and will make the paper publishable at these venues. GigaScience is slightly more forgiving of single-task scope; Bioinformatics expects methods to be generalizable, so the authors should emphasize the configurable design.

  • Why Scientific Data is conditional: It requires a second organism/treatment pair to justify a data-descriptor submission. The current 150-project Arabidopsis/ABA dataset is useful but narrow. A follow-up study (rice/drought, as suggested) would make this a strong fit.

  • Avoid: Top-tier venues (Nature, Science, Nature Methods) are out of reach for a single-task benchmark with a single-curator label set, even after revision. The contribution is solid but incremental — it is a controlled comparison of existing models on a defined task, not a methodological breakthrough. Specialty journals in plant biology or genomics would undervalue the LLM/computational contribution.

← All documents in this review