JevGPT: Thinking Fast and Slow
in Autonomous Research

Yasheng Sun, Yanning Dai, Yimeng Chen, Nanbo Li, Firas Laakom, Yifan Xu, Piotr Piękos, Mateusz Ostaszewski, Wenyi Wang, Cheng Luo, Yuhui Wang, Jürgen Schmidhuber
King Abdullah University of Science and Technology (KAUST)
JevGPT dual-system architecture: System Two plans searches, sets evidence objectives, integrates findings and produces results; System One checks support, locates passages, scores relevance and adapts reading.

JevGPT’s dual-system architecture for autonomous research. System Two uses GPT to plan searches and integrate findings into answers or rankings. System One uses Jev to guide parallel evidence inspection and return source passages; the dashed loop indicates adaptive reading.

Abstract

Autonomous research agents must acquire and reason over evidence within a limited budget. Yet relevant sources can remain uninspected or unused, leaving a gap between retrieval coverage and the evidence that informs research. The challenge is to align fast local judgments with changing evidence needs and feed their findings back into research decisions. We introduce JevGPT, a dual-system architecture for autonomous research that couples fast evidence processing with deliberative research planning. System Two sets evidence objectives and integrates findings, while System One locates support, assesses relevance, and guides further inspection. Independent source judgments run in parallel; selected original passages inform the next research step. Experiments on fixed-corpus question answering and document ranking show that JevGPT achieves leading task performance, with faster completion and lower cost than comparably effective research agents. Evidence analysis shows broader source inspection and greater coverage of supporting documents in the research loop, highlighting efficient evidence processing as a route to more capable autonomous research.

Method

Key observation. Research planning and local evidence judgments require different scopes of information. Planning uses the accumulated investigation, whereas a source judgment can be bounded by an explicit evidence objective. Independent judgments under that objective can run in parallel, while their findings return to the research process to inform the next objective.

Overview of JevGPT: a System Two research loop delegates requests to System One readers for evidence localization, relevance assessment and evidence discovery over hybrid BM25 candidates.

Overview of JevGPT. System Two plans research and integrates evidence; System One guides evidence localization, relevance assessment, and discovery. The readers return original passages with local judgments. Dashed loops adapt reading; the dashed discovery branch supplies additional research leads asynchronously.

Results

We evaluate on BrowseComp-Plus (fixed-corpus question answering, 830 questions) and NeuCLIRBench (document ranking, 105 topics). JevGPT achieves leading task performance at lower cost than comparably effective research agents, and it also completes research faster.

Quality versus API cost on BrowseComp-Plus and NeuCLIRBench; JevGPT sits at the upper left in both panels.

Quality and API cost. Stars mark JevGPT; upper left is better. Costs include both systems for JevGPT; the NeuCLIRBench panel shows GPT-based methods.

BrowseComp-Plus results on 830 questions. Resources are per-question means; S2/S1 denote the two systems’ API costs. Bold and underlining mark the best and second-best values, including ties.

Performance Resources / question Cost / question ($)
MethodRetrieverAccuracy (%) ↑ Tokens (K) ↓Searches ↓Time (s) ↓ S2 ↓S1 ↓
BCP/ReActBM2577.11216924.87182.13.0798—
Pi-SeriniBM2582.0526614.41112.60.4053—
AgenticaBM2584.4633533.88111.70.7919—
AtlasNavBM25 + map89.1694820.54144.01.5257—
RISEBM2589.8860926.08111.01.1050—
Reason-ColBERTColBERT90.0093116.36136.21.6090—
JevGPTHybrid BM2590.484339.1391.70.60810.0600

NeuCLIRBench results on 105 topics. Resources are per-topic means. Bold and underlining mark the top two values; dashes denote inapplicable or unreported resources.

Performance Resources / topic Cost / topic ($)
MethodRetrievernDCG@20 ↑F1@20 (%) ↑ Tokens (K) ↓Searches ↓Time (s) ↓ S2 ↓S1 ↓
BM25BM250.360826.13—————
RM3BM250.362226.17—————
PatapscoBM250.348524.80—————
Qwen3-RerankerFusion0.513835.06—————
RankGPTBM250.484332.48761.00141.30.6402—
BCP/ReActBM250.484730.6085315.42186.80.9707—
AgenticaBM250.510734.1951632.85211.00.8256—
Pi-SeriniBM250.524035.027087.35177.00.8515—
JevGPTHybrid BM250.539036.101582.6879.30.57560.0082

Analysis

Gold-document recall at candidate pool, inspection, source delivery and final citation for JevGPT, Reason-ColBERT, Pi-Serini and BCP/ReAct.

Gold-document coverage. Mean per-question recall over 830 BrowseComp-Plus questions, measured separately for each document set under native retrieval settings. JevGPT and Pi-Serini have similar candidate-pool coverage, yet JevGPT achieves higher recall for both inspection and delivery of original text to System Two.

Accuracy versus total API cost for JevGPT with different System Two models on BrowseComp-Plus.

Cost and accuracy across System Two models. Each point represents JevGPT with a different System Two model on 415 matched BrowseComp-Plus questions. API cost includes both systems. The dashed line marks the observed Pareto frontier.

BibTeX

@article{sun2026jevgpt,
  title   = {{JevGPT}: Thinking Fast and Slow in Autonomous Research},
  author  = {Sun, Yasheng and Dai, Yanning and Chen, Yimeng and Li, Nanbo
             and Laakom, Firas and Xu, Yifan and Pi{\k{e}}kos, Piotr
             and Ostaszewski, Mateusz and Wang, Wenyi and Luo, Cheng
             and Wang, Yuhui and Schmidhuber, J{\"u}rgen},
  journal = {arXiv preprint arXiv:submit/8222684},
  year    = {2026}
}