AI शोधकर्ता किट
ML शोध की योजना, निष्पादन और प्रकाशन: पूर्व-पंजीकरण, प्रशिक्षण योजना, डेटा प्रबंधन, प्रयोग, बेंचमार्क, मानव मूल्यांकन, शोध पत्र और पुनरुत्पादनीयता।
योजना
Study Preregistration Template
मानकPreregistration of hypotheses, design, sampling plan and stopping rule, variables, analysis plan, exclusions and deviations log
OSF preregistration (concepts)Model Training Plan Template
पूर्णObjective and success criteria, data mix and splits, baseline, architecture, 6ND compute budget in KaTeX, ablations, checkpoints, stop rules, gates, risks
Planning concepts from Kaplan et al. 2020 and Hoffmann et al. 2022Data Management Plan (DMP) Template
पूर्णFunder-style DMP – storage, sharing, privacy
NIH/NSF/EU DMP conventions
मूल्यांकन और सुरक्षा
ML Experiment Tracking Report Template
पूर्णHypothesis and decision rule, setup, config and seeds, data versions, results vs baseline with variance, paired test, ablations, failure analysis, decision
Reporting informed by the NeurIPS Paper Checklist (2026)Model Benchmark Report Template
पूर्णBenchmark choice and validity, contamination checks, protocol, prompts and decoding, repeated runs, confidence intervals, McNemar test, comparison table
Practice from HELM (TMLR 2023), Miller 2024 and Sainz et al. 2023Human Evaluation Protocol Template
पूर्णTask and rubric, rater recruitment and training, ethics and consent, sample size, blinding, Cohen's/Fleiss' kappa, Krippendorff's alpha, QC, analysis
Human Evaluation Datasheet (HumEval 2022); van der Lee et al. 2021
दस्तावेज़ीकरण
ML Conference Paper Template (NeurIPS Checklist)
पूर्णML conference paper: abstract, method, experiments, results, limitations, broader impact, reproducibility statement, appendix, NeurIPS 2026 checklist, ACL note
NeurIPS 2026 Paper Checklist (16 items, paraphrased); ARR Responsible NLP checklistML Reproducibility Checklist Template (REFORMS)
पूर्णREFORMS-aligned ML science checklist: 32 items in 8 modules, leakage audit worksheet, evaluation protocol, code and data release, compute reporting
REFORMS (Kapoor et al., Science Advances 2024), 32 items in 8 modules, paraphrasedModel Card Template (Mitchell et al. 2019)
पूर्णModel details, intended and out-of-scope uses, factors, metrics, data, disaggregated results, ethics, caveats
Model Cards for Model Reporting (Mitchell et al., 2019)Datasheet for Datasets Template (Gebru et al. 2021)
पूर्णDataset motivation, composition, collection, labelling, uses, distribution, maintenance, privacy and consent
Datasheets for Datasets (Gebru et al., 2021)Peer Review Report Template
मानकPeer review report: summary, assessment, numbered major and minor comments, methods and ethics checks, recommendation, editor notes
COPE Ethical Guidelines for Peer Reviewers (cited)