Markdown Editor

Kit peneliti AI

Rencanakan, jalankan, dan publikasikan riset ML: prapendaftaran, rencana pelatihan, manajemen data, eksperimen, benchmark, evaluasi manusia, makalah, dan reproduktibilitas.

Langkah 1

Perencanaan

  1. Study Preregistration Template

    Standar

    Preregistration of hypotheses, design, sampling plan and stopping rule, variables, analysis plan, exclusions and deviations log

    OSF preregistration (concepts)
  2. Model Training Plan Template

    Lengkap

    Objective and success criteria, data mix and splits, baseline, architecture, 6ND compute budget in KaTeX, ablations, checkpoints, stop rules, gates, risks

    Planning concepts from Kaplan et al. 2020 and Hoffmann et al. 2022
  3. Data Management Plan (DMP) Template

    Lengkap

    Funder-style DMP – storage, sharing, privacy

    NIH/NSF/EU DMP conventions
Langkah 2

Evaluasi dan keselamatan

  1. ML Experiment Tracking Report Template

    Lengkap

    Hypothesis and decision rule, setup, config and seeds, data versions, results vs baseline with variance, paired test, ablations, failure analysis, decision

    Reporting informed by the NeurIPS Paper Checklist (2026)
  2. Model Benchmark Report Template

    Lengkap

    Benchmark choice and validity, contamination checks, protocol, prompts and decoding, repeated runs, confidence intervals, McNemar test, comparison table

    Practice from HELM (TMLR 2023), Miller 2024 and Sainz et al. 2023
  3. Human Evaluation Protocol Template

    Lengkap

    Task and rubric, rater recruitment and training, ethics and consent, sample size, blinding, Cohen's/Fleiss' kappa, Krippendorff's alpha, QC, analysis

    Human Evaluation Datasheet (HumEval 2022); van der Lee et al. 2021
Langkah 3

Dokumentasi

  1. ML Conference Paper Template (NeurIPS Checklist)

    Lengkap

    ML conference paper: abstract, method, experiments, results, limitations, broader impact, reproducibility statement, appendix, NeurIPS 2026 checklist, ACL note

    NeurIPS 2026 Paper Checklist (16 items, paraphrased); ARR Responsible NLP checklist
  2. ML Reproducibility Checklist Template (REFORMS)

    Lengkap

    REFORMS-aligned ML science checklist: 32 items in 8 modules, leakage audit worksheet, evaluation protocol, code and data release, compute reporting

    REFORMS (Kapoor et al., Science Advances 2024), 32 items in 8 modules, paraphrased
  3. Model Card Template (Mitchell et al. 2019)

    Lengkap

    Model details, intended and out-of-scope uses, factors, metrics, data, disaggregated results, ethics, caveats

    Model Cards for Model Reporting (Mitchell et al., 2019)
  4. Datasheet for Datasets Template (Gebru et al. 2021)

    Lengkap

    Dataset motivation, composition, collection, labelling, uses, distribution, maintenance, privacy and consent

    Datasheets for Datasets (Gebru et al., 2021)
  5. Peer Review Report Template

    Standar

    Peer review report: summary, assessment, numbered major and minor comments, methods and ethics checks, recommendation, editor notes

    COPE Ethical Guidelines for Peer Reviewers (cited)