mfrmr

GitHub R-CMD-check pkgdown test-coverage License: MIT

Native R package for many-facet ordered-response measurement models: the Rasch-family RSM / PCM route, plus the package’s bounded GPCM extension where explicitly documented.

Public surface

mfrmr has many specialist helpers, but most users should start from a small public surface and drill down only when a report or review question requires it.

Layer Use first Purpose
Fit fit_mfrm() -> diagnose_mfrm() Explicit, scriptable model roles and diagnostics
Results res <- mfrm_results(fit) -> summary(res) FACETS-style first screen, section status, plot routes, next actions, replay code
Report report <- mfrm_report(res) -> summary(report) Report readiness, cautious wording routes, HTML/Markdown report output
Viewer launch_mfrmr_viewer(res) Optional local reader over an existing mfrm_results object
Export export_mfrm_results(res, include = c("default", "report")) Download folder with CSVs, report HTML/Markdown, RDS, replay code, manifest
Guide mfrmr_output_guide("public") Compact map from user purpose to the next route
Interactive mfrm_results_interactive(df) Explicit opt-in column prompts for exploratory console work

The rest of the namespace is best read as specialist follow-up: *_table() functions expose focused evidence tables, *_report() and *_review() functions bundle evidence for a particular question, *_bundle() functions prepare reusable handoff objects, and export_*() functions write files. Use mfrmr_output_guide("public") for the top-level map and mfrmr_output_guide("reports"), "reviews", "exports", "linking", "simulation", "response_time", "facets", or "r" only after the first screen points there. The guide’s ObjectRole and DecisionBoundary columns are the most direct way to check whether a route estimates the model, summarizes existing evidence, displays a result, writes files, or merely points to the next helper.

For an initial analysis, run this route before branching into specialized tables, reviews, simulations, or compatibility outputs.

library(mfrmr)
toy <- load_mfrmr_data("example_core")

fit <- fit_mfrm(
  toy,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "MML",
  model = "RSM"
  # quad_points defaults to 31 (publication tier); set 7 or 15 for
  # exploratory iteration.
)

summary(fit)

# Comprehensive first screen: diagnostics, tables, report status, plot routes.
res <- mfrm_results(fit)
summary(res)
plot(res, type = "qc", preset = "publication")
summary(res)$next_actions

# Report-readiness first screen and shareable output.
report <- mfrm_report(res)
summary(report)
mfrm_report(res, output = "html")
export_mfrm_results(
  res,
  output_dir = "mfrmr-results",
  prefix = "analysis01",
  include = c("default", "report"),
  overwrite = TRUE
)

# Compact public-API map for any branch that remains unclear.
mfrmr_output_guide("public")

When the first screen points to a specific need, use a scoped guide rather than scanning the namespace:

mfrmr_output_guide("reports")
mfrmr_output_guide("reviews")
mfrmr_output_guide("exports")
mfrmr_output_guide("linking")
mfrmr_output_guide("response_time")

First API routes

Use this table after the public surface when a specific situation applies.

Situation First call Then
New reproducible analysis fit_mfrm() -> mfrm_results() summary(res), plot(res, type = "qc"), summary(res)$next_actions
Binary person-item response data fit_mfrm(..., facets = "Item", model = "RSM") -> mfrm_results() Check fit$summary$Categories == 2; use mfrmr_output_guide("binary") for the route
Existing mfrm_fit object mfrm_results(fit) Drill into res$components or build_summary_table_bundle(res)
Local point-and-click review mfrm_results(fit, include = ...) -> launch_mfrmr_viewer(res) Use mfrmr_output_guide("viewer") to choose include = "publication", "bias", "misfit_review", "linking", or a combined route
Report-ready QC or validation text res <- mfrm_results(fit) -> mfrm_report(res, style = "qc") Use style = "apa", "validation", "reviewer", or "technical" only for that reporting question
Download the comprehensive result export_mfrm_results(res, include = c("default", "report")) Writes summary CSVs, collected tables, report CSV/Markdown/HTML, results HTML, RDS, replay code, and a written-files manifest
Anchor and linking readiness mfrm_results(fit, include = "linking") Inspect summary(res$components$linking_review) and plot(res, type = "anchors"); use mfrmr_output_guide("linking") for drift/equating follow-up
Response-time metadata response_time_review(data, person = ..., time = ...) Use plot_response_time_review(..., draw = FALSE) and mfrmr_output_guide("response_time"); keep timing as descriptive QC, not a fitted speed parameter
Unfamiliar data frame at the console mfrm_results_interactive(df) Move the printed replay code into an explicit script
Purpose-specific reporting or review mfrmr_output_guide("reviews") / "reports" / "exports" Use the listed helper only when that reporting question is needed
FACETS-facing handoff mfrmr_output_guide("facets") Keep compatibility outputs as presentation contracts, not equivalence claims

For the shortest programmatic version of this map, use mfrmr_output_guide("public"); for fit/result creation routes only, use mfrmr_output_guide("entry"). For viewer-specific include choices, use mfrmr_output_guide("viewer"). The guide also carries APILayer, ObjectRole, DecisionBoundary, Lifecycle, UserLevel, and RecommendedEntry columns so top-level public surfaces, specialist follow-ups, advanced design review, compatibility routes, and migration routes are not mixed together by accident.

Before branching into specialist helpers, keep the 0.2.1 boundary summary in view:

Area 0.2.1 conclusion Do not claim from this route alone
mfrm_results() First-screen result object over existing fit, diagnostics, reports, tables, plot routes, and next actions. A new estimator, new diagnostic rule, or automatic acceptance decision.
Response-time QC Descriptive timing review that can be carried through mfrm_results(), plots, viewer, and exports when timing metadata are supplied. Speed parameters, a joint speed-accuracy model, modified logits, or automatic exclusion rules.
Bounded GPCM Supported only inside the documented capability matrix; direct outputs and caveated helpers are usable where marked. Full FACETS score-side support, posterior predictive checks, or heavy backends unless gpcm_capability_matrix() marks that row as supported.

For dichotomous person-item data, use the same explicit route rather than a separate function. Pass the person column to person, pass the item column as the single non-person facet, and keep the score column as ordered binary integer categories:

fit_bin <- fit_mfrm(
  data = binary_df,
  person = "Person",
  facets = "Item",
  score = "Score",
  model = "RSM"
)

fit_bin$summary[, c("Model", "Facets", "Categories", "Converged")]
mfrmr_output_guide("binary")
res_bin <- mfrm_results(fit_bin)
summary(res_bin)$triage

With exactly two ordered categories, the RSM branch is the ordinary binary Rasch logit up to the package’s centering and threshold-identification conventions. Score may be coded as 0/1 or 1/2; inspect fit_bin$prep$score_map when documenting the coding. Do not include the person column again inside facets.

If you want a local point-and-click reader after creating the comprehensive result object, use the optional Shiny viewer. The viewer does not fit a model or contact an external web application; it reads an existing mfrm_results object and displays its overview, triage, status, tables, plots, and replay code. When the result object contains the relevant sections, the viewer also exposes QC evidence, APA-style draft text and table/figure notes, bias-screen tables, the pathway map, and an unexpected-response selector for row-level misfit inspection. The QC, Report, Bias, and Pathway/Misfit tabs show section-status tables, so omitted or unavailable sections are explained in the tab where the user expects them. Bias-interaction review still requires an explicit facet-pair choice in code; the viewer does not choose that contrast automatically.

res <- mfrm_results(fit, include = c("publication", "bias", "misfit_review"))
mfrmr_output_guide("viewer")[, c("Question", "MainFunction")]

if (interactive() && requireNamespace("shiny", quietly = TRUE)) {
  launch_mfrmr_viewer(res)
}

This keeps the reproducible analysis route explicit: first create fit, then create res <- mfrm_results(fit), then use the viewer only for inspection. To download the same comprehensive result without opening Shiny, export it:

download <- export_mfrm_results(
  res,
  output_dir = "mfrmr-results",
  prefix = "analysis01",
  include = c("default", "report"),
  overwrite = TRUE
)
download$written_files

For report drafting, keep the same object-first route and turn the already assembled evidence into a section plan:

report <- mfrm_report(res, style = "qc")
summary(report)
report$first_screen
report$report_index
report$template_index
names(report$tables)
mfrm_report(res, style = "validation", output = "html")

mfrm_report() is a reporting surface over mfrm_results(): it does not add a new estimator, recompute diagnostics, or turn fit, separation, bias screens, misfit rows, or anchor evidence into automatic pass/fail decisions. Its first_screen, report_index, template_index, claim_readiness, and report_gaps tables are intended to make report wording more conservative. first_screen is the FACETS-like entry surface: it gives an Overall row and one row per major evidence area with Status, Readiness, MainIssue, NextAction, and PrimaryRoute, so users can see where to start before opening the detailed tables. summary(report) is the short reader-facing version of that surface: it lists the immediate actions, optional not-requested sections, claim-readiness counts, report gaps, and wording boundaries without adding a new pass/fail rule. HTML output uses the same order, placing reader guidance and report-summary tables before the full Markdown text. report_index then shows the major evidence areas, status, readiness label, review-signal count, and primary/template tables to inspect next; claim_readiness and report_gaps show which claims are ready, which need caveats, and which require a more specific include preset or helper. report_index also carries EvidenceRoute, TemplateRoute, PlotRoute, ExportRoute, and IncludePreset columns so the report route points to the next table, figure, export, or mfrm_results(include = ...) call without turning those routes into new evidence. template_index stacks all reporting-template rows across fit, precision, bias, misfit/pathway, and linking/anchor areas so unsupported or caveated wording can be reviewed before opening the full template text. Detailed tables remain available through report$tables; use report$report_index$PrimaryTable, report$report_index$TemplateTable, and report$report_index$PlotRoute to choose the next table or figure rather than opening every report table by default. For fit claims, also inspect fit_criteria, zstd_conventions, and fit_decision_policy, plus the result-specific fit_evidence_summary, fit_threshold_sensitivity, fit_reporting_templates, and fit_df_sensitivity_summary tables. Also inspect precision_evidence_summary, precision_basis, and precision_reporting_templates before writing separation, reliability, or strata claims. These tables keep the selected MnSq band, observed fit-status counts, alternative published threshold profiles, engine-vs-FACETS-style ZSTD standardization, and Rasch/FACETS-style precision indices visible. The reporting templates turn those counts into cautious APA/QC/validation/reviewer wording scaffolds without turning the result into a single pass/fail sentence. Each reporting-template table also carries EvidenceTable, EvidenceRoute, BoundaryType, ClaimStrength, and RecommendedUse, so wording can be traced back to its evidence source and claim boundary before it is pasted into a manuscript, QC memo, reviewer response, or appendix. FACETS-style ZSTD review uses the fourth-moment df convention and can retain positive df below 1 with capped ZSTD values; report this as a standardization convention rather than as a different MnSq fit signal. If a ZSTD flag changes only because the df convention changes, treat that row as a review prompt and return to the MnSq size, facet role, and response context before writing a substantive fit claim. If separation or reliability is high, still report it as precision evidence rather than inter-rater agreement or standalone validity evidence. When res was built with include = "bias", bias_evidence_summary and bias_reporting_templates add the same guardrails for bias, DFF, and fairness language: facet-level bias rows are screening prompts, interaction-bias contrasts must be chosen explicitly, and DFF claims require a documented group, method, linking/anchor support, and threshold policy. When res was built with include = "misfit_review", misfit_evidence_summary and misfit_reporting_templates extend the same boundary to unexpected responses, displacement, and pathway maps: local misfit rows are case-review prompts, not automatic exclusion, fairness, or validity decisions. When res was built with include = "linking", linking_evidence_summary and linking_reporting_templates extend the boundary to anchor readiness, drift review, and equating-chain wording: anchor evidence supports scale-maintenance review, but drift and equating claims still require explicit multi-fit wave/form comparisons.

Inside summary(res), start with triage before reading every table. It orders unavailable, review, informational, and OK signals across diagnostics, plots, tables, precision/reliability, reporting, model scope, and network review surfaces.

mfrm_results() accepts purpose presets in include, so common workflows can stay readable:

mfrm_results(fit, include = "standard")     # first screen
mfrm_results(fit, include = "publication")  # add APA assembly
mfrm_results(fit, include = "validation")   # add FACETS-fit review
mfrm_results(fit, include = "bias")         # add bias-screen guidance
mfrm_results(fit, include = "misfit_review")# add unexpected/displacement/pathway review
mfrm_results(fit, include = "linking")      # add anchor-readiness/linking review
mfrm_results(fit, include = "network")      # add connectivity review
mfrm_results(                              # add descriptive timing QC
  fit,
  include = "response_time",
  response_time = "ResponseTime",
  response_time_data = original_data
)
mfrm_results(fit, include = "gpcm_review")  # standard route with GPCM caveats

If you want the shortest possible recommendation:

Minimum input contract

mfrmr expects long-format rating data: one row per observed rating.

Response-time metadata can be screened as a separate quality-control layer:

rt <- response_time_review(
  dat,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  time = "ResponseTime"
)

summary(rt)
plot_response_time_review(rt, type = "distribution")
plot_response_time_review(rt, type = "person")

res_rt <- mfrm_results(
  fit,
  include = c("standard", "response_time"),
  response_time = "ResponseTime",
  response_time_data = dat
)
summary(res_rt)$next_actions
plot(res_rt, type = "response_time", draw = FALSE)

Use these outputs to locate rapid/slow response-time patterns by person, facet, or score category. Do not describe them as joint speed-accuracy model parameters or automatic exclusion rules.

Minimal pattern:

names(df)
# [1] "Person" "Rater" "Criterion" "Score"

fit <- fit_mfrm(
  data = df,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "MML",
  model = "RSM"
)

For exploratory use, mfrm_results(df) can start from a standard long-format data frame when Person and Score are unambiguous column names; all remaining columns are treated as facets. For ambiguous files, keep the reproducible route explicit with fit_mfrm(...). If you want column-selection prompts in an interactive R session, use the opt-in wizard:

if (interactive()) {
  res <- mfrm_results_interactive(df)
}

Main capabilities

Core analysis:

Reporting and QA:

Linking, fairness, and advanced review:

Design-adequacy review and partial pooling:

Advanced or compatibility scope:

Latent regression status

mfrmr now includes a first-version latent-regression branch inside fit_mfrm(). Activate it with method = "MML", population_formula = ~ ..., and one-row-per-person person_data.

Current supported boundary:

What to inspect after fitting:

Introductory workflow:

# response data: one row per rating event
# person data: one row per person, with the same Person IDs
person_tbl <- unique(dat[c("Person", "Grade", "Group")])

fit_pop <- fit_mfrm(
  data = dat,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "MML",
  model = "RSM",
  population_formula = ~ Grade + Group,
  person_data = person_tbl,
  population_policy = "error"
)

s_pop <- summary(fit_pop)
s_pop$population_overview      # posterior basis, residual variance, omissions
s_pop$population_coefficients  # latent-regression coefficients
s_pop$population_coding        # categorical levels / contrasts / encoded columns
s_pop$caveats                  # complete-case and category-support warnings

Use population_policy = "omit" only when complete-case removal is intended, then report the omitted-person and omitted-row counts. Coefficients in population_coefficients are conditional-normal population-model parameters, not a post hoc regression on EAP/MLE scores.

Reference checks for this branch:

bench_pop <- reference_case_benchmark(
  cases = c("synthetic_latent_regression_omit", "synthetic_conquest_overlap_dry_run"),
  method = "MML",
  model = "RSM",
  quad_points = 5,
  maxit = 30
)

summary(bench_pop)
bench_pop$population_policy_checks  # complete-case omission check
bench_pop$conquest_overlap_checks   # package-side ConQuest preparation check

The ConQuest preparation case checks only package-side preparation. It does not run ConQuest. When actual ConQuest output tables are available for the documented overlap case, use the external-table comparison helpers:

bundle <- build_conquest_overlap_bundle(fit_overlap, output_dir = "conquest_overlap")
normalized <- normalize_conquest_overlap_files(
  population_file = "conquest_population.csv",
  item_file = "conquest_items.csv",
  case_file = "conquest_cases.csv"
)
review <- review_conquest_overlap(bundle, normalized)
summary(review)$summary
review$attention_items

Treat this as a scoped comparison, not as full ConQuest numerical equivalence. ConQuest must be run separately and the extracted tables must be reviewed.

Current non-goals for this branch:

This should be described as first-version overlap with the ConQuest latent-regression framework, not as ConQuest numerical equivalence.

predict_mfrm_population() remains a simulation-based scenario-forecasting helper. It should not be described as the latent-regression estimator itself.

Bounded GPCM support

GPCM is now part of the supported package scope, but only within a bounded route. Use gpcm_capability_matrix() to see the current boundary in one place. The matrix includes RecommendedRoute and NextValidationStep columns, so out-of-scope helper families point to the supported substitute workflow and the evidence needed before that boundary can move. mfrmr_output_guide("gpcm") routes users to the same support matrix and to the table that lists how out-of-scope GPCM routes are handled.

When a blocked or deferred helper is called on a bounded-GPCM path, the error message includes the capability row, recommended substitute route, and next validation step rather than silently returning a partial reporting object. These errors carry class mfrmr_gpcm_scope_error with helper, area, status, recommended_route, and next_validation_step fields for programmatic handling. Advanced users can call gpcm_runtime_guard_coverage() to see which out-of-scope rows stop with that structured guidance and which rows are documented as future-extension scope.

The model basis is Muraki’s generalized partial credit model and its information-function extension. The package-level slope_regime labels used in simulation specifications are narrower: they are operational recovery stress labels for reading generated conditions, not psychometric fit or adequacy cut points from Muraki or later literature. The recovery workflow is organized in the ADEMP spirit: aims, data-generating mechanism, estimands, methods, and performance measures are kept explicit before interpreting Monte Carlo summaries.

For the 0.2.1 GPCM refinement evidence map:

file.show(system.file(
  "validation", "release-evidence-map-0.2.1.md",
  package = "mfrmr"
))

The unsupported helpers depend on FACETS-style score-side or posterior-predictive assumptions that are validated for the Rasch-family route but not yet for bounded GPCM. Use gpcm_score_side_contract() to inspect the specific score-side estimand, native uncertainty, score-side delta SE, reduction-test, schema, and FACETS-compatible uncertainty requirements that separate the current caveated scorefile route from full FACETS-style score-side review.

The installed bounded-GPCM scope notes keep those unsupported areas explicit:

file.show(system.file(
  "validation", "gpcm-post-0.2.1-roadmap.md",
  package = "mfrmr"
))

For release review, the optional script system.file("validation", "recovery-validation.R", package = "mfrmr") defines core RSM / PCM / bounded-GPCM recovery cases, an extended latent-regression case, an extended high-dispersion/sparse-category bounded-GPCM case, structured release-review steps, and CSV/RDS/Markdown summaries. It is intentionally separate from routine tests because the useful settings are long-running Monte Carlo checks. The summary separates recovery metric status from uncertainty status, generator-condition status, and diagnostic-only fit/separation status, so unavailable coverage columns, sparse generated categories, or fit/separation flags do not look like failed parameter recovery by themselves. Printing the validation object or calling summary(validation) shows the release-level status first.

For direct recovery checks, plot(evaluate_mfrm_recovery(...), ...) shows recovery summaries, row-level errors, truth-estimate scatter, and replication status. After assess_mfrm_recovery(), use recovery_review$condition_reporting_notes before recovery_review$condition_review to confirm the bounded-GPCM slope-regime generator condition and generated score-category support, then recovery_review$diagnostic_reporting_notes before recovery_review$diagnostic_review if the recovery run retained diagnostic fit/separation operating characteristics, then plot(recovery_review, type = "status") for checklist status counts and plot(recovery_review, type = "metrics", metric = "rmse") for the parameter-group metric review. The recommended reading order is: summary(recovery_review), then condition notes/review, then diagnostic notes/review when available, then the status plot, then the metric plot, and only then the row-level recovery table for the parameter groups that need follow-up. summary(recovery_review)$reading_order records this order directly; the draw = FALSE plot data also include reading_order and guidance fields for plotting handoff.

A compact bounded-GPCM recovery smoke check looks like this. The one replication setting is for checking the workflow and reading the handoff tables; increase reps before using the result as release evidence.

gpcm_spec <- build_mfrm_sim_spec(
  n_person = 14,
  n_rater = 2,
  n_criterion = 2,
  raters_per_person = 2,
  model = "GPCM",
  step_facet = "Criterion",
  slope_facet = "Criterion",
  slopes = c(0.85, 1.15),
  assignment = "crossed"
)

gpcm_rec <- evaluate_mfrm_recovery(
  sim_spec = gpcm_spec,
  reps = 1,
  fit_method = "MML",
  quad_points = 5,
  maxit = 12,
  include_person = FALSE,
  include_diagnostics = TRUE,
  diagnostic_fit_df_method = "both",
  seed = 456
)

gpcm_review <- assess_mfrm_recovery(
  gpcm_rec,
  min_reps = 1,
  max_rmse = c(slope = 2),
  max_abs_bias = c(slope = 1),
  min_se_available = NULL,
  max_mcse_rmse_ratio = NULL
)

gpcm_review$condition_reporting_notes[, c(
  "ConditionArea", "ReportingAttention", "ConditionFinding"
)]
gpcm_review$condition_review[, c(
  "Model", "GPCMSlopeRegime", "StressLevel", "ScoreSupportStatus"
)]
gpcm_review$diagnostic_reporting_notes[, c(
  "Facet", "ReportingAttention", "DiagnosticFinding"
)]
gpcm_review$diagnostic_review[, c(
  "Facet", "MeanSeparation", "MeanReliability", "ValidationUse"
)]
summary(gpcm_review)$reading_order
plot(gpcm_review, type = "status")
plot(gpcm_review, type = "metrics", metric = "rmse")

Read the validation outputs in this order:

For appendix handoff, pass the validation summary to build_summary_table_bundle(summary(validation)). The bundle includes the top-line decision, case decisions, case summary, condition summary, and domain decision tables, plus condition reporting notes, diagnostic reporting notes, and raw diagnostic summaries under recovery-validation appendix roles.

A local smoke-read of the packaged validation protocol is:

source(system.file("validation", "recovery-validation.R", package = "mfrmr"))

validation <- mfrmr_run_recovery_validation(
  case_ids = c("gpcm_slope_profile", "gpcm_high_dispersion_sparse"),
  quick = TRUE,
  seed = 20260525,
  verbose = FALSE
)

s_validation <- summary(validation)
s_validation$reading_order
s_validation$topline_release_decision
s_validation$condition_reporting_notes[, c(
  "CaseID", "ConditionArea", "ReportingAttention", "ConditionFinding"
)]
s_validation$condition_summary[, c(
  "CaseID", "GPCMSlopeRegime", "ScoreSupportStatus"
)]
s_validation$diagnostic_reporting_notes[, c(
  "CaseID", "Facet", "ReportingAttention", "DiagnosticFinding"
)]
s_validation$diagnostic_oc_summary[, c(
  "CaseID", "Facet", "MeanSeparation", "MeanReliability",
  "DiagnosticAvailability", "ValidationUse"
)]

validation_bundle <- build_summary_table_bundle(s_validation)
validation_bundle$tables$reading_order
validation_bundle$tables$condition_reporting_notes
validation_bundle$tables$diagnostic_reporting_notes
validation_bundle$tables$domain_decision_table

validation_appendix <- export_summary_appendix(
  list(validation = s_validation),
  output_dir = tempdir(),
  prefix = "mfrmr_validation_appendix",
  preset = "recommended",
  include_html = FALSE,
  overwrite = TRUE
)
validation_appendix$selection_catalog

# The same validation summary can be supplied to
# export_mfrm_bundle(..., summary_tables = list(validation = s_validation))
# when you want release-review tables co-located with a fit-based bundle.

In particular, do not treat OverallStatus = "review" as a release-level recovery failure by itself. In the validation bundle, UncertaintyStatus = "review" can mean that SE/coverage evidence is intentionally reported as a separate limitation while recovery metrics remain acceptable.

For a source-grounded release review plan, read the packaged evidence map and its structured checklist. The 0.2.1 files cover the current public workflow, bounded-GPCM recovery-review refinements, sparse linked designs, peer-review design review, and release-engineering gates; the external common-data recovery summary remains the 0.2.0 artifact until that separate workflow is refreshed.

file.show(system.file(
  "validation", "release-evidence-map-0.2.1.md",
  package = "mfrmr"
))

read.csv(system.file(
  "validation", "release-evidence-checklist-0.2.1.csv",
  package = "mfrmr"
))

file.show(system.file(
  "validation", "external-parameter-recovery-simulation-0.2.0.md",
  package = "mfrmr"
))

It links the release checks to the ordered-response model literature, FACETS/Winsteps fit conventions, ADEMP-style simulation-study reporting, and the package’s current implementation boundaries. The checklist classifies each item as required release evidence, caveat-managed evidence, or future-scope evidence.

The external parameter-recovery summary records a separate common-data simulation workflow. It supports the distinction between recovery checks, cross-engine agreement, and design endorsement: sparse stress designs can converge and agree across engines while still showing recovery, coverage, precision, or role-bias risk. The large generated datasets and engine outputs are not bundled with the package; the validation bundle includes a sourceable review helper for re-reading a local Parameter_Recovery_Simulation output directory, checking expected CSV schemas, and recording file fingerprints when that external workflow is refreshed.

Equal weighting and when to prefer the Rasch-family route

mfrmr treats RSM / PCM as the package’s equal-weighting reference models. In that Rasch-family route, category discrimination is fixed, so the operational scoring contract does not let the psychometric model reweight some item-facet combinations more heavily than others.

Bounded GPCM serves a different purpose. It allows estimated slopes, so some observed design cells become more influential than others through discrimination-based reweighting. This often improves fit, but a better-fitting GPCM does not automatically make it the preferred operational model.

The package therefore recommends:

One more distinction matters. The weight = argument in fit_mfrm() is for an observation-weight column. That is different from the equal-weighting question discussed above. Observation weights adjust how rating events enter estimation and summaries; they do not turn a Rasch-family fit into a discrimination-based model.

Model selection guide and report wording

Use the model argument to match the score interpretation first, then use fit statistics and diagnostics as checks on that interpretation.

Choose When it is the right starting point Report wording
RSM The rubric is intended to share the same category thresholds across items, criteria, or other step-facet levels. “We fit a many-facet rating-scale Rasch model, treating category thresholds as common across the step facet.”
PCM Category thresholds may differ by item or criterion, but equal contribution of rating events remains part of the scoring argument. “We fit a many-facet partial-credit Rasch model, allowing step thresholds to vary by the designated step facet.”
bounded GPCM You explicitly want a slope-aware sensitivity model and can defend discrimination-based reweighting. “We fit a bounded generalized partial-credit many-facet model as a slope-aware sensitivity analysis.”

Avoid these shortcuts:

In a manuscript, a defensible model-choice sentence is:

We treated RSM/PCM as the equal-weighting operational reference and used bounded GPCM to inspect whether allowing discrimination-based reweighting changed the substantive conclusions.

After fitting candidate models, use build_model_choice_review() to keep the same guidance attached to the actual fit objects:

review <- build_model_choice_review(RSM = fit_rsm, GPCM = fit_gpcm)
summary(review)

# Add the detailed reweighting review when an RSM/PCM reference and bounded
# GPCM sensitivity fit were estimated on the same response data.
review <- build_model_choice_review(RSM = fit_rsm, GPCM = fit_gpcm,
                                    run_weighting_review = TRUE)

Documentation map

The README is only the shortest map. The package now has guide-style help pages for the main workflows.

Companion vignettes:

A two-page landscape cheatsheet of the public API ships at system.file("cheatsheet", "mfrmr-cheatsheet.pdf", package = "mfrmr") (pre-rendered) and system.file("cheatsheet", "mfrmr-cheatsheet.Rmd", package = "mfrmr") (source). Open the PDF directly for a quick printable reference, or knit the .Rmd with rmarkdown::render() when you want a customised version.

Installation

# GitHub
if (!requireNamespace("remotes", quietly = TRUE)) install.packages("remotes")
remotes::install_github("Ryuya-dot-com/mfrmr", build_vignettes = TRUE)

# CRAN (when available)
# install.packages("mfrmr")

If you install from GitHub without build_vignettes = TRUE, use the guide-style help pages included in the package, for example:

Installed vignettes:

browseVignettes("mfrmr")

Core workflow

fit_mfrm() --> diagnose_mfrm() --> reporting / advanced analysis
                    |
                    +--> analyze_residual_pca()
                   +--> estimate_bias()
                    +--> interaction_effect_table()
                    +--> analyze_dff()
                    +--> compare_mfrm()
                    +--> run_qc_pipeline()
                    +--> anchor_to_baseline() / detect_anchor_drift()
  1. Fit model: fit_mfrm()
  2. Diagnostics: diagnose_mfrm()
  3. Optional residual-structure screen: analyze_residual_pca()
  4. Optional interaction bias: estimate_bias()
  5. Optional model-estimated facet interactions: interaction_effect_table()
  6. Differential-functioning analysis: analyze_dff(), dif_report()
  7. Model comparison: compare_mfrm()
  8. Reporting: apa_table(), build_apa_outputs(), build_visual_summaries()
  9. Quality control: run_qc_pipeline()
  10. Anchoring & linking: anchor_to_baseline(), detect_anchor_drift(), build_equating_chain()
  11. FACETS output-contract review when needed: facets_output_contract_review(); this checks package output contracts, not external FACETS numerical equivalence
  12. Reproducible inspection: summary() and plot(..., draw = FALSE)

Dimensionality wording is deliberately conservative. Residual PCA and Q3-style local-dependence screens are exploratory follow-up evidence, not standalone proofs that unidimensionality has been established and not implementations of DIMTEST/UNIDIM. For MFRM manuscripts, combine global residual fit, element fit, residual PCA, and local-dependence checks, and use limited wording such as “evidence consistent with essential unidimensionality under the specified facet structure.”

Choose a route

Use the route that matches the question you are trying to answer.

Question Recommended route
Can I fit the model and get a first-pass diagnosis quickly? fit_mfrm() -> diagnose_mfrm() -> plot_qc_dashboard()
Which reporting elements are draft-complete, and with what caveats? diagnose_mfrm() -> precision_review_report() -> reporting_checklist()
Which tables and prose should I adapt into a manuscript draft? reporting_checklist() -> build_apa_outputs() -> apa_table()
Is the design connected well enough for a common scale? subset_connectivity_report() -> plot(..., type = "design_matrix")
Do I need to place a new administration onto a baseline scale? make_anchor_table() -> anchor_to_baseline()
Are common elements stable across separately fitted forms or waves? fit each wave -> detect_anchor_drift() -> build_equating_chain()
Are some facet levels functioning differently across groups? subset_connectivity_report() -> analyze_dff() -> dif_report()
Do I need old fixed-width or wrapper-style outputs? run_mfrm_facets() or build_fixed_reports() only at the compatibility boundary

Additional routes

After the canonical MML + both route above, these are the next shortest specialized routes.

Shared setup used by the snippets below:

library(mfrmr)
toy <- load_mfrmr_data("example_core")

1. Quick first pass

fit <- fit_mfrm(toy, "Person", c("Rater", "Criterion"), "Score",
                method = "MML", model = "RSM", quad_points = 7)
diag <- diagnose_mfrm(fit, diagnostic_mode = "both", residual_pca = "none")
summary(diag)
plot_qc_dashboard(fit, diagnostics = diag, preset = "publication")

1b. Preferred MML + marginal-fit route

fit_final <- fit_mfrm(
  toy,
  "Person",
  c("Rater", "Criterion"),
  "Score",
  method = "MML",
  model = "RSM",
  quad_points = 15
)

diag_final <- diagnose_mfrm(
  fit_final,
  diagnostic_mode = "both",
  residual_pca = "none"
)

summary(fit_final)
summary(diag_final)

For RSM / PCM, this is the recommended final-analysis route when you want legacy continuity plus the newer strict marginal screening path.

2. Design and linking check

diag <- diagnose_mfrm(fit, residual_pca = "none")
sc <- subset_connectivity_report(fit, diagnostics = diag)
summary(sc)
plot(sc, type = "design_matrix", preset = "publication")
plot_wright_unified(fit, preset = "publication", show_thresholds = TRUE)

3. Manuscript and reporting check

# Add `bias_results = ...` if you want the bias/reporting layer included.
chk <- reporting_checklist(fit, diagnostics = diag)
apa <- build_apa_outputs(fit, diag)

chk$checklist[, c("Section", "Item", "DraftReady", "NextAction")]
cat(apa$report_text)

4. Hierarchical structure and sample-adequacy review

Use this when rater counts are small, raters may be nested in schools or regions, or a reviewer asks for ICC / design-effect evidence that the additive fixed-effects many-facet model cannot partition out on its own.

review <- facet_small_sample_review(fit)
review$facet_summary         # worst level per facet + SampleCategory
summary(review)              # counts of sparse / marginal / standard / strong

nest <- detect_facet_nesting(toy, c("Rater", "Criterion"))
plot(nest)                   # nesting index heatmap

# Combined bundle (ICC uses lme4, connectivity uses igraph, both Suggests):
h <- analyze_hierarchical_structure(toy, c("Rater", "Criterion"), score = "Score",
                                    person = "Person")
summary(h)

reporting_checklist(fit, hierarchical_structure = h) then marks the “Hierarchical structure review” item ready.

5. Empirical-Bayes shrinkage for small-N facets

When a facet has 3-10 levels, the fixed-effects many-facet model retains wide per-level SEs. Empirical-Bayes partial pooling (Efron & Morris, 1973) dominates the MLE under squared-error loss whenever K >= 3.

# Integrated path: shrinkage applied as part of the fit.
fit_eb <- fit_mfrm(toy, "Person", c("Rater", "Criterion"), "Score",
                   method = "MML", quad_points = 15,
                   facet_shrinkage = "empirical_bayes")
shrinkage_report(fit_eb)
plot(fit_eb, type = "shrinkage", show_ci = TRUE)

# Post-hoc path: apply to an existing fit.
fit_post <- apply_empirical_bayes_shrinkage(fit)
head(fit_post$facets$others[, c("Facet", "Level", "Estimate",
                                 "ShrunkEstimate", "ShrinkageFactor")])

6. Missing-code pre-processing

fit_mfrm(..., missing_codes = TRUE) converts the default FACETS / SPSS / SAS sentinels ("99", "999", "-1", "N", "NA", "n/a", ".", "") to NA on the person, facets, and score columns before estimation. Replacement counts are kept in fit$prep$missing_recoding and surfaced by build_mfrm_manifest()$missing_recoding. The default (missing_codes = NULL) is strictly backward-compatible.

fit <- fit_mfrm(
  dirty_data, "Person", c("Rater", "Criterion"), "Score",
  missing_codes = TRUE           # or supply a custom character vector
)
fit$prep$missing_recoding

A standalone recode_missing_codes() helper is exported for users who prefer to recode before calling fit_mfrm().

Estimation choices

The package treats MML and JML differently on purpose.

Typical pattern:

toy <- load_mfrmr_data("example_core")

fit_final <- fit_mfrm(
  toy, "Person", c("Rater", "Criterion"), "Score",
  method = "MML", model = "RSM", quad_points = 15
)

diag_final <- diagnose_mfrm(
  fit_final,
  diagnostic_mode = "both",
  residual_pca = "none"
)

precision_review_report(fit_final, diagnostics = diag_final)

Fit and separation reporting boundary

Fit and separation are useful, but they should not be treated as automatic validation success criteria. fit_measures_table() keeps mean-square fit (Infit, Outfit) as the primary size diagnostic and uses fit_df_method = "both" plus facets_fit_review() when ZSTD differences need to be read as FACETS-style df or standardization differences. Mean-square bands are sourced to Wright and Linacre (1994) and Linacre (2002), while separation, reliability, and strata follow the Wright and Masters G/R/H convention.

precision_review_report() now returns fit_separation_basis, a compact source-grounding table that separates:

Use that table as a reporting and validation boundary: fit and separation summaries can support diagnostic interpretation and external-output review, but they do not replace recovery checks, convergence review, design checks, or substantive validity evidence. For appendix handoff, pass the precision review directly to build_summary_table_bundle() or export_summary_appendix(); the fit_separation_basis table stays in the precision-review role instead of being folded into a top-line validation decision. The same appendix route now accepts fit_measures_table() and facets_fit_review() outputs, so df/ZSTD sensitivity and optional external FACETS matching can be exported beside, but not collapsed into, MnSq fit status. reporting_checklist() also surfaces this as a Global Fit item before users move into draft text.

The same boundary is used in recovery validation. When include_diagnostics = TRUE, evaluate_mfrm_recovery(), assess_mfrm_recovery(), and the release validation protocol retain fit/separation operating characteristics for diagnostic context, while the assessment and top-line release decisions remain based on recovery metrics, convergence, uncertainty, and Monte Carlo precision. DiagnosticStatus is an availability/status-routing field, not a judgement that fit or separation values are adequate. Read diagnostic_reporting_notes before the raw diagnostic_review or diagnostic_oc_summary when deciding how strongly to phrase fit, separation, or reliability caveats in reports. For diagnostic-screening simulations, evaluate_mfrm_diagnostic_screening() can also retain the mfrm_report() report_index surface with include_report = TRUE. The resulting report_signal_summary shows how often the report layer was available and how many fit, precision, or misfit review signals were routed to review, but it remains an operating-characteristic summary, not a validation pass/fail gate. Use plot(diag_eval, type = "overview", draw = FALSE) or plot_data(diag_eval, type = "overview", component = "plot_long") to collect legacy ZSTD, strict marginal, strict pairwise, strict combined, and optional report-review rates in one long-form visualization table. type = "report" focuses on report readiness/review signals, type = "contrast" shows misspecification-minus-well-specified deltas, and type = "runtime" summarizes elapsed-time operating characteristics. The same draw-free plot object also retains overview, reading_order, next_actions, reporting_notes, and figure_recipes, so custom ggplot2, plotly, Quarto, or Shiny displays can carry the interpretation boundaries and caption/display guidance beside the plotted values. For appendix handoff, summary(diag_eval), build_summary_table_bundle(diag_eval), and export_summary_appendix(diag_eval, preset = "recommended") return the same scenario, performance, report-signal, contrast, and draw-free plot-data surfaces as tables, keeping simulation screening signals separate from validation pass/fail decisions. Start with summary(diag_eval)$reading_order, then read summary(diag_eval)$next_actions and summary(diag_eval)$reporting_notes before using the raw scenario or plot-data tables in a manuscript or reviewer appendix. Use mfrmr_output_guide("simulation") when deciding whether the next step is data generation, design/recovery evaluation, diagnostic screening, appendix export, or network/peer-review design review.

For bounded-GPCM recovery runs, read condition_reporting_notes before condition_review or condition_summary. Those notes separate declared generator stress, such as high-dispersion slopes or sparse generated score support, from parameter-recovery performance.

Mathematical note for expert users

Full marginal-likelihood and strict-marginal derivations, along with the literature positioning (Bock & Aitkin, 1981; Linacre, 1989; Eckes, 2005; Orlando & Thissen, 2000; Haberman & Sinharay, 2013; Sinharay & Monroe, 2025), are collected in the dedicated vignette:

vignette("mfrmr-mml-and-marginal-fit", package = "mfrmr")

Documentation datasets

Basic workflow

library(mfrmr)

data("mfrmr_example_core", package = "mfrmr")
df <- mfrmr_example_core

# Fit
fit <- fit_mfrm(
  data = df,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "MML",
  model = "RSM",
  quad_points = 7
)
summary(fit)

# Fast diagnostics first
diag <- diagnose_mfrm(fit, residual_pca = "none")
summary(diag)

# APA outputs
apa <- build_apa_outputs(fit, diag)
cat(apa$report_text)

# QC pipeline reuses the same diagnostics object
qc <- run_qc_pipeline(fit, diagnostics = diag)
summary(qc)

Main objects you will reuse

Most package workflows reuse a small set of objects rather than recomputing everything from scratch. The canonical list is kept up to date in summary(fit) under “Next actions”; the items below are a short orientation pointer.

Typical reuse pattern:

toy <- load_mfrmr_data("example_core")

fit <- fit_mfrm(toy, "Person", c("Rater", "Criterion"), "Score",
                method = "MML", model = "RSM", quad_points = 7)
diag <- diagnose_mfrm(fit, residual_pca = "none")
chk <- reporting_checklist(fit, diagnostics = diag)
apa <- build_apa_outputs(fit, diag)
sc <- subset_connectivity_report(fit, diagnostics = diag)

Reporting and APA route

If your endpoint is a manuscript or internal report, use the package-native reporting contract rather than composing text by hand.

diag <- diagnose_mfrm(fit, residual_pca = "none")

# Add `bias_results = ...` to either helper when bias screening should
# appear in the checklist or draft text.
chk <- reporting_checklist(fit, diagnostics = diag)
chk$checklist[, c("Section", "Item", "DraftReady", "Priority", "NextAction")]

apa <- build_apa_outputs(
  fit,
  diag,
  context = list(
    assessment = "Writing assessment",
    setting = "Local scoring study",
    scale_desc = "0-4 rubric scale",
    rater_facet = "Rater"
  )
)

cat(apa$report_text)
apa$section_map[, c("SectionId", "Available", "Heading")]

tbl_fit <- apa_table(fit, which = "summary")
tbl_reliability <- apa_table(fit, which = "reliability", diagnostics = diag)

For a question-based map of the reporting API, see help("mfrmr_reporting_and_apa", package = "mfrmr").

Visualization recipes

A task-oriented index of the plotting surface lives at help("mfrmr_visual_diagnostics", package = "mfrmr"), and worked publication examples are collected in vignette("mfrmr-visual-diagnostics", package = "mfrmr"). The common starter patterns are:

plot(fit, type = "wright", preset = "publication", show_ci = TRUE)
plot(fit, type = "pathway", preset = "publication")
plot(fit, type = "ccc", preset = "publication")
plot_qc_dashboard(fit, diagnostics = diag, preset = "publication")

For interval-aware figures and tables, start with:

mfrmr_interval_guide("visual")[, c("Route", "PrimaryHelper", "Basis")]
plot_fair_average(fit, show_ci = TRUE, ci_level = 0.95)
plot_bias_interaction(bias, plot = "ranked", show_ci = TRUE, ci_level = 0.95)
plot_rater_severity_profile(fit, ci_level = 0.95)
plot_apa_figure_one(fit, ci_level = 0.95, draw = FALSE)
fm <- fit_measures_table(fit, ci_level = 0.95)
plot(fm, type = "measure_ci")

The interval guide separates Wald, delta-method, profile-like, and plotting overlay routes so 95% CI displays are read as precision or screening evidence, not as automatic fit, fairness, or validity decisions.

A second-wave teaching / drift / agreement layer ships for follow-up inspection; it is not a default reporting figure set:

plot_guttman_scalogram(fit, diagnostics = diag)       # teaching ordering view
plot_residual_qq(fit, diagnostics = diag)             # residual tail follow-up
plot_rater_agreement_heatmap(fit, diagnostics = diag) # compact pairwise agreement
plot_rater_trajectory(list(T1 = fit_a, T2 = fit_b))   # requires anchor-linked waves

Linking, anchors, and DFF route

Use this route when your design spans forms, waves, or subgroup comparisons.

data("mfrmr_example_bias", package = "mfrmr")
df_bias <- mfrmr_example_bias
fit_bias <- fit_mfrm(df_bias, "Person", c("Rater", "Criterion"), "Score",
                     method = "MML", model = "RSM", quad_points = 7)
diag_bias <- diagnose_mfrm(fit_bias, residual_pca = "none")

# Connectivity and design coverage
sc <- subset_connectivity_report(fit_bias, diagnostics = diag_bias)
summary(sc)
plot(sc, type = "design_matrix", preset = "publication")

# Anchor export from a baseline fit
anchors <- make_anchor_table(fit_bias, facets = "Criterion")
head(anchors)

# Differential facet functioning
dff <- analyze_dff(
  fit_bias,
  diag_bias,
  facet = "Criterion",
  group = "Group",
  data = df_bias,
  method = "residual"
)
dff$summary
plot_dif_heatmap(dff)
plot_dif_summary(dff)

For linking-specific guidance, see help("mfrmr_linking_and_dff", package = "mfrmr").

DFF / DIF analysis

data("mfrmr_example_bias", package = "mfrmr")
df_bias <- mfrmr_example_bias
fit_bias <- fit_mfrm(df_bias, "Person", c("Rater", "Criterion"), "Score",
                     method = "MML", model = "RSM", quad_points = 7)
diag_bias <- diagnose_mfrm(fit_bias, residual_pca = "none")

dff <- analyze_dff(fit_bias, diag_bias, facet = "Criterion",
                   group = "Group", data = df_bias, method = "residual")
dff$dif_table
dff$summary

# Cell-level interaction table
dit <- dif_interaction_table(fit_bias, diag_bias, facet = "Criterion",
                             group = "Group", data = df_bias)

# Visual, narrative, and bias reports
plot_dif_heatmap(dff)
plot_dif_summary(dff)

# Optional display controls for review meetings or appendices
plot_dif_heatmap(dff, metric = "t", flag_threshold = 2,
                 show_values = FALSE, scale_limit = 3)
plot_dif_summary(dff, ci_level = 0.90,
                 effect_thresholds = c(screen = 0.5))
dr <- dif_report(dff)
cat(dr$narrative)

# Refit-based contrasts can support ETS labels only when subgroup linking is adequate
dff_refit <- analyze_dff(fit_bias, diag_bias, facet = "Criterion",
                         group = "Group", data = df_bias, method = "refit")
dff_refit$summary

bias <- estimate_bias(fit_bias, diag_bias, facet_a = "Rater", facet_b = "Criterion")
summary(bias)

# App-style batch bias estimation across all modeled facet pairs
bias_all <- estimate_all_bias(fit_bias, diag_bias)
bias_all$summary

Interpretation rules:

Model-estimated facet interactions

For confirmatory interaction hypotheses, fit_mfrm() can estimate explicit two-way non-person facet interactions in the model likelihood.

fit_add <- fit_mfrm(df, "Person", c("Rater", "Criterion"), "Score",
                    method = "MML", model = "RSM")

fit_rxcrit <- fit_mfrm(df, "Person", c("Rater", "Criterion"), "Score",
                       method = "MML", model = "RSM",
                       facet_interactions = "Rater:Criterion")

interaction_effect_table(fit_rxcrit)
compare_mfrm(Additive = fit_add, RaterCriterion = fit_rxcrit, nested = TRUE)

Rules for interpretation:

Model comparison

fit_rsm <- fit_mfrm(df, "Person", c("Rater", "Criterion"), "Score",
                     method = "MML", model = "RSM")
fit_pcm <- fit_mfrm(df, "Person", c("Rater", "Criterion"), "Score",
                     method = "MML", model = "PCM", step_facet = "Criterion")
cmp <- compare_mfrm(RSM = fit_rsm, PCM = fit_pcm)
cmp$table

# Request nested tests only when models are truly nested and fit on the same basis
cmp_nested <- compare_mfrm(RSM = fit_rsm, PCM = fit_pcm, nested = TRUE)
cmp_nested$comparison_basis

# RSM design-weighted precision curves
info <- compute_information(fit_rsm)
plot_information(info)

Design simulation

spec <- build_mfrm_sim_spec(
  n_person = 50,
  n_rater = 4,
  n_criterion = 4,
  raters_per_person = 2,
  assignment = "rotating",
  model = "RSM"
)

sim_eval <- evaluate_mfrm_design(
  n_person = c(30, 50, 80),
  n_rater = 4,
  n_criterion = 4,
  raters_per_person = 2,
  reps = 2,
  maxit = 30,
  sim_spec = spec,
  seed = 123
)

s_sim <- summary(sim_eval)
s_sim$design_summary
s_sim$ademp

rec <- recommend_mfrm_design(sim_eval)
rec$recommended

plot(sim_eval, facet = "Rater", metric = "separation", x_var = "n_person")
plot(sim_eval, facet = "Criterion", metric = "severityrmse", x_var = "n_person")

Notes:

Sparse linked simulation

Use assignment = "sparse_linked" when the design itself should contain planned missingness: most persons receive a small rater subset, while a linking set receives a larger rater set to preserve common-person links among raters.

sparse_spec <- build_mfrm_sim_spec(
  n_person = 80,
  n_rater = 6,
  n_criterion = 4,
  raters_per_person = 2,
  assignment = "sparse_linked",
  sparse_controls = list(
    link_fraction = 0.10,
    link_raters_per_person = 6,
    min_common_persons_per_rater_pair = 4
  )
)

sparse_sim <- simulate_mfrm_data(sim_spec = sparse_spec, seed = 20260526)
sparse_design <- attr(sparse_sim, "mfrm_sparse_design")
sparse_design$overview
sparse_design$rater_pair_links

sparse_eval <- evaluate_mfrm_design(
  n_person = c(40, 80),
  n_rater = 6,
  n_criterion = 4,
  raters_per_person = 2,
  assignment = "sparse_linked",
  sparse_controls = list(
    link_fraction = 0.10,
    link_raters_per_person = 6,
    min_common_persons_per_rater_pair = 4
  ),
  reps = 2,
  maxit = 30,
  seed = 20260526,
  progress = FALSE
)
summary(sparse_eval)$design_summary[
  ,
  c("Facet", "n_person", "MeanDesignDensity",
    "MeanPlannedMissingRate", "MeanMinCommonPersonsPerRaterPair")
]
summary(sparse_eval)$sparse_review

plot(
  sparse_eval,
  facet = "Rater",
  metric = "plannedmissingrate",
  x_var = "n_person",
  draw = FALSE
)

sparse_bundle <- build_summary_table_bundle(summary(sparse_eval))
sparse_bundle$tables$sparse_review
sparse_bundle$tables$sparse_design

This is a true data-generating simulation route, unlike observed-data resampling below. The sparse-design metadata reports design density, planned missing rate, rater coverage, and rater-pair common-person counts so users can inspect whether the generated rating network has enough linking for the study they intend to run. The table bundle keeps the same sparse diagnostics in a separate appendix-ready table, rather than mixing them into performance metrics. Its LinkReviewStatus column flags zero common-person rater pairs or requested-link target shortfalls as design-review items; it is not a parameter-recovery or model-fit decision.

Peer-review simulation

Use build_peer_review_sim_spec() when submissions and reviewers are drawn from the same participant pool, as in peer-assessment or peer-review scoring studies. The helper builds a fixed skeleton so self-review can be excluded by design, ordinary submissions can receive a small peer set, and a smaller anchor set can be reviewed by many or all eligible peers for common-link support.

peer_spec <- build_peer_review_sim_spec(
  n_submission = 30,
  n_criterion = 4,
  reviewers_per_submission = 3,
  anchor_fraction = 0.10,
  avoid_self_review = TRUE
)

peer_sim <- simulate_mfrm_data(sim_spec = peer_spec, seed = 20260526)
peer_review <- build_peer_review_design_review(peer_sim)
summary(peer_review)$overview[
  ,
  c("Submissions", "Reviewers", "ReviewPairs", "SelfReviews",
    "MinCommonSubmissionsPerReviewerPair", "ZeroCommonReviewerPairs")
]

peer_bundle <- build_summary_table_bundle(peer_review)
peer_bundle$tables$low_common_pairs

The peer-review metadata reports assignment density, self-review counts, reviewer load, reciprocal review pairs, and common submissions per reviewer pair. These are design diagnostics. They do not by themselves establish peer fairness, reviewer quality, fit, separation, or parameter recovery.

The same metadata can be carried into build_mfrm_network_review() after a model is fit, so peer-review assignment checks appear alongside graph connectedness and bridge/articulation diagnostics.

if (requireNamespace("igraph", quietly = TRUE)) {
  peer_fit <- fit_mfrm(
    peer_sim,
    person = "Person",
    facets = c("Reviewer", "Criterion"),
    score = "Score",
    method = "JML",
    maxit = 30
  )

  peer_net <- build_mfrm_network_review(
    peer_fit,
    peer_review_design = peer_sim,
    top_n = 8
  )
  summary(peer_net)$peer_review
}

MFRM design-network review

Use build_mfrm_network_review() when the question is whether the observed person-by-facet design is well linked enough to support common-scale interpretation. The helper wraps mfrm_network_analysis() and keeps graph diagnostics separate from MFRM fit, separation, recovery, and rater-quality claims.

toy <- load_mfrmr_data("example_core")
fit <- fit_mfrm(
  toy,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "JML",
  maxit = 30
)

if (requireNamespace("igraph", quietly = TRUE)) {
  net_review <- build_mfrm_network_review(fit, top_n = 8)
  summary(net_review)$overview
  summary(net_review)$top_cut_nodes
  summary(net_review)$top_bridge_edges

  net_bundle <- build_summary_table_bundle(net_review)
  net_bundle$tables$overview
  net_bundle$tables$facet_summary
}

For sparse simulations, pass the generated sparse-design metadata so the same review can show both observed network vulnerability and planned-missingness link diagnostics.

if (requireNamespace("igraph", quietly = TRUE)) {
  net_review <- build_mfrm_network_review(
    fit,
    sparse_design = sparse_design,
    top_n = 8
  )
  summary(net_review)$sparse_review
}

This route follows the linking-set and sparse-design literature by treating connected components, articulation points, bridge edges, and common-person rater links as design evidence. It does not turn network centrality into a person measure, rater severity estimate, fit statistic, or recovery gate.

Observed-data resampling validation

Use the resampling helpers when the study target is stability or reproducibility against a full-data reference estimate rather than recovery of known generated truth. The draw layer is person-clustered, so all observations for a selected person stay together. Stratification can preserve small substantive groups such as Region, while preserve_facets asks the draw to review and, when possible, top up rater or other facet-level coverage.

toy_region <- simulate_mfrm_data(
  n_person = 30,
  n_rater = 4,
  n_criterion = 3,
  raters_per_person = 2,
  seed = 20260525
)
region_map <- setNames(
  rep(c("A", "B", "C"), length.out = length(unique(toy_region$Person))),
  unique(toy_region$Person)
)
toy_region$Region <- unname(region_map[toy_region$Person])

rs_spec <- build_mfrm_resampling_spec(
  toy_region,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  strata = "Region",
  preserve_facets = "Rater",
  reps = 5,
  sample_fraction = 0.5,
  seed = 20260525
)

rs_draws <- draw_mfrm_resamples(rs_spec)
summary(rs_draws)$overview
summary(rs_draws)$stratum_summary
summary(rs_draws)$preserve_summary
rs_draws$manifest

The returned mfrm_resamples object includes samples, a replicate-level manifest, stratum_manifest, and preserve_manifest. These objects are a validation input layer: the full-data estimates remain reference estimates, not known true parameters, so reports should describe later comparisons as estimation stability, reproducibility, or agreement with the full-data reference.

Population forecast

spec_pop <- build_mfrm_sim_spec(
  n_person = 50,
  n_rater = 4,
  n_criterion = 4,
  raters_per_person = 2,
  assignment = "rotating",
  model = "RSM"
)

pred_pop <- predict_mfrm_population(
  sim_spec = spec_pop,
  n_person = 60,
  reps = 2,
  maxit = 30,
  seed = 123
)

s_pred <- summary(pred_pop)
s_pred$forecast[, c("Facet", "MeanSeparation", "McseSeparation")]

Notes:

Future-unit posterior scoring

toy_pred <- load_mfrmr_data("example_core")
toy_fit <- fit_mfrm(
  toy_pred,
  "Person", c("Rater", "Criterion"), "Score",
  method = "MML",
  quad_points = 7
)

raters <- unique(toy_pred$Rater)[1:2]
criteria <- unique(toy_pred$Criterion)[1:2]

new_units <- data.frame(
  Person = c("NEW01", "NEW01", "NEW02", "NEW02"),
  Rater = c(raters[1], raters[2], raters[1], raters[2]),
  Criterion = c(criteria[1], criteria[2], criteria[1], criteria[2]),
  Score = c(2, 3, 2, 4)
)

pred_units <- predict_mfrm_units(toy_fit, new_units, n_draws = 0)
summary(pred_units)$estimates[, c("Person", "Estimate", "Lower", "Upper")]

pv_units <- sample_mfrm_plausible_values(
  toy_fit,
  new_units,
  n_draws = 3,
  seed = 123
)
summary(pv_units)$draw_summary[, c("Person", "Draws", "MeanValue")]

Notes:

Prediction-aware bundle export

bundle_pred <- export_mfrm_bundle(
  fit = toy_fit,
  population_prediction = pred_pop,
  unit_prediction = pred_units,
  plausible_values = pv_units,
  output_dir = tempdir(),
  prefix = "mfrmr_prediction_bundle",
  include = c("manifest", "predictions", "html"),
  overwrite = TRUE
)

bundle_pred$summary

Notes:

DIF / Bias screening simulation

spec_sig <- build_mfrm_sim_spec(
  n_person = 50,
  n_rater = 4,
  n_criterion = 4,
  raters_per_person = 2,
  assignment = "rotating",
  group_levels = c("A", "B")
)

sig_eval <- evaluate_mfrm_signal_detection(
  n_person = c(30, 50, 80),
  n_rater = 4,
  n_criterion = 4,
  raters_per_person = 2,
  reps = 2,
  dif_effect = 0.8,
  bias_effect = -0.8,
  maxit = 30,
  sim_spec = spec_sig,
  seed = 123
)

s_sig <- summary(sig_eval)
s_sig$detection_summary
s_sig$ademp

plot(sig_eval, signal = "dif", metric = "power", x_var = "n_person")
plot(sig_eval, signal = "bias", metric = "false_positive", x_var = "n_person")

Notes:

Bundle export

bundle <- export_mfrm_bundle(
  fit_bias,
  diagnostics = diag_bias,
  bias_results = bias_all,
  output_dir = tempdir(),
  prefix = "mfrmr_bundle",
  include = c("core_tables", "checklist", "manifest", "visual_summaries", "script", "html"),
  overwrite = TRUE
)

bundle$written_files

bundle_pred <- export_mfrm_bundle(
  toy_fit,
  output_dir = tempdir(),
  prefix = "mfrmr_prediction_bundle",
  include = c("manifest", "predictions", "html"),
  population_prediction = pred_pop,
  unit_prediction = pred_units,
  plausible_values = pv_units,
  overwrite = TRUE
)

bundle_pred$written_files

replay <- build_mfrm_replay_script(
  fit_bias,
  diagnostics = diag_bias,
  bias_results = bias_all,
  data_file = "your_data.csv"
)

replay$summary

Anchoring and linking

d1 <- load_mfrmr_data("study1")
d2 <- load_mfrmr_data("study2")
fit1 <- fit_mfrm(d1, "Person", c("Rater", "Criterion"), "Score", method = "JML", maxit = 25)
fit2 <- fit_mfrm(d2, "Person", c("Rater", "Criterion"), "Score", method = "JML", maxit = 25)

# Anchored calibration
res <- anchor_to_baseline(d2, fit1, "Person", c("Rater", "Criterion"), "Score")
summary(res)
res$drift

# Drift detection
drift <- detect_anchor_drift(list(Wave1 = fit1, Wave2 = fit2))
summary(drift)
plot_anchor_drift(drift, type = "drift")

# Screened linking chain
chain <- build_equating_chain(list(Form1 = fit1, Form2 = fit2))
summary(chain)
plot_anchor_drift(chain, type = "chain")

Notes:

QC pipeline

qc <- run_qc_pipeline(fit, threshold_profile = "standard")
qc$overall      # "Pass", "Warn", or "Fail"
qc$verdicts     # per-check verdicts
qc$recommendations

plot_qc_pipeline(qc, type = "traffic_light")
plot_qc_pipeline(qc, type = "detail")

# Threshold profiles: "strict", "standard", "lenient"
qc_strict <- run_qc_pipeline(fit, threshold_profile = "strict")

Compatibility layer

Compatibility helpers are still available, but they are no longer the primary route for new scripts.

For the full map, see help("mfrmr_compatibility_layer", package = "mfrmr").

External-software wording should stay conservative:

chk <- reporting_checklist(fit, diagnostics = diag)
chk$facets_positioning
chk$software_scope
summary(chk)$software_scope

Legacy-compatible one-shot wrapper

run <- run_mfrm_facets(
  data = df,
  person = "Person",
  facets = c("Rater", "Criterion"),
  score = "Score",
  method = "JML",
  model = "RSM"
)
summary(run)
plot(run, type = "fit", draw = FALSE)

Public API map

For day-to-day use, start with the compact map:

mfrmr_output_guide("public")[, c("Question", "APILayer", "ObjectRole", "MainFunction")]

Rows with APILayer == "top_level_public_surface" are the preferred user surface. ObjectRole tells whether the row estimates, summarizes, displays, exports, or routes; DecisionBoundary states what the row must not be used to claim. Rows marked specialist_followup, advanced_design_review, or migration_or_integration should normally be reached from summary(res), summary(report), or a scoped guide rather than chosen from the namespace by name.

The full exported function index (with categories such as Model and diagnostics, Bias and DFF, Anchoring and linking, Reporting and APA, Plots and dashboards, Simulation and design, and Export utilities) is generated from roxygen. Within R the same grouping is available through the topic help pages ?mfrmr_workflow_methods, ?mfrmr_visual_diagnostics, ?mfrmr_reports_and_tables, ?mfrmr_reporting_and_apa, ?mfrmr_linking_and_dff, and ?mfrmr_compatibility_layer.

Output-terminology note: ModelSE is the model-based standard error used for primary summaries; RealSE is the fit-adjusted companion. fair_average_table() keeps the historical display labels (Fair(M) Average, Fair(Z) Average) alongside package-native aliases AdjustedAverage, StandardizedAdjustedAverage, ModelBasedSE, and FitAdjustedSE.

Reliability terminology note: diagnostics$reliability reports Rasch/FACETS-style separation, strata, and separation reliability. These indices answer whether persons, raters, criteria, or other facet elements are distinguishable on the fitted logit scale. They are not intra-class correlations. Use compute_facet_icc() only when you want a complementary random-effects variance-share summary on the observed-score scale; for non-person facets such as raters, a large ICC is systematic facet variance, not better reliability.

Scope note: mfrmr does not estimate latent-class mixture models or response-time / careless-rating adjustments. Use person fit, residual matrices, Q3-style local-dependence screens, rater drift, and DFF diagnostics as screening evidence, not as substitutes for an explicit mixture or response-time model.

FACETS reference mapping

A reference table mapping FACETS-program output tables (Table 1, Table 5, Table 7, …) to the mfrmr helper functions that produce substantively corresponding or adjacent package-native reports ships with the installed package. Open it with:

file.show(system.file("references", "FACETS_manual_mapping.md", package = "mfrmr"))

The mapping is a package-output contract reference, not evidence that FACETS was executed or that numerical FACETS equivalence has been established for any given fit. The intended workflow is to estimate and report from mfrmr objects, then use FACETS-style routes only for transition, handoff, or explicit external-table review.

Packaged synthetic datasets

Lazy-loaded under data/ and accessed either by name or via the canonical loader:

data("ej2021_study1", package = "mfrmr")
# or
df <- load_mfrmr_data("study1")

Current packaged dataset sizes:

Citation

citation("mfrmr")

Acknowledgements

mfrmr has benefited from discussion and methodological input from Dr. Atsushi Mizumoto and Dr. Taichi Yamashita.