MLV Tools

Replication and Comparison

Estimate ranking instability caused by variance overlap

MNIST case uses repeated-run metrics generated externally; detection case uses multispectral fusion pipelines from a dedicated utility repository.

Configure trial counts for Monte Carlo and Bootstrap before running the results.

Monte Carlo simulations

Bootstrap resamples

Results

Model	Best value	N	Mean	Std. dev.	Normal P90

Estimate disorder probability over the selected models, averaging N sampled scores per model.

Normality diagnostics justify Monte Carlo representativeness. If diagnostics are weak, Bootstrap is the robust reference.

					Shapiro-Wilk		Normality summary
Model	Median	Mean	Skewness	Kurtosis (Fisher)	W	p-value (%)	Mean≈Med	Skew+Kurt	S-W

Monte Carlo samples from fitted normals; Bootstrap samples from empirical data with replacement.

	p(!correct order)
N samples/model	Monte Carlo	Bootstrap