SKIP TO CONTENT

SOLVER VERIFICATION / VALIDATION

EVIDENCE FIRST. CLAIM BOUNDARIES INCLUDED.

Review a classified 63-case solver gate, exact and manufactured production-network oracles, named NAFEMS and NASA comparisons, a broader radiation corpus, one narrow hardware-TVAC case, and explicit external-evidence blockers.

63 / 63 FORMAL GATE CASES / GATE A READY / GATE B PARTIAL / GATE C BLOCKED

Strongest validation evidence
NASA Shuttle MRS TP1A: narrow T3 hardware TVAC, 1.000 K RMS residual across eight outlets
Formal verification gate
63 / 63 classified cases across analytical, numerical, public-reference, hardware, research-support, and regression evidence classes
External closure
Gate A ready within the declared lumped-network scope; Gate B partial; Gate C blocked; no completed claim-eligible T4 flight result
Terms used on this page
V&V
Verification asks whether the equations and numerics are implemented correctly. Validation asks whether a model adequately represents its intended physical use. Use validity is decided for a stated decision and evidence scope.
Evidence class
A machine-readable category separating analytical and numerical verification, public-reference parity, hardware or flight validation, research support, and internal regression.
Claim-eligible
Evidence complete enough to support its narrowly stated claim. Passing research-support or regression code does not automatically make it claim-eligible.
Gate A / B / C
Bounded public-beta credibility / independent cross-tool corroboration / additional hardware and flight evidence. Each gate has its own completion criteria.
RK4
Fourth-order Runge–Kutta, an explicit numerical method used for transient integration.
BE / CN
Backward Euler and Crank–Nicolson, implicit transient-integration methods.
MCP
Model Context Protocol, a standard interface through which software agents can use approved product tools.
TVAC
Thermal-vacuum testing, used to correlate a model with instrumented hardware in a space-like environment.
FEA
Finite-element analysis. Here it refers to external structural or higher-fidelity thermal comparison.
MLI
Multi-layer insulation used to reduce radiative heat transfer on spacecraft.
TCS
Thermal Control System.
NAFEMS
An independent engineering-analysis organization that publishes benchmark problems.

Current evidence posture

The three proof lines below are the fastest way to assess the current evidence. The full ledger remains available for technical review.

  1. T3 hardware TVAC — executed

    NASA Shuttle MRS TP1A

    Eight production steady-state solves predict measured radiator-panel outlet temperatures with 1.000 K RMS and 1.449 K maximum residual. The model uses measured inlet temperature, branch flow, absorbed environment, geometry, and optics; no output target was fitted.

  2. 63 / 63 classified cases — passing

    Formal Solver Gate

    The machine-readable gate separates analytical verification, numerical verification, public-reference parity, hardware validation, research support, and internal regressions. A passing regression is not automatically counted as validation evidence.

  3. Gate A ready · Gate B partial · Gate C blocked

    External Evidence Gates

    Gate A is ready only for the declared lumped-network scope. Independent cross-tool executions are not yet attached, and no second source-complete hardware case or claim-eligible T4 flight case is complete.

Review the complete evidence ledger (17 states)

NASA Shuttle MRS TP1A

T3 hardware TVAC — executed

Eight production steady-state solves predict measured radiator-panel outlet temperatures with 1.000 K RMS and 1.449 K maximum residual. The model uses measured inlet temperature, branch flow, absorbed environment, geometry, and optics; no output target was fitted.

Formal Solver Gate

63 / 63 classified cases — passing

The machine-readable gate separates analytical verification, numerical verification, public-reference parity, hardware validation, research support, and internal regressions. A passing regression is not automatically counted as validation evidence.

External Evidence Gates

Gate A ready · Gate B partial · Gate C blocked

Gate A is ready only for the declared lumped-network scope. Independent cross-tool executions are not yet attached, and no second source-complete hardware case or claim-eligible T4 flight case is complete.

Exact & Manufactured Network Oracles

T1 — implemented

Independent linear-system solutions and prescribed nonlinear trajectories exercise the production steady-state, RK4, and implicit-Euler seams, including convergence and energy-closure checks.

Named Public-Reference Cases

T2 — implemented narrowly

Abaqus NAFEMS T2, T3, and T4 plus the NASA/NASTRAN washer problem reproduce named public targets. These cases support their encoded equations and boundary conditions, not broad equivalence to either commercial tool.

Public Radiation Corpus

T1 — 37 / 37 checks

Howell, NASA CHAR, and Abaqus references exercise configuration factors, closure, reciprocity, surface ordering, direction, emissivity limits, radiosity, and open-environment accounting within the supported diffuse-gray scope.

No-License Interoperability Pack

T2 support — external runs pending

Tool-neutral cases, exact checkpoints, an immutable execution-evidence schema, and SATMO published inputs are frozen. SciPy, SUNDIALS, GUNNS, TNSolver, CalculiX, SATMO, and Thermal Desktop parity remain unclaimed until real external executions are attached.

Hardware / Flight Acquisition Protocol

T3/T4 readiness — not evidence

Source records and a fail-closed staged TVAC protocol are implemented. They define how future evidence must be acquired; they do not substitute for a second physical test or an untouched flight holdout.

PharmaSat / SatTherm Proxy

Exploratory — not claim-eligible

The source-informed three-node midpoint comparison does not reproduce the published geometry, orbit, full network, or raw flight telemetry. It is retained as research history, not presented as solver validation or flight correlation.

Non-Earth Environment Forcing

T1 and source-derived inputs

Deep-space, heliocentric, central-body, Horizons, WebGeocalc, and local SPICE-export workflows drive forcing from explicit profile rows. The trajectory data remain externally sourced.

Mars Express Solar-Flux Check

External forcing check — executed

All 65,952 rows in the MD5-matched public Figshare file were compared with Verixos 1/r² solar forcing: -2.164 W/m² mean bias, 2.190 W/m² RMS residual, 3.126 W/m² maximum absolute residual, and 0.438% maximum absolute percent residual. This tests solar forcing only, not spacecraft temperature prediction.

Rosetta TCS Data Intake

Telemetry audit — not correlation

The 42,210-row ESA PSA/PDS MIRO housekeeping table was parsed; 41,510 post-ephemeris rows were paired with JPL Horizons Sun-relative geometry. No Rosetta physical thermal model, node map, operating context, or temperature tolerance is attached, so this is not flight-temperature validation.

Quetzal-1 Source Model

Published-formulation verification — not correlation

The source-locked telemetry repository, thesis, derived fixture hashes, and Eq. 34 one-node formulation are encoded. The case verifies the transcribed heat-balance formulation under stated closure assumptions; missing attitude, internal heat, as-built coupling, and source-complete thermal state prevent a flight-correlation claim.

OPS-SAT SEPP Source Model

Published source-model verification — not hardware validation

The dissertation equations and SEPP stack table are encoded as a reduced-order source-model check. Effective emissivity and specific heat come from the source vacuum run, so this verifies the published formulation rather than independent hardware or flight behavior.

Finite-Disc Shadow Geometry

T1 — implemented

Analytical cases cover full Sun, partial penumbra, full umbra, multiple occulting bodies, and row-level body overrides. This verifies illumination geometry and profile handling.

LADEE LDEX Intake

Telemetry audit — not spacecraft validation

The public housekeeping audit extracted 3,796 rows across five Celsius temperature channels. These are instrument-housekeeping data, not a validated spacecraft-bus thermal model.

Outer-Solar-System Forcing

T1 — implemented

Analytical cases check 1/r² solar forcing at Jupiter distance, 20 AU, and 32 AU. RTG/RHU heat, radiation dose, degradation, and mission thermal response are separate inputs and evidence needs.

Benchmark evidence

Hardware validation, analytical verification, public-reference parity, and exploratory proxies are different evidence classes. They are separated here so a proxy cannot be mistaken for a validation result.

NASA Shuttle MRS TP1A — T3 hardware thermal-vacuum validation

Verixos ran eight sequential steady-state production-solver cases for the NASA Shuttle Modular Radiator System TP1A test. The model predicts radiator-panel outlet temperatures from the measured inlet temperature, measured branch flow, source-reported absorbed environments, radiator geometry, and optical properties. No parameter was fitted to the eight outlet-temperature targets.

Compared outputs
8 panel outlets
RMS residual
1.000 K
Maximum residual
1.449 K
Declared screen
3.333 K maximum

What this supports

A narrow claim for steady-state radiator radiation and energy balance, including sequential coolant-temperature prediction under prescribed measured flow. The 3.333 K screen comes from the approximately 6 °F resolution reported for the plotted AJ temperature channels in Volume IV, Book 1, Table 7, and was fixed before the production solve.

What this does not support

Flight validation, orbital-environment validation, pump or flow-distribution prediction, or a general spacecraft-accuracy claim. The reduced-order model uses mean coolant temperature as the lumped tube temperature, and the source outputs were public before implementation.

Primary sources: Volume II, Volume III, Volume IV, Book 1, and Volume IV, Book 2.

16 highlighted verification results

1.1

Conduction Transient

Single-node lumped capacitance cooling

0.026% RK4 error

Bergman et al.

1.2

Two-Node Steady State

Coupled conduction to boundary

0.030 K absolute error

Çengel & Ghajar

1.3

Radiation Equilibrium

Solar flux / deep-space balance (3 cases)

< 1 K all cases

NASA SP-8105

1.4

Radiation Cool-Down

T⁴ nonlinearity — pure radiative transient

0.0014% RK4 error

Çengel & Ghajar

1.5

Parallel Plates Radk

Grey-body radiation conductor

0.0000% exact match

Bergman et al.

1.6

Enclosure Closure

View factor sum rule Σ Fᵢⱼ = 1

0.002% row-sum error

Howell et al.

1.7

Radiation Shield Enclosure

Three-surface diffuse-gray shield equilibrium

< 0.05 K shield temp error

Bergman et al.

B9

Heat Pipe Conductor Curve

Piecewise-effective conductance at cold, nominal, and hot points

0.0039% worst ΔT error

Internal regression

B10

Monte Carlo View Factors

Parallel disks, perpendicular rectangles, and concentric spheres

0.31% worst current error @ 1e5 rays

Howell et al.

2B

Two-Band Optics

Material-driven α_solar / ε_IR equilibrium with coating assumptions

< 1 K equilibrium error

NASA SP-8105

V8

Forced Convection Flat Plate

Laminar air-flow heat rejection to a fixed-temperature sink

< 0.1 K surface temp error

Bergman et al.

V18

Abaqus NAFEMS T3

Refined transient-conduction reproduction against the public NAFEMS T3 target

< 0.1 K refined RK4 error

Abaqus NAFEMS T3

V35

Abaqus NAFEMS T2

Steady conduction-radiation endpoint through the production network seam

< 0.5 K vs 927 K target

Abaqus NAFEMS T2

V36

Abaqus NAFEMS T4

Structured lumped finite-volume refinement toward the point-E target

< 1.0 °C vs 18.3 °C target

Abaqus NAFEMS T4

V37

Public Radiation Corpus

Howell, NASA CHAR, and Abaqus factors through production radiation paths

37 / 37 checks passed

Howell catalog

V38

Exact & Manufactured Oracles

Independent linear-network solutions and prescribed nonlinear transients

22 / 22 checks passed

Independent reference oracles

PharmaSat / SatTherm — exploratory proxy, not validation

The repository contains a source-informed three-node comparison with midpoint temperatures reported in the SatTherm paper. It does not reproduce the published spacecraft geometry, orbit and attitude, complete thermal network, material inputs, operating timeline, or raw time-aligned flight telemetry. The proxy is therefore not a source-complete PharmaSat reproduction, not solver validation, and not flight correlation. It will remain outside public validation claims unless those inputs are obtained and the case is rebuilt with pre-registered acceptance criteria.

Claim boundaries and limitations

Use the evidence by scope: named benchmark results show solver behavior; mission decisions pair those results with project inputs, review criteria, and customer evidence.

DEMONSTRATED IN CURRENT EVIDENCE

  • A 63-case formal gate passes with machine-readable evidence classes and claim eligibility; internal regressions and research-support cases remain outside scientific evidence totals.
  • Exact and manufactured production-network oracles cover independent steady-state solutions, RK4 refinement, implicit-Euler convergence, nonlinear forcing, and arithmetic and energy closure.
  • Narrow published-reference parity for Abaqus NAFEMS T2, T3, and T4 plus the NASA/NASTRAN washer conduction problem.
  • A 37-check Howell, NASA CHAR, and Abaqus radiation corpus covers configuration factors, diffuse-gray radiosity, closure, reciprocity, ordering, direction, emissivity limits, and open-environment accounting.
  • One completed narrow T3 hardware-TVAC case: NASA Shuttle MRS TP1A, with eight production solves, 1.000 K RMS residual, and 1.449 K maximum residual.
  • Analytical deep-space and heliocentric forcing with 1/r² solar-flux checks and source-labeled imported ephemeris profiles.
  • Mars Express full-file check of 1/r² solar-flux forcing: 65,952 public rows, MD5-matched source, and 3.126 W/m² maximum absolute residual.
  • Rosetta full-file telemetry audit and geometry pairing: 42,210 source rows and 41,510 post-ephemeris rows, without a temperature-correlation claim.
  • Quetzal-1 source-locked Eq. 34 formulation verification with public telemetry/thesis provenance and explicit closure assumptions.
  • OPS-SAT SEPP reduced-order source-model verification against dissertation equations and tables.
  • Analytical finite-disc shadow validation for full Sun, penumbra, umbra, multiple occulting bodies, and row-level overrides.
  • LADEE LDEX instrument-housekeeping intake: 3,796 rows and five Celsius channels, without a spacecraft-bus validation claim.
  • Analytical low-solar-flux outer-solar-system forcing checks for Jupiter, 20 AU, and 32 AU cases.

EVIDENCE SCOPE

  • No completed claim-eligible T4 flight-correlation result exists today.
  • Gate A readiness is bounded to the declared lumped-parameter thermal-network class; it is not a general spacecraft-accuracy, FEA-equivalence, or certification claim.
  • Gate B remains partial because no immutable external SciPy, SUNDIALS, GUNNS, TNSolver, CalculiX, SATMO, or Thermal Desktop execution record is attached.
  • Gate C remains blocked because a second source-complete hardware article and an untouched, claim-eligible flight interval have not been executed.
  • SATMO-to-Thermal-Desktop replay is blocked on absent public Thermal Desktop temperature histories and native model files, even though the published 18-case SATMO input matrix is frozen.
  • The PharmaSat three-node midpoint proxy is not a source-complete reproduction, solver validation case, or flight correlation.
  • SAE 961452 is not claimed: the licensed paper and source-complete model inputs have not been obtained and reproduced.
  • NASA Shuttle MRS TP1A is hardware-TVAC evidence for prescribed-flow radiator energy balance; it does not validate flight environments, pump behavior, or flow distribution.
  • Commercial-tool comparison is limited to the exact Abaqus NAFEMS T2, T3, and T4 plus NASA/NASTRAN washer public cases.
  • Mission trajectories enter through imported Horizons, WebGeocalc, or SPICE-derived profiles rather than in-app N-body propagation.
  • Mars Express evidence covers solar-flux forcing only; it does not validate spacecraft temperatures or heater power.
  • Rosetta evidence covers file audit and geometry pairing only; temperature residuals require a physical model, channel-to-node map, operating context, and reviewed tolerances.
  • Quetzal-1 evidence verifies a published isothermal formulation under reconstructed assumptions; it does not validate an as-flown spacecraft model or EPS temperature prediction.
  • OPS-SAT SEPP evidence verifies the published reduced-order source model; it does not independently validate hardware, flight telemetry, or spacecraft-level thermal response.
  • Outer-solar-system evidence covers low-solar-flux forcing; RTG coupling, radiation effects, and telemetry correlation are separate mission inputs.

Modeling considerations

MLI blanket modeling

Mission-dependent

Use MLI abstractions for trade studies, then set project acceptance criteria with blanket-specific test or correlation evidence.

Fluid loops / pumped coolant

Reduced-order only

Prescribed coolant transport can be represented in a lumped network. Pump, pressure-drop, two-phase, and flow-distribution prediction are outside the validated scope.

Heat pipe physics depth

Model-dependent

Conductance curves and operating-envelope inputs support network studies; startup, orientation, and transport limits require mission-specific characterization.

Contact conductance certainty

Input-sensitive

Contact conductance is an engineering input best bracketed by test data, hardware correlation, or a documented sensitivity range.

Spectral radiation detail

Model-dependent

Two-band and temperature-aware optics are supported; use external higher-fidelity evidence when full spectral temperature dependence drives the decision.

Thermoelastic structural response

External comparison

Abaqus and NASTRAN handoff artifacts carry temperatures and provenance; displacement and stress acceptance occurs in the external structural workflow.

Commercial-tool comparison

Named cases only

Public parity is scoped to the exact Abaqus NAFEMS T2, T3, and T4 plus NASA/NASTRAN cases listed on this page. No broad Abaqus, Thermal Desktop, ESATAN, or arbitrary FEA parity is claimed.

Radiation exchange

Diffuse-gray scope

The verified multisurface formulation is bounded to diffuse-gray exchange. Specular and mixed-reflection authoring states are not supported in production solver paths.

Flight correlation

Not yet claim-eligible

A completed T4 case requires a named mission, as-flown model inputs, time-aligned telemetry, mapped channels, operating context, and pre-registered acceptance criteria.

Next external evidence

The roadmap prioritizes broader published comparison, instrumented hardware correlation, and public flight or heritage evidence with enough context for technical review.

  1. Independent cross-tool execution

    Runtime blocked

    Run the frozen tool-neutral cases in SciPy or SUNDIALS and NASA GUNNS, TNSolver, or CalculiX; record tool version, timestamp, immutable output hash, and residuals.

  2. SATMO / Thermal Desktop history parity

    Blocked on source files

    Obtain the published study’s paired Thermal Desktop histories or native models before making any SATMO-to-Thermal-Desktop parity claim.

  3. Near-Earth environment parity pack

    Planned

    Attach frozen GMAT or near-Earth SPICE geometry and CERES flux outputs with immutable provenance and declared tolerances.

  4. Second hardware-TVAC article

    Planned

    Execute the staged protocol on a source-complete test article with uncertainty, fixed calibration rules, and a preregistered held-out interval.

  5. Public T4 flight correlation

    Planned

    Requires as-flown spacecraft inputs, time-aligned temperature telemetry, orbit and attitude context, an auditable channel-to-node map, and acceptance criteria fixed before the held-out solve.

  6. Rosetta thermal response

    Research candidate

    The public telemetry audit and geometry pairing are complete. A physical MIRO model, attitude and operations context, channel mapping, and reviewed residual tolerances are still required.

  7. Quetzal-1 flight correlation

    Research candidate

    The source repository, thesis, and formulation are locked. A claim-eligible case still needs attitude and operations context, time-resolved internal heat, an as-built thermal network, mapped channels, and pre-registered residual criteria.

  8. OPS-SAT SEPP independent validation

    Research candidate

    The published SEPP source model is encoded. Independent validation requires measured inputs and outputs not already used to fit the reduced-order source parameters.

  9. PharmaSat source-complete reproduction

    Blocked on source data

    Requires the published mission geometry, orbit and attitude, full thermal network and material inputs, operating timeline, and raw time-aligned flight telemetry.

References

Review 40 source references
  1. 1.NASA-STD-7009B, Standard for Models and Simulations
  2. 2.ECSS-E-ST-31C, Thermal Control General Requirements
  3. 3.Bergman, Lavine, Incropera & DeWitt, Fundamentals of Heat and Mass Transfer, 7th ed.
  4. 4.Çengel & Ghajar, Heat and Mass Transfer: Fundamentals and Applications
  5. 5.Howell, Mengüç, Siegel & Daun, Thermal Radiation Heat Transfer, 7th ed.
  6. 6.Gilmore, Spacecraft Thermal Control Handbook, Vol. 1, 2nd ed.
  7. 7.NASA SP-8105, Spacecraft Thermal Control
  8. 8.ECSS-E-HB-31-03A, Thermal Analysis Handbook
  9. 9.VanOutryve, A Thermal Analysis and Design Tool for Small Spacecraft, SJSU thesis (2008)
  10. 10.Allison, Diaz-Aguado & Jaroux, SatTherm: A Thermal Analysis and Design Tool for Small Spacecraft
  11. 11.Abaqus NAFEMS T3: One-dimensional transient heat transfer
  12. 12.Abaqus NAFEMS T2: One-dimensional heat transfer with radiation
  13. 13.Abaqus NAFEMS T4: Two-dimensional heat transfer with convection
  14. 14.Howell primary configuration-factor catalog
  15. 15.NASA CHAR thermal analysis software report
  16. 16.NASA GUNNS repository
  17. 17.TNSolver thermal-network reference
  18. 18.SATMO public repository
  19. 19.NASA-TM-X-3504 thermal analyzer sample problems
  20. 20.NASTRAN Demonstration Problem Manual
  21. 21.NASA Shuttle Modular Radiator System, Volume II
  22. 22.NASA Shuttle Modular Radiator System, Volume III
  23. 23.NASA Shuttle Modular Radiator System, Volume IV, Book 1
  24. 24.NASA Shuttle Modular Radiator System, Volume IV, Book 2
  25. 25.FASTSAT-HSV01 thermal model correlation
  26. 26.Petković et al., Machine-learning ready data on the thermal power consumption of the Mars Express Spacecraft
  27. 27.Mars Express thermal-power dataset, 60-minute resolution, version 1
  28. 28.ESA Rosetta TCS MIRO source label
  29. 29.ESA Rosetta TCS MIRO source table
  30. 30.ESA Rosetta SPICE kernel archive
  31. 31.JPL Horizons API documentation
  32. 32.LRO Planetary Data System archive
  33. 33.LRO Diviner science archive
  34. 34.LADEE LDEX PDS4 housekeeping archive
  35. 35.NASA New Horizons radioisotope thermoelectric generator
  36. 36.New Horizons spacecraft description, PDS
  37. 37.Galileo thermal design and redesign record, NASA NTRS
  38. 38.Quetzal-1 telemetry repository
  39. 39.Quetzal-1 thesis source
  40. 40.OPS-SAT SEPP dissertation source

Need evidence for a specific review?

Tell us the benchmark, deployment, or procurement scope. We’ll share the current source-backed materials relevant to that review.

Request review materials