Normative framework.
Engine power and fuel consumption are declared under ISO 3046-1:2002 [18]. The steady-state modes of ISO 8178-4:2020 provide a recognised grid for fixing the measurement points of a laboratory campaign in advance [19]. On vehicles, SAE J1321 measures the change in fuel consumption of a given heavy vehicle after a modification, with a control vehicle running in tandem [20]; SAE J1526 compares vehicles with one another and must not be used to assess a component change [21].
Measurement.
Fuel flow is preferably measured by direct gravimetry, whose regulatory linearity criteria are stricter than those of a flow meter [22]. A comparison between two benches adds their calibration errors to the measured difference; the difference is established by a paired comparison on the same instrumentation, where common calibration errors cancel.
The uncertainty budget follows the GUM [23]. Consumption is referred to energy (MJ per kWh) using the measured LHV of each batch, and the uncertainty of that measurement enters the budget. The exhaust carbon balance [24] checks the paired difference measured by gravimetry, within a tolerance declared in the protocol: it detects a gross error; it does not replace the gravimetric measurement.
Experimental design.
The protocol and the analysis plan are filed before any measurement: operating points, primary criterion, claimed size, equivalence margin, decision thresholds. A homogenised parent batch supplies treated and control batches in equal numbers, at least three of each. Apart from the intervention, treated and control batches are handled identically.
A third party randomly assigns and codes each batch as treated or control; the terms of application of the intervention, witnessed by that third party, are kept in a confidential annex. Operator and analyst remain blind to the code until the data are frozen. The batch is the statistical unit of the primary criterion: the number of batch pairs is sized with Table 4, using σd measured in an A-versus-A campaign, between-batch variability included.
Measurements alternate treated and control fuel in a balanced crossover design, for example ABBA, in a randomised order; fuel changeover conditions and the carry-over test are fixed in the protocol. The contrast (B1 + B2 − A1 − A2)/2 cancels any linear drift of the bench. The engine control unit is frozen, or all its parameters are logged, since an adaptive controller can create or mask a difference. A preliminary A-versus-A campaign, on control batches only, estimates the dispersion of the differences and checks the false-positive rate.
Low coefficients of variation have been obtained on a chassis dynamometer, over a drive cycle, by a laboratory that controlled its noise factors [25]; they do not transfer as such to an engine bench at steady state.
The number of batch pairs is fixed from σd measured in an A-versus-A campaign, between-batch variability included: read the ABBA column with c replaced by σd, or the AB column with c replaced by σd/√2; the per-measurement c only sizes the number of runs per batch. Demonstrating equivalence is sized separately, with n = ((t1−α/2 + t1−β/2)·σ/δ)², where δ is the equivalence margin; the protocol keeps the larger of the two numbers.
Diagnostics.
Beyond consumption, the bench measures the quantities the balance requires: indicated work, exhaust, cooling, regulated emissions. At equal heating value, the first law requires the sum of the measured terms to change by as much as the energy of the fuel consumed; the protocol checks this consistency within the closure uncertainty of the balance, declared in advance. The paired exergy balance then splits the change between exergy destroyed and exergy lost (A1).
Refutation criterion.
The claimed size Δ, as a percentage of energy-specific fuel consumption at the point or cycle declared as primary criterion, is handed over in writing when the protocol is filed; the equivalence margin is strictly smaller than Δ. This size is refuted if the upper bound of the 95% confidence interval of the reduction is below Δ; if its lower bound is also positive, an effect exists, smaller than claimed.
Claim A1, in the form declared in the protocol, is refuted if this 95% interval lies entirely within the equivalence margin. An interval containing both zero and Δ leaves the result inconclusive; this case remains possible with the sizing of Table 4 and allows neither a conclusion nor an extension of the campaign not provided for in the protocol.
The supplier accepts in writing, before the campaign, that a result meeting the refutation criterion counts as refutation. The protocol requires a second independent laboratory to reproduce the effect and all data to be published, unfavourable data included.
Precedents.
The US EPA states that its evaluation programme for aftermarket retrofit devices neither approves nor certifies any product [26], and that most of the devices evaluated in previous years had a neutral or negative effect on fuel economy or emissions [27]. The Federal Trade Commission requires scientific substantiation of any fuel-saving claim [28].
US federal regulation (40 CFR Part 610) lists the validity criteria for data submitted by a manufacturer, including disclosure of all results, positive, negative or inconclusive, and the independence of the laboratory [24]. The protocol above adopts these requirements.