Skip to content

Commit f33460a

Browse files
committed
SF_TPTest: Avoid issue due to rounding differences
The recent introduction of decimal multiplier constants changed the last digits of the result. But we are actually not interested in an arbitrary precise result, so let's use the tol parameter.
1 parent 3d50bb2 commit f33460a

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

Packages/Testing-MIES/UTF_SweepFormulaHardware.ipf

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -213,19 +213,19 @@ static Function TestSweepFormulaTP(string device)
213213
SetDimLabel LAYERS, 0, DA0, wRef
214214
SetDimLabel LAYERS, 1, DA1, wRef
215215
SetScale d, 0, 0, "MΩ", wRef
216-
CHECK_EQUAL_WAVES(tpResult, wRef)
216+
CHECK_EQUAL_WAVES(tpResult, wRef, tol = 1e-12)
217217

218218
formula = "tp(inst, channels(DA), sweeps())"
219219
WAVE tpResult = SF_FormulaExecutor(DirectToFormulaParser(formula), graph=graph)
220-
CHECK_EQUAL_WAVES(tpResult, wRef)
220+
CHECK_EQUAL_WAVES(tpResult, wRef, tol = 1e-12)
221221

222222
formula = "tp(1, channels(DA), sweeps())"
223223
WAVE tpResult = SF_FormulaExecutor(DirectToFormulaParser(formula), graph=graph)
224-
CHECK_EQUAL_WAVES(tpResult, wRef)
224+
CHECK_EQUAL_WAVES(tpResult, wRef, tol = 1e-12)
225225

226226
formula = "tp(2, channels(DA), sweeps())"
227227
WAVE tpResult = SF_FormulaExecutor(DirectToFormulaParser(formula), graph=graph)
228-
CHECK_EQUAL_WAVES(tpResult, wRef)
228+
CHECK_EQUAL_WAVES(tpResult, wRef, tol = 1e-12)
229229

230230
formula = "tp(base, channels(DA), sweeps())"
231231
WAVE tpResult = SF_FormulaExecutor(DirectToFormulaParser(formula), graph=graph)

0 commit comments

Comments
 (0)