Fit log-log data with gnuplot

Question

i try to fit this plot enter image description here as you cans see the fit is not so good for the data.

My code is:

    clear
reset


set terminal pngcairo size 1000,600 enhanced font 'Verdana,10'
set output 'LocalEnergyStepZoom.png'
set ylabel '{/Symbol D}H/H_0'
set xlabel 'n_{step}'
set format y '%.2e'

set xrange [*:*]
set yrange [1e-16:*]

f(x) = a*x**b
fit f(x) "revErrEnergyGfortCaotic.txt" via a,b


set logscale

plot 'revErrEnergyGfortCaotic.txt' w p,\
 'revErrEnergyGfortRegular.txt' w p,\
f(x) w l lc rgb "black" lw 3 

exit

So the question is how mistake i compute here? because i suppose that in a log-log plane a fit of the form i put in the code should rappresent very well the data.

Thanks a lot

Finally i can be able to solve the problem using the suggestion in the answer of Christop and modify it just a bit.

I found the approximate slop of the function (something near to -4) then taking this parameter fix i just fit the curve with only a, found it i fix it and modify only b. After that using the output as starting solution for the fit i found the best fit. enter image description here

Your best bet is to fit to a linear function f(x) = a*x + b and then fit using log(y) versus log(x). For this use the using option: fit f(x) "data" using (log($1)):(log($2)) via a,b. — Miguel
– Miguel, Commented May 13, 2014 at 18:34
@RamanShah The question was (strictly speaking) on how to fit to an exponential using gnuplot, for which Christoph's answer is the correct one. Now, if you ask about the right way to tackle this problem from the data analysis point of view... I'll just leave the comment as a useful "workaround" for people with similar problems. — Miguel
– Miguel, Commented May 14, 2014 at 4:57

Christoph · Accepted Answer · 2014-05-13 18:29:26Z

1

You must find appropriate starting values to get a correct fit, because that kind of fitting doesn't have one global solution. If you don't define a and b, both are set to 1 which might be too far away. Try using

a = 100
b = -3

for a better start. Maybe you need to tweak those value a bit more, I couldn't because I don't have the data file.

Also, you might want to restrict the region of the fitting to the part above 10:

fit [10:] f(x) "revErrEnergyGfortCaotic.txt" via a,b

Of course only, if it is appropriate.

answered May 13, 2014 at 18:29

Christoph

48.7k8 gold badges94 silver badges198 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Raman Shah · Accepted Answer · 2014-05-13 18:31:30Z

This is a common issue in data analysis, and I'm not certain if there's a nice Gnuplot way to solve it.

The issue is that the penalty functions in standard fitting routines are typically the sum of squares of errors, and try as you might, if your data have a lot of dynamic range, the errors for the smallest y-values come out to essentially zero from the point of view of the algorithm.

I recently taught a course to students where they needed to fit such data. Lots of them beat their (matlab) fitting routines into submission by choosing very stringent convergence criteria, but even this did not help too much.

What you really need to do, if you want to fit this power-law tail well, is to convert the data into log-log form and run a linear regression on that log-log representation.

mrossi · Accepted Answer · 2014-11-11 13:22:24Z

1

The main problem here is that the residual errors of the function values of the higher x are very small compared to the residuals at lower x values. After all, you almost span 20 orders of magnitude on the y axis.

Just weight the y values with 1/y**2, or even better: if you have the standard deviations of your data points weight the values with 1/std**2. Then the fit should converge much much better.

In gnuplot weighting is done using a third data column:

fit f(x) 'data' using 1:2:(1/$2**2") via ...

Or you can use Raman Shah's advice and linearize the y axis and do a linear regression.

answered Nov 11, 2014 at 13:22

mrossi

4716 silver badges8 bronze badges

Comments

user15083428 · Accepted Answer · 2021-01-26 10:57:56Z

-1

you need to use weights for your fit (currently low values are not considered as important) and have a better starting guess (via "pars_file.pars")

answered Jan 26, 2021 at 10:57

user15083428

1

Collectives™ on Stack Overflow

Fit log-log data with gnuplot

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related