How to fit a curve to my data

Question

I have a datasheet. It looks like an hyperbola. How can I fit a curve to it? And how can I plot a curve of the first derivative?

Time (x)second  Normalized data (y)

   0            100.00%
 100            102.60%
 200            104.39%
 300            105.53%
 400            106.80%
 500            107.49%
1000            113.03%
1500            113.13%
2000            113.30%
2500            113.63%
3000            113.78%
3500            113.92%
4000            113.92%

Answer 1

You can use least-squares fitting if you can express the curve that you want to fit as $$y = \sum_{i=1}^{n} a_i f_i(x),$$ where $a_i$'s are the unknowns that you would like to estimate from your data and $f_i$'s are known functions of $x$.

Let $Y = \begin{bmatrix}y_1 \\ \vdots \\ y_m\end{bmatrix}$, $A = \begin{bmatrix} a_1 \\ \vdots \\a_n\end{bmatrix}$, and $F = \begin{bmatrix} f_1(x_1) \ldots f_n(x_1) \\ f_1(x_2) \ldots f_n(x_2) \\ \ldots \\ f_1(x_m) \ldots f_n(x_m) \end{bmatrix}$, then the least squares solution is given by "inverting" $Y = F\cdot A$ to obtain an estimate $\hat{A}$ of $A$: $$\hat{A} = (F^{T}F)^{-1} F^{T} Y$$

The first derivative is simply given by $$\dfrac{dy}{dx} = \sum_{i=1}^{n} \hat{a}_i \dfrac{df_i(x)}{dx}$$

Answer 2

For any functional form, you can do a multidimensional minimization over the parameters of the form you choose. Any numerical analysis book will have a description. I like sections 10.4 through 10.7 of Numerical Recipes (obsolete versions are free). Then for the derivative you can take the derivative of the form you find. But it may not be as accurate as the function values-differentiation amplifies high frequency noise.

Answer 3

I wrote a tutorial article on the topic:

Linear and Non-Linear Least Squares with Math.NET

Of course, you need to know the type of curve beforehand. That is the model function with parameters you would like to fit, e.g.

$$y = ax^{2}+b$$

Of course, you can interpolate the data with some piecewise polynomial or spline.

Answer 4

If you have access to Excel, use the "Trend Line" function to do the fitting. You can choose several types of functions to use for fitting. No sense writing fitting algorithms yourself unless your objective is to learn how. I agree with Ross M's comment above -- the data looks like two straight lines, so fitting any kind of curve to it is going to be tricky. But, it depends what characteristics you want in the fit. Using Excel will let you play around with several different options easily, and you might be able to find a fit that you like. If you do, then Excel will give you the equation of the curve, and then you can easily get the derivative.