How to sample dynamic data

32 Views Asked by At

I don know math and statistics.I want to divide data into 2 sets . Set#1 contain short values and Set#2 contain large values.Data is coming from stream and i don know the values in advance. How can i decide short and long values. For example Data is=1,1,1,2,2,100 then i can have set1={1,2,2,2,2} and set2={100} Or data can be 1,2,3,4,4 then set1={1,2} set2={3,4,4} I don know the domain name of this problem . What i should google . What i should learn so that i can sample data on the basis of particular formula or pattern.

1

There are 1 best solutions below

4
On

Try googling confidence banding for time series. This will give you a way of determining whether a value is large based on a confidence level (say $90\%$). You'll want to look up linear regression as well, in order to perform this style of analysis. I don't have the time to write it all out right now; I'll try to come back later when I have more time.