Gamestudio Links
Zorro Links
Newest Posts
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Data from CSV not parsed correctly
by EternallyCurious. 04/20/24 21:39
M1 Oversampling
by 11honza11. 04/20/24 20:57
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
folder management functions
by VoroneTZ. 04/17/24 06:52
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
3 registered members (frutza, Quad, AndrewAMD), 385 guests, and 1 spider.
Key: Admin, Global Mod, Mod
Newest Members
EternallyCurious, howardR, 11honza11, ccorrea, sakolin
19047 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Data quality and accuracy of test results #471179
02/21/18 20:04
02/21/18 20:04
Joined: Feb 2018
Posts: 7
A
alb Offline OP
Newbie
alb  Offline OP
Newbie
A

Joined: Feb 2018
Posts: 7
Hi, I'm starting to test the data quality and I discover a strange beahvour so I decide to did the following experiment:
I train and test workshop6 from 2012 to 2016 with only one asset eurusd.
then I erase EURUSD_2012.t6 - EURUSD_2016.t6 and I download it from fxcm (api)
after retrain i can read a complitly different results:
orginal data

Number of trades 142 (89/year, 2/week, 1/day)
Percent winning 36.6%
Max win/loss 516$ / -337$
Avg trade profit 4.54$ 4.0p (+116.9p / -61.3p)


fxcm data:
Number of trades 65 (41/year, 1/week, 1/day)
Percent winning 49.2%
Max win/loss 1339$ / -925$
Avg trade profit 10.37$ 3.5p (+140.1p / -129.0p)


I can't understand; why this workshop is so data depending?

Can someone help me to understand?

thks a lot, alb


Last edited by alb; 02/21/18 20:04.
Re: Data quality and accuracy of test results [Re: alb] #471183
02/22/18 07:26
02/22/18 07:26
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Workshop 6 reinvests profit. Tiny differences thus have large impact on the end result.

Re: Data quality and accuracy of test results [Re: jcl] #471189
02/22/18 10:32
02/22/18 10:32
Joined: Feb 2018
Posts: 7
A
alb Offline OP
Newbie
alb  Offline OP
Newbie
A

Joined: Feb 2018
Posts: 7
Hi jcl, thanks for your answer, for your time and for your great work.
Sorry I forgot to specify that I disable the reinvest ability. I only use optimalF and a fraction of capital like yours examples so I enabled
Margin = 0.5 * OptimalF * Capital;

Can I ask you the source of the data in the setup.exe package and if you act some kind of denoise, correction or filter in the data? I start to coding my own scripts but I need to trust in the results of test, for avoid wrong belief.
many thanks for your help, Alb

Last edited by alb; 02/22/18 10:33.
Re: Data quality and accuracy of test results [Re: alb] #471194
02/22/18 12:44
02/22/18 12:44
Joined: Aug 2017
Posts: 102
Spain
B
Brax Offline
Member
Brax  Offline
Member
B

Joined: Aug 2017
Posts: 102
Spain
As far as i know, i think zorro provided data is from Oanda.

Data from different providers can have significant result differences, especially in forex and CFD, not to mention commisions, slippage and so on.

Surely jcl can give you more details.

Re: Data quality and accuracy of test results [Re: Brax] #471205
02/23/18 11:36
02/23/18 11:36
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
I found no records of the data source, but if I remember right, the Forex data before 2017 was from Oanda and the CFD data from FXCM. If you want to trade with a particular broker, it is recommended to test the strategy with data from that broker if available. For the workshops it won't matter much since they are for learning only.

Re: Data quality and accuracy of test results [Re: jcl] #471231
02/24/18 14:39
02/24/18 14:39
Joined: Jan 2018
Posts: 29
L
luisd Offline
Newbie
luisd  Offline
Newbie
L

Joined: Jan 2018
Posts: 29
alb,

would you be able to post 2 charts - same time window - one for each data set, both showing at least 1 trade each?

Re: Data quality and accuracy of test results [Re: luisd] #471293
02/26/18 18:42
02/26/18 18:42
Joined: Feb 2018
Posts: 7
A
alb Offline OP
Newbie
alb  Offline OP
Newbie
A

Joined: Feb 2018
Posts: 7
thanks alot for yours answers,
@luisd no I can't do this experiment because I'd aligned all t6 files in all zorro installations and I can confirm the same results in this conditions as expected.

thks

Re: Data quality and accuracy of test results [Re: alb] #471762
03/19/18 14:19
03/19/18 14:19
Joined: Feb 2018
Posts: 7
A
alb Offline OP
Newbie
alb  Offline OP
Newbie
A

Joined: Feb 2018
Posts: 7
I have deepened my studies and I realized that some indicators are more susceptible to the small variations caused by the otc market. For example, the broker's management of weekend candles affects the atr in a significant way. However, even if it's a little rough, I'm using this method to test the robustness of my scripts and I have to say that by making small changes the scripts become less susceptible to changes (for example by applying indicator smoothing)
I also noticed a big difference between the currency data and the index data provided by differents brokers.
Finally it is impressive note how weakly the z12 script is susceptible to data variations


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1