Gamestudio Links
Zorro Links
Newest Posts
Data from CSV not parsed correctly
by EternallyCurious. 04/18/24 10:45
StartWeek not working as it should
by Zheka. 04/18/24 10:11
folder management functions
by VoroneTZ. 04/17/24 06:52
lookback setting performance issue
by 7th_zorro. 04/16/24 03:08
zorro 64bit command line support
by 7th_zorro. 04/15/24 09:36
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:48
Zorro FIX plugin - Experimental
by flink. 04/14/24 07:46
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
1 registered members (AndrewAMD), 600 guests, and 2 spiders.
Key: Admin, Global Mod, Mod
Newest Members
EternallyCurious, 11honza11, ccorrea, sakolin, rajesh7827
19046 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Prediction error #454121
08/28/15 05:04
08/28/15 05:04
Joined: Apr 2014
Posts: 482
Sydney, Australia
B
boatman Offline OP
Senior Member
boatman  Offline OP
Senior Member
B

Joined: Apr 2014
Posts: 482
Sydney, Australia
JCL has provided some useful info on prediction error in the past, but I have another question. In the performance report below, I get a large negative prediction error. The strategy creates a stationary spread by combining four JPY pairs and enters and exits positions in each of the pairs based on the spread's deviation from a recent mean value (loving the R bridge, by the way).

What does the large negative prediction error indicate? Would its negative value be related to the fact that even though the strategy is profitable, its average trade profit in pips is negative? I'm not sure exactly how performance error is calculated, so perhaps it isn't even applicable for spread trading or basket-type trading strategies??

BackTest MR_spd_4_grid portfolio

Simulated account AssetsFixFXP_Pers.dta
Bar period 1 hour
Test period 02.01.2008-24.07.2015
Lookback time 16 bars (16 hours)
Monte Carlo cycles 200
Assumed slippage 10.0 sec

Gross win/loss 163841$ / -155454$ (-22220p)
Average profit 1110$/year, 92$/month, 4.27$
Max drawdown -2060$ 25% (MAE -2060$ 25%)
Total down time 94% (TAE 97%)
Max down time 164 weeks from Feb 2012
Max open margin 228$
Max open risk 70318$
Trade volume 75811933$ (10032569$/year)
Transaction costs -7381$ spr, 178$ slp, -410$
Capital required 1526$

Number of trades 33387 (4419/year, 85/week, 8/day
Percent winning 50%
Max win/loss 309$ / -211$
Avg trade profit 0.25$ -0.7p (+26.0p / -24.7p
Avg trade slippage 0.01$ 0.0p (+0.3p / -0.3p)
Avg trade bars 9 (+8 / -8)
Max trade bars 94 (3 days)
Time in market 717%
Max open trades 31
Max loss streak 31 (uncorrelated 16)

Annual return 73%
Profit factor 1.05 (PRR 1.04)
Sharpe ratio 1.17
Kelly criterion 1.87
R2 coefficient 0.000
Ulcer index 8.8%
Prediction error -161%

Re: Prediction error [Re: boatman] #454126
08/28/15 11:04
08/28/15 11:04
Joined: Jul 2000
Posts: 27,978
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,978
Frankfurt
A negative prediction error is strange. Can you contact Support and send them your script? This looks like a bug in the prediction error calculation.

Re: Prediction error [Re: jcl] #454152
08/30/15 03:51
08/30/15 03:51
Joined: Apr 2014
Posts: 482
Sydney, Australia
B
boatman Offline OP
Senior Member
boatman  Offline OP
Senior Member
B

Joined: Apr 2014
Posts: 482
Sydney, Australia
Done!

Re: Prediction error [Re: boatman] #454183
08/31/15 08:40
08/31/15 08:40
Joined: Apr 2014
Posts: 482
Sydney, Australia
B
boatman Offline OP
Senior Member
boatman  Offline OP
Senior Member
B

Joined: Apr 2014
Posts: 482
Sydney, Australia
Response from support:

Hello,

Thanks fort the script! This was indeed a bug caused by a negative Pip result and a positive $ result. This will be fixed in the next-but-one update.


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1