Gamestudio Links
Zorro Links
Newest Posts
Data from CSV not parsed correctly
by jcl. 04/26/24 11:18
M1 Oversampling
by jcl. 04/26/24 11:12
Why Zorro supports up to 72 cores?
by jcl. 04/26/24 11:09
Eigenwerbung
by jcl. 04/26/24 11:08
MT5 bridge not working on MT5 v. 5 build 4160
by EternallyCurious. 04/25/24 20:49
Trading Journey
by howardR. 04/24/24 20:04
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Scripts not found
by juergen_wue. 04/20/24 18:51
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
3 registered members (AndrewAMD, wandaluciaia, 1 invisible), 798 guests, and 6 spiders.
Key: Admin, Global Mod, Mod
Newest Members
wandaluciaia, Mega_Rod, EternallyCurious, howardR, 11honza11
19049 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Huge array for Deep Learning #472798
05/23/18 20:28
05/23/18 20:28
Joined: Jul 2016
Posts: 64
G
gtell Offline OP
Junior Member
gtell  Offline OP
Junior Member
G

Joined: Jul 2016
Posts: 64
Dear all,
dear jcl,

I am designing a strategy which uses Deep Learning with a great number of variables and long sliding window.
I have a sliding window of 128 and 163 features.
This means that I would pass to adviseLong an array of 20864 var.
I can't do it, it crashes.
Do you have any other good idea?
I am thinking to pass only the 163 features and then build the sliding window array from R, but the problem is the prediction part.
How to give to prediction the deepness of the sliding window?
Can you please give me some hint?

Thanks.
Best regards.

Re: Huge array for Deep Learning [Re: gtell] #472801
05/24/18 10:06
05/24/18 10:06
Joined: Jul 2000
Posts: 27,986
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,986
Frankfurt
I have not yet seen a machine learning algorithm with 20,000 features, but theoretically there is no hard limit. Make sure that you allocate this array on the heap, not on the stack, and that you use an objective and not the trade result for prediction. If this does not help, you can contact Support with that script and they'll look into it.

For a sliding window, I would use either a LSTM neural net, or indeed store the data on the R side. In the prediction part, use an array for storing the features, and shift it by 163 with any new incoming feature set.


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1