Gamestudio Links
Zorro Links
Newest Posts
Trading Journey
by howardR. 04/24/24 20:04
M1 Oversampling
by Petra. 04/24/24 10:34
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Data from CSV not parsed correctly
by EternallyCurious. 04/20/24 21:39
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
folder management functions
by VoroneTZ. 04/17/24 06:52
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (sleakz, AndrewAMD), 684 guests, and 3 spiders.
Key: Admin, Global Mod, Mod
Newest Members
Mega_Rod, EternallyCurious, howardR, 11honza11, ccorrea
19048 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Huge array for Deep Learning #472798
05/23/18 20:28
05/23/18 20:28
Joined: Jul 2016
Posts: 64
G
gtell Offline OP
Junior Member
gtell  Offline OP
Junior Member
G

Joined: Jul 2016
Posts: 64
Dear all,
dear jcl,

I am designing a strategy which uses Deep Learning with a great number of variables and long sliding window.
I have a sliding window of 128 and 163 features.
This means that I would pass to adviseLong an array of 20864 var.
I can't do it, it crashes.
Do you have any other good idea?
I am thinking to pass only the 163 features and then build the sliding window array from R, but the problem is the prediction part.
How to give to prediction the deepness of the sliding window?
Can you please give me some hint?

Thanks.
Best regards.

Re: Huge array for Deep Learning [Re: gtell] #472801
05/24/18 10:06
05/24/18 10:06
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
I have not yet seen a machine learning algorithm with 20,000 features, but theoretically there is no hard limit. Make sure that you allocate this array on the heap, not on the stack, and that you use an objective and not the trade result for prediction. If this does not help, you can contact Support with that script and they'll look into it.

For a sliding window, I would use either a LSTM neural net, or indeed store the data on the R side. In the prediction part, use an array for storing the features, and shift it by 163 with any new incoming feature set.


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1