Gamestudio Links
Zorro Links
Newest Posts
Zorro Trader GPT
by TipmyPip. 03/06/24 09:27
VSCode instead of SED
by 3run. 03/01/24 19:06
Deeplearning Script
by wolfi. 02/26/24 12:46
Sam Foster Sound | Experienced Game Composer for Hire
by titanicpiano14. 02/22/24 16:22
AssetAdd() vs. modern asset list?
by jcl. 02/21/24 15:01
How many still using A8
by Aku_Aku. 02/20/24 12:18
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (Quad, AndrewAMD), 567 guests, and 5 spiders.
Key: Admin, Global Mod, Mod
Newest Members
sakolin, rajesh7827, juergen_wue, NITRO_FOREVER, jack0roses
19043 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Huge array for Deep Learning #472798
05/23/18 20:28
05/23/18 20:28
Joined: Jul 2016
Posts: 64
G
gtell Offline OP
Junior Member
gtell  Offline OP
Junior Member
G

Joined: Jul 2016
Posts: 64
Dear all,
dear jcl,

I am designing a strategy which uses Deep Learning with a great number of variables and long sliding window.
I have a sliding window of 128 and 163 features.
This means that I would pass to adviseLong an array of 20864 var.
I can't do it, it crashes.
Do you have any other good idea?
I am thinking to pass only the 163 features and then build the sliding window array from R, but the problem is the prediction part.
How to give to prediction the deepness of the sliding window?
Can you please give me some hint?

Thanks.
Best regards.

Re: Huge array for Deep Learning [Re: gtell] #472801
05/24/18 10:06
05/24/18 10:06
Joined: Jul 2000
Posts: 27,977
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,977
Frankfurt
I have not yet seen a machine learning algorithm with 20,000 features, but theoretically there is no hard limit. Make sure that you allocate this array on the heap, not on the stack, and that you use an objective and not the trade result for prediction. If this does not help, you can contact Support with that script and they'll look into it.

For a sliding window, I would use either a LSTM neural net, or indeed store the data on the R side. In the prediction part, use an array for storing the features, and shift it by 163 with any new incoming feature set.


Moderated by  Petra 

Powered by UBB.threads™ PHP Forum Software 7.7.1