Gamestudio Links
Zorro Links
Newest Posts
Trading Journey
by howardR. 04/24/24 20:04
M1 Oversampling
by Petra. 04/24/24 10:34
Zorro FIX plugin - Experimental
by flink. 04/21/24 07:12
Data from CSV not parsed correctly
by EternallyCurious. 04/20/24 21:39
Scripts not found
by juergen_wue. 04/20/24 18:51
zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06
StartWeek not working as it should
by jcl. 04/20/24 08:38
folder management functions
by VoroneTZ. 04/17/24 06:52
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (AndrewAMD, howardR), 472 guests, and 7 spiders.
Key: Admin, Global Mod, Mod
Newest Members
Mega_Rod, EternallyCurious, howardR, 11honza11, ccorrea
19048 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Page 1 of 2 1 2
Backfilling data after a disconnect #471761
03/19/18 13:32
03/19/18 13:32
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784

Zorro does not seem to backfill missing data after the disconnect of an MT4 terminal(!?)

How to work with this in live trading?
One has to programmatically identify such situations, send email/text alert and then get to manually stop/restart Zorro? This becomes a less reliable and less automated solution.

Also, upon reconnect to an MT4 terminal, Zorro showed "offline" for another 1-2min before actually reconnecting.
Is there a way to make it reconnect as soon as the data source is available again?

Re: Backfilling data after a disconnect [Re: Zheka] #471764
03/19/18 14:35
03/19/18 14:35
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
Some more details re behaviour at reconnect:
- if MT4 closed/ restarted quickly, Zorro reconnects quickly
- during the disconnect, seconds in Zorro status line change "chaotically" (as if to the arriving ticks rythm) and not always forward...
- if disconnect is longer then 3-5min (in my case BarPeriod=5min), then the square switches from Red to Purple.
- message in MT4 switches to "Zorro disconnected!" (sometimes - not)
- when MT4 is restarted after longer disconnect, Zorro reconnects in 3.5-4min...Message in MT4 sometimes stays "Zorro disconnected" and sometimes gets back to "Controlled by Zorro bridge 1.15"..

Re: Backfilling data after a disconnect [Re: Zheka] #471827
03/21/18 12:51
03/21/18 12:51
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Look also here: http://manual.zorro-project.com/trading.htm under "Getting disconnected".

Re: Backfilling data after a disconnect [Re: jcl] #471828
03/21/18 13:07
03/21/18 13:07
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
OK.
But the questions still remain:

- maintaining data continuity/backfilling is nearly standard a feature of most trading engines; I really took it for granted.
Can Zorro be improved in this respect?

- how to shorten the time of Zorro reconnect attempts? 3.5-4 min is an eternity in many cases.

Re: Backfilling data after a disconnect [Re: Zheka] #471840
03/21/18 15:42
03/21/18 15:42
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
What do you want to "backfill"?

Re: Backfilling data after a disconnect [Re: jcl] #471842
03/21/18 15:56
03/21/18 15:56
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
On reconnect to the broker server, Zorro should request the number of bars missed since the disconnect and THEN continue script execution.

Re: Backfilling data after a disconnect [Re: Zheka] #471845
03/21/18 16:03
03/21/18 16:03
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
There are no bars when there's no connection. You could not do much with the requested prices.

Re: Backfilling data after a disconnect [Re: jcl] #471851
03/21/18 16:24
03/21/18 16:24
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
Quote:
You could not do much with the requested prices.
Script execution should continue from the bar it stopped. All system timeframe formation, indicator, etc calculations will be orderly.
Why would we not want that?

Yes, a user might need to be warned that a trade might have been missed, but that is a lesser/ rare evil to handle.

A flag indicating a connection status to the broker and to the price feed would also be extremely helpful.

Last edited by Zheka; 03/21/18 20:13.
Re: Backfilling data after a disconnect [Re: Zheka] #471866
03/22/18 08:04
03/22/18 08:04
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Do you know a broker API with a connection status flag?

Re: Backfilling data after a disconnect [Re: jcl] #471878
03/22/18 12:15
03/22/18 12:15
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
Quote:
Do you know a broker API with a connection status flag?
Sure. Most broker APIs provide error codes on connection status.

https://interactivebrokers.github.io/tws-api/message_codes.html#gsc.tab=0

http://fxcodebase.com/bin/forexconnect/1.5.0/help/CPlusPlus/web-content.html#SessionStatus.html

https://docs.mql4.com/constants/errorswarnings/enum_trade_return_codes

FIX/DTC use "heartbeats" to confirm that connection is "alive".

My suggestion is for Zorro to expose this to the end-user via some sort of flag or variable,
regardless of how Zorro internally determines that the connection is "offline" (Zorro already does this, right?)

Exposing order rejection errors would also be helpful.

Re: Backfilling data after a disconnect [Re: Zheka] #471879
03/22/18 12:31
03/22/18 12:31
Joined: Jul 2000
Posts: 27,982
Frankfurt
jcl Offline

Chief Engineer
jcl  Offline

Chief Engineer

Joined: Jul 2000
Posts: 27,982
Frankfurt
Thanks, but none of your links is a usable connection status flag or similar function. But if you still find one, please post it here. I know that it is difficult.

FXCM does not detect interruptions, only logouts or server outages on their side. The LastErrorCode by MT4 can return ERR_NO_CONNECTION when sending an order. But it's no good idea to send orders for testing the connection status.


Re: Backfilling data after a disconnect [Re: jcl] #471882
03/22/18 13:35
03/22/18 13:35
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
https://docs.mql4.com/check/isconnected

This seems to the flag for MT4.

LastError() code can also be used - to signal a relevant error.

Both MultiCharts and SierraChart use IB API error codes to determine the status of connection. SC then exposes this further to a user via a variable at run-time.

Re: Backfilling data after a disconnect [Re: Zheka] #472050
04/03/18 13:29
04/03/18 13:29
Joined: Jul 2017
Posts: 784
Z
Zheka Offline OP
User
Zheka  Offline OP
User
Z

Joined: Jul 2017
Posts: 784
JCL,

is there any update on this - for MT4 and IB?

Re: Backfilling data after a disconnect [Re: Zheka] #472051
04/03/18 13:47
04/03/18 13:47
Joined: Feb 2017
Posts: 1,725
Chicago
AndrewAMD Online
Serious User
AndrewAMD  Online
Serious User

Joined: Feb 2017
Posts: 1,725
Chicago
Originally Posted By: Zheka
FIX/DTC use "heartbeats" to confirm that connection is "alive".
This would only confirm the connection between DTC client and DTC server and not necessarily the layer behind it (i.e. Sierra Chart's connection to its server).

Page 1 of 2 1 2

Moderated by  Petra 

Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de

Powered by UBB.threads™ PHP Forum Software 7.7.1