OK, it turned out that it was not the last hour being corrupted, but actually the time period where market data appeared every day in the file was inconsistent. So one cannot just cut out a fixed time frame each day from the downloaded data. See my new post for details.