Stephen
Posts:1
 |
| 06/15/2006 4:51 AM |
 Quote
 Reply
 Alert
|
Over the last few days the files within the openbook FTP download have started to exceed 4GB in size.
This causes many utilities (particularly the Java ZIPFile routines) to fail.
Are there any plans to split the data into smaller files, or are there any known work arounds?
|
|
|
|
|
jleija (guest)
|
| 06/18/2008 5:09 PM |
Quote
Reply
Alert
|
About the SymbolMap.xml file that has the conversion table between SecurityIndex and stock symbol for openbook ultra:
1. What is the best time in the morning for us to update our table with your xml file? (at what time does it get updated for the day)
2. Two days ago we downloaded a SymbolMap.xml that had a couple of symbols with no SecurityIndex number in them (that xml element' content was empty). How should we handle this case?
|
|
|
|
|
Lydia
Posts:68
|
| 06/19/2008 8:57 AM |
Quote
Reply
Alert
|
Thank you for your inquiry. The appropriate parties have been notified of your question, and we will respond shortly.
Regards,
NYX Data Team |
|
|
|
|
Lydia
Posts:68
|
| 06/19/2008 12:16 PM |
Quote
Reply
Alert
|
Stephen,
Here is a link that will refer you to a similar forum posting that hopefully answers your question.
http://www.nyxdata.com/nysedata/Support/DiscussionBoard/tabid/108/view/topic/forumid/2/postid/63/Default.aspx
The reason for the error is that the zip format does not handle files >4gb properly. So the programs that implement the zip method are
left to come up with their own solutions or just not handle these files. Here are the options for the linux folks as we see them:
1) The recommended solution is PKware.
2) If they'd like to use a free alternative, gunzip should work even though it is a zip file. gunzip does in fact work with certain kinds of zip files
(we've confirmed this ourselves with the TAQ files).
You can try the following:
gunzip -S .zip taqquote20060720.zip
You will likely get a falsely triggered message about a length error. The following workaround will get it to decompress and just complain about
the error without deleting the result:
gunzip -S .zip < taqquote20060720.zip > taqquote20060720
This is not the recommended approach since there may be situations where there really is a problem with the zip (e.g. due to a corrupted download).
3) Info-zip's unzip is not recommended. It does not handle >4gb files well. They intend to provide better support in a future version.
You can also use 7-Zip to overcome this size limit. It's free an available for both Windows and Linux:
http://www.7-zip.org/
Regards,
NYX Data Team |
|
|
|
|
jleija (guest)
|
| 07/11/2008 10:09 AM |
Quote
Reply
Alert
|
| We continue to see symbols with no SecurityIndex in the ftp download of SymbolMap.xml. Do you have any news on this? |
|
|
|
|
jleija (guest)
|
| 07/29/2008 8:11 AM |
Quote
Reply
Alert
|
About the SymbolMap.xml file, we are still seeing some symbols without an index in the xml file. We just ignore them, is this an 'ok' behavior on our feed handler?
Also, we have seen that your xml file continues changing during the morning hours. Does this mean that we could not rely on it to have a final set of symbols for the day?
Thanks. |
|
|
|
|
Lydia
Posts:68
|
| 08/05/2008 11:56 AM |
Quote
Reply
Alert
|
Thank you for your inquiry. We will respond shortly.
Regards,
NYX Data Team |
|
|
|
|