bobnorway Posted May 9, 2013 Report Share Posted May 9, 2013 Hi I'm running WinXP SP3 and have tried several differant computers, The Data Table Editor V 1-0-14-0 gives an 'out of memory error' after 5-10 seconds of reading from my log_data.udt The file seems readable from a file reader (textpad). Shortening the logg time from 1 month to 1 week to 1 day hasn't helped with the problem. any ideas? Link to comment Share on other sites More sharing options...
Saragani Posted May 9, 2013 Report Share Posted May 9, 2013 If you are not planing to edit the file but just view its content, then you can use SD Card Manager and import the file (It will be converted to a different file type). SD Card manager is paging the data (1000 rows on each page) while Data Tables Editor tries to show them all... This could result an out of memory exception since it was not originaly designed for the use of appended files but rather on RAM data tables and FDT files (which have a predefined or maximum size). 1 Link to comment Share on other sites More sharing options...
bobnorway Posted May 9, 2013 Author Report Share Posted May 9, 2013 I tried the Card Manager and got an 'error exceed the maximum number of rows'. Obviously I'm misunderstanding something here. The calculator says I can do this for over a year yet it doesnt even go a day. The UDT file is over 74 MB. The Forum will not allow me to post the log.upd file, but here is a screen shot. I'm logging a row each second. Link to comment Share on other sites More sharing options...
Saragani Posted May 9, 2013 Report Share Posted May 9, 2013 Hi, I believe that the error you are referring to about it exceeds the maximum number of rows is talking about conversion of the files to Excel (When importing files, it both converts its to *.usd files and also to excel files, so the data can be viewed in excel). Excel (old xls and not xlsx) files have the limit of 65536 rows (while xlsx files have 1048576 if I remember correctly). I think that you should still see the files in the tree on the left side (If you didn't give it an Alias, then you should see it by a tree item with the time and date where it was imported). There you should see the files you imported (Appended files, can be converter/split to several files if they are given section). I'm assuming that in your case you will have a just 1 big file. If you click on the Tree Item on the left that represent the data table file you logged, then you should see on the pane on the center the data that you logged shown in a table. If you still get stuck (for example, it still doesn't work, or no item was added to tree), tell me and I'll see what can be done. 1 Link to comment Share on other sites More sharing options...
bobnorway Posted May 10, 2013 Author Report Share Posted May 10, 2013 Just a quick update, I'm still looking for answers. I reformatted the SD and started it all again. After one evening it is a 60MB udt file. The Card Manager does show the file as you said even though it reports an error that it can't handle it. I have 60 seconds(rows) of data of a total of 1,836,000 empty rows! I guess this could be called progress. I can't see that I will ever be able to teach my customer to retreive this data. Link to comment Share on other sites More sharing options...
Saragani Posted May 10, 2013 Report Share Posted May 10, 2013 1,836,000 empty rows is a lot (Am i understanding right that it was sampled in 60 seconds?) I don't think that you should write the data in such frequency. I'm not sure what you write each time (the whole table, or just few rows each time). For what purpose you need to use the udt? what is the purpose of the logging? Are you planing to read from the udt file in ladder or just write to it? Those questions can help you build the ladder code correctly. Maybe you can define sections in the file (different sections should make it split to different file in the SD Card Manager), maybe you need to log only 1 or few rows each time. Please talk to our support guys and explain them your needs. Link to comment Share on other sites More sharing options...
bobnorway Posted May 10, 2013 Author Report Share Posted May 10, 2013 Please understand this is a mix of end user version and provocation of a problem. Normally the table would be writen to the SD once an hour not once a second. I can't wait 30 days to see if my code is ok. I've changed the SD utility parameters to allow partial log to SD writing. This gives a better view of the data without empty rows and now there is no longer any reading problem. I feel the problem occurs when reading an SD card with a large number of lines. Lets say more than 65536. I thought the SD write function was automaticaly handling this by creating a new log file +1 when it reached the end? I don't really see how to do this externally with the num to ascii parameters. Link to comment Share on other sites More sharing options...
Saragani Posted May 10, 2013 Report Share Posted May 10, 2013 Hi, The file name can be indirect in the write data table (Either const file name or it can come from an vector of MIs which represents the ASCII) The SD Write does not decide when to close the file. You can track the number of rows you write and decide to create a new file every X rows or every X hours. Link to comment Share on other sites More sharing options...
bobnorway Posted May 11, 2013 Author Report Share Posted May 11, 2013 Thanks, 1) I agree as the SD sizes are getting larger and larger in order to make full use of them we need a way to handle the files. 2) A sample application with a file rollover would be a great help. 3) Is there a description of the udt available so I could write my own handler? 4) I'm not sure about your comment on xlsx file size because I can't see how to choose it in the card manager as a read output option? 5) As a fix for now I will reduce the storage frequency and hold the file size down. Link to comment Share on other sites More sharing options...
Saragani Posted May 11, 2013 Report Share Posted May 11, 2013 Hi, for compatibility reasons, the SD Card Manager converts it to XLS files only, I just mentioned that Microsoft have improved the total num of rows allows in a file (but either way, 1,836,000 would be too much as well) I'll talk with the support guys to see if they have some examples of using DT Write to SD and some example of giving files in an indirect way. I'm sorry, but a udt file description is not available. Link to comment Share on other sites More sharing options...
Ofir Posted May 12, 2013 Report Share Posted May 12, 2013 Hi, The name of the file needs to be in ASCII format. There are many options to create a file name using the HMI or Ladder string functions. For example you can use the function RTC to ASCII to create a file name based on date. Attached is an example for writing DT to SD with indirect name that can be entered from the HMI. Please note that you have total of 5 DT folders which in each one you can create up to 64 files. (in root folder DT up to 60 files). DT_SD.vlp Link to comment Share on other sites More sharing options...
Saragani Posted May 13, 2013 Report Share Posted May 13, 2013 Hi, please try the attached application. it is not perfect, but it can open some big udt files. (It will not be able to handle 1.8 million rows, but it can open ones that have 400,000 rows without a problem). It loads all the rows to the view, so it takes a lof of memory for large udt files, so it it had paging it would take much less. I hope it helps. Note: You need .Net framework 4.0 (or 4.5) for it to work Unitronics UDT Viewer.zip Link to comment Share on other sites More sharing options...
bobnorway Posted May 17, 2013 Author Report Share Posted May 17, 2013 Sorry, the big file viewer gives the same 'system out of memory error'. The revised file is not working, after a week there is no data. Very frustrating data logger. I can record 'some of the data some of the time' but not 'all of the data every time'. The SD blocks are showing what the plc tried to do not what the sd card actually has. For example what is the actual last row number on the SD? Can I re-write it (not append) if the success bit is not set. Link to comment Share on other sites More sharing options...
Saragani Posted May 17, 2013 Report Share Posted May 17, 2013 I wrote: (It will not be able to handle 1.8 million rows, but it can open ones that have 400,000 rows without a problem). It loads all the rows to the view, so it takes a lot of memory for large udt files, so it it had paging it would take much less. 1.8 million records is a lot. I'll think of making it have paging. Link to comment Share on other sites More sharing options...
bobnorway Posted May 18, 2013 Author Report Share Posted May 18, 2013 I'm pretty sure I know whats going wrong. Using your SD_130 program made on 18/05/10 Remove all networks accept append table. Insert a MB13 to toggle the logg on/off (instead of F keys) Add a network for function 'Safely Remove SD'. After a remove is toggled the success bit never comes back. The status becomes '64' 'No SD present'. Correct operation can only be achieved by a power cycle. Link to comment Share on other sites More sharing options...
Saragani Posted May 19, 2013 Report Share Posted May 19, 2013 I'm pretty sure I know whats going wrong. Using your SD_130 program made on 18/05/10 Remove all networks accept append table. Insert a MB13 to toggle the logg on/off (instead of F keys) Add a network for function 'Safely Remove SD'. After a remove is toggled the success bit never comes back. The status becomes '64' 'No SD present'. Correct operation can only be achieved by a power cycle. Please contact our support.and explain them the problem. Link to comment Share on other sites More sharing options...
Saragani Posted May 20, 2013 Report Share Posted May 20, 2013 Hi, the attached program is a newer version of the UDT Viewer. It now supports paging. Unitronics UDT Viewer.zip Link to comment Share on other sites More sharing options...
Jerin Posted December 18, 2013 Report Share Posted December 18, 2013 Thanks Mr.Saragani, I have the same problem like Mr.Bob. And my UDT file size is of 106MB and I couldn't open it in Data table editor. Now your hand made UDT viwer opened it but is it possible to convert it into excel...? And is there any tips to overcome this problem by not creating big udt files.. Hw can i split the data and have it in different UDT files. Jerin.S Link to comment Share on other sites More sharing options...
Saragani Posted December 18, 2013 Report Share Posted December 18, 2013 Hi, the UDT Viewer is now a part of the SD Card Suite (the udt file extension is still registered to the Data Tables Editor) and you should use that version since I have fixed few issues since the version I've posted in May. Currently, the UDT Viewer does not support convert to Excel (this feature might be added in the future), but if you import the file using SD Card Manager then in converts the file automatically to Excel You can select the file name by using an indirect file name, but please note that each folder is limited to 62 files (so take that under consideration). Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now