question

swisssolar avatar image

vrmlogger-backlog - file too big / missing data after splitting the file

Good day

We retrieved a backlog file of 1.12GB original file, see here: https://www.dropbox.com/s/tk9lnq1lh91cntb/vrmlogger-backlog.sqlite3?dl=0 , the zip file here: https://www.dropbox.com/s/j92anffr9993n3j/vrmlogger-backlog.sqlite3.zip?dl=0 (82.7MB)

We were splitting this file and imported 2 files, but are missing the very important battery SOC data.



Here the 2 files after the split:

- https://www.dropbox.com/s/kkalkyxwoa5qyq7/vrmlogger-backlog_olddata.zip?dl=0

- https://www.dropbox.com/s/l4j2nelsmfckzns/vrmlogger-backlog.zip?dl=0

Thanks for any advise and support.

VRM
1545109063041.png (96.6 KiB)
1 comment
2 |3000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

How did you split the file? I have split a file with "Split to volumes bytes" in 7-zip but VRM tells me it is not a .sqlite3 format when I upload. My file is over 2GB

2 Answers
Guy Stewart (Victron Community Manager) avatar image
Guy Stewart (Victron Community Manager) answered ·

You may also wish to try using the database conversion feature of VictronConnect for Windows or Mac.

https://www.victronenergy.com/live/victronconnect:start#importing_and_converting_a_gx_product_family_database_file

Though I have never used it for a dataset so big, so please let me know if it works. It might take an hour of computer thinking 💭

2 |3000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Guy Stewart (Victron Community Manager) avatar image
Guy Stewart (Victron Community Manager) answered ·

That might be working as intended. Full VRM data is only stored for 6 months. Consumption and Production summery data is stored for 5 years, but that doesn't include battery states of charge.

See the section in the VRM FAQ here - How long is the data stored for?

I have some ideas for how this behaviour could be improved myself, and have been thinking about it for a while.

Feel free to express your experience into the editable google doc so we can work together to make it better.

2 |3000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.