VRM outages and slowness - a central thread

Well done to the team in trying to resolve performance issues with the database. Glad to see improvement in performance and being able to view what is happening. It felt like I was flying an aircraft without any functioning instruments in the cockpit at night. No visible reference points to aid in orientation.

This makes me think back to 2017 when I was involved in a major upgrade project at ESKOM to replace IBM Servers, upgrade Maximo, the system used to control the national grid and fault logging and tracking. The RDBMS system used was Oracle and database sizes were in excess of 10 Petabytes. Upgrading the database engine and the individual databases is an enormous undertaking that spans many man hours. The Java Virtualised environment was prone to memory leaks and soon one found that the available memory was severely depleted.

Quick fixes, some had the desired outcome and some made matters worse. So, performance tuning requires time and a level headed approach. Parameters are adjusted in a painstakingly systematic method until a sweet spot was detected by the previous setting or one notices that the performance has begun to deteriorate after going a little past the sweet spot.

Patience is always a virtue, especially with various kinds of system we now have become accustomed to.

1 Like

My solar production in VRM for today is off by a third of the total. I’ll keep a close eye on it tomorrow. Hoping that it will be back to normal. Too bad that it hurts the overal data. No longer reliable

I don’t believe anything has been lost. It may not be visible or processed, so bear with us.

2 Likes

This is why Victron is the best company and I’m happy I put my trust in you… admits issues, keeps customers updated and fixes things! Thank you and keep up the great work!

3 Likes

All back to normal today :+1:

1 Like

Hi all,

This morning, we have been switching on the features that we previously disabled to help database loads. Slowly, everything on VRM works as you are used to.

  • Consumption forecasts are enabled again
  • Some forecasts are still duplicated, which we are working on at the moment

We will continue to watch for any signs of performance issues today.

Once we have a clear picture of the cause of the outages, we will report back to you here with the post mortem. For now, I hope you don’t hear from me in this thread today :wink:

14 Likes

I’m not sure If I can agree with your comment.

If you really need to know the status of your system ASAP and at any time you should provide some kind of backup yourself.

2 Likes

Thank you for updating the user base in a very clear message in an understandable language for everyone to read and understand!

1 Like

Thank you very much for all your hard work and effort. VRM is free for everyone, which is more then awesome! I don’t know any competitor who offers the same quality and functionality like Victron does. Often they make you buy a subscription to have less functionalities as you have with VRM.

@Ananas just out of curiosity, since your system seems to be that critical, do you have two internet connections that rely on different technologies with a redundant network or how do you handle internet outages? I’m experiencing more internet outages than VRM downtimes.

2 Likes

I don’t know about you but my system wasn’t free at all. I invested in the best brand so I demand a good service.

About internet if you have problems with it you can always connect to Venus directly and/or you can use mobile phone data and share the internet with the system. Try satellite internet if you need a reliable provider.

2 posts were split to a new topic: VRM unable to access ESS controls

A post was merged into an existing topic: VRM unable to access ESS controls

You’re too irritable, blunt, and emotional.
I assure you, 100% uptime for computing and cloud systems does not exist.
Show a bit more tolerance.

You’re not the exclusive “mega investor” there are many of them, and quite a few among my clients. Honestly, I couldn’t even tell you offhand how many of them have spent over €50K on their independence. And none of them has reached out to me in the last two days to ask what’s going on, since I suspect they haven’t even noticed anything.

Be a star :wink:

8 Likes

It seems that not everyone is affected equally by the VRM outages. The only thing I’ve noticed in the last few days is that the solar forecasts are useless due to the deviations.

On some days, the forecast is too low, on others, like today, it is over 57% above what my PV system has ever achieved at peak (Peak 141 kWh, forecast 222 kWh).

That’s a shame because before the outage, the forecast matched my system except for minor deviations. I hope this will be resolved again in the coming weeks.

2 Likes

I drink a Dies(s)el on that!

Some people can just lose a little perspective.

Victron sets high standards for themselves, and as we can see here are more than transparent.

Everyone appreciates how important VRM is, for the most part it has been reliable with a few smaller exceptions. By global standards it does well, considering it is quite unique in what it does.

Very few systems have 100% uptime, there are some specialty hardware platforms that offer it, but when it comes to software designed by humans, and managed by humans, there will always be some form of unplanned downtime, only the amount varies.

They could probably go throw more money at it, adding complexity and resources which might round a few corners but still won’t completely remove the possibility of an outage. That isn’t practical either as the goal is to have a platform that does not require a subscription to cover costs, nor to unreasonably load product costs. So, there is a balance to be had, and so far they have managed rather well.

People just need to take a breath and not overreact. it will all pass.

10 Likes

I agree with everything that’s been said!

The current lifestyle in society is turning people into ruthless and ungrateful consumers.
It pains me to see this happening, especially when it’s aimed at those who are trying to maintain a high standard of quality and innovation.
I’ve got something to compare it to, as I work with various LV/HV systems from leading brands, including Victron.
And this ecosystem is truly brilliant, both for the integrator & the end user.
I guess for consumers to start appreciating and valuing what they have, they’ll first need to lose it or try something that’s “Designed in China”.

4 Likes

All systems are go

My forecasts are looking ok as well now

For me as software developer it was a bit annoying. Needed to verify things before my vacation. Delayed everything a bit. But such is life. Right. Not going to lie, I actually learned something from it. Sometimes :poop:just hits the fan and then you should be prepared. Honestly. I wasn’t. Lesson learned. No big deal. Thank you for the quick fix. Love it.