Evaluated config in colmenaHive.nodes is different to nixosConfigurations #320
Description
I am recently running to an issue which prevents some hosts evaluating, and other hosts which are evaluating to have different configurations to their equivalent (real/actual) configuration in nixosConfigurations.
An end result is that I cannot build some hosts via Colmena, and the hosts that I can build via Colmena have wrong configuration, in my specific current case, the entire configuration for vmagent is wrong and it is scraping incorrect endpoints with incorrect tags. I felt as if I was being gaslighted by my config as nixosConfigurations was stating my config was what I expected, but the deployed configuration was incorrect.
I am not really sure what extra information to provide for this bug, as I simply cannot understand why the configuration ends up being so different in colmenaHive.nodes vs nixosConfigurations. I have been using colmena for a few years and this is the first time I have noticed such a large different in config.
It seems this could be related to #294 ? But to be honest, I am really unsure.