Our system is pretty straight forward. Our loads are controlled by a metachain that in turn kicks off other process chains. Everything was running fine until all the sudden, some of the subchains stopped executing.
They show up red in the metachain log but when I look at their individual logs, there are no logs for the day. It's as if they were never touched by the metachain.
When I manually trigger the subchain, they execute correctly.
Better yet, it's not always the same set of chains that fail. Sometimes, it's just an AR chain. The next day AR and SL. Later in the week ECCS fails.
Obviously, it's rather annoying to have to go in every day and rerun part of the loads. Does anyone have an idea what might be going on?