Spark 3.5’s Phantom Exit: When Long-Running Loops Vanish Without a Trace
Spark 3.5+ jobs in infinite loops are silently terminating after 8-12 iterations despite stable memory and no errors. The culprit isn’t OOM or GC, it’s metadata accumulation in Catalyst. Here’s what the logs won’t tell you.
