They can still align with Olympia! As long as characters don't try something like using the Temples to war-monger, they can do almost whatever they want outside of the Temples. Politically speaking, the Temples consider themselves neutral rather than a third party in the Olympia/Wyver divide, so they don't consider aligning with Olympia a "betrayal."