“Square” in this context means directly; not at an angle.
“Looking at a problem square in the face” means facing directly up to that problem.
Here are a couple more collocations using “square in the”.
He punched him square on the jaw.
He turned, looked her square in the eyes and said, “It’s over”.