Even though it's reported to be for the sake of their three children, Jennifer Garner is now rumored to be starting to rethink her idea of continuing to live under the same roof as estranged husband Ben Affleck.

According to People magazine, as rumors of Affleck's infidelity spanning at least 10 years continue to percolate, the 43-year-old Garner seems to be experiencing a change of heart.  

The couple publicly announced in late June that they were splitting, but since then have remained committed to putting on an united front wherever they could when it comes to their children. They recently went on a family vacation together and continue to wear their wedding rings.

But that may all be about to change.

"Jen will always make sure that Ben spends as much time with the kids as he wants, but she is rethinking their living situation," said a source. "She can't stand the situation Ben has put her and the kids in."

The couple's latest troubles largely stem from recent reports of Affleck having an affair with the children's 28-year-old nanny, Christine Ouzounian.

Affleck and his representatives have vehemently denied the accusations, labeling them as "baseless and untrue."

Reports are Affleck met the woman in question at a time when he and Garner were secretly going through a 10-month trial separation. Ouzounian was hired as the nanny to 9-year-old Violet, 6-year-old Seraphina and 3-year-old Samuel.

Currently, Affleck is reported to be on "full-time daddy duty" while Garner works on the set of her latest movie in Atlanta, where her soon-to-be ex recently brought all three of the children for an uplifting visit.

"[Jen] is being smart and not putting too much pressure on herself right now," added a source close to the family. "When she comes back to L.A., she will take things day by day."