“Someone called me and said, ‘Do you want to do a movie withJennifer Garner? It’s this drama,’ ” Baldwin, 61, tells PEOPLE inthis week’s issue. “I thought, I love Jennifer Garner. She’s a wonderful actress and she’s this fantastic movie star. Who wouldn’t want to do that? It was a pretty good script and good drama.”

For more on Alec Baldwin, pick up the latest issue ofPEOPLE, on newsstands now

So what ultimately kept thefather of fivefrom taking the part: the film’s location.

Roy Rochlin/FilmMagic; Neilson Barnard/Getty

Alec Baldwin, Jennifer Garner

“They said, ‘We’re going to go to South Africa for five weeks,’ “ he continues. “I said, ‘I can’t go to Africa for five weeks because of my kids and school.’ Everything I do and I don’t do revolves around my family.”

RELATED VIDEO: Alec Baldwin Transforms Into ‘Tragic’ Automaker John DeLorean in New Doc Hybrid

TheMatch Gamehost calls watching his four kids wifeHilaria— sonsRomeo Alejandro David, 12 months,Leonardo Ángel Charles, 2, andRafael Thomas, 4 this month, and daughterCarmen Gabriela, 5 — grow up“the greatest journey of them all.”

Hilaria Baldwin/Instagram

Hilaria Baldwin, Alec Baldwin, Ireland Baldwin

“As they’re growing up in that slow-motion way that you watch children, they turn this corner, and two weeks later they say something else,” says Baldwin, also dad to daughterIreland, 23, from his first marriage toKim Basinger. “You see the way that they develop in real time, up close in your own family. There’s nothing more interestingthan watching people grow up.”

Framing John DeLoreanis out now, andMatch Gamereturns to ABC on Wednesday at 10 p.m. ET.

source: people.com