"She needs her daddy, and I need to be with my little girl," the TLC star exclusively told Page Six.