I found that keeping up with people over video works better when you're in the same time zone. When I was managing teams at +8 hours and -12.5 relative hours, communication and trust just weakened steadily over time and creative collaboration stalled. Spending a week there in person usually got things unstuck.
I know people on split engineering teams between LA and Seattle who prefer all virtual and it's worked long term. LA to NY I think would be a heavier lift.
And, of course, this whole discussion is always dominated by software engineers; there are lots of jobs that involve actual manipulation of matter where in person collaboration is essential to communicate skills.
Random bullshit go!