I'm sure that's the theory.
I'm also sure that somewhere, at some time, someone got rid of a barn by dismantling it or bulldozing it or otherwise making it actually go away. But I've never seen any evidence of this either.
Yup, the standard way of getting rid of a barn is to just stay the hell out of it for a couple of hundred years until it's just a mound and some archeologists makes you stop farming long enough for them to conduct an exhaustive excavation so they can tell you what your great-great-great grandparents' chickens ate.
Anyway, this is the closest I've ever seen anyone come to success with this tactic. I know there's nothing growing there yet, but I can feel it coming any minute now...or maybe in another decade or four.
Ladies and Gentlemen...I present you the Fallingest Downingest Barn in America.
I'm so proud I could weep.