Heartless neighbor!!

I have a neighbor that just moved in next door of me. We have to sure a carport, they are on one side and we are on the other. Before they moved in we have had this birds nest in the carport for along time now. The birds have had ALOT of babys in this nest, and when the babys are gone the parents come back every night. So it not like it wasn't a home for these birds. It was in the middle of the carport but more on my side of the carport then theirs. Well they have knocked it down one day when I wasn't home. Did they have that right to do this. I feel that this was very heartless and it upsets me very much. If these birds come back and make another nest how can I pretect the nest from these people doing this again. Thank You for your time!