Visa canceled...can I return to the US???

I am from Brazil and my mother married an American guy. Because of that I was allowed to live in the US with them on a family visa.

4 years ago I was due to fly from LA to Las Vegas with a friend of mine. She was stopped at the airport and they discovered that she was illegal. She was arrested and sent home. There wasn't any problem with me because I had the family visa and I was allowed to go on my way.

A few months later I went back to Brazil for a holiday. When I flew back to the US I was stopped by immigration. They cancelled my family Visa on the spot. They said that because I knew my friend was an illegal immigrant they would be canceling my Visa. They said I should have reported it and because of that they were canceling my Visa. They said I wasn't being deported but my visa was no longer valid so I had to turn round and go back to Brazil.

I am now married to a British man and we live in the UK. The company he works for is opening a branch in the US and he has been asked to go and manage it. I'm not sure what Visa he will be getting yet but we presume I will go with him as his partner. Will it be a problem for me to go with him because they previously canceled my Visa 4 years ago??