Uncle has given me POA

My uncle is 80 and suffering from Alzheimer - he has given me POA.
In the past, I ashamed to say but other family members were taking advantage and abusing him and his money. Out of concern and because it was the moral and christian thing I stepped in he gave me POA. However I am having a hard time with my family members. They are using his name to file claims, loans and credit. I am not sure what I can do. I am constantly threatened by my family members because of the POA. I would like to know what I need to do legally to put a stop to all of this.

My uncle receives a retirement from the Military and the Civil Service. I have advised these agency that I was given POA that his funds should be directed into another account to prevent the family from accesses and using his money which he needs for his care (He is in a Alzheimer facility) they advised that he would have to make this request. The problem is my uncle has no clue what year we are in and harldy speaks anymore.

All I want is for him to receive the care he needs and for the family to stop taking his retirement money which he worked for in his youth which is to provide for his Twilight years and care.

Please help me I need all the advice you can offer