Bank Account Fraud..or is it

My ex and I were together for over 5 years. She had terrible credit and couldn't get her own CHECKING account. I didn't want her to have access to my money so I put her on as a joint account holder on my SAVINGS account. We just split about 2 months ago and I found out that she took out an internet payday loan for over 1,000 dollars using her name, social, and MY CHECKING Account number. So far the company has taken 820 dollars out of my checking acct. I called them and they said she has to call and give them a new checking account number or they'll continue to deduct from my account. I bank with a credit union who said I have to take this up with her. The deductions are coming out in HER NAME...SHE was never an authorized user on my checking account and her name no longer appears on my savings. I have taken action to ensure no more money is deducted by this company. But now what..isn't what she did illegal..and shouldn't the bank have caught this or brought it to my attention.. I spoke with her and she said since I broke it off it's my bed and I'll just have to lie in it..(we split because of her alcoholism and love for beating on me) Isn't there anything I can do legally to at LEAST get my money back if not have her thrown in JAIL!

if nothing else take her to civil court