Any online statistical model AI can be beaten by making the same request repeatedly until it just gives you whatever you want, it’s absolutely trash for that purpose.

Using a machine learning algorithm to find methods to attack in closed environment might yield some benefits, though.