Project 6 Extra Credit only

Correctly implementing Q-learning on the task of learning how to orient correctly to fire a bullet at another ship or base.

5 points for implementing: Your state space should be a discretized set of relative angles between you and the other ship or base. You should break it into no smaller than 5 degree increments (but do it in radians, all the math in java is in radians!). You can break into larger groupings but no larger than 22.5 degrees.

2 points for implementing: Reward your agent +1 for hitting the ship, -1 for missing, and 0 if the bullet gets lost in some other way (e.g. hits a beacon or asteroid)

3 points for correctly drawing graphics (or using printouts) that enable you to debug your learning and that help us to grade it.

5 points for collecting data and demonstrating learning using a learning curve (in the writeup). For full credit, make sure you explain why it is learning or not learning (if it isn’t learning, you will not lose your points if you can explain WHY it is not learning)