Advances in smart phone technology have contributed to the recent interest in Augmented Reality (AR). Augmented Reality is on its way to changing how we live, work and learn. Apart from the use of AR in the military, healthcare and engineering, there are currently many possible uses for AR on small scale, and many mobile AR applications are being created by individuals for gaming, marketing, branding and entertainment. However, very few applications exist on the popular mobile platforms that have an educational purpose. Mathematics is an often a challenging subject and requires learners to be able to visualize and understand abstract concepts. Therefore tools that help learners to develop understanding of fundamental mathematical concepts and motivate them to learn are needed. This study aims to address this issue and find a solution with the study of the application of Augmented Reality in mathematics learning, through the use of smart phones and mobile learning. Thus, we developed a prototype 3D visualization tool for learning geometry, with a focus on the individual's experience and then to expand it into a collaborative Augmented Reality game, that addresses other mathematical learning outcomes.