I thought Hitler signed a Pact with Stalin? Why did it break off?

Were they supposed to fight as Allies or just agreee not to fight each other? If so where did this go wrong?