Oil Leaking from dirt bike?

I had gotten a 2008 KX 100 and i have a FMF power core 2 slip on pipe. Under the pipe oil leaks out and gets all over the swing arm. What should I do? Do i get another pipe and which pipe or do I fix something? Somebody please answer back!!!