Looks like someone brazed a drain tube or something in there. Definitely not OEM. I would go to your local parts store with that leaky cap and replace. Maybe get a couple extras and change them every oil change to be safe.
If you're feeling really ambitios have it welded closed, or get yourself a good used pan for cheap and replace that one you've got.