Ok, so it turns out that CONTRARY to every datasheet I found except for one, you need to put the contrast pin at a negative voltage and NOT ground. Really glad that I am not insane and was hooking it up as documented and just the documentation was wrong.