Fix test_ipye

Remove most of the assertion as it will be different on different
runtimes.