If you never had a php.ini file on your server (you just used default PHP settings), you'll have to create a new one. They don't come with the server and ready for you to update. Your control panel (cPanel or LPCP) can create (and edit) a new one for you, or you can upload it from your PC (after creating it there).
Right now you're running with 32MB of memory. It's quite possible that you need a bit more, but if 64MB also runs out, that could indicate a serious code problem, unless Wordpress support advises you to use an even larger amount.