Yes, it's port 25/tcp that needs to be open to receive incoming email on a mail server.
Also make sure that your MX records are correct, and that all firewalls including hardware firewalls or software firewalls on the server have the port open.
Other ports you might want open include 110/tcp for POP3 and 143/tcp for IMAP.