Converting Adobe After Effects directly to MPEG-4 Videos (.aae to .mp4 conversion) is possible and quite straightforward, even though your options are limited.
Simply use the render function in Adobe After Effects, which allows users to export AAE files in MP4 format.
Open AAE file Open MP4 file