Do I need to submit my GRE score at the time of applying to universities?

Yes, you will need to submit your test scores at the time of application.