Should I stay in a hotel in NYC itself or somewhere outside of it?

If you are driving then do not stay in NYC. Parking in NYC is scarce and expensive. Stay in NJ and take a train to the city. NJ Transit can get you right into Penn Station in Manhattan. If you really want to go cheap go to a Hostel.