Ultrafast neuromorphic computing driven by polariton nonlinearities