Ultrafast Neuromorphic Computing Driven by Polariton Nonlinearities