Consumers are getting more pessimistic as inflation refuses to fall