You can live a long and happy life without the filter. It is just extra over kill from the factory and really just serves to keep oil off of the paper element.
In fact one way of reducing air flow restriction to the engine is to go to a K&N element. That is not a paper filter and uses oil to help it catch air bound particles of debris. So actually the combination of the two would be a compatible one.