feature selection/ input variable selection

I have large data of 91 inputs and 1 output, if i run the ANN model without any feature selection the R2 value is 95% if i use the feature selection method like Random Forest, Iterative input selection, correlation coefficient the R2 value when i run WNN on selected feature is lower 90%. I am lost. Any help will be appreciated.