Due to the complexity of the images and dearth of anatomical models, it is highly difficult to accurately represent the various deformations in each component of the medical images. In recent years, a significant number of children and adults have affected from brain tumors, which is one of the most terrible types of disease affects the people around the world. Moreover, the Magnetic Resonance Imaging (MRI) based brain tumor detection is one of a significant study area in the field of medical imaging. Since, the use of computerized methods aids in the detection and treatment of disease by the medical professionals. The development of an automated method for the accurate detection and classification of tumors from brain MRIs. In this framework, a tanh normalization process is used to smooth out the input brain MRIs with less noise artefacts and improved quality. Then, a group feature extraction model is used to extract the relevant features from the normalized image, which includes both Speeded Up Robust Features (SURF) and Grey Level Co-occurrence Matrix (GLCM) features. The Water Chaotic Fruitfly Optimization (WChFO) method is used to identify the best features for increasing the speed of classifier training and testing processes with less time. Moreover, a Deep Recurrent Neural Network (DRNN) model is used to classify the type of brain tumor for accurate early diagnosis and treatment. The most well-known benchmarking datasets, like BRATS and Kaggle, employed for analysis in order to assess the effectiveness and results of the proposed brain tumor diagnosis system. By using the proposed WChFO-DRNN technique, the accuracy of the tumor detection system is increased to 99.2% with the sensitivity, specificity of 99% and time consumption of 0.2s.