A Dataset and a Comparison of Classification Methods for Valve Plate Fault Prediction of Piston Pump

The article introduces datasets representing piston pump failures along with the experimental evaluation of various machine learning classification models. It starts with a detailed description of three classification datasets consisting of three different levels of valve plate damages and signals recorded from sensors used in classical hydraulic systems (pressure, temperature, flow). The obtained datasets consist of 100k (Failure 1), 30k (Failure 2) and 30k (Failure 3) samples and eight attributes. Then a broad range of classifiers are evaluated including three ensemble models based on decision trees: Random Forest, Gradient-Boosted Trees, and Rotation Forest, as well as the kNN algorithm and a neural network. The analysis showed that neural networks achieved the highest prediction accuracy, enabling a prediction accuracy level of 89%. The kNN algorithm ranked second, and tree-based algorithms performed 4% worse than the neural network. Next, the attribute importance analysis revealed that leak flow, pressure output, pressure of the leak line, and oil temperature are the most important parameters for accurate predictions. Additionally, the research includes a sensitivity analysis of the best classifier to verify the impact of sensor measurements or other noise indicators on the prediction model performance. The analysis indicates a 5% margin of measurement quality.