关键词: 高维数据流, 稳健型控制图, EWMA, top-r统计量, 统计过程控制

Abstract: As technology advances quickly, the functions of products are expanding in number, and their structures are becoming progressively more complicated. Therefore, it is often necessary to monitor multiple quality characteristics simultaneously during the production process. However, the data dimension is expanding quickly with the rapid growth of data collecting technology in the data age with the innovation of science technology and the advanced Internet. The number of product indicators that need to be monitored during the production process is growing day by day. High-dimensional data streams appear more and more frequently in various industries, especially in sensor-based manufacturing and image processing. High-dimensional data streams have attracted a lot of attention as a new type of data, and they have been already pervasive in daily life. Examples include information returned by sensors, real-time meteorological cloud images captured by satellites and user communication records.
However, the complexity of high-dimensional data brings many new challenges to quality monitoring. For instance, due to a large number of variables, the normality assumption of data is often invalid in high-dimensional cases, and the distribution form is usually unknown in practical applications. At the same time, the control chart that only detects mean shifts has been unable to satisfy the practical needs. Therefore, we urgently need statistical methods to monitor high-dimensional data streams.
To this end, a new robust control chart for monitoring independent high-dimensional data streams is proposed. Firstly, the local statistics for monitoring each dimension of the data streams are constructed by combining the score test statistic with the exponentially weighted moving average strategy. As a result, for the tth observations of kth data stream X_k,t, the final local charting statistic is given by
R_k,t=(θ_k,t)^TI^-1₀θ_k,t,
where, θ_k,t is the EWMA-type score function vector, and I₀is the Fisher information matrix in control. Naturally, this type of statistic makes use of all data up to the current time point, and the control chart gives different observations varying weights. On this basis, the global monitoring statistics are constructed by utilizing the sum, the maximum value, and the top-r strategy. Especially, the proposed control chart method based on top-r method Z_top-r monitors is better than the method Z_max and more efficiently than the method Z_sum because it only needs to calculate the first r local statistics. Therefore, this method is more convenient for calculation and more economical in cost. Accordingly, we advise we use the method Z_top-r whether it is for detecting mean shifts or variance drifts. In fact, the numerical simulations and a real case study have demonstrated its effectiveness. Practically, the top-r control chart method can be expressed as
$Z_{\mathrm{top}-r}=\sum_{k=1}^{r} R_{(k), t}=\sum_{k=1}^{r}\left[\left(\theta_{(k), t}\right)^{\mathrm{T}} I_{0}^{-1} \theta_{(k), t}\right], 1 \leq k \leq p,$,
where R_(k),t denotes the kth largest local statistic. In practice, the simulation results have shown that using the Z_top-r statistics is sensitive and robust to detect process changes with suitable choices of the parameter r.
This method is appropriate for data with normal distribution or non-normal distribution. At the same time, it can detect not only shifts of mean value, but also shifts of variance, which is not available in many control charts. In order to evaluate the monitoring effect of the proposed control charts, the Monte Carlo simulation method is used. The average run length is used as an indicator to evaluate the monitoring performance of the control chart. The effectiveness and robustness of the proposed control charts are verified by the numerical simulation.
In order to illustrate the monitoring effect of the new control chart method in practical application, a practical case study is carried out with a set of real data. The data set contains 1,567 samples in total from a semiconductor manufacturing process. Each observation vector is composed of 590 dimensional variables. The final results prove that the proposed method Z_top-r has a higher calculation and detection efficiency. And it can detect abnormal shifts well in practical production in high-dimensional data streams.
The proposed new control chart in this paper has several advantages. Firstly, it can deal with both the normal and non-normal data. Secondly, it can not only detect mean shifts, but also variance shifts. Finally, the method only needs to focus on the first r local statistics. The statistics are simple in form and calculation, and more efficient. Therefore, these advantages of this new method guarantee that in the actual production process, any shifts of data streams can be quickly and effectively alarmed. The new control chart can be used in actual production process and effectively monitor product quality.
In this paper, we assume that the data streams are independent of one another, but in the actual production process, the relationship among data streams will be more complex as the dimension increases. In future research, we can consider extending the proposed method to the case of more general high-dimensional data streams.

Key words: high-dimensional data streams, robust control charts, EWMA, the top-r statistics, statistical process control