TY - JOUR
T1 - Post-correlation radio frequency interference classification methods
AU - Offringa, A. R.
AU - de Bruyn, A. G.
AU - Biehl, M.
AU - Zaroubi, S.
AU - Bernardi, G.
AU - Pandey, V. N.
PY - 2010/6
Y1 - 2010/6
N2 - We describe and compare several post-correlation radio frequency interference (RFI) classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for RFI mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95 per cent recognition and an approximately 0.1 per cent false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition, it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest.
AB - We describe and compare several post-correlation radio frequency interference (RFI) classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for RFI mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95 per cent recognition and an approximately 0.1 per cent false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition, it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest.
KW - Instrumentation: interferometers
KW - Methods: data analysis
KW - Radio continuum: general
KW - Techniques: interferometric
UR - http://www.scopus.com/inward/record.url?scp=77953568347&partnerID=8YFLogxK
U2 - 10.1111/j.1365-2966.2010.16471.x
DO - 10.1111/j.1365-2966.2010.16471.x
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:77953568347
SN - 0035-8711
VL - 405
SP - 155
EP - 167
JO - Monthly Notices of the Royal Astronomical Society
JF - Monthly Notices of the Royal Astronomical Society
IS - 1
ER -