Radio Frequency Interference Excision Using Spectral‐Domain Statistics

• Published in: Publications of the Astronomical Society of the Pacific 2007-07, Vol.119 (857), p.805-827
• Main Authors: Nita, Gelu M., Gary, Dale E., Liu, Zhiwei, Hurford, Gordon J., White, Stephen M.
• Format: Article
• Language: English
• Subjects: Astronomy; Data sampling; Earth, ocean, space; Estimators; Exact sciences and technology; Expected values; Kurtosis; Line spectra; Radio spectrum; Signal detection; Solar radio bursts; Statistical variance; Statistics
• ISSN: 0004-6280; 1538-3873
• DOI: 10.1086/520938

A radio frequency interference (RFI) excision algorithm based on spectral kurtosis, a spectral variant of time‐domain kurtosis, is proposed and implemented in software. The algorithm works by providing a robust estimator for Gaussian noise that, when violated, indicates the presence of non‐Gaussian RFI. A theoretical formalism is used that unifies the well‐known time‐domain kurtosis estimator with past work related to spectral kurtosis, and leads naturally to a single expression encompassing both. The algorithm accumulates the first two powers ofMpower spectral density (PSD) estimates, obtained via Fourier transform, to form a spectral kurtosis (SK) estimator whose expected statistical variance is used to define an RFI detection threshold. The performance of the algorithm is theoretically evaluated for different time‐domain RFI characteristics and signal‐to‐noise ratios η. The theoretical performance of the algorithm for intermittent RFI (RFI present inRout ofMPSD estimates) is evaluated and shown to depend greatly on the duty cycle, \documentclass{aastex} \usepackage{amsbsy} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{bm} \usepackage{mathrsfs} \usepackage{pifont} \usepackage{stmaryrd} \usepackage{textcomp} \usepackage{portland,xspace} \usepackage{amsmath,amsxtra} \usepackage[OT2,OT1]{fontenc} \newcommand\cyr{ \renewcommand\rmdefault{wncyr} \renewcommand\sfdefault{wncyss} \renewcommand\encodingdefault{OT2} \normalfont \selectfont} \DeclareTextFontCommand{\textcyr}{\cyr} \pagestyle{empty} \DeclareMathSizes{10}{9}{7}{6} \begin{document} \landscape $d=R/ M$ \end{document} . The algorithm is most effective for \documentclass{aastex} \usepackage{amsbsy} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{bm} \usepackage{mathrsfs} \usepackage{pifont} \usepackage{stmaryrd} \usepackage{textcomp} \usepackage{portland,xspace} \usepackage{amsmath,amsxtra} \usepackage[OT2,OT1]{fontenc} \newcommand\cyr{ \renewcommand\rmdefault{wncyr} \renewcommand\sfdefault{wncyss} \renewcommand\encodingdefault{OT2} \normalfont \selectfont} \DeclareTextFontCommand{\textcyr}{\cyr} \pagestyle{empty} \DeclareMathSizes{10}{9}{7}{6} \begin{document} \landscape $d=1/ ( 4+\eta ) $ \end{document} , but cannot distinguish RFI from Gaussian noise at any η when \documentclass{aastex} \usepackage{amsbsy} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{bm} \usepackage{mathrsfs} \usepackage{pifont} \usepackage{stmaryrd} \usepackage{textcomp} \usepackage{portland,xspace} \usepack