Correlated signal inference by free energy exploration [CL]

http://arxiv.org/abs/1612.08406

The inference of correlated signal fields with unknown correlation structures is of high scientific and technological relevance, but poses significant conceptual and numerical challenges. To address these, we develop the correlated signal inference (CSI) algorithm within information field theory (IFT) and discuss its numerical implementation. To this end, we introduce the free energy exploration (FrEE) strategy for numerical information field theory (NIFTy) applications. The FrEE strategy is to let the mathematical structure of the inference problem determine the dynamics of the numerical solver. FrEE uses the Gibbs free energy formalism for all involved unknown fields and correlation structures without marginalization of nuisance quantities. It thereby avoids the complexity marginalization often impose to IFT equations. FrEE simultaneously solves for the mean and the uncertainties of signal, nuisance, and auxiliary fields, while exploiting any analytically calculable quantity. Finally, FrEE uses a problem specific and self-tuning exploration strategy to swiftly identify the optimal field estimates as well as their uncertainty maps. For all estimated fields, properly weighted posterior samples drawn from their exact, fully non-Gaussian distributions can be generated. Here, we develop the FrEE strategies for the CSI of a normal, a log-normal, and a Poisson log-normal IFT signal inference problem and demonstrate their performances via their NIFTy implementations.

Read this paper on arXiv…

T. Ensslin and J. Knollmuller
Wed, 28 Dec 16
31/46

Comments: 19 pages, 5 figures, submitted

Advertisement

Real-time kinematic positioning of LEO satellites using a single-frequency GPS receiver [IMA]

http://arxiv.org/abs/1611.04683

Due to their low cost and low power consumption, single-frequency GPS receivers are considered suitable for low-cost space applications such as small satellite missions. Recently, requirements have emerged for real-time accurate orbit determination at sub-meter level in order to carry out onboard geocoding of high-resolution imagery, open-loop operation of altimeters and radio occultation. This study proposes an improved real-time kinematic positioning method for LEO satellites using single-frequency receivers. The C/A code and L1 phase are combined to eliminate ionospheric effects. The epoch-differenced carrier phase measurements are utilized to acquire receiver position changes which are further used to smooth the absolute positions. A kinematic Kalman filter is developed to implement kinematic orbit determination. Actual flight data from China small satellite SJ-9A are used to test the navigation performance. Results show that the proposed method outperforms traditional kinematic positioning method in terms of accuracy. A 3D position accuracy of 0.72 m and 0.79 m has been achieved using the predicted portion of IGS ultra-rapid products and broadcast ephemerides, respectively.

Read this paper on arXiv…

P. Chen, J. Zhang and X. Sun
Wed, 16 Nov 16
32/64

Comments: 27 pages, 8 figures, ready for publication in GPS Solutions

Sparse image reconstruction on the sphere: analysis vs synthesis [CL]

http://arxiv.org/abs/1608.00553

We develop techniques to solve ill-posed inverse problems on the sphere by sparse regularisation, exploiting sparsity in both axisymmetric and directional scale-discretised wavelet space. Denoising, inpainting, and deconvolution problems, and combinations thereof, are considered as examples. Inverse problems are solved in both the analysis and synthesis settings, with a number of different sampling schemes. The most effective approach is that with the most restricted solution-space, which depends on the interplay between the adopted sampling scheme, the selection of the analysis/synthesis problem, and any weighting of the l1 norm appearing in the regularisation problem. More efficient sampling schemes on the sphere improve reconstruction fidelity by restricting the solution-space and also by improving sparsity in wavelet space. We apply the technique to denoise Planck 353 GHz observations, improving the ability to extract the structure of Galactic dust emission, which is important for studying Galactic magnetism.

Read this paper on arXiv…

C. Wallis, Y. Wiaux and J. McEwen
Thu, 22 Sep 16
24/62

Comments: 11 pages, 6 Figures

Autonomous Orbit Determination via Kalman Filtering of Gravity Gradients [IMA]

http://arxiv.org/abs/1609.05225

Spaceborne gravity gradients are proposed in this paper to provide autonomous orbit determination capabilities for near Earth satellites. The gravity gradients contain useful position information which can be extracted by matching the observations with a precise gravity model. The extended Kalman filter is investigated as the principal estimator. The stochastic model of orbital motion, the measurement equation and the model configuration are discussed for the filter design. An augmented state filter is also developed to deal with unknown significant measurement biases. Simulations are conducted to analyze the effects of initial errors, data-sampling periods, orbital heights, attitude and gradiometer noise levels, and measurement biases. Results show that the filter performs well with additive white noise observation errors. Degraded observability for the along-track position is found for the augmented state filter. Real flight data from the GOCE satellite are used to test the algorithm. Radial and cross-track position errors of less than 100 m have been achieved.

Read this paper on arXiv…

X. Sun, P. Chen, C. Macabiau, et. al.
Tue, 20 Sep 16
71/74

Comments: 29 pages, 15 figures, Ready for Publication in IEEE Transactions on Aerospace and Electronic Systems

Gravity Gradient Tensor Eigendecomposition for Spacecraft Positioning [IMA]

http://arxiv.org/abs/1608.03366

In this Note, a new approach to spacecraft positioning based on GGT inversion is presented. The gravity gradient tensor is initially measured in the gradiometer reference frame (GRF) and then transformed to the Earth-Centered Earth-Fixed (ECEF) frame via attitude information as well as Earth rotation parameters. Matrix Eigen-Decomposition is introduced to directly translate GGT into position based on the fact that the eigenvalues and eigenvectors of GGT are simplespecific functions of spherical coordinates of the observation position. without the need of an initial position. Unlike the strategy of inertial navigation aiding, no prediction or first guess of the spacecraft position is needed. The method makes use of the J2 gravity model, and is suitable for space navigation where higher frequency terrain contributions to the GGT signals can be neglected.

Read this paper on arXiv…

P. Chen, X. Sun and C. Han
Fri, 12 Aug 16
1/38

Comments: 18 pages, 9 figures

Low-Earth Orbit Determination from Gravity Gradient Measurements [IMA]

http://arxiv.org/abs/1608.03367

An innovative orbit determination method which makes use of gravity gradients for Low-Earth-Orbiting satellites is proposed. The measurement principle of gravity gradiometry is briefly reviewed and the sources of measurement error are analyzed. An adaptive hybrid least squares batch filter based on linearization of the orbital equation and unscented transformation of the measurement equation is developed to estimate the orbital states and the measurement biases. The algorithm is tested with the actual flight data from the European Space Agency Gravity field and steady-state Ocean Circulation Explorer. The orbit determination results are compared with the GPS-derived orbits. The radial and cross-track position errors are on the order of tens of meters, whereas the along-track position error is over one order of magnitude larger. The gravity gradient based orbit determination method is promising for potential use in GPS-denied spacecraft navigation.

Read this paper on arXiv…

X. Sun, P. Chen, C. Macabiau, et. al.
Fri, 12 Aug 16
20/38

Comments: 34 pages, 8 figures

Sparse image reconstruction on the sphere: analysis vs synthesis [CL]

http://arxiv.org/abs/1608.00553

We develop techniques to solve ill-posed inverse problems on the sphere by sparse regularisation, exploiting sparsity in both axisymmetric and directional scale-discretised wavelet space. Denoising, inpainting, and deconvolution problems, and combinations thereof, are considered as examples. Inverse problems are solved in both the analysis and synthesis settings, with a number of different sampling schemes. The most effective approach is that with the most restricted solution-space, which depends on the interplay between the adopted sampling scheme, the selection of the analysis/synthesis problem, and any weighting of the l1 norm appearing in the regularisation problem. More efficient sampling schemes on the sphere improve reconstruction fidelity by restricting the solution-space and also by improving sparsity in wavelet space. We apply the technique to denoise Planck 353 GHz observations, improving the ability to extract the structure of Galactic dust emission, which is important for studying Galactic magnetism.

Read this paper on arXiv…

C. Wallis, Y. Wiaux and J. McEwen
Tue, 2 Aug 16
20/80

Comments: 11 pages, 6 Figures

Second-Generation Curvelets on the Sphere [CL]

http://arxiv.org/abs/1511.05578

Curvelets are efficient to represent highly anisotropic signal content, such as local linear and curvilinear structure. First-generation curvelets on the sphere, however, suffered from blocking artefacts. We present a new second- generation curvelet transform, where scale-discretised curvelets are constructed directly on the sphere. Scale-discretised curvelets exhibit a parabolic scaling relation, are well-localised in both spatial and harmonic domains, support the exact analysis and synthesis of both scalar and spin signals, and are free of blocking artefacts. We present fast algorithms to compute the exact curvelet transform, reducing computational complexity from $\mathcal{O}(L^5)$ to $\mathcal{O}(L^3\log_{2}{L})$ for signals band-limited at $L$. The implementation of these algorithms is made publicly available. Finally, we present an illustrative application demonstrating the effectiveness of curvelets for representing directional curve-like features in natural spherical images.

Read this paper on arXiv…

J. Chan, B. Leistedt, T. Kitching, et. al.
Thu, 19 Nov 15
59/73

Comments: 10 pages, 7 figures, Code available at this http URL

Directional spin wavelets on the sphere [CL]

http://arxiv.org/abs/1509.06749

We construct a directional spin wavelet framework on the sphere by generalising the scalar scale-discretised wavelet transform to signals of arbitrary spin. The resulting framework is the only wavelet framework defined natively on the sphere that is able to probe the directional intensity of spin signals. Furthermore, directional spin scale-discretised wavelets support the exact synthesis of a signal on the sphere from its wavelet coefficients and satisfy excellent localisation and uncorrelation properties. Consequently, directional spin scale-discretised wavelets are likely to be of use in a wide range of applications and in particular for the analysis of the polarisation of the cosmic microwave background (CMB). We develop new algorithms to compute (scalar and spin) forward and inverse wavelet transforms exactly and efficiently for very large data-sets containing tens of millions of samples on the sphere. By leveraging a novel sampling theorem on the rotation group developed in a companion article, only half as many wavelet coefficients as alternative approaches need be computed, while still capturing the full information content of the signal under analysis. Our implementation of these algorithms is made publicly available.

Read this paper on arXiv…

J. McEwen, B. Leistedt, M. Buttner, et. al.
Thu, 24 Sep 15
10/60

Comments: 11 pages, 7 figures. Code available on http://www.s2let.org

3D weak lensing with spin wavelets on the ball [CEA]

http://arxiv.org/abs/1509.06750

We construct the spin flaglet transform, a wavelet transform to analyse spin signals in three dimensions. Spin flaglets can probe signal content localised simultaneously in space and frequency and, moreover, are separable so that their angular and radial properties can be controlled independently. They are particularly suited to analysing of cosmological observations such as the weak gravitational lensing of galaxies. Such observations have a unique 3D geometrical setting since they are natively made on the sky, have spin angular symmetries, and are extended in the radial direction by additional distance or redshift information. Flaglets are constructed in the harmonic space defined by the Fourier-Laguerre transform, previously defined for scalar functions and extended here to signals with spin symmetries. Thanks to various sampling theorems, both the Fourier-Laguerre and flaglet transforms are theoretically exact when applied to band-limited signals. In other words, in numerical computations the only loss of information is due to the finite representation of floating point numbers. We develop a 3D framework relating the weak lensing power spectrum to covariances of flaglet coefficients. We suggest that the resulting novel flaglet weak lensing estimator offers a powerful alternative to common 2D and 3D approaches to accurately capture cosmological information. While standard weak lensing analyses focus on either real or harmonic space representations (i.e., correlation functions or Fourier-Bessel power spectra, respectively), a wavelet approach inherits the advantages of both techniques, where both complicated sky coverage and uncertainties associated with the physical modelling of small scales can be handled effectively. Our codes to compute the Fourier-Laguerre and flaglet transforms are made publicly available.

Read this paper on arXiv…

B. Leistedt, J. McEwen, T. Kitching, et. al.
Thu, 24 Sep 15
11/60

Comments: 24 pages, 4 figures

Localisation of directional scale-discretised wavelets on the sphere [CL]

http://arxiv.org/abs/1509.06767

Scale-discretised wavelets yield a directional wavelet framework on the sphere where a signal can be probed not only in scale and position but also in orientation. Furthermore, a signal can be synthesised from its wavelet coefficients exactly, in theory and practice (to machine precision). Scale-discretised wavelets are closely related to spherical needlets (both were developed independently at about the same time) but relax the axisymmetric property of needlets so that directional signal content can be probed. Needlets have been shown to satisfy important quasi-exponential localisation and asymptotic uncorrelation properties. We show that these properties also hold for directional scale-discretised wavelets on the sphere and derive similar localisation and uncorrelation bounds in both the scalar and spin settings. Scale-discretised wavelets can thus be considered as directional needlets.

Read this paper on arXiv…

J. McEwen, C. Durastanti and Y. Wiaux
Thu, 24 Sep 15
16/60

Comments: 29 pages, 8 figures

A novel sampling theorem on the rotation group [CL]

http://arxiv.org/abs/1508.03101

We develop a novel sampling theorem for functions defined on the three-dimensional rotation group SO(3) by associating the rotation group with the three-torus through a periodic extension. Our sampling theorem requires $4L^3$ samples to capture all of the information content of a signal band-limited at $L$, reducing the number of required samples by a factor of two compared to other equiangular sampling theorems. We present fast algorithms to compute the associated Fourier transform on the rotation group, the so-called Wigner transform, which scale as $O(L^4)$, compared to the naive scaling of $O(L^6)$. For the common case of a low directional band-limit $N$, complexity is reduced to $O(N L^3)$. Our fast algorithms will be of direct use in speeding up the computation of directional wavelet transforms on the sphere. We make our SO3 code implementing these algorithms publicly available.

Read this paper on arXiv…

J. McEwen, M. Buttner, B. Leistedt, et. al.
Fri, 14 Aug 15
33/49

Comments: 5 pages, 2 figures

Complementary Lattice Arrays for Coded Aperture Imaging [CL]

http://arxiv.org/abs/1506.02160

In this work, we consider complementary lattice arrays in order to enable a broader range of designs for coded aperture imaging systems. We provide a general framework and methods that generate richer and more flexible designs than existing ones. Besides this, we review and interpret the state-of-the-art uniformly redundant arrays (URA) designs, broaden the related concepts, and further propose some new design methods.

Read this paper on arXiv…

J. Ding, M. Noshad and V. Tarokh
Tue, 9 Jun 15
41/56

Comments: N/A

Meta learning of bounds on the Bayes classifier error [CL]

http://arxiv.org/abs/1504.07116

Meta learning uses information from base learners (e.g. classifiers or estimators) as well as information about the learning problem to improve upon the performance of a single base learner. For example, the Bayes error rate of a given feature space, if known, can be used to aid in choosing a classifier, as well as in feature selection and model selection for the base classifiers and the meta classifier. Recent work in the field of f-divergence functional estimation has led to the development of simple and rapidly converging estimators that can be used to estimate various bounds on the Bayes error. We estimate multiple bounds on the Bayes error using an estimator that applies meta learning to slowly converging plug-in estimators to obtain the parametric convergence rate. We compare the estimated bounds empirically on simulated data and then estimate the tighter bounds on features extracted from an image patch analysis of sunspot continuum and magnetogram images.

Read this paper on arXiv…

K. Moon, V. Delouille and A. Hero
Tue, 28 Apr 15
36/70

Comments: 6 pages, 3 figures

The NIFTY way of Bayesian signal inference [IMA]

http://arxiv.org/abs/1412.7160

We introduce NIFTY, “Numerical Information Field Theory”, a software package for the development of Bayesian signal inference algorithms that operate independently from any underlying spatial grid and its resolution. A large number of Bayesian and Maximum Entropy methods for 1D signal reconstruction, 2D imaging, as well as 3D tomography, appear formally similar, but one often finds individualized implementations that are neither flexible nor easily transferable. Signal inference in the framework of NIFTY can be done in an abstract way, such that algorithms, prototyped in 1D, can be applied to real world problems in higher-dimensional settings. NIFTY as a versatile library is applicable and already has been applied in 1D, 2D, 3D and spherical settings. A recent application is the D3PO algorithm targeting the non-trivial task of denoising, deconvolving, and decomposing photon observations in high energy astronomy.

Read this paper on arXiv…

M. Selig
Wed, 24 Dec 14
18/37

Comments: 6 pages, 2 figures, refereed proceeding of the 33rd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 2013), software available at this http URL and this http URL

A Novel, Fully Automated Pipeline for Period Estimation in the EROS 2 Data Set [IMA]

http://arxiv.org/abs/1412.1840

We present a new method to discriminate periodic from non-periodic irregularly sampled lightcurves. We introduce a periodic kernel and maximize a similarity measure derived from information theory to estimate the periods and a discriminator factor. We tested the method on a dataset containing 100,000 synthetic periodic and non-periodic lightcurves with various periods, amplitudes and shapes generated using a multivariate generative model. We correctly identified periodic and non-periodic lightcurves with a completeness of 90% and a precision of 95%, for lightcurves with a signal-to-noise ratio (SNR) larger than 0.5. We characterize the efficiency and reliability of the model using these synthetic lightcurves and applied the method on the EROS-2 dataset. A crucial consideration is the speed at which the method can be executed. Using hierarchical search and some simplification on the parameter search we were able to analyze 32.8 million lightcurves in 18 hours on a cluster of GPGPUs. Using the sensitivity analysis on the synthetic dataset, we infer that 0.42% in the LMC and 0.61% in the SMC of the sources show periodic behavior. The training set, the catalogs and source code are all available in this http URL

Read this paper on arXiv…

P. Protopapas, P. Huijse, P. Estevez, et. al.
Mon, 8 Dec 14
5/61

Comments: N/A

On spin scale-discretised wavelets on the sphere for the analysis of CMB polarisation [IMA]

http://arxiv.org/abs/1412.1340

A new spin wavelet transform on the sphere is proposed to analyse the polarisation of the cosmic microwave background (CMB), a spin $\pm 2$ signal observed on the celestial sphere. The scalar directional scale-discretised wavelet transform on the sphere is extended to analyse signals of arbitrary spin. The resulting spin scale-discretised wavelet transform probes the directional intensity of spin signals. A procedure is presented using this new spin wavelet transform to recover E- and B-mode signals from partial-sky observations of CMB polarisation.

Read this paper on arXiv…

J. McEwen, M. Buttner, B. Leistedt, et. al.
Thu, 4 Dec 14
3/82

Comments: 4 pages, Proceedings IAU Symposium No. 306, 2014 (A. F. Heavens, J.-L. Starck, A. Krone-Martins eds.)

Application of Lossless Data Compression Techniques to Radio Astronomy Data flows [CL]

http://arxiv.org/abs/1405.5634

The modern practice of Radio Astronomy is characterized by extremes of data volume and rates, principally because of the direct relationship between the signal to noise ratio that can be achieved and the need to Nyquist sample the RF bandwidth necessary by way of support. The transport of these data flows is costly. By examining the statistical nature of typical data flows and applying well known techniques from the field of Information Theory the following work shows that lossless compression of typical radio astronomy data flows is in theory possible. The key parameter in determining the degree of compression possible is the standard deviation of the data. The practical application of compression could prove beneficial in reducing the costs of data transport and (arguably) storage for new generation instruments such as the Square Kilometer Array.

Read this paper on arXiv…

T. Natusch
Fri, 23 May 14
12/44

Comments: In preparation for submission

Slepian Spatial-Spectral Concentration on the Ball [CL]

http://arxiv.org/abs/1403.5553

We formulate and solve the Slepian spatial-spectral concentration problem on the three-dimensional ball. Both the standard Fourier-Bessel and also the Fourier-Laguerre spectral domains are considered since the latter exhibits a number of practical advantages (spectral decoupling and exact computation). The Slepian spatial and spectral concentration problems are formulated as eigenvalue problems, the eigenfunctions of which form an orthogonal family of concentrated functions. Equivalence between the spatial and spectral problems is shown. The spherical Shannon number on the ball is derived, which acts as the analog of the space-bandwidth product in the Euclidean setting, giving an estimate of the number of concentrated eigenfunctions and thus the dimension of the space of functions that can be concentrated in both the spatial and spectral domains simultaneously. Various symmetries of the spatial region are considered that reduce considerably the computational burden of recovering eigenfunctions, either by decoupling the problem into smaller subproblems or by affording analytic calculations. The family of concentrated eigenfunctions forms a Slepian basis that can be used be represent concentrated signals efficiently. We illustrate our results with numerical examples and show that the Slepian basis indeeds permits a sparse representation of concentrated signals.

Read this paper on arXiv…

Z. Khalid, R. Kennedy and J. McEwen
Mon, 24 Mar 14
49/50

On the art and theory of self-calilbration [IMA]

http://arxiv.org/abs/1312.1349

Calibration is the process of inferring how much measured data depend on the signal one is interested in. It is essential for any quantitative signal estimation on the basis of the data. Here, we investigate the “art” of self-calibration that augments an external calibration solution using a known reference signal with an internal calibration on the unknown measurement signal itself. Contemporary self-calibration schemes try to find a self-consistent solution for signal and calibration. This can be understood in terms of maximizing their joint probability. Thus, the full uncertainty structure of this probability around its maximum is not taken into account by these schemes. Therefore better schemes — in sense of minimal square error — can be designed that also reflect the uncertainties of signal and calibration reconstructions. We argue that at least the signal uncertainty should not be neglected in typical measurement situations, since the calibration solutions suffer from a systematic bias otherwise, which consequently distorts the signal reconstruction. Furthermore, we argue that non-parametric, signal-to-noise filtered calibration should provide more accurate reconstructions than the common bin averages and provide a new, improved self-calibration scheme. We illustrate our findings with a simplistic numerical example.

Read this paper on arXiv…

Fri, 6 Dec 13
27/55

D3PO – Denoising, Deconvolving, and Decomposing Photon Observations [IMA]

http://arxiv.org/abs/1311.1888

The analysis of astronomical images is a non-trivial task. The D3PO algorithm addresses the inference problem of denoising, deconvolving, and decomposing photon observations. The primary goal is the simultaneous reconstruction of the diffuse and point-like photon flux from a given photon count image. In order to discriminate between these morphologically different signal components, a probabilistic algorithm is derived in the language of information field theory based on a hierarchical Bayesian parameter model. The signal inference exploits prior information on the spatial correlation structure of the diffuse component and the brightness distribution of the spatially uncorrelated point-like sources. A maximum a posteriori solution and a solution minimizing the Gibbs free energy of the inference problem using variational Bayesian methods are discussed. Since the derivation of the solution does not dependent on the underlying position space, the implementation of the D3PO algorithm uses the NIFTY package to ensure operationality on various spatial grids and at any resolution. The fidelity of the algorithm is validated by the analysis of simulated data, including a realistic high energy photon count image showing a 32 x 32 arcmin^2 observation with a spatial resolution of 0.1 arcmin. In all tests the D3PO algorithm successfully denoised, deconvolved, and decomposed the data into a diffuse and a point-like signal estimate for the respective photon flux components.

Read this paper on arXiv…

Mon, 11 Nov 13
31/39