Research output

Publications

Peer-reviewed articles, conference papers, manuscripts under review, and current working papers spanning longitudinal inference, causal learning, time series, biomedical data science, and AI.

† Student or trainee supervised/co-supervised by D. Ghosh.

Contribution to Data Science: Time Series, Uncertainty Quantification and Applications

Washington University in St. Louis · Doctor of Philosophy in Statistics

Advisor: Soumendra Lahiri · Co-Advisor: Tucker McElroy

The dissertation brings together nonlinear time-series prediction, polyspectral inference, social-media analytics, bot detection, and bootstrap methods for extreme values.

Peer-reviewed and accepted

25
  1. Pal, S., Imon, D. & Ghosh, D. Temporally Resolved Spatial Health Analytics for Environmental Exposure Surveillance: PM2.5, COPD, and Stroke across U.S. Cities. Accepted as a full paper at HCist 2026; forthcoming in Procedia Computer Science (2026).
  2. † Ibenye, C., † Jimenez, A.-V., † Jaeger, S. & Ghosh, D. When Machines Lie Differently: Detecting AI vs Human Fake News.Cited by 1 Accepted at ICMLA (2026).

    Summary. This study asks whether fake news is equally detectable when it is written by humans versus generated by AI. Using the same feature representation and modeling pipeline for both tasks, the paper compares real news with human-written fake news and with AI-generated fake news using lexical-diversity, readability, and emotion features together with logistic regression, random forests, support vector machines, gradient boosting, neural networks, and an ensemble model.

    Across all models, AI-generated fake news was substantially easier to distinguish from real news: most models achieved AUCs above 0.99 for the AI-generated task, compared with roughly 0.89–0.96 for human-written fake news. Feature analyses suggest that AI-generated misinformation currently shows more uniform patterns in readability and emotional expression, whereas human-written fake news more closely resembles legitimate journalism.

    Undergraduate research project: This work was developed with undergraduate researchers Calvin Ibenye, Aya-Vera Jimenez, and Samuel Jaeger through Kennesaw State University’s First-Year Scholars Program.
    Fake news detectionAI-generated textMachine learningReadabilitySentiment & emotion
    Read the preprint →
  3. Ghosh, D. A Rank-Based Information Fusion Framework for Comparing Clustered Multivariate Socioeconomic Outcomes.Cited by 0 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 1–5 (2026).

    Summary. This paper develops a multivariate, distribution-free rank-based framework for comparing clustered and correlated outcomes across groups. The method adapts the Longitudinal Rank-Sum Test (LRST) to a clustered cross-sectional setting, treating states as independent units and counties as dependent observations within states, while combining several socioeconomic outcomes into a single omnibus comparison.

    The framework is applied to pooled U.S. county data from 2019–2023 to compare states with and without refundable Earned Income Tax Credit (EITC) policies across poverty, income inequality, housing cost burden, medical care costs, and per-capita income. Across repeated county subsampling and different cluster sizes, counties in EITC states consistently showed more favorable joint socioeconomic rankings. The analysis is explicitly descriptive rather than causal and illustrates how rank-based information fusion can provide robust, interpretable comparisons when outcomes are multivariate and clustered.

    Rank-based inferenceInformation fusionClustered dataLRSTSocioeconomic outcomesEITC
    Read the IEEE paper →
  4. Ghosh, D., Boettcher, W., Johnston, R. & Lahiri, S. Machine Learning Based Bot Detection on X With Temporal and Semantic Feature Integration.Cited by 5 IEEE Transactions on Computational Social Systems (2026).

    Summary. This paper develops an interpretable machine-learning framework for distinguishing organic users from social-media bots using information extracted from users’ X/Twitter histories. Rather than relying only on profile metadata or opaque deep-learning representations, the method combines temporal behavior—such as periodicity, ARIMA-based dynamics, and periodogram structure—with semantic features including lexical diversity, hashtag use, word-frequency patterns, and sentiment.

    Using verified organic and inorganic accounts, the study evaluates k-means clustering and support vector machines and finds that combining temporal and semantic features yields the strongest discrimination. The framework also adds split conformal prediction to quantify uncertainty, producing calibrated prediction sets alongside class labels; the conformal analysis reported approximately 94.7% test accuracy with an AUC of 0.978.

    Interdisciplinary collaboration: Developed with William Boettcher and Rob Johnston at North Carolina State University, combining social-science questions with statistical and machine-learning methodology.
    Bot detectionSocial mediaTemporal featuresSemantic featuresSVMConformal prediction
    Read the IEEE paper →
  5. Ghosh, D., McElroy, T. & Lahiri, S. Polyspectral Mean Estimation of General Nonlinear Processes.Cited by 3 Bernoulli (2026), in press.

    Summary. This paper develops a general inferential theory for polyspectral means—weighted averages of higher-order spectra designed to capture nonlinear and non-Gaussian dependence that ordinary second-order spectral methods can miss. It establishes asymptotic normality for polyspectral-mean estimators of arbitrary order and derives an explicit limiting variance involving higher-order polyspectra, providing a unified basis for large-sample inference.

    The paper also proposes a new bispectrum-based test of the linear-process hypothesis. Simulations study finite-sample behavior, while applications illustrate the methodology through linearity testing for sunspot data and clustering GDP growth trajectories across countries using bispectral features.

    Invited presentations: This work has also been the subject of multiple invited talks on higher-order spectral analysis and nonlinear time-series inference.
    PolyspectraNonlinear time seriesHigher-order spectraAsymptotic inferenceLinearity testingTime-series clustering
    Read the preprint →
  6. Ghosh, D. & Pal, S. Efficacy Analysis in Clinical Trials: A Comprehensive Review of Statistical and Machine Learning Approaches.Cited by 3 The New England Journal of Statistics in Data Science, 1–23 (2026).

    Summary. This review organizes the major methodological families used for efficacy analysis in clinical trials, spanning classical parametric procedures, nonparametric methods, Bayesian approaches, and modern machine-learning techniques. It emphasizes when each framework is most appropriate, the assumptions each requires, and how the choice of method changes with longitudinal, skewed, high-dimensional, or otherwise complex trial data.

    The paper also discusses missing-data mechanisms, adaptive and personalized trial settings, deep learning, reinforcement learning, and emerging computational approaches. Its central goal is to connect traditional statistical inference with newer predictive methodology while making the tradeoffs in robustness, interpretability, uncertainty quantification, and scalability explicit.

    Clinical trialsEfficacy analysisNonparametricsBayesian methodsMachine learningMissing data
    Read the article →
  7. Ghosh, D., Tushar, F., Dahal, L., Vancoillie, L., Lafata, K. J., Samei, E., Lo, J. Y. & Luo, S. Demographic distribution matching between real-world and virtual phantom population.Cited by 3 Medical Physics 53, e70364 (2026).

    Summary. This paper introduces DISTINCT (Distributional Subsampling for Covariate-Targeted Alignment), a framework for selecting a subsample from a large real-world cohort whose joint demographic distribution matches that of a virtual phantom population. The method aligns continuous and categorical covariates together and evaluates distributional similarity using Wasserstein and Kolmogorov–Smirnov distances.

    Applied to the National Lung Screening Trial and the Virtual Lung Screening Trial, DISTINCT identified an aligned NLST cohort of 9,974 participants. Downstream lung-cancer risk-score performance stabilized once aligned samples exceeded roughly 6,000 participants, illustrating how demographic alignment can support more representative comparisons between real and virtual imaging studies.

    Virtual imaging collaboration: Conducted with Duke’s Center for Virtual Imaging Trials and supported in part by NIH/NIBIB funding.
    Virtual imaging trialsDistribution matchingWasserstein distanceNLSTVLSTFair evaluation
    Read the article →
  8. McElroy, T., Ghosh, D. & Lahiri, S. Polyspectral factorization.Cited by 2 Annals of the Institute of Statistical Mathematics, 1–25 (2026).

    Summary. This paper generalizes classical spectral factorization from second-order spectra to higher-order polyspectral densities, developing a mathematical framework for nonlinear and non-Gaussian time series. It establishes new mappings between higher-dimensional cepstral coefficients and autocumulants while respecting the symmetry structure of polyspectra.

    The resulting representation provides tools for nonlinear filtering and forecasting and offers a flexible semiparametric route to modeling stationary nonlinear processes without imposing a specific nonlinear equation in advance.

    Polyspectral factorizationCepstral representationAutocumulantsNonlinear time seriesForecasting
    Read the article →
  9. † Peddi, P. K. & Ghosh, D. Integrating Causal Inference with Graph Neural Networks for Alzheimer’s Disease Analysis.Cited by 1 DATA 2026, 450–457.

    Summary. This paper introduces Causal-GCN, a graph convolutional framework designed to move beyond purely associational Alzheimer’s disease prediction. Each subject is represented as a brain graph, while age, sex, and APOE4 information are incorporated into a back-door adjustment strategy so that ROI-level interventions can be evaluated within the trained network.

    Applied to 484 ADNI participants, the framework achieves classification performance comparable to standard graph-neural-network baselines while producing interpretable intervention-based rankings of brain regions. The analysis highlights posterior, cingulate, and insular regions as influential hubs and uses bootstrap resampling to assess the stability of the estimated effects.

    Master’s student research: This project was led by Pranay Kumar Peddi, an M.S. student in Computer Science at Kennesaw State University, under my supervision.
    Causal inferenceGraph neural networksAlzheimer’s diseaseADNIMRIInterventional learning
    Read the paper →
  10. Dahal, L., Ghojoghnejad, M., Vancoillie, L., Ghosh, D., et al. XCAT 3.0: A comprehensive library of personalized digital twins derived from CT scans.Cited by 35 Medical Image Analysis 103, 103636 (2025).
  11. Ghosh, D. Assessing air quality extremes: a comparative extreme value analysis of metropolitan cities across India and the world.Cited by 8 Environmental Monitoring and Assessment 197, 276 (2025).

    Summary. This paper uses extreme-value methods to study severe Air Quality Index episodes rather than focusing only on average pollution levels. Daily maximum AQI values are analyzed for five major Indian cities and eight metropolitan areas elsewhere in the world, with separate attention to seasonal behavior and the upper tail of the pollution distribution.

    The analysis documents pronounced city-to-city and seasonal differences in extreme pollution risk, with especially severe wintertime behavior in cities such as Delhi and Dhaka. The study illustrates how extreme-value analysis and bootstrap-based uncertainty assessment can help quantify rare but high-impact environmental events.

    Extreme value theoryAir Quality IndexEnvironmental statisticsBootstrapUrban air pollution
    Read the article →
  12. Ghosh, D. Polyspectral mean based time series clustering of Indian stock market.Cited by 7 Discover Data 3, 10 (2025).

    Summary. This paper develops a time-series clustering approach that uses spectral and bispectral means as features, allowing the clustering procedure to incorporate higher-order dependence and nonlinear structure that ordinary second-order spectral summaries can miss.

    The method is applied to 49 NIFTY 50 stocks using a 1,000-day window of value-weighted average prices. K-means clustering of the higher-order spectral features identifies five distinct groups, revealing market structure that cuts across conventional sector labels and illustrating the use of polyspectral features for nonlinear financial time-series analysis.

    PolyspectraBispectraTime-series clusteringNonlinear dependenceIndian stock market
    Read the article →
  13. Ghosh, D., Boettcher, W. A., Johnston, R. & Lahiri, S. THANOS: A Predictive Model of Electoral Campaigns Using Twitter Data and Opinion Polls.Cited by 9 Data Science in Science 4, 2484180 (2025).

    Summary. This paper develops two statistical forecasting frameworks that combine traditional opinion polls with social-media information. THOS uses Twitter hashtag frequencies, while THANOS augments those signals with network-structure features such as centrality measures, with the goal of using fast-moving online information alongside slower but more representative polling data.

    The models are evaluated on Ireland’s 2018 referendum on the 36th constitutional amendment and the 2018 U.S. Senate elections. In those studied cases, the paper reports that the simpler THOS model worked well when margins were relatively clear, whereas network information became more useful in closely contested races. The results are presented as an empirical forecasting study rather than as a general guarantee about future elections.

    Interdisciplinary collaboration: Developed with William Boettcher and Rob Johnston in Political Science at North Carolina State University.
    Election forecastingSocial media analyticsOpinion pollsNetwork analysisTime-series regression
    Read the article →
  14. Ghosh, D. & Luo, S. A non-parametric U-statistic testing approach for multi-arm clinical trials with multivariate longitudinal data.Cited by 5 Journal of Multivariate Analysis 209, 105447 (2025).

    Summary. This paper extends the Longitudinal Rank-Sum Test from two-arm trials to multi-arm randomized clinical trials with multiple longitudinal outcomes. The resulting U-statistic framework provides a global, distribution-free comparison across treatment arms while retaining the temporal and multivariate structure of the data.

    Simulation studies show strong Type I error control and improved power relative to applying separate two-arm LRSTs with multiplicity correction. An application to the Bapineuzumab 301 Alzheimer’s disease trial demonstrates how the method can be used to evaluate several dose groups against a common control and then identify promising treatment arms after a global rejection.

    LRSTMulti-arm trialsU-statisticsLongitudinal dataAlzheimer’s disease
    Read the article →
  15. Ghosh, D., Pal, S., Lutz, M., Luo, S. & ADNI. Ensemble survival analysis for preclinical cognitive decline prediction in Alzheimer’s disease using longitudinal biomarkers.Cited by 14 Journal of Alzheimer’s Disease 107(3), 1256–1266 (2025).

    Summary. This study develops an ensemble survival framework for predicting progression from cognitively normal status to mild cognitive impairment or Alzheimer’s disease using longitudinal ADNI biomarkers. The approach combines penalized Cox models with Random Survival Forest, DeepSurv, and XGBoost, and then aggregates predictions using ensemble averaging and Bayesian model averaging.

    Among 721 initially cognitively normal participants, the ensemble achieved a peak C-index of 0.907 and integrated time-dependent AUC of 0.904, compared with a C-index of 0.608 for baseline-only models. A notable practical finding is that adding one follow-up visit produced most of the predictive gain, while a second follow-up added relatively little.

    Alzheimer’s diseaseSurvival analysisADNILongitudinal biomarkersMachine learningEnsemble learning
    Read the article →
  16. Ghosh, D., Xu, X., Luo, S. & CPP Integrated Parkinson’s Database. Power and sample size calculation for multivariate longitudinal trials using the longitudinal rank sum test.Cited by 3 Statistics in Medicine 44, e70261 (2025).

    Summary. This paper develops the power and sample-size theory needed to use the Longitudinal Rank-Sum Test prospectively when designing multivariate longitudinal clinical trials. It derives the LRST distribution under both null and alternative hypotheses, obtains closed-form expressions for power and sample size, and develops consistent estimators with large-sample justification.

    Simulation studies validate the calculations, and applications to Alzheimer’s and Parkinson’s disease trials illustrate how the framework can be used to plan adequately powered studies when several outcomes are followed repeatedly over time.

    LRSTPowerSample sizeClinical trial designNeurodegenerative disease
    Read the article →
  17. Mayan, I., Roth, H., Ghosh, D., Whitson, H. E. & Johnson, K. G. Genetic and biomarker disclosure process in a memory and aging study.Cited by 3 Journal of Alzheimer’s Disease 104(2), 312–318 (2025).
  18. Pal, S., Ghosh, D. & Yang, S. Penalized FCI for Causal Structure Learning in a Sparse DAG for Biomarker Discovery in Parkinson’s Disease.Cited by 5 Annals of Applied Statistics, accepted/in press (2025).

    Summary. This paper develops Penalized Fast Causal Inference (PFCI) for high-dimensional causal discovery when the underlying biomarker network is sparse and latent confounding may be present. The method first uses penalized neighborhood selection to reduce the dependency graph and then applies FCI to the smaller structure, preserving the ability to represent hidden confounders while making causal discovery more scalable.

    The approach is applied to PPMI proteomic data containing 2,924 plasma and CSF biomarkers. The analysis identifies a compact set of candidate biomarkers connected to Parkinson’s disease, including the plasma biomarker Myocilin together with several CSF markers, illustrating how sparsity-aware causal discovery can prioritize potentially informative biomarker pathways in very high-dimensional biological data.

    Causal discoveryPFCISparse DAGsLatent confoundingParkinson’s diseasePPMI
    Read the preprint →
  19. Tushar, F. I., Vancoillie, L., McCabe, C., Kavuri, A., Dahal, L., Harrawood, B., Fryling, M., Zarei, M., Sotoudeh-Paima, S., Ho, F. C., et al. Virtual lung screening trial (VLST): An in silico study inspired by the national lung screening trial for lung cancer detection.Cited by 24 Medical Image Analysis 103, 103576 (2025).
  20. Xu, X., Ghosh, D., Luo, S. & CPP Integrated Parkinson’s Database. A novel longitudinal rank-sum test for multiple primary endpoints in clinical trials: Applications to neurodegenerative disorders.Cited by 5 Statistics in Biopharmaceutical Research (2025).

    Summary. This paper introduces the Longitudinal Rank-Sum Test (LRST), a nonparametric U-statistic-based global test for clinical trials with multiple primary endpoints measured repeatedly over time. The method aggregates evidence across outcomes and visits into a single omnibus test, avoiding separate multiplicity adjustment while accommodating non-normal and heterogeneous outcome distributions.

    Simulations examine a range of realistic trial settings, including conflicting effects across endpoints, and demonstrate Type I error control together with competitive power. Applications to neurodegenerative-disease trial data illustrate how LRST can summarize treatment efficacy across cognitive, functional, and other longitudinal domains.

    Foundational LRST paper: This article introduces the core LRST framework that underlies the later multi-arm, power/sample-size, missing-data, and covariate-adjusted extensions.
    LRSTMultiple primary endpointsU-statisticsNonparametric inferenceNeurodegenerative trials
    Read the article →
  21. McElroy, T. S., Ghosh, D. & Lahiri, S. Quadratic Prediction of Time Series via Auto-Cumulants. Sankhya A 86, 431–463 (2024).

    Summary. This paper develops a general nonlinear forecasting framework based on quadratic predictors for stationary time series. The predictor extends the classical linear Yule–Walker equations by incorporating second-, third-, and fourth-order auto-cumulants, allowing nonlinear and non-Gaussian dependence to contribute directly to prediction.

    The theory characterizes when a process is second-order forecastable—that is, when quadratic prediction can improve on the best linear forecast—and connects that condition to spectral and bispectral structure. Numerical studies show substantial prediction gains in nonlinear settings, while applications to U.S. unemployment and Wolfer sunspot data reduce mean-squared prediction error by 16.5% and 29.2%, respectively.

    Nonlinear time seriesQuadratic predictionAuto-cumulantsPolyspectraYule–Walker equationsForecasting
    Read the article →
  22. Sotoudeh-Paima, S., Segars, W. P., Ghosh, D., Luo, S., Samei, E. & Abadi, E. A systematic assessment and optimization of photon-counting CT for lung density quantifications.Cited by 21 Medical Physics 51, 2893–2904 (2024).

    Summary. This study evaluates photon-counting CT for quantitative lung-density measurement and compares it with conventional energy-integrating CT. It combines retrospective clinical data with scanner-specific virtual imaging experiments, allowing reconstruction parameters and radiation dose to be varied systematically against known virtual ground truth.

    The analysis identifies imaging settings associated with lower lung-density error and reports that, under the optimized settings studied, photon-counting CT achieved lower lung and emphysema density error than the compared energy-integrating CT scanners. The work illustrates how virtual imaging trials can complement clinical data when controlled repeated imaging experiments would be impractical in patients.

    Interdisciplinary imaging study: This project brought together biostatistics, medical physics, biomedical engineering, and Duke’s Center for Virtual Imaging Trials.
    Photon-counting CTQuantitative imagingVirtual imaging trialsLung densityMedical physics
    Read the article →
  23. Tushar, F. I., Vancoillie, L., McCabe, C., Kavuri, A., Dahal, L., Harrawood, B., Fryling, M., Zarei, M., Sotoudeh-Paima, S., Ho, F. C., et al. Virtual NLST: towards replicating national lung screening trial.Cited by 6 Medical Imaging 2024: Physics of Medical Imaging 12925, 442–447 (2024).
  24. Ghosh, D. Spatiotemporal Characterization of Overdose Mortality in Georgia, USA Using Spectral and Nonlinear Interaction Analysis, 2003–2021.Cited by 0 Accepted in Spatial and Spatio-temporal Epidemiology (2026).
  25. † Jaeger, S., † Ibenye, C., † Vera-Jimenez, A. & Ghosh, D. Human vs. Machine Deception: Distinguishing AI-Generated and Human-Written Fake News Using Ensemble Learning.Cited by 2 Accepted in the American Journal of Undergraduate Research (2026).

Under review / revision

3
  1. Ghosal, R., Ghosh, D., Yue, Y. & Roy, A. Penalized Cox Regression with Graph-Structured Distribution-Valued Predictors. Submitted to JCGS (2026).
  2. Ghosh, D., Song, Z., Xiao, L. & Luo, S. A comprehensive goodness-of-fit test for covariance structures in multivariate longitudinal data. Submitted to Biometrics (2026). Public preprint (current title).
  3. Karami, A., Imran, M., Ghosh, D. & Carlisle, J. Predicting Areas at the Risk of Lung Cancer Based on Modifiable Risk Factors. Revised manuscript under review at JCO Clinical Cancer Informatics (2026).

Working papers

11