[R-sig-ME] GLMM with many and highly correlated features

[Thierry Onkelinx]

Dear John,

It looks like you have a binomial response variable. And each
participant has either always 0 or always 1 as outcome. Adding
participant as a random effect, will induce complete separation.
Aggregating the data to one observation per participant leaves you
with 60 observations: in case of a balanced design 30 with the outcome
and 30 without. Hence you have about 30 effective observations, which
leaves room for at most 3 (three) parameters to be estimated. So
you'll need a way to reduce your 350 variables down to 3 without
looking at the response variable.

IMHO Tukey's quote in my signature and fortunes::fortune(119) apply.

Best regards,

ir. Thierry Onkelinx
Statisticus / Statistician

Vlaamse Overheid / Government of Flanders
INSTITUUT VOOR NATUUR- EN BOSONDERZOEK / RESEARCH INSTITUTE FOR NATURE
AND FOREST
Team Biometrie & Kwaliteitszorg / Team Biometrics & Quality Assurance
thierry.onkelinx using inbo.be
Havenlaan 88 bus 73, 1000 Brussel
www.inbo.be

///////////////////////////////////////////////////////////////////////////////////////////
To call in the statistician after the experiment is done may be no
more than asking him to perform a post-mortem examination: he may be
able to say what the experiment died of. ~ Sir Ronald Aylmer Fisher
The plural of anecdote is not data. ~ Roger Brinner
The combination of some data and an aching desire for an answer does
not ensure that a reasonable answer can be extracted from a given body
of data. ~ John Tukey
///////////////////////////////////////////////////////////////////////////////////////////



ir. Thierry Onkelinx
Statisticus / Statistician

Vlaamse Overheid / Government of Flanders
INSTITUUT VOOR NATUUR- EN BOSONDERZOEK / RESEARCH INSTITUTE FOR NATURE
AND FOREST
Team Biometrie & Kwaliteitszorg / Team Biometrics & Quality Assurance
thierry.onkelinx using inbo.be
Havenlaan 88 bus 73, 1000 Brussel
www.inbo.be

///////////////////////////////////////////////////////////////////////////////////////////
To call in the statistician after the experiment is done may be no
more than asking him to perform a post-mortem examination: he may be
able to say what the experiment died of. ~ Sir Ronald Aylmer Fisher
The plural of anecdote is not data. ~ Roger Brinner
The combination of some data and an aching desire for an answer does
not ensure that a reasonable answer can be extracted from a given body
of data. ~ John Tukey
///////////////////////////////////////////////////////////////////////////////////////////




Op ma 3 dec. 2018 om 08:56 schreef <j.zavrakidis using nki.nl>:
>
> Dear all,
>
> Lately I came upon a very interesting project, which also made me thinking since it was the first time for me to work on such data.
> So, I have 2-level data, with 60 participants having 2-3 measurements each, allocated (almost balanced) in two groups, say Y variable. This Y is also my outcome. Then, there are also about 350 features.
> Therefore, the goal is to predict the Y class based on the 350 features.
>
> Problem: I have around 180 (not independent) observations, and 350 variables. Obviously this will not work... So somehow they have to be reduced
>
> Possible solution : These 350 features are highly correlated in groups, meaning that they can form clusters which give similar information. If we were talking about independent data, then possible solution would be, say PCA, and then building the prediction model with a GLM based on these PCA features (although I never tried something like that, I see it is usual).
>
> However, Now that ultimately the goal is to use a GLMM, how can this be done ? Can you do PCA (or any variable reduction technique) in 2-level data ? And if yes, can you point me out where to learn about it?
> If this is not possible, can you suggest something that you would do in this case ?
>
> P.S. Since we are talking about a prediction model, is it still valid to assess prediction accuracy with AUC under GLMM ?
>
> Thank you
> John Zavrakidis
>
> Junior Researcher - Statistician
> Department of Epidemiology and Biostatistics
>
> _______________________________________________
> R-sig-mixed-models using r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-sig-mixed-models