Draft Module 11: 'Analysis & Modeling' #9
Comments
Progress!Fleshed out a pretty solid mixed effects model case study to showcase some of the relevant concepts. Included a nice simulated dataset with the prerequisite nested structure which also set up the architecture (tracked by Git and ignored in advanced) for other modules that benefit for example datasets |
Mixed-Effects Fully DraftedI want to revisit the case study but at least a draft topic covering random intercepts, slopes, and nested random effects is now live in the module |
Frequentist vs. Multi-Model Inference Aside DraftedAs I was starting the MMI bit I realized it would just be simpler to address the philosophical difference between the two at the start of the module rather than trying to define MMI in opposition to mixed-effects models after a third of the module's content is already done |
MMI Fully DraftedI may need to revisit this to refine it / add detail but the current draft of the multi-model inference module is not unreasonable. |
Meta-Analysis Work OngoingContinuing to read into meta-analysis to flesh out that topic of this module. Somewhat slow going as many resources focus more on the use of meta-analysis functions and less on how users need to structure their data going into that process. That feels like the more important bit for our tutorial of meta-analysis so I'm focusing there (at least for now). The 'meta' R package is promising but their vignette often does not specify arguments so it is difficult to figure out what are hard requirements of the input data file and what are convenience changes to make the vignette functions simpler |
|
@njlyon0 I added a few resources to the task list above if helpful. I think that the structure of data going in will vary depend on what effect size you intend to calculate. But once effect sizes are calculated the syntax should be similarish from there on out. Maybe give 1-2 examples and then refer people to escalc documentation? |
|
Please do attach any resources you have to this issue and I'll integrate them into the module page! I'm thinking along the same lines as you module structure-wise, just having a hard time finding any solid documentation of what data format(s) are accepted by the effect size calculation functions. |
Meta-Analysis DraftedDrafted meta-analysis section and added Sarah's resources (see below). That section is a little short but we're pressed for time if we do need to do a deep dive on the preceding statistical methods so maybe that's fine. We also need to decide whether to cover this module at all if we're leaning towards a flipped approach (or schedule two--likely consecutive--class sessions to split the load) New Resources
|
|
@njlyon0 at the risk of making this more work than one wants for what might become a bonus module, I had the thought that changing the two alternate modes of thinking from frequentist vs multimodel to a 3 forms of thinking that is more 'what are you trying to do' orientation would be helpful. This paper is meaty but I think incredibly helpful in pinning down: what is my goal and then, working backwards from there, what analytical tools you might use to get there (plus some gotcha's of where you really need to be clear about what you have/haven't done in your exploratory analysis to have your p values be meaningful, i.e if you're going to dredge for relationships - go for it, but be clear that's what you did. I think you could fold what you have into those 3 buckets, putting mixed models under "inference", AIC under "prediction", and maybe adding a 3rd tab that is more on exploration/data dredging (or could just talk about it in general rather than run through a dredge example)?. And then stack the bottoms of each of those pages with targeted resources (i.e. to learn about regularization - look here, blah blah). |
Module Framing ChangeDuring the in person week I think we had decided that this module should be only the 'flipped' component (it became very clear talking to the students that many of them are stats experts in their own right already). With that in mind, I tweaked the overview / made a small area at the top of the module to store any files / content that students want to link when the time comes. So, @scelmendorf I like your idea for an alternate structure to the module but I think that stuff is effectively just bonus content for asynchronous review so I think for now my plan is to just leave it as-is for now. Though this issue will be a nice reminder if we decide to 'actually' offer the module and/or revisit its content! Also, can you tell me which paper you referenced so I can link it in the 'additional resources'? It sounds cool but I dropped the ball and didn't click the link when it was working and I now get a 404 error 🤕 |
|
@njlyon0 paper for you: https://doi.org/10.1002/ecy.3336 |
|
Excellent, thanks! I've added it and the website is re-deploying as we speak. I'm going to go ahead and close this issue but we can definitely revisit the scaffolding for these topics down the line! |
Summary
Need to create a strong draft of this module so that we can revise and eventually offer this section of the course.
Sub-Tasks
Resources
The text was updated successfully, but these errors were encountered: