Questions tagged [hypothesis-testing]
Hypothesis testing assesses whether data are inconsistent with a given hypothesis (usually a null hypothesis of no effect).
11,110 questions
1
vote
0
answers
23
views
Compare two independent meta-analysis
I extracted the overall effect from an existing meta-analysis that I would like to compare with the overall effect of my meta-analysis by performing an equivalence test (These are two independent meta-...
- 83
0
votes
0
answers
29
views
Fisher's exact test on a 4x2 table possible? [duplicate]
I have a 2×2 factorial experiment where I measured soil infiltration using a device that didn’t work properly at all locations, so I had to move it several times.
My data looks like this:
Treatment
...
- 155
0
votes
0
answers
10
views
Handling multiple comparison corrections in association rule mining
We’re working on a project applying association rule mining to environmental DNA (eDNA) datasets, and run into some uncertainty regarding how to best handle multiple comparison corrections in this ...
0
votes
0
answers
28
views
Running adaptive shrinkage on marginal means (conjoint analysis)
I am trying to use adaptive shrinkage (using the ashr R package) to adjust for multiple hypothesis testing in conjoint analysis. My understanding from recent ...
- 65
1
vote
2
answers
78
views
How can I compare the average change between two unpaired groups?
I have two groups of participants, a test group and a control group, both of whom have completed pre/post activity surveys. For the test group, I can match their pre and post surveys to get change at ...
5
votes
1
answer
415
views
Only one hypothesis?
I was wondering if it's ok to only have one hypothesis for a research experiment? Advisors have suggested for me to add a few more, but I worry they might muddy the findings from my first one. Do ...
- 51
2
votes
1
answer
197
views
Help with original test of two medians
I am fairly new to statistics and for some reason I decided it was a good idea to come up with my own test to try and answer a research question. I'm wondering if this test I came up mostly via ...
- 21
3
votes
0
answers
173
views
What is the name for a hypothesis that won't be tested unless other hypotheses are supported
I am writing a research proposal for the OSF (Open Science Framework). I want to make it as clear as possible. I don't know what to call one of my hypotheses (dependent? conditional? something else?).
...
- 141
1
vote
1
answer
76
views
Suggestions for evaluating survey results using Factor analysis
currently I am tasked with evaluating the survey responses as part of ongoing marketing research and am hoping to get some suggestions as to how to evaluate them. There are 6 surveys in total (2 ...
- 11
2
votes
1
answer
169
views
Does autocorrelated independent variable in a regression cause issues with t-stat estimate?
I saw the below question in an exam:
We have $X_t$ and $Y_t$ that are i.i.d. time series. Let $A_t = X_t + X_{t-1} + X_{t-2} + X_{t-3} + X_{t-4}$. We regress $Y_t \sim \alpha + \beta \cdot A_t$ and ...
- 390
3
votes
1
answer
76
views
Determining Sample Representativeness of Lat/Long Points
Let's say I have 100,000 points where each point represents a customers location in a given city. A third party has visited 10,000 customers and recorded information from them. I do not have access to ...
- 161
5
votes
3
answers
319
views
Analyzing test result using test statistic vs p-value?
I am trying to understand how/when to use a test-statistic and/or p-value to draw a conclusion on a test.
As far as I understand, when running a statistical test we must decide whether to use the test ...
- 75
13
votes
3
answers
2k
views
Why is the Bonferroni correction needed?
Intuitively it makes sense that extracting multiple hypotheses from the same dataset is a bad idea because the probability of a false positive goes up. But when I think more about it, it doesn't make ...
6
votes
1
answer
251
views
Do you need to do correction on multi-factor ANOVAs?
Assume a 2-way ANOVA with no post-hoc comparisons.
Do you need to use e.g. Bonferroni correction to determine the correct alpha?
I have seen anecdotally that some don't do this. I guess you can ...
- 381
0
votes
0
answers
47
views
Sampling counterfactual posterior to mitigate error autocorrelation in event studies
I have question regarding event studies (pre-event data is observed, an event occurs at $t=e$, then following the treatment is assumed to be in-effect.)
There are multiple approaches to event study ...
- 3,970