stud
bud
Sign up
Log in
Home
Library
Explore
SAT
More
Research, Statistics & Program Eval Quiz Flashcards | StudBud
Explore
/
Research, Statistics & Program Eval Quiz
Research, Statistics & Program Eval Quiz
100 terms
·
StudBud Administration
Test your knowledge on descriptive statistics, scales of measurement, central tendency, and more
Flashcards
100 cards
F
Practice quiz
P
Host live
L
Questions
100
Answers
1
Type II Error occurs when you
you do not test for significance
reject a true null
there's a beta error
accept a false null
2
Formative evaluation occurs:
After a program ends
Only with qualitative methods
During program implementation
Only in clinical settings
3
A Type I error occurs when:
A sample is too small
Data is not normally distributed
A true null hypothesis is rejected
A false null hypothesis is accepted
4
Which sampling method gives every individual an equal chance of being selected?
Stratified
Snowball
Convenience
Simple random sampling
5
Which term describes the degree to which an intervention is delivered as intended?
Internal consistency
Validity
Fidelity
Reliability
6
A Norm Referenced score compares an individuals score to
other individual scores in the study
score(s) from a norm group
an external criterion
The norm score using a different measure
7
A Raw score
shows PERECENTILE
represents the NUMBER of items answered correctly
shows PERCENTAGE of items answered correctly
is expressed in units by which it was originally obtained
8
Raising the significance level does all the following EXCEPT:
increases the probability of alpha errors
increasing the probability of finding statistical significance(true affect)
adjusting the P value from 0.05 to 0.02
adjusting the P value from 0.02 to 0.05
9
Which of the following indicates a strong positive correlation?
r = 0.70
r = –0.65
r = 0.03
r = –0.01
10
If an experimentor is looking to ferret out the effects of more than 1 IV, they will use
Pearson R
Spearman Rank order Rho
Factorial Design
Solomon four-group
11
What is the purpose of random assignment in experimental research?
Control for confounding variables
Increase external validity
Ensure data is generalizable
Collect more data
12
Descriptive Statistics summarize data by using all the following but:
Standard Deviation
Mean
Measures of central tendency
Hypothesis Testing
13
Which is the best measure of central tendency for skewed data?
Median
Standard deviation
Mean
Mode
14
The main difference of a MANOVA and ANOVA
A MANOVA analyzes the impact of multiple IVs on mutliple DVs
an anova measures multiple independent variable
15
When correlational data describes the nature of 2 variables the term _______ is utilized
dual-variate
variate
bivariate
multivariate
16
Summative evaluation is primarily used to:
Identify implementation barriers
Determine program effectiveness
Guide fidelity assessments
Improve program delivery
17
Factors that can threaten internal validity include all the following except
Confounding variables
Maturation
History
Situation Effect
18
Which level of significance would best rule out chance factors?
0.01
0.05
0.2
0.001
19
What measure of central tendency is the most stable DESPITE extreme scores
Mode
Mean
Standard Deviation
Median
20
If a researcher changes the significance level from 0.05 to 0.001
alpha and beta errors increasse
alphaerrors increase but beta errors decrease
alpha errors decrease; beta errors increase
no impact on type I and type II errors
21
Which type of variable can take on only specific, separate values (e.g., number of clients)?
Nominal
Ordinal
Discrete
Continuous
22
Standard deviation is a measure of:
Reliability
Variability
Central tendency
The average score
23
Unconsciously rating attractive female as better counselors is most attributable to
The Halo Effect
The Recency effect
The Hawthorne Effect
Sexism
24
Regardless of the distribution the _____ will always be the highest point when graphically displayed
mean
median
R
mode
25
A bell curve with an abundance of low scores is_______
negatively skewed
positively skewed
26
P=0.05 really means that
differences truly exist; experimenter will obtain same result 99/100 times
95% error factor
10% error factor
differences truly exist; experimenter will obtain same result 95/100 times
27
Reliability refers to:
Whether a test measures what it's supposed to
Consistency of measurement
Accuracy of a measure
Utility of a test
28
Which method is best for determining the predictive validity of a new college readiness assessment?
Correlation with GPA after one semester
Cronbach’s alpha
Content analysis
Test-retest correlation
29
A horse that is categorized as "2nd" place in a race represents a(n)
ordinal scale
Nominal scale
ratio scale
interval scale
30
A logic model typically includes all EXCEPT:
Inputs
Outputs
Sampling error
Outcomes
31
Which research design tracks participants over time?
Meta-analysis
Experimental
Cross-sectional
Longitudinal
32
Which of the following will yield the closet to a perfect correlation
length in inches and length in centimeters
ICD diagnosis and salary
IQ and salary
height and weight
33
An action research model is best used when:
Conducting meta-analysis
Exploring a national trend
Testing a hypothesis in a lab
Solving a local problem in real-time
34
The Belmont Report outlines all of the following principles EXCEPT:
Confidentiality
Beneficence
Respect for persons
Justice
35
A line of best fit is most commonly referred to as a ____________
Correlation coefficient
none of these answers
Slope
Regression Line
36
Pearson R is to interval and ratio data as Spearman Rho is to _________
Ordinal
Nominal
37
A T score must ________ critical T to be considered statistically significant
not exceed
exceed
be the inverse of
Equate to
38
To compare the data from a control and experimental group the researcher will use
a test for significance
percentile rank
a correlation coefficient
descriptive statistics
39
If the data are skewed right, the mean will be:
Less than the median
Greater than the median
Unaffected
Equal to the median
40
Which is NOT a threat to internal validity?
External validity
Maturation
Selection bias
Instrumentation
41
Which approach is most appropriate to understand multicultural client outcomes across settings?
Meta-analysis
Single case study
Experimental design
Grounded theory
42
The range of scores in a 153 person class would likely be _________ the range of scores in a 77 person class
less than
not enough information
equal to
greater than
43
Experimental is to cause and effect as CORRELATIONAL is to _______
Ex-Post Facto research only
degree (strength and direction) of relationship
N=1 Design
Blind Studies
44
Type I Error occurs when you
reject a true null
there's a beta error
you do not test for significance
accept a false null
45
Which research method is most appropriate to explore lived experiences of clients in recovery?
Survey research
Phenomenological research
Longitudinal study
Experimental design
46
What is the mean of the following set: 3, 5, 5, 7, 10?
10
7
6
5
47
If an experiment can be replicated by others with near identical findings, the experiment is
said to be reliable
impacted by observer effect
depicts high error variance
depicts true variance
48
Which of the following is a non-parametric test?
Chi-square
T-test
Pearson’s r
ANOVA
49
What is the main difference between experimental and quasi-experimental research designs?
collecting interval or ratio data
normal distribution
The ability to use random sampling
the use of a control group
50
The first step in conducting a program evaluation is to:
Submit findings to IRB
Collect qualitative data
Identify stakeholders and goals
Analyze outcomes
51
The p-value tells us:
The probability of results occurring by chance
The direction of the relationship
How large the sample is
The size of the effect
52
A bell curve with an abundance of high scores is_______
positively skewed
negatively skewed
53
Which is an example of an ordinal scale?
Weight
Temperature
IQ
Class rank
54
Which statistic is most appropriate for determining relationships between two continuous variables?
ANOVA
T-test
Pearson correlation
Chi-square
55
Student who study a lot get higher scores on the NCE. This represents a ________ correlation
negative
the question does not provide enough data
0.00
positive
56
Which statistic is used for pre/post testing with the same group?
Independent samples t-test
Chi-square
ANOVA
Paired samples t-test
57
A sociogram is to a counseling group as a scattergram is to ____________
The normal curve
the correlation coefficient
the range
a histogram
58
Which correlation coefficient depicts the strongest correlation
-0.8
0.01
0.7
0.3
59
What does the term "internal validity" refer to in a research study?
study measures what it intends to measure without interference from ext
The consistency of the study's results across different time periods.
The accuracy of the study's findings when tested in a real-world setting.
a study's results can be generalized to other populations or settings.
60
The Beck Depression Inventory (BDI) is an example of a:
Qualitative interview
Physiological measure
Projective test
Standardized self-report inventory
61
An IQ of 101 would fall between
z=-1 and z=-3
the mean and Z= +1
the mean and Z=-1
all of the above
62
what percentage of data falls within the mean and z=-2
34%
68%
48%
13%
63
If you're a behaviorist using an N=1 design, your first step should be
decide on a non parametric statistical test
find a sample or similar indviduals for generalization
none of the above
obtain a baseline
64
The mean falls on the ______ stanine
5th
3rd
1st
9th
65
Effect size measures:
Statistical significance
Practical significance
Sampling error
Confidence intervals
66
Which of the following is a limitation of using self-report measures in research?
High reliability
Objective scoring
Demand characteristics and social desirability bias
Large sample access
67
Neither clients nor researcher knew which group received the drug and which recieved the placebo. This was a
Typical AB Design
Factorial Design
Single Blind Study
Double Blind
68
Dr. Y completed research that shows that many students who obtain NCC status become behaviorally oriented. This shows
Correlation
Causation
69
Z-scores....
show the number of standard deviations a value is from the mean
determine probabilities in NON-normal distributions
determine the correlation coefficient between IVs and DVs
typically range from -2, +2
70
Which of the following is a strength of a longitudinal study compared to a cross-sectional study?
Cross-sectional studies provide more accurate data about trends over time
Longitudinal studies are quicker and less expensive to conduct
Longitudinal studies collect data from different populations at one time
Longitudinal studies collect data over time to demonstrate correlation
71
the most useful measure of central tendency is _____
The mean
Mode
Standard Deviation
Median
72
Scores that fall just outside of -3 or +3 standard deviations from the mean are
extreme
+/- 3 percentage points from the mean
all very low
relatively average
73
Control Group: 0 IV intervention; Group A: 4 IV interventions; Group B: 8 IV interventions. The researcher should use:
ANOVA
t-test
a two-way ANOVA
a MANOVA
74
In qualitative research, credibility is most similar to what quantitative concept?
Generalizability
Validity
Significance
Reliability
75
Which type of reliability is assessed by giving the same test to the same group at two different times?
Test-retest reliability
Internal consistency
Inter-rater reliability
Split-half reliability
76
Which of the following indicates the strongest evidence of a treatment’s effectiveness?
Correlational study
Quasi-experiment
RCT (Randomized Control Trial)
Case study
77
Which of the following would likely require IRB approval?
A classroom project with anonymous surveys
Interviewing clients for a published article
An in-class demonstration
A literature review
78
The median is
never more useful than the mean
the most-frequent value obtained
the arithmetic average
the middle score when data is arranged from highest to lowest
79
Which ethical principle requires researchers to protect participants from harm?
Beneficence
Autonomy
Fidelity
Justice
80
This type of scale has NO true 0 point
Nominal
Ratio
Interval
Ordinal
81
Which of the following research types most values thick description and reflexivity?
Qualitative
Experimental
Survey
Quantitative
82
The independent variable is best defined as:
The manipulated variable
The measured outcome
The variable that changes naturally
The variable held constant
83
If a researcher sets an alpha level at .05, they are:
Accepting a 5% chance of Type I error
Ensuring 95% confidence in the results
Accepting a 5% chance of Type II error
Eliminating sampling error
84
An experimenters beliefs leading to specific treatment and yielding hypothesized results is most attributable to
Observer bias
Rosenthal Effect
Halo effect
Hawthorne Effect
85
Which variable is typically placed on the x-axis of a graph?
Moderator
Dependent
Independent
Control
86
When executing naturalistic observation, researchers
create a natural (control) groups
only work with non-human animals
manipulate the IV
do not manipulate any variables
87
When researchers "control" for a variable, they are trying to:
Reduce its influence as a confounder
Increase the generalizability
Ensure it's the dependent variable
Eliminate it from the data
88
The study that would best rule out chance factors would have a significance level of
P=0.001
P=0.05
P=0.08
P=0.01
89
Which of the following is a true experimental design?
Randomized control trial
Correlational design
One-group pretest-posttest design
case study
90
A small p-value (e.g., < .01) suggests:
The effect is weak
Strong evidence against the null hypothesis
No relationship exists
High variability in data
91
Which of the following is most concerned with ensuring a study's findings can be generalized to other settings?
Face validity
External validity
Statistical significance
Internal validity
92
A bimodal distribution denotes that the experiment most likely
observes 1 group with 2 DVs
has a normal distribution
observes 2 groups
the data is invalid
93
If you would correlate the wingspan of CACREP graduates and CPCE scores the results would likely be
close to 1.00
close to 0.00
about +0.70
close to -1.00
94
Which program evaluation model focuses on cost-effectiveness?
Logic model
CIPP
Outcome-based model
Cost-benefit analysis
95
Which of the following is a type of validity that evaluates whether a test looks like it measures what it says it does?
Criterion-related validity
Content validity
Face validity
Construct validity
96
The horizontal line under the data
plots the IV
all of the aboce
is known as the x-axis
represents that factor mainoulated by the experimentor
97
An N=1 design indicates
You should never use a sample of n=1
Single Subject Design
Case Study
Survey Research
98
Type I and Type II errors are called ___________ and _________ respectively
beta; alpha
0.01;0.05
a; b
alpha; beta
99
On the NCE (and this quiz) you will be expected not just to select a CORRECT answer but the ___________
BEST ANSWER
There will only be one plausible answer
100
a distribution with class intervals, like pre and post test scores, can be displayed using
a double-barred histogram
a genogram
a histogram
a sociogram
