represents the NUMBER of items answered correctly, is expressed in units by which it was originally obtained

The first step in conducting a program evaluation is to:

Identify stakeholders and goals

Which method is best for determining the predictive validity of a new college readiness assessment?

Correlation with GPA after one semester

Which of the following is a limitation of using self-report measures in research?

Demand characteristics and social desirability bias

A small p-value (e.g., < .01) suggests:

Strong evidence against the null hypothesis

An action research model is best used when:

Solving a local problem in real-time

Which of the following will yield the closet to a perfect correlation

length in inches and length in centimeters

Experimental is to cause and effect as CORRELATIONAL is to _______

degree (strength and direction) of relationship

What is the purpose of random assignment in experimental research?

Control for confounding variables

What does the term "internal validity" refer to in a research study?

study measures what it intends to measure without interference from ext

the middle score when data is arranged from highest to lowest

Summative evaluation is primarily used to:

Determine program effectiveness

What is the main difference between experimental and quasi-experimental research designs?

The ability to use random sampling

a distribution with class intervals, like pre and post test scores, can be displayed using

a histogram, a double-barred histogram

If a researcher sets an alpha level at .05, they are:

Accepting a 5% chance of Type I error

When executing naturalistic observation, researchers

do not manipulate any variables

A Type I error occurs when:

A true null hypothesis is rejected

Which of the following is a strength of a longitudinal study compared to a cross-sectional study?

Longitudinal studies collect data over time to demonstrate correlation

Raising the significance level does all the following EXCEPT:

adjusting the P value from 0.05 to 0.02

studbud

Research, Statistics & Program Eval Quiz

100 termsStudBud Administration

Test your knowledge on descriptive statistics, scales of measurement, central tendency, and more

Flashcards100 cardsFPractice quizPHost liveL

Questions 100

Answers

1
A Raw score
represents the NUMBER of items answered correctly
shows PERCENTAGE of items answered correctly
shows PERECENTILE
is expressed in units by which it was originally obtained
2
The mean falls on the ______ stanine
9th
3rd
5th
1st
3
Effect size measures:
Confidence intervals
Practical significance
Statistical significance
Sampling error
4
In qualitative research, credibility is most similar to what quantitative concept?
Validity
Reliability
Generalizability
Significance
5
This type of scale has NO true 0 point
Ordinal
Nominal
Interval
Ratio
6
The first step in conducting a program evaluation is to:
Analyze outcomes
Identify stakeholders and goals
Collect qualitative data
Submit findings to IRB
7
A line of best fit is most commonly referred to as a ____________
Correlation coefficient
Regression Line
Slope
none of these answers
8
Which method is best for determining the predictive validity of a new college readiness assessment?
Test-retest correlation
Cronbach’s alpha
Correlation with GPA after one semester
Content analysis
9
Dr. Y completed research that shows that many students who obtain NCC status become behaviorally oriented. This shows
Correlation
Causation
10
Which of the following is a limitation of using self-report measures in research?
Objective scoring
Demand characteristics and social desirability bias
High reliability
Large sample access
11
Scores that fall just outside of -3 or +3 standard deviations from the mean are
+/- 3 percentage points from the mean
all very low
relatively average
extreme
12
A small p-value (e.g., < .01) suggests:
The effect is weak
High variability in data
Strong evidence against the null hypothesis
No relationship exists
13
A bell curve with an abundance of low scores is_______
negatively skewed
positively skewed
14
Descriptive Statistics summarize data by using all the following but:
Hypothesis Testing
Mean
Standard Deviation
Measures of central tendency
15
An action research model is best used when:
Testing a hypothesis in a lab
Conducting meta-analysis
Exploring a national trend
Solving a local problem in real-time
16
Which of the following will yield the closet to a perfect correlation
length in inches and length in centimeters
ICD diagnosis and salary
height and weight
IQ and salary
17
Experimental is to cause and effect as CORRELATIONAL is to _______
degree (strength and direction) of relationship
N=1 Design
Ex-Post Facto research only
Blind Studies
18
What is the purpose of random assignment in experimental research?
Collect more data
Control for confounding variables
Increase external validity
Ensure data is generalizable
19
Pearson R is to interval and ratio data as Spearman Rho is to _________
Nominal
Ordinal
20
If you're a behaviorist using an N=1 design, your first step should be
find a sample or similar indviduals for generalization
none of the above
decide on a non parametric statistical test
obtain a baseline
21
Reliability refers to:
Consistency of measurement
Whether a test measures what it's supposed to
Utility of a test
Accuracy of a measure
22
What does the term "internal validity" refer to in a research study?
a study's results can be generalized to other populations or settings.
study measures what it intends to measure without interference from ext
The accuracy of the study's findings when tested in a real-world setting.
The consistency of the study's results across different time periods.
23
The study that would best rule out chance factors would have a significance level of
P=0.08
P=0.01
P=0.05
P=0.001
24
On the NCE (and this quiz) you will be expected not just to select a CORRECT answer but the ___________
There will only be one plausible answer
BEST ANSWER
25
The median is
the most-frequent value obtained
never more useful than the mean
the middle score when data is arranged from highest to lowest
the arithmetic average
26
If an experiment can be replicated by others with near identical findings, the experiment is
impacted by observer effect
depicts high error variance
said to be reliable
depicts true variance
27
If the data are skewed right, the mean will be:
Unaffected
Less than the median
Equal to the median
Greater than the median
28
Summative evaluation is primarily used to:
Identify implementation barriers
Improve program delivery
Determine program effectiveness
Guide fidelity assessments
29
What is the main difference between experimental and quasi-experimental research designs?
collecting interval or ratio data
The ability to use random sampling
normal distribution
the use of a control group
30
a distribution with class intervals, like pre and post test scores, can be displayed using
a histogram
a sociogram
a genogram
a double-barred histogram
31
When correlational data describes the nature of 2 variables the term _______ is utilized
bivariate
variate
multivariate
dual-variate
32
Which is an example of an ordinal scale?
Class rank
IQ
Temperature
Weight
33
A sociogram is to a counseling group as a scattergram is to ____________
the range
a histogram
the correlation coefficient
The normal curve
34
If you would correlate the wingspan of CACREP graduates and CPCE scores the results would likely be
about +0.70
close to 0.00
close to 1.00
close to -1.00
35
What is the mean of the following set: 3, 5, 5, 7, 10?
5
10
6
7
36
Which of the following is a non-parametric test?
ANOVA
Pearson’s r
T-test
Chi-square
37
Which type of reliability is assessed by giving the same test to the same group at two different times?
Internal consistency
Split-half reliability
Test-retest reliability
Inter-rater reliability
38
If a researcher sets an alpha level at .05, they are:
Ensuring 95% confidence in the results
Accepting a 5% chance of Type II error
Accepting a 5% chance of Type I error
Eliminating sampling error
39
Which correlation coefficient depicts the strongest correlation
-0.8
0.3
0.7
0.01
40
The independent variable is best defined as:
The manipulated variable
The measured outcome
The variable that changes naturally
The variable held constant
41
When executing naturalistic observation, researchers
manipulate the IV
only work with non-human animals
do not manipulate any variables
create a natural (control) groups
42
Type II Error occurs when you
accept a false null
reject a true null
there's a beta error
you do not test for significance
43
A Type I error occurs when:
A true null hypothesis is rejected
A sample is too small
Data is not normally distributed
A false null hypothesis is accepted
44
Which statistic is used for pre/post testing with the same group?
Paired samples t-test
Independent samples t-test
Chi-square
ANOVA
45
Which is the best measure of central tendency for skewed data?
Mode
Median
Mean
Standard deviation
46
Formative evaluation occurs:
Only in clinical settings
During program implementation
After a program ends
Only with qualitative methods
47
What measure of central tendency is the most stable DESPITE extreme scores
Median
Mean
Standard Deviation
Mode
48
Which of the following is a strength of a longitudinal study compared to a cross-sectional study?
Cross-sectional studies provide more accurate data about trends over time
Longitudinal studies collect data from different populations at one time
Longitudinal studies are quicker and less expensive to conduct
Longitudinal studies collect data over time to demonstrate correlation
49
Control Group: 0 IV intervention; Group A: 4 IV interventions; Group B: 8 IV interventions. The researcher should use:
t-test
a two-way ANOVA
ANOVA
a MANOVA
50
Type I Error occurs when you
you do not test for significance
there's a beta error
accept a false null
reject a true null
51
Raising the significance level does all the following EXCEPT:
increases the probability of alpha errors
adjusting the P value from 0.02 to 0.05
adjusting the P value from 0.05 to 0.02
increasing the probability of finding statistical significance(true affect)
52
A logic model typically includes all EXCEPT:
Inputs
Sampling error
Outputs
Outcomes
53
Which of the following indicates a strong positive correlation?
r = 0.03
r = 0.70
r = –0.01
r = –0.65
54
Which term describes the degree to which an intervention is delivered as intended?
Fidelity
Reliability
Validity
Internal consistency
55
An IQ of 101 would fall between
all of the above
the mean and Z=-1
z=-1 and z=-3
the mean and Z= +1
56
Which sampling method gives every individual an equal chance of being selected?
Simple random sampling
Snowball
Stratified
Convenience
57
Which level of significance would best rule out chance factors?
0.001
0.01
0.2
0.05
58
When researchers "control" for a variable, they are trying to:
Ensure it's the dependent variable
Increase the generalizability
Eliminate it from the data
Reduce its influence as a confounder
59
Regardless of the distribution the _____ will always be the highest point when graphically displayed
mean
median
mode
R
60
Neither clients nor researcher knew which group received the drug and which recieved the placebo. This was a
Double Blind
Typical AB Design
Factorial Design
Single Blind Study
61
A horse that is categorized as "2nd" place in a race represents a(n)
ratio scale
interval scale
Nominal scale
ordinal scale
62
Which of the following is a type of validity that evaluates whether a test looks like it measures what it says it does?
Content validity
Construct validity
Face validity
Criterion-related validity
63
The horizontal line under the data
represents that factor mainoulated by the experimentor
all of the aboce
plots the IV
is known as the x-axis
64
The p-value tells us:
The size of the effect
The probability of results occurring by chance
The direction of the relationship
How large the sample is
65
Which approach is most appropriate to understand multicultural client outcomes across settings?
Experimental design
Meta-analysis
Grounded theory
Single case study
66
Type I and Type II errors are called ___________ and _________ respectively
alpha; beta
a; b
beta; alpha
0.01;0.05
67
Which is NOT a threat to internal validity?
Selection bias
External validity
Maturation
Instrumentation
68
The Beck Depression Inventory (BDI) is an example of a:
Standardized self-report inventory
Qualitative interview
Physiological measure
Projective test
69
Student who study a lot get higher scores on the NCE. This represents a ________ correlation
negative
0.00
positive
the question does not provide enough data
70
Standard deviation is a measure of:
The average score
Central tendency
Reliability
Variability
71
A Norm Referenced score compares an individuals score to
The norm score using a different measure
score(s) from a norm group
other individual scores in the study
an external criterion
72
If a researcher changes the significance level from 0.05 to 0.001
no impact on type I and type II errors
alpha and beta errors increasse
alphaerrors increase but beta errors decrease
alpha errors decrease; beta errors increase
73
Z-scores....
typically range from -2, +2
determine the correlation coefficient between IVs and DVs
determine probabilities in NON-normal distributions
show the number of standard deviations a value is from the mean
74
Which of the following research types most values thick description and reflexivity?
Quantitative
Qualitative
Experimental
Survey
75
the most useful measure of central tendency is _____
Median
Mode
Standard Deviation
The mean
76
Which ethical principle requires researchers to protect participants from harm?
Justice
Fidelity
Beneficence
Autonomy
77
what percentage of data falls within the mean and z=-2
34%
13%
48%
68%
78
To compare the data from a control and experimental group the researcher will use
a correlation coefficient
a test for significance
percentile rank
descriptive statistics
79
Which of the following would likely require IRB approval?
Interviewing clients for a published article
An in-class demonstration
A literature review
A classroom project with anonymous surveys
80
The main difference of a MANOVA and ANOVA
A MANOVA analyzes the impact of multiple IVs on mutliple DVs
an anova measures multiple independent variable
81
Which variable is typically placed on the x-axis of a graph?
Control
Dependent
Independent
Moderator
82
P=0.05 really means that
differences truly exist; experimenter will obtain same result 99/100 times
differences truly exist; experimenter will obtain same result 95/100 times
95% error factor
10% error factor
83
A bimodal distribution denotes that the experiment most likely
observes 1 group with 2 DVs
has a normal distribution
observes 2 groups
the data is invalid
84
A T score must ________ critical T to be considered statistically significant
Equate to
not exceed
exceed
be the inverse of
85
The range of scores in a 153 person class would likely be _________ the range of scores in a 77 person class
less than
greater than
not enough information
equal to
86
Which research method is most appropriate to explore lived experiences of clients in recovery?
Phenomenological research
Survey research
Longitudinal study
Experimental design
87
Factors that can threaten internal validity include all the following except
History
Maturation
Confounding variables
Situation Effect
88
An N=1 design indicates
Survey Research
Case Study
You should never use a sample of n=1
Single Subject Design
89
A bell curve with an abundance of high scores is_______
negatively skewed
positively skewed
90
If an experimentor is looking to ferret out the effects of more than 1 IV, they will use
Factorial Design
Pearson R
Spearman Rank order Rho
Solomon four-group
91
Which of the following indicates the strongest evidence of a treatment’s effectiveness?
Quasi-experiment
RCT (Randomized Control Trial)
Case study
Correlational study
92
Unconsciously rating attractive female as better counselors is most attributable to
Sexism
The Recency effect
The Halo Effect
The Hawthorne Effect
93
The Belmont Report outlines all of the following principles EXCEPT:
Respect for persons
Confidentiality
Beneficence
Justice
94
Which research design tracks participants over time?
Experimental
Meta-analysis
Cross-sectional
Longitudinal
95
Which of the following is most concerned with ensuring a study's findings can be generalized to other settings?
Face validity
Internal validity
External validity
Statistical significance
96
Which type of variable can take on only specific, separate values (e.g., number of clients)?
Nominal
Discrete
Continuous
Ordinal
97
Which of the following is a true experimental design?
Correlational design
Randomized control trial
One-group pretest-posttest design
case study
98
An experimenters beliefs leading to specific treatment and yielding hypothesized results is most attributable to
Hawthorne Effect
Halo effect
Rosenthal Effect
Observer bias
99
Which statistic is most appropriate for determining relationships between two continuous variables?
Chi-square
ANOVA
T-test
Pearson correlation
100
Which program evaluation model focuses on cost-effectiveness?
Outcome-based model
CIPP
Logic model
Cost-benefit analysis

Research, Statistics & Program Eval Quiz Flashcards | StudBud