SlideShare a Scribd company logo
2
Most read
3
Most read
10
Most read
Panel Data Models
Day 2, Lecture 2
By Ragui Assaad
Training on Applied Micro-Econometrics and
Public Policy Evaluation
July 25-27, 2016
Economic Research Forum
Pooled OLS and Its limitations
• An OLS estimation of panel data would look as follows
• 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝜃𝑇𝑖 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + 𝜀 𝑖𝑡
• To get consistent estimates of the parameters α, β,θ and γ
using this model, the following conditions must be satisfied:
1. Linearity with respect to independent variables Xit Tit and
2. Exogeneity. Expected value of disturbances eitis zero and the are
not correlated to any regressors (i.e. omitted variables are not
correlated with included variables)
3. Disturbances are independent and identically distributed, have the
same variance (homoscedasticity) and not related to each other
(non-auto-correlated)
4. Non-stochastic independent variables
5. No exact multi-collinearity among independent variables (full-rank)
If there are time-invariant individual effects ui≠ 0, this might violate
assumptions 2 and 3. Why?
eit
eit
Fixed and Random Effects Models
• Now we will allow for time-invariant individual effects.
• The model can be re-written in two ways
• Fixed effects: 𝑦𝑖𝑡 = 𝛼 + 𝑢𝑖 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + 𝜈𝑖𝑡
• Random effects: 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + (𝑢𝑖 + 𝜈𝑖𝑡)
• ui is either a fixed effect specific to each individual (which now includes
𝜃𝑇𝑖)
• Each individual has a different intercept, but all individual have the same slopes
• Error terms have constant variance and satisfy assumptions 2 and 3.
• ui can be correlated with the other regressorswithout causing bias
• ui is a random effect, i.e. part of an individual-specific random component
of the error term (error component model).
• Intercepts and slopes are constant across individuals
• However, in this case ui cannot be correlated with Xit or Tit if estimates of b and g
are to remain unbiased(this would violate assumption 2)
• Disturbances do not have constant variance, but are randomly distributed across
individuals
Fixed and random effects models
• If the original problem that panel data is supposed to
resolve is that unobserved time-invariant characteristics
are either correlated with the regressors or affect selection
into the sample, then a random effects model will not
solve the problem.
• A fixed effects model will solve the problem, so long as
the time-varying unobservables are not correlated with the
regressors.
Estimating Fixed Effects (FE) Model
• Fixed effect models can be estimated using the Least
Squares Dummy Variable Model (LSDV)
• This consists of including a dummy variable for each individual in
the data except for one (the reference)
• If the number of individuals is large and the number of period is
small we do not get consistent estimates of the fixed effects
themselves, but the other coefficients of the model are consistently
estimated.
• Alternative is the “within estimation” model
• Consists of taking differences across individuals and estimating
using these first differences
• “Within estimator” model produces wrong standard errors that must be
corrected
Estimating Random Effects (RE)
Models
• The RE model has the following composite errors
• Both components of the error term are assumed
independent of the included variables
• 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + (𝑢𝑖 + 𝜈𝑖𝑡)
• Because the model has two parts for the error, we obtain
two variance estimates su
2and sn
2
• The variances differs across individuals, making the
model heteroskedastic
• We therefore estimate the model using Generalized Least
Squares (GLS) instead of OLS
Testing the Fixed and Random Effects Models
Against the Pooled Cross Section model
• Since the FE model is simply an OLS model with
individual dummies added, it can be tested against the
pooled-cross section model using an F–test of the joint
significance of the dummies
• Testing the RE model again the pooled cross-section
model involves something called:
• The Breusch-Pagan Lagrange Multiplier Test
• This is essentially a c2 test with one degree of freedom that su
2=0
and therefore the composite errors can be reduced to regular IID
distributed errors
Testing FE vs. RE effects
• The null hypothesis of the test is that the individual unobserved
effects (the fixed effects and the random effects) are
uncorrelated with the included variables Xit
• If that hypothesis is rejected, FE is the preferred model because it is
consistent and RE is not
• It that null hypothesis is accepted both models are consistent, but RE
is more efficient and is therefore preferred
• The test compares the coefficient estimates from both models
and if they are jointly not significantly different from each other,
i.e., there is no detectable bias in RE (Null hypothesis is
accepted and RE is preferred.
A test that does that is the Hausman test
• Where
Testing Fixed Effects vs Random
Effects
• One problem with Hausman test is that W is not always
positive definite (i.e. some of the elements of var(FE) can
be lower than var(RE)) and we may incorrectly assume
that the null is not rejected.
Random Coefficients Model
• We allowed for either the intercept to differ (FE) or the variance
of the disturbances to differ (RE) across individuals, but what
about allowing the slopes (b) themselves to differ across
individuals?
• This would require a relatively large number of time periods T to allow
for estimation of a slope for each individual
• If we did this, the model would look like this
• Notice the i subscript on the b
• This model can be estimated using Hierarchical Linear Models
if there are enough time periods.
• There is a test to test it against the FE model. One basically conducts
a traditional Chow Test H0: bi=b
• . It is called a poolability test.
yit =a +ui + ¢Xitbi +vit

More Related Content

PPTX
ders 6 Panel data analysis.pptx
PPTX
Dummy variables
DOCX
Autocorrelation
PPT
Auto Correlation Presentation
PPT
Heteroskedasticity
PDF
Heteroscedasticity
PPTX
Multicollinearity PPT
PPTX
Econometrics chapter 5-two-variable-regression-interval-estimation-
ders 6 Panel data analysis.pptx
Dummy variables
Autocorrelation
Auto Correlation Presentation
Heteroskedasticity
Heteroscedasticity
Multicollinearity PPT
Econometrics chapter 5-two-variable-regression-interval-estimation-

What's hot (20)

PPTX
Heteroscedasticity | Eonomics
PDF
Panel slides
PPTX
Lesson 2 stationary_time_series
PPTX
Autocorrelation
PPT
Econometrics ch2
PDF
PPT
Multicollinearity
PPTX
Dummy variable model
DOCX
Dummy variable
PPT
Cointegration and error correction model
PPTX
Logit and Probit and Tobit model: Basic Introduction
PPTX
Multicolinearity
PPTX
Identification problem in simultaneous equations model
PPTX
ders 7.1 VAR.pptx
PDF
Econometric Method - Simultaneous equation model.pdf
PDF
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
PPTX
Heteroscedasticity
PPT
Autocorrelation- Remedial Measures
PPTX
regression assumption by Ammara Aftab
PDF
Introduction to regression analysis 2
Heteroscedasticity | Eonomics
Panel slides
Lesson 2 stationary_time_series
Autocorrelation
Econometrics ch2
Multicollinearity
Dummy variable model
Dummy variable
Cointegration and error correction model
Logit and Probit and Tobit model: Basic Introduction
Multicolinearity
Identification problem in simultaneous equations model
ders 7.1 VAR.pptx
Econometric Method - Simultaneous equation model.pdf
Advanced Econometrics by Sajid Ali Khan Rawalakot: 0334-5439066
Heteroscedasticity
Autocorrelation- Remedial Measures
regression assumption by Ammara Aftab
Introduction to regression analysis 2
Ad

Viewers also liked (20)

PDF
Difference-in-Difference Methods
PDF
Instrumental Variables and Control Functions
PDF
Propensity Score Matching Methods
PDF
Regression Discontinuity Method
PDF
Causal Inference and Program Evaluation
PDF
Overview and Objectives of the Workshop
PDF
Potential Solutions to the Fundamental Problem of Causal Inference: An Overview
PDF
Overview of Mixed Models
PDF
Multilevel Binary Logistic Regression
PPTX
How do we do research in economics
PPTX
Panel data analysis
PDF
Lessons for Democratic Transition in the Arab World
PDF
Democracy, Elections, and Development
PDF
How to make democratic accountability work better for development?
PDF
Forms of Democracy and Development
PDF
Culture and democratization
PDF
The Arab Spring: Much Violence, Little Democracy
PDF
Panel data analysis
PPT
Blasting 10 Big Data Myths with 10 Panel Data Examples
PDF
Empirical Applications of Collective Household Labour Supply Models in Iraq
Difference-in-Difference Methods
Instrumental Variables and Control Functions
Propensity Score Matching Methods
Regression Discontinuity Method
Causal Inference and Program Evaluation
Overview and Objectives of the Workshop
Potential Solutions to the Fundamental Problem of Causal Inference: An Overview
Overview of Mixed Models
Multilevel Binary Logistic Regression
How do we do research in economics
Panel data analysis
Lessons for Democratic Transition in the Arab World
Democracy, Elections, and Development
How to make democratic accountability work better for development?
Forms of Democracy and Development
Culture and democratization
The Arab Spring: Much Violence, Little Democracy
Panel data analysis
Blasting 10 Big Data Myths with 10 Panel Data Examples
Empirical Applications of Collective Household Labour Supply Models in Iraq
Ad

Similar to Panel Data Models (20)

PPT
FE3.ppt
PPT
Intro to ecm models and cointegration.ppt
PDF
Ch_17_Wooldridge_6e_PPT_Updated.pdf.pdf
PPT
rzStructural_Equation_Modeling.ppt ok this is AMOS
PDF
Structural equation modeling BY Abdul Rahim Chandio
PPT
Econometric model ing
PPTX
Specification Errors | Eonomics
PPTX
Presentation1.econometrics 2 by habtamuu
PPTX
Essex-Quantitative-Methods-Lecture-6.pptx
PPSX
Viva extented final
PPT
Diagnostic Tests.ppt
PPTX
Types of models
PDF
Mixed Effects Models - Fixed Effect Interactions
PPT
A presentation for Multiple linear regression.ppt
PDF
Ch 10. SEM Structural Equation Modelling
PPTX
Chapter8_Final.pptxkhnhkjllllllllllllllllllllllllllllllllllllllllllllllllllll...
PPT
Lecture 10.ppt
PPTX
10. SEM Models_JASP.pptx00000000000000000
PDF
Factor Analysis - Statistics
PPT
Ch11 slides
FE3.ppt
Intro to ecm models and cointegration.ppt
Ch_17_Wooldridge_6e_PPT_Updated.pdf.pdf
rzStructural_Equation_Modeling.ppt ok this is AMOS
Structural equation modeling BY Abdul Rahim Chandio
Econometric model ing
Specification Errors | Eonomics
Presentation1.econometrics 2 by habtamuu
Essex-Quantitative-Methods-Lecture-6.pptx
Viva extented final
Diagnostic Tests.ppt
Types of models
Mixed Effects Models - Fixed Effect Interactions
A presentation for Multiple linear regression.ppt
Ch 10. SEM Structural Equation Modelling
Chapter8_Final.pptxkhnhkjllllllllllllllllllllllllllllllllllllllllllllllllllll...
Lecture 10.ppt
10. SEM Models_JASP.pptx00000000000000000
Factor Analysis - Statistics
Ch11 slides

More from Economic Research Forum (20)

PPTX
Session 4 farhad mehran, single most data gaps
PDF
Session 3 mahdi ben jelloul, microsimulation for policy evaluation
PDF
Session 3 m.a. marouani, structual change, skills demand and job quality
PPTX
Session 3 ishac diwn, bridging mirco and macro appraoches
PDF
Session 3 asif islam, jobs flagship report
PPTX
Session 2 yemen hlel, insights from tunisia
PPT
Session 2 samia satti, insights from sudan
PPTX
Session 2 mona amer, insights from egypt
PPTX
Session 2 ali souag, insights from algeria
PPTX
Session 2 abdel rahmen el lahga, insights from tunisia
PPTX
Session 1 ragui assaad, moving beyond the unemployment rate
PPTX
Session 1 luca fedi, towards a research agenda
PDF
من البيانات الى السياسات : مبادرة إتاحة البيانات المنسقة
PPTX
The Future of Jobs is Facing the Biggest Policy Induced Price Distortion in H...
PPTX
Job- Creating Growth in the Emerging Global Economy
PPTX
The Role of Knowledge in the Process of Innovation in the New Global Economy:...
PPTX
Rediscovering Industrial Policy for the 21st Century: Where to Start?
PPTX
How the Rise of the Intangibles Economy is Disrupting Work in Africa
PPTX
On Ideas and Economic Policy: A Survey of MENA Economists
PPTX
Future Research Directions for ERF
Session 4 farhad mehran, single most data gaps
Session 3 mahdi ben jelloul, microsimulation for policy evaluation
Session 3 m.a. marouani, structual change, skills demand and job quality
Session 3 ishac diwn, bridging mirco and macro appraoches
Session 3 asif islam, jobs flagship report
Session 2 yemen hlel, insights from tunisia
Session 2 samia satti, insights from sudan
Session 2 mona amer, insights from egypt
Session 2 ali souag, insights from algeria
Session 2 abdel rahmen el lahga, insights from tunisia
Session 1 ragui assaad, moving beyond the unemployment rate
Session 1 luca fedi, towards a research agenda
من البيانات الى السياسات : مبادرة إتاحة البيانات المنسقة
The Future of Jobs is Facing the Biggest Policy Induced Price Distortion in H...
Job- Creating Growth in the Emerging Global Economy
The Role of Knowledge in the Process of Innovation in the New Global Economy:...
Rediscovering Industrial Policy for the 21st Century: Where to Start?
How the Rise of the Intangibles Economy is Disrupting Work in Africa
On Ideas and Economic Policy: A Survey of MENA Economists
Future Research Directions for ERF

Recently uploaded (20)

PDF
PPT - Primary Rules of Interpretation (1).pdf
PPTX
The DFARS - Part 250 - Extraordinary Contractual Actions
PPT
Quality Management Ssystem PPT - Introduction.ppt
PPT
Adolescent Health Orientation and Health care
DOCX
Empowering Citizens Through Digital Portals.docx
PDF
2026 RMHC Terms & Conditions agreement - updated 8.1.25.pdf
PDF
Environmental Management Basics 2025 for BDOs WBCS by Samanjit Sen Gupta.pdf
PPTX
STG - Sarikei 2025 Coordination Meeting.pptx
PDF
Strategic Planning for Child Rights and Protection Programming.pdf
PDF
ISO-9001-2015-gap-analysis-checklist-sample.pdf
PDF
Item # 2 - 934 Patterson Specific Use Permit (SUP)
PDF
मुख्यमंत्राी सामूहिक विवाह कार्यक्रम, जनपद बाँदा
PPTX
Social_Medias_Parents_Education_PPT.pptx
PDF
ISO-9001-2015-internal-audit-checklist2-sample.pdf
PDF
Courtesy Meeting NIPA and MBS Australia.
PDF
Bambang PWD Easter Egg Hunting 2025
PDF
Population Estimates 2025 Regional Snapshot 08.11.25
PPTX
Introduction_to_the_Study_of_Globalization.pptx
PPTX
Nur Shakila Assesmentlwemkf;m;mwee f.pptx
PDF
Strategic Planning 2025-2026 (Bambang PWD Association, Inc.)
PPT - Primary Rules of Interpretation (1).pdf
The DFARS - Part 250 - Extraordinary Contractual Actions
Quality Management Ssystem PPT - Introduction.ppt
Adolescent Health Orientation and Health care
Empowering Citizens Through Digital Portals.docx
2026 RMHC Terms & Conditions agreement - updated 8.1.25.pdf
Environmental Management Basics 2025 for BDOs WBCS by Samanjit Sen Gupta.pdf
STG - Sarikei 2025 Coordination Meeting.pptx
Strategic Planning for Child Rights and Protection Programming.pdf
ISO-9001-2015-gap-analysis-checklist-sample.pdf
Item # 2 - 934 Patterson Specific Use Permit (SUP)
मुख्यमंत्राी सामूहिक विवाह कार्यक्रम, जनपद बाँदा
Social_Medias_Parents_Education_PPT.pptx
ISO-9001-2015-internal-audit-checklist2-sample.pdf
Courtesy Meeting NIPA and MBS Australia.
Bambang PWD Easter Egg Hunting 2025
Population Estimates 2025 Regional Snapshot 08.11.25
Introduction_to_the_Study_of_Globalization.pptx
Nur Shakila Assesmentlwemkf;m;mwee f.pptx
Strategic Planning 2025-2026 (Bambang PWD Association, Inc.)

Panel Data Models

  • 1. Panel Data Models Day 2, Lecture 2 By Ragui Assaad Training on Applied Micro-Econometrics and Public Policy Evaluation July 25-27, 2016 Economic Research Forum
  • 2. Pooled OLS and Its limitations • An OLS estimation of panel data would look as follows • 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝜃𝑇𝑖 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + 𝜀 𝑖𝑡 • To get consistent estimates of the parameters α, β,θ and γ using this model, the following conditions must be satisfied: 1. Linearity with respect to independent variables Xit Tit and 2. Exogeneity. Expected value of disturbances eitis zero and the are not correlated to any regressors (i.e. omitted variables are not correlated with included variables) 3. Disturbances are independent and identically distributed, have the same variance (homoscedasticity) and not related to each other (non-auto-correlated) 4. Non-stochastic independent variables 5. No exact multi-collinearity among independent variables (full-rank) If there are time-invariant individual effects ui≠ 0, this might violate assumptions 2 and 3. Why? eit eit
  • 3. Fixed and Random Effects Models • Now we will allow for time-invariant individual effects. • The model can be re-written in two ways • Fixed effects: 𝑦𝑖𝑡 = 𝛼 + 𝑢𝑖 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + 𝜈𝑖𝑡 • Random effects: 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + (𝑢𝑖 + 𝜈𝑖𝑡) • ui is either a fixed effect specific to each individual (which now includes 𝜃𝑇𝑖) • Each individual has a different intercept, but all individual have the same slopes • Error terms have constant variance and satisfy assumptions 2 and 3. • ui can be correlated with the other regressorswithout causing bias • ui is a random effect, i.e. part of an individual-specific random component of the error term (error component model). • Intercepts and slopes are constant across individuals • However, in this case ui cannot be correlated with Xit or Tit if estimates of b and g are to remain unbiased(this would violate assumption 2) • Disturbances do not have constant variance, but are randomly distributed across individuals
  • 4. Fixed and random effects models • If the original problem that panel data is supposed to resolve is that unobserved time-invariant characteristics are either correlated with the regressors or affect selection into the sample, then a random effects model will not solve the problem. • A fixed effects model will solve the problem, so long as the time-varying unobservables are not correlated with the regressors.
  • 5. Estimating Fixed Effects (FE) Model • Fixed effect models can be estimated using the Least Squares Dummy Variable Model (LSDV) • This consists of including a dummy variable for each individual in the data except for one (the reference) • If the number of individuals is large and the number of period is small we do not get consistent estimates of the fixed effects themselves, but the other coefficients of the model are consistently estimated. • Alternative is the “within estimation” model • Consists of taking differences across individuals and estimating using these first differences • “Within estimator” model produces wrong standard errors that must be corrected
  • 6. Estimating Random Effects (RE) Models • The RE model has the following composite errors • Both components of the error term are assumed independent of the included variables • 𝑦𝑖𝑡 = 𝛼 + 𝛽𝑋𝑖𝑡 + 𝛾𝑇𝑖 𝑡 + 𝛿𝑡 + (𝑢𝑖 + 𝜈𝑖𝑡) • Because the model has two parts for the error, we obtain two variance estimates su 2and sn 2 • The variances differs across individuals, making the model heteroskedastic • We therefore estimate the model using Generalized Least Squares (GLS) instead of OLS
  • 7. Testing the Fixed and Random Effects Models Against the Pooled Cross Section model • Since the FE model is simply an OLS model with individual dummies added, it can be tested against the pooled-cross section model using an F–test of the joint significance of the dummies • Testing the RE model again the pooled cross-section model involves something called: • The Breusch-Pagan Lagrange Multiplier Test • This is essentially a c2 test with one degree of freedom that su 2=0 and therefore the composite errors can be reduced to regular IID distributed errors
  • 8. Testing FE vs. RE effects • The null hypothesis of the test is that the individual unobserved effects (the fixed effects and the random effects) are uncorrelated with the included variables Xit • If that hypothesis is rejected, FE is the preferred model because it is consistent and RE is not • It that null hypothesis is accepted both models are consistent, but RE is more efficient and is therefore preferred • The test compares the coefficient estimates from both models and if they are jointly not significantly different from each other, i.e., there is no detectable bias in RE (Null hypothesis is accepted and RE is preferred. A test that does that is the Hausman test • Where
  • 9. Testing Fixed Effects vs Random Effects • One problem with Hausman test is that W is not always positive definite (i.e. some of the elements of var(FE) can be lower than var(RE)) and we may incorrectly assume that the null is not rejected.
  • 10. Random Coefficients Model • We allowed for either the intercept to differ (FE) or the variance of the disturbances to differ (RE) across individuals, but what about allowing the slopes (b) themselves to differ across individuals? • This would require a relatively large number of time periods T to allow for estimation of a slope for each individual • If we did this, the model would look like this • Notice the i subscript on the b • This model can be estimated using Hierarchical Linear Models if there are enough time periods. • There is a test to test it against the FE model. One basically conducts a traditional Chow Test H0: bi=b • . It is called a poolability test. yit =a +ui + ¢Xitbi +vit