SlideShare a Scribd company logo
ERF Training Workshop
Panel Data 4
Raimundo Soto
Instituto de Economía, PUC-Chile
FIRST-DIFFERENCES ESTIMATOR
• Another alternative to tackle the heterogeneity
problem of 𝑦𝑖𝑡 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡 consists in first-
differencing the model
𝑦𝑖𝑡 − 𝑦𝑖𝑡−1 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡 − 𝛼𝑖 + 𝛽𝑥𝑖𝑡−1 + 𝜀𝑖𝑡−1
∆𝑦𝑖𝑡= 𝛽∆𝑥𝑖𝑡 + ∆𝜀𝑖𝑡
• Hence, the first-difference estimator is simply
𝛽 𝐹𝐷 = ∆𝑥𝑖𝑡′∆𝑥𝑖𝑡
−1∆𝑥𝑖𝑡′∆𝑦𝑖𝑡
2
FIRST-DIFFERENCES ESTIMATOR
• This estimator is consistent if 𝐸[𝑥𝑖𝑡 𝜀𝑖𝑡] = 0 but slightly less
efficient than the within estimator
– Notice: the restriction is 𝐸 𝑥𝑖𝑡 𝜀𝑖𝑡 and the exogeneity of 𝑥𝑖𝑡 is not
needed as is the case in the within estimator (e.g., it allows for
correlation between 𝑥𝑖𝑡 y 𝜀𝑖𝑡−2).
• Notice that the residual ∆𝜀𝑖𝑡 is autocorrelated even if 𝜀𝑖𝑡 is
not. Thus t-statistics are distorted
• All information on non-time varying variables is lost.
• First observation of each individual is lost
3
FIRST-DIFFERENCES ESTIMATOR RESULTS
4
_cons .0337766 .0045505 7.42 0.000 .0248557 .0426975
D1. -.0998219 .1910678 -0.52 0.601 -.4743976 .2747537
l_popt
D1. -.0134668 .0029968 -4.49 0.000 -.0193419 -.0075917
l_infl2
D1. -.2939159 .0468332 -6.28 0.000 -.3857292 -.2021026
l_realgdp
D.l_money Coef. Std. Err. t P>|t| [95% Conf. Interval]
Total 162.369352 5064 .032063458 Root MSE = .17805
Adj R-squared = 0.0113
Residual 160.435782 5061 .031700411 R-squared = 0.0119
Model 1.93357008 3 .644523359 Prob > F = 0.0000
F( 3, 5061) = 20.33
Source SS df MS Number of obs = 5065
5
* p<0.1, ** p<0.05, *** p<0.01
t statistics in parentheses
Observations 5436 5436 5436 5436 5065
(39.10) (-31.67) (5.14) (-18.82) (7.42)
Constant 3.315*** -7.845*** 2.450*** -4.160*** 0.0338***
(-0.52)
D.Population -0.0998
(-4.49)
D.Inflation -0.0135***
(-6.28)
D.Real GDP -0.294***
(0.24) (2.56) (0.30) (2.62)
Population 0.00144 0.0732** 0.00875 0.0564***
(-20.94) (-5.92) (-6.24) (-7.92)
Inflation -0.165*** -0.0281*** -0.406*** -0.0403***
(-2.36) (25.09) (-0.37) (21.47)
Real GDP -0.00867** 0.385*** -0.00630 0.258***
Pooled Within Between Random FirstDif
(1) (2) (3) (4) (5)
FIT
• The R2 statistics is valid to undertake comparisons
between the pooled model pooled and the fixed effects
model.
• Using R2 statistics to undertake comparisons between the
fixed effects model and the random effects model is invalid,
because the individual effects 𝛼𝑖 are random variables in
FE but are part of the error term in the RE model.
6
HETEROSKEDASTICITY TESTS
• We would like to test whether 𝜎2
(i) = 𝜎2
, for all 𝑖 = 1, … , 𝑁
• This only makes sense in the fixed effects model
7
Prob>chi2 = 0.0000
chi2 (163) = 3.3e+05
H0: sigma(i)^2 = sigma^2 for all i
in fixed effect regression model
Modified Wald test for groupwise heteroskedasticity
. xttest3
It is heteroskedastic
UNBALANCED PANELS
• When dealing with the estimation of the model
𝑦𝑖𝑡 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡
We tacitly assumed that we observed data for 𝑖 =
1, … 𝑁 at each instant of time 𝑡 = 1, … , 𝑇
• What if there are missing data?
– It depends on how the data got lost
8
UNBALANCED PANELS
• From a mechanic point of view, the within estimator is
not sensitive to missing data, since as long as you can
compute:
𝑆 𝑤
𝑥𝑥
=
𝑖=1
𝑁
𝑡=1
𝑇
𝑥𝑖𝑡 − 𝑥𝑖 ′ 𝑥𝑖𝑡 − 𝑥𝑖
𝑆 𝑤
𝑥𝑦
=
𝑖=1
𝑁
𝑡=1
𝑇
𝑥𝑖𝑡 − 𝑥𝑖 ′ 𝑦𝑖𝑡 − 𝑦𝑖
You can obtain:
𝛽 𝑤 =
𝑆 𝑤
𝑥𝑦
𝑆 𝑤
𝑥𝑥
9
UNBALANCED PANELS
• Computing the estimator is not the main issue, but why data is
missing.
• Let 𝑠𝑖𝑡 indicate if one observation exists or is missing. That is
𝑠𝑖𝑡 takes value 1 if the observation exists and 0 otherwise.
• Let us remove the mean of each individual using the available
data;
𝑦𝑖𝑡 = 𝑦𝑖𝑡 −
1
𝑇 𝑖
𝑟=1
𝑇
𝑠𝑖𝑟 𝑦𝑖𝑟 𝑥𝑖𝑡 = 𝑥𝑖𝑡 −
1
𝑇 𝑖
𝑟=1
𝑇
𝑠𝑖𝑟 𝑥𝑖𝑟
𝑇𝑖 =
𝑡=1
𝑇
𝑠𝑖𝑡
10
UNBALANCED PANELS
• The FE estimator is
𝛽 𝑤 = (𝑁𝑇)−1 𝑥𝑖𝑡´ 𝑥𝑖𝑡
−1
(𝑁𝑇)−1 𝑥𝑖𝑡´ 𝑦𝑖𝑡
= 𝑁−1
𝑖=1
𝑁
𝑡=1
𝑇
𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑥𝑖𝑡
−1
𝑁−1
𝑖=1
𝑁
𝑡=1
𝑇
𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑦𝑖𝑡
= 𝛽 + 𝑁−1
𝑖=1
𝑁
𝑡=1
𝑇
𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑥𝑖𝑡
−1
𝑁−1
𝑖=1
𝑁
𝑡=1
𝑇
𝑠𝑖𝑡 𝑥𝑖𝑡´𝜀𝑖𝑡
11
UNBALANCED PANELS
• The FE estimator will be consistent if and only if
𝑝𝑙𝑖𝑚 𝑁−1
𝑖=1
𝑁
𝑡=1
𝑇
𝑠𝑖𝑡 𝑥𝑖𝑡´𝜀𝑖𝑡 = 0
• It requires no correlation between 𝑥𝑖𝑡 and 𝜀𝑖𝑡
• It requires no correlation between 𝑠𝑖𝑡 and 𝜀𝑖𝑡. That is:
– The nature of heterogeneity must be uncorrelated to choice
– Feedback must be absent for choice to be exogenous
• In summary, E(𝛼) must not depend on 𝑠𝑖𝑡
12

More Related Content

PPTX
ERF Training Workshop Panel Data 3
PPTX
Static Models of Continuous Variables
PPTX
ERF Training Workshop Panel Data 5
PDF
Some study materials
PPTX
Probability Distribution
PPT
Admission in India
PPT
Hypergeometric distribution
PPT
Statistics
ERF Training Workshop Panel Data 3
Static Models of Continuous Variables
ERF Training Workshop Panel Data 5
Some study materials
Probability Distribution
Admission in India
Hypergeometric distribution
Statistics

What's hot (15)

PPTX
PDF
Lecture 01 probability distributions
PPT
Chap12 simple regression
PPTX
Introduction to Regression Analysis
PDF
Scatter diagrams
PPTX
Chap12 multiple regression
PDF
Applied Business Statistics ,ken black , ch 3 part 2
PDF
Applied Business Statistics ,ken black , ch 6
PPTX
Simple linear regression and correlation
PDF
Applied Business Statistics ,ken black , ch 5
PPTX
PPTX
Standard normal distribution
PDF
Simple & Multiple Regression Analysis
PDF
Project2
PPTX
Chapter9 the normal curve distribution
Lecture 01 probability distributions
Chap12 simple regression
Introduction to Regression Analysis
Scatter diagrams
Chap12 multiple regression
Applied Business Statistics ,ken black , ch 3 part 2
Applied Business Statistics ,ken black , ch 6
Simple linear regression and correlation
Applied Business Statistics ,ken black , ch 5
Standard normal distribution
Simple & Multiple Regression Analysis
Project2
Chapter9 the normal curve distribution
Ad

Similar to ERF Training Workshop Panel Data 4 (20)

PPTX
Chapter 3_M of Location and dispersion mean, median, mode, standard deviation
PPT
Exploratory Data Analysis EFA Factor analysis
PDF
Systematics Lecture: Phenetics
PDF
Biostatistics CH Lecture Pack
PPTX
Estimating Tail Parameters
PPTX
Measures of-variation
PPTX
Revisionf2
PPTX
Feature Engineering
PPTX
Summary statistics (1)
PPTX
maft0a2_Statistics_lecture2_2021.pptx
PPTX
3. parametric assumptions
PDF
Measures of dispersion are statistical tools that show how spread out a set o...
PPTX
Percentiles_Presentation_Extended.pptxss
PPTX
Discrete Choice Model
PDF
3Measurements of health and disease_MCTD.pdf
PDF
Statistics for analytics
PPT
Lesson 7 measures of dispersion part 2
PPT
Graphics Basic Stats in Excel.ppt
PDF
Unit-I Measures of Dispersion- Biostatistics - Ravinandan A P.pdf
PPT
Ch6 slides
Chapter 3_M of Location and dispersion mean, median, mode, standard deviation
Exploratory Data Analysis EFA Factor analysis
Systematics Lecture: Phenetics
Biostatistics CH Lecture Pack
Estimating Tail Parameters
Measures of-variation
Revisionf2
Feature Engineering
Summary statistics (1)
maft0a2_Statistics_lecture2_2021.pptx
3. parametric assumptions
Measures of dispersion are statistical tools that show how spread out a set o...
Percentiles_Presentation_Extended.pptxss
Discrete Choice Model
3Measurements of health and disease_MCTD.pdf
Statistics for analytics
Lesson 7 measures of dispersion part 2
Graphics Basic Stats in Excel.ppt
Unit-I Measures of Dispersion- Biostatistics - Ravinandan A P.pdf
Ch6 slides
Ad

More from Economic Research Forum (20)

PPTX
Session 4 farhad mehran, single most data gaps
PDF
Session 3 mahdi ben jelloul, microsimulation for policy evaluation
PDF
Session 3 m.a. marouani, structual change, skills demand and job quality
PPTX
Session 3 ishac diwn, bridging mirco and macro appraoches
PDF
Session 3 asif islam, jobs flagship report
PPTX
Session 2 yemen hlel, insights from tunisia
PPT
Session 2 samia satti, insights from sudan
PPTX
Session 2 mona amer, insights from egypt
PPTX
Session 2 ali souag, insights from algeria
PPTX
Session 2 abdel rahmen el lahga, insights from tunisia
PPTX
Session 1 ragui assaad, moving beyond the unemployment rate
PPTX
Session 1 luca fedi, towards a research agenda
PDF
من البيانات الى السياسات : مبادرة إتاحة البيانات المنسقة
PPTX
The Future of Jobs is Facing the Biggest Policy Induced Price Distortion in H...
PPTX
Job- Creating Growth in the Emerging Global Economy
PPTX
The Role of Knowledge in the Process of Innovation in the New Global Economy:...
PPTX
Rediscovering Industrial Policy for the 21st Century: Where to Start?
PPTX
How the Rise of the Intangibles Economy is Disrupting Work in Africa
PPTX
On Ideas and Economic Policy: A Survey of MENA Economists
PPTX
Future Research Directions for ERF
Session 4 farhad mehran, single most data gaps
Session 3 mahdi ben jelloul, microsimulation for policy evaluation
Session 3 m.a. marouani, structual change, skills demand and job quality
Session 3 ishac diwn, bridging mirco and macro appraoches
Session 3 asif islam, jobs flagship report
Session 2 yemen hlel, insights from tunisia
Session 2 samia satti, insights from sudan
Session 2 mona amer, insights from egypt
Session 2 ali souag, insights from algeria
Session 2 abdel rahmen el lahga, insights from tunisia
Session 1 ragui assaad, moving beyond the unemployment rate
Session 1 luca fedi, towards a research agenda
من البيانات الى السياسات : مبادرة إتاحة البيانات المنسقة
The Future of Jobs is Facing the Biggest Policy Induced Price Distortion in H...
Job- Creating Growth in the Emerging Global Economy
The Role of Knowledge in the Process of Innovation in the New Global Economy:...
Rediscovering Industrial Policy for the 21st Century: Where to Start?
How the Rise of the Intangibles Economy is Disrupting Work in Africa
On Ideas and Economic Policy: A Survey of MENA Economists
Future Research Directions for ERF

Recently uploaded (20)

PDF
Items # 6&7 - 900 Cambridge Oval Right-of-Way
PPTX
ANALYSIS OF THE PROCLAMATION OF THE PHILIPPHINE INDEPENDENCE.pptx
PDF
PPT Items # 6&7 - 900 Cambridge Oval Right-of-Way
PPTX
Workshop-Session-1-LGU-WFP-Formulation.pptx
PPTX
Portland FPDR Oregon Legislature 2025.pptx
PPTX
CHS rollout Presentation by Abraham Lebeza.pptx
PDF
Redefining Diplomacy: Françoise Joly on Navigating a Multipolar Order
PPTX
SUKANYA SAMRIDDHI YOJANA RESEARCH REPORT AIMS OBJECTIVES ITS PROVISION AND IM...
PPTX
Robotics_Presentation.pptxdhdrhdrrhdrhdrhdrrh
PPTX
Empowering Teens with Essential Life Skills 🚀
PDF
UNEP/ UNEA Plastic Treaty Negotiations Report of Inc 5.2 Geneva
PDF
Concept_Note_-_GoAP_Primary_Sector_-_The_Great_Rural_Reset_-_Updated_18_June_...
PPTX
International Tracking Project Unloading Guidance Manual V1 (1) 1.pptx
PDF
2024-Need-Assessment-Report-March-2025.pdf
PDF
The GDP double bind- Anders Wijkman Honorary President Club of Rome
PPTX
Chapter 1: Philippines constitution laws
PPTX
Parliamentary procedure in meeting that can be use
PDF
Item # 8 - 218 Primrose Place variance req.
DOCX
EAPP.docxdffgythjyuikuuiluikluikiukuuuuuu
PDF
PPT Item # 9 - FY 2025-26 Proposed Budget.pdf
Items # 6&7 - 900 Cambridge Oval Right-of-Way
ANALYSIS OF THE PROCLAMATION OF THE PHILIPPHINE INDEPENDENCE.pptx
PPT Items # 6&7 - 900 Cambridge Oval Right-of-Way
Workshop-Session-1-LGU-WFP-Formulation.pptx
Portland FPDR Oregon Legislature 2025.pptx
CHS rollout Presentation by Abraham Lebeza.pptx
Redefining Diplomacy: Françoise Joly on Navigating a Multipolar Order
SUKANYA SAMRIDDHI YOJANA RESEARCH REPORT AIMS OBJECTIVES ITS PROVISION AND IM...
Robotics_Presentation.pptxdhdrhdrrhdrhdrhdrrh
Empowering Teens with Essential Life Skills 🚀
UNEP/ UNEA Plastic Treaty Negotiations Report of Inc 5.2 Geneva
Concept_Note_-_GoAP_Primary_Sector_-_The_Great_Rural_Reset_-_Updated_18_June_...
International Tracking Project Unloading Guidance Manual V1 (1) 1.pptx
2024-Need-Assessment-Report-March-2025.pdf
The GDP double bind- Anders Wijkman Honorary President Club of Rome
Chapter 1: Philippines constitution laws
Parliamentary procedure in meeting that can be use
Item # 8 - 218 Primrose Place variance req.
EAPP.docxdffgythjyuikuuiluikluikiukuuuuuu
PPT Item # 9 - FY 2025-26 Proposed Budget.pdf

ERF Training Workshop Panel Data 4

  • 1. ERF Training Workshop Panel Data 4 Raimundo Soto Instituto de Economía, PUC-Chile
  • 2. FIRST-DIFFERENCES ESTIMATOR • Another alternative to tackle the heterogeneity problem of 𝑦𝑖𝑡 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡 consists in first- differencing the model 𝑦𝑖𝑡 − 𝑦𝑖𝑡−1 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡 − 𝛼𝑖 + 𝛽𝑥𝑖𝑡−1 + 𝜀𝑖𝑡−1 ∆𝑦𝑖𝑡= 𝛽∆𝑥𝑖𝑡 + ∆𝜀𝑖𝑡 • Hence, the first-difference estimator is simply 𝛽 𝐹𝐷 = ∆𝑥𝑖𝑡′∆𝑥𝑖𝑡 −1∆𝑥𝑖𝑡′∆𝑦𝑖𝑡 2
  • 3. FIRST-DIFFERENCES ESTIMATOR • This estimator is consistent if 𝐸[𝑥𝑖𝑡 𝜀𝑖𝑡] = 0 but slightly less efficient than the within estimator – Notice: the restriction is 𝐸 𝑥𝑖𝑡 𝜀𝑖𝑡 and the exogeneity of 𝑥𝑖𝑡 is not needed as is the case in the within estimator (e.g., it allows for correlation between 𝑥𝑖𝑡 y 𝜀𝑖𝑡−2). • Notice that the residual ∆𝜀𝑖𝑡 is autocorrelated even if 𝜀𝑖𝑡 is not. Thus t-statistics are distorted • All information on non-time varying variables is lost. • First observation of each individual is lost 3
  • 4. FIRST-DIFFERENCES ESTIMATOR RESULTS 4 _cons .0337766 .0045505 7.42 0.000 .0248557 .0426975 D1. -.0998219 .1910678 -0.52 0.601 -.4743976 .2747537 l_popt D1. -.0134668 .0029968 -4.49 0.000 -.0193419 -.0075917 l_infl2 D1. -.2939159 .0468332 -6.28 0.000 -.3857292 -.2021026 l_realgdp D.l_money Coef. Std. Err. t P>|t| [95% Conf. Interval] Total 162.369352 5064 .032063458 Root MSE = .17805 Adj R-squared = 0.0113 Residual 160.435782 5061 .031700411 R-squared = 0.0119 Model 1.93357008 3 .644523359 Prob > F = 0.0000 F( 3, 5061) = 20.33 Source SS df MS Number of obs = 5065
  • 5. 5 * p<0.1, ** p<0.05, *** p<0.01 t statistics in parentheses Observations 5436 5436 5436 5436 5065 (39.10) (-31.67) (5.14) (-18.82) (7.42) Constant 3.315*** -7.845*** 2.450*** -4.160*** 0.0338*** (-0.52) D.Population -0.0998 (-4.49) D.Inflation -0.0135*** (-6.28) D.Real GDP -0.294*** (0.24) (2.56) (0.30) (2.62) Population 0.00144 0.0732** 0.00875 0.0564*** (-20.94) (-5.92) (-6.24) (-7.92) Inflation -0.165*** -0.0281*** -0.406*** -0.0403*** (-2.36) (25.09) (-0.37) (21.47) Real GDP -0.00867** 0.385*** -0.00630 0.258*** Pooled Within Between Random FirstDif (1) (2) (3) (4) (5)
  • 6. FIT • The R2 statistics is valid to undertake comparisons between the pooled model pooled and the fixed effects model. • Using R2 statistics to undertake comparisons between the fixed effects model and the random effects model is invalid, because the individual effects 𝛼𝑖 are random variables in FE but are part of the error term in the RE model. 6
  • 7. HETEROSKEDASTICITY TESTS • We would like to test whether 𝜎2 (i) = 𝜎2 , for all 𝑖 = 1, … , 𝑁 • This only makes sense in the fixed effects model 7 Prob>chi2 = 0.0000 chi2 (163) = 3.3e+05 H0: sigma(i)^2 = sigma^2 for all i in fixed effect regression model Modified Wald test for groupwise heteroskedasticity . xttest3 It is heteroskedastic
  • 8. UNBALANCED PANELS • When dealing with the estimation of the model 𝑦𝑖𝑡 = 𝛼𝑖 + 𝛽𝑥𝑖𝑡 + 𝜀𝑖𝑡 We tacitly assumed that we observed data for 𝑖 = 1, … 𝑁 at each instant of time 𝑡 = 1, … , 𝑇 • What if there are missing data? – It depends on how the data got lost 8
  • 9. UNBALANCED PANELS • From a mechanic point of view, the within estimator is not sensitive to missing data, since as long as you can compute: 𝑆 𝑤 𝑥𝑥 = 𝑖=1 𝑁 𝑡=1 𝑇 𝑥𝑖𝑡 − 𝑥𝑖 ′ 𝑥𝑖𝑡 − 𝑥𝑖 𝑆 𝑤 𝑥𝑦 = 𝑖=1 𝑁 𝑡=1 𝑇 𝑥𝑖𝑡 − 𝑥𝑖 ′ 𝑦𝑖𝑡 − 𝑦𝑖 You can obtain: 𝛽 𝑤 = 𝑆 𝑤 𝑥𝑦 𝑆 𝑤 𝑥𝑥 9
  • 10. UNBALANCED PANELS • Computing the estimator is not the main issue, but why data is missing. • Let 𝑠𝑖𝑡 indicate if one observation exists or is missing. That is 𝑠𝑖𝑡 takes value 1 if the observation exists and 0 otherwise. • Let us remove the mean of each individual using the available data; 𝑦𝑖𝑡 = 𝑦𝑖𝑡 − 1 𝑇 𝑖 𝑟=1 𝑇 𝑠𝑖𝑟 𝑦𝑖𝑟 𝑥𝑖𝑡 = 𝑥𝑖𝑡 − 1 𝑇 𝑖 𝑟=1 𝑇 𝑠𝑖𝑟 𝑥𝑖𝑟 𝑇𝑖 = 𝑡=1 𝑇 𝑠𝑖𝑡 10
  • 11. UNBALANCED PANELS • The FE estimator is 𝛽 𝑤 = (𝑁𝑇)−1 𝑥𝑖𝑡´ 𝑥𝑖𝑡 −1 (𝑁𝑇)−1 𝑥𝑖𝑡´ 𝑦𝑖𝑡 = 𝑁−1 𝑖=1 𝑁 𝑡=1 𝑇 𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑥𝑖𝑡 −1 𝑁−1 𝑖=1 𝑁 𝑡=1 𝑇 𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑦𝑖𝑡 = 𝛽 + 𝑁−1 𝑖=1 𝑁 𝑡=1 𝑇 𝑠𝑖𝑡 𝑥𝑖𝑡´ 𝑥𝑖𝑡 −1 𝑁−1 𝑖=1 𝑁 𝑡=1 𝑇 𝑠𝑖𝑡 𝑥𝑖𝑡´𝜀𝑖𝑡 11
  • 12. UNBALANCED PANELS • The FE estimator will be consistent if and only if 𝑝𝑙𝑖𝑚 𝑁−1 𝑖=1 𝑁 𝑡=1 𝑇 𝑠𝑖𝑡 𝑥𝑖𝑡´𝜀𝑖𝑡 = 0 • It requires no correlation between 𝑥𝑖𝑡 and 𝜀𝑖𝑡 • It requires no correlation between 𝑠𝑖𝑡 and 𝜀𝑖𝑡. That is: – The nature of heterogeneity must be uncorrelated to choice – Feedback must be absent for choice to be exogenous • In summary, E(𝛼) must not depend on 𝑠𝑖𝑡 12