Home > Statistics > Labour force survey > 2013 > November > Quality Description: Labour force survey

Quality Description: Labour force survey

• 1. Relevance of statistical information
• 2. Methodological description of the statistical survey
• 3. Correctness and accuracy of data
• 4. Timeliness and promptness of published data
• 5. Accessibility and transparency/clarity of data
• 6. Comparability of statistics
• 7. Coherence and consistency/uniformity

1. Relevance of statistical information

The Labour Force Survey is a sample survey used in the compilation of monthly, quarterly and annual statistics on participation in the labour market, employment, unemployment and working hours among the population aged between 15 and 74. The data content of the Survey is based on an EU regulation, and the Survey sample includes approximately 12,000 persons every month. The information provided by the respondents is used to draw a picture of the activities of the entire population aged between 15 and 74 on the labour market during one week. In the basic classification of labour market status, the population is divided into the employed, the unemployed and the economically inactive. The active population (labour force) consists of the employed and the unemployed.

The Survey provides an up-to-date and comprehensive picture of the active population (labour force) and changes on the labour market. Public attention focuses each month especially on the changes in employment and unemployment from the corresponding month of the previous year. Seasonally adjusted figures are used to monitor the trend of the changes. The Survey also provides information about persons of working age who are not employed or job seekers. Since 2003, information has also been obtained from a subsample about the structure of households and the activities of all household members aged 15 to 74 relative to the labour market. A description of the data content of the Labour Force Survey is available at: http://tilastokeskus.fi/til/tyti/tyti_2008-02-19_tlu_001_en.html .

The monthly and quarterly results of the Labour Force Survey describe the seasonal and trend variation of employment. The Labour Force Survey time series describe long term changes in the labour market. Annual averages describe the active population, that is, the employed and the unemployed, and the economically inactive persons by, for instance, industry, occupation, education, age, gender and area.

The results of the Survey are used in preparing, among other things, labour market projections and plans, as support for decision-making and in the monitoring of the effects of different measures on employment. Key users of the results are ministries, authorities responsible for regional planning, employers’ and employees’ organisations, universities and research institutes, international organisations and the European Union. At Statistics Finland the data are used in, for instance, calculations of National Accounts. The Statistical Office of the European Communities, Eurostat, steers the content of the Survey and monitors its quality. Eurostat produces structural indicators and other statistics from the quarterly data that are submitted to it.

The concepts and definitions used in the Survey comply with the recommendations of ILO, the International Labour Organisation of the UN, and the regulations of the European Union on official statistics. The current data content of the Labour Force Survey is mainly based on the EU Regulations concerning Labour Force Surveys (Nos 577/98, 2257/2003 and 430/2005). A detailed description of the EU Labour Force Survey is available at: http://epp.eurostat.ec.europa.eu/statistics_explained/index.php/EU_labour_force_survey . Since 1999 a harmonised EU ad hoc survey with an annually changing topic has been conducted in connection with the Labour Force Survey. Further information about the ad hoc surveys can be found (in Finnish) at: http://tilastokeskus.fi/til/tyti/tyti_2011-11-28_men_001.html .

Concepts:

• A person is employed if he/she has during the survey week been in gainful employment for at least one hour against pay in money or fringe benefits, or to make a profit, or has been temporarily absent from work. Persons absent from work during the survey week are classified as employed if the reason for absence is own illness or maternity or paternity leave or the absence has lasted for under three months. The employed are divided into employees, self-employed or unpaid family workers.

• A person is unemployed if he/she is without work during the survey week, has actively sought employment in the past four weeks as an employee or self-employed and would be available for work within two weeks. A person who is without work and waiting for an agreed job to start within three months is also classified as unemployed, if he/she could start work within two weeks.

• The active population (labour force) comprises all persons who are employed or unemployed during the survey week.

• The economically inactive population consists of persons who are not employed or unemployed during the survey week. The economically inactive population can also be referred as persons outside the labour force. Explanations for other concepts of the Labour Force Survey can be found at: http://tilastokeskus.fi/til/tyti/kas_en.html .

The classifications used in the Labour Force Survey include the Standard Industrial Classification (TOL 2008, NACE Rev. 2), the Classification of Occupations 2010 (ISCO-08), the Classification of Socio-economic Groups 1989 (based on the Classification of Occupations 2010) and the Classification of Education 1997 (ISCED 1997) as well as the regional classification into Major Regions, Regional State Administrative Agencies (AVI), Centres for Economic Development, Transport and the Environment (ELY Centre) and Regions.

2. Methodological description of the statistical survey

The population of the Labour Force Survey consists of persons aged between 15 and 74 who are permanent residents of Finland. The population also comprises persons residing temporarily (for under one year) abroad as well as foreign nationals registered in the Finnish Population Information System whose stay in Finland will last for at least one year ( http://www.vrk.fi/default.aspx?id=48 ).

The sample of the Labour Force Survey is drawn twice a year as a stratified random sample from Statistics Finland’s population database, which is based on the Central Population Register. The survey is a panel survey in which one person is interviewed five times. The interviews are conducted every three months, apart from the fourth interview which is conducted six months after the third interview. The first and last interviews are 15 months apart. The sample of each month consists of approximately 12,000 persons, which is, on the average, every 300th person in the population. The sample for one survey month consists of five rotation groups which have entered the survey at different points of time. The sample changes gradually so that different persons answer the questions during three consecutive months. In consecutive quarters three-fifths of the respondents are the same. In consecutive years the overlap is two-fifths. The data are collected from all weeks of the year.

In most European countries the Labour Force Survey data are collected from a sample of households, which means that all members of a household living at the same address are interviewed at the same time. Besides Finland, Sweden, Denmark and Switzerland are the only other countries were the sample is based on individual persons, i.e. only the target persons drawn into the sample are interviewed. However, the EU regulation also requires data concerning households and in Finland this has been solved by exploiting the panel nature of the Labour Force Survey. In addition to the basic interview, a household interview is conducted on the fifth interview round to ascertain the members who belong to the household of the interviewee and the activity of the household members aged 15 to 74 on the labour market. So that the data would describe the whole population, a supplementing sample is added to it of households in which all members are aged 75 or over. Children under the age of 15 and persons aged over 75 are not interviewed in the Labour Force Survey, but certain data are imputed for them to describe their status on the labour market.

The household data enable examinations of, for instance, employment in the family and the joint status of both spouses on the labour market. In 2011, the household data comprised approximately 55,000 persons who formed 23,000 households. The household data for the Labour Force Survey have been collected by the present method since 2003 and the data can mainly be published starting from the year 2004.

The data content of the survey varies by survey round. Certain basic pieces of information are inquired in the first round and checks are then made in subsequent rounds to see whether they have remained unchanged. The data content is wider in the last, or the fifth, survey round which includes the household module, the annual ad hoc module with variable topics, as well as certain additional questions concerning the main job.

Statistics Finland’s interviewers collect the data with computer-assisted telephone interviews. Approximately 106,000 interviews were conducted in 2012. On the average, the non-response rate of this survey was 26 per cent.

The results from the sample are weighted to correspond to the entire population aged between 15 and 74. The effects of non-response on the results are corrected by using so called weight calibration, in which weighting is used to produce the correct population distributions by area, gender and age. Information from the job seeker register of the Ministry of Employment and the Economy is also used as supplementary data.

Like all figures collected with a sample survey, the figures of the Labour Force Survey are so called estimates. An estimate is an estimation of a quality of the population derived by applying a mathematical procedure (estimation) to sample observations. For example, the number of the unemployed published in a certain month is an estimate of the number of unemployed persons aged between 15 and 74 in Finland obtained by such a procedure.

Quarterly and annual estimates are averages of monthly estimates. Working days and hours worked are estimated basing on the number of calendar days in the month concerned. Quarterly and annual estimates of working days and hours worked are sums of monthly estimates.

The employment and unemployment figures of the Labour Force Survey vary relatively regularly in different months of the year. So-called trends are also published from the Labour Force Survey. Variation which occurs annually in similar ways has been removed from these trends. The direction of long-term developments and cyclical variations are easier to see from a trend than from unadjusted monthly data. Due to the method used, the last data of the trend become slightly revised when the data of the following month are inserted into the time series. This preliminary nature of trends should be taken into account when drawing conclusions. Starting from June 2007, the trend components of the time series have been calculated with the Tramo/Seats method recommended by Eurostat, the Statistical Office of the European Communities. Further information about the trend and limitations in its use can be found at: http://tilastokeskus.fi/til/tramo_seats_en.html .

3. Correctness and accuracy of data

The reliability of the figures of the Labour Force Survey is affected by non-response (see above), measurement errors and random variation due to sampling.

Measurement errors arise from, among other things, differences in interpreting or understanding of the questions, respondents’ inability to recall or unwillingness to give certain information, or erroneous recording of answers. Development and testing of the questions, interviewer instructions and the user interface, and training of interviewers are measures used to contain measurement errors.

Random variation due to sampling means that figures calculated from different samples deviate somewhat from each other. When evaluating roughly the magnitude of random variation due to sampling in different situations, the main principle is that 1) the larger the sample is from which the figures are calculated and 2) the larger the population described by the figures is, the less uncertainty due to sampling there will be in the figures. For instance, quarterly figures are more accurate than monthly figures in describing the same phenomenon, as quarterly data have been collected by interviewing three times the number of persons interviewed for monthly data. Annual figures are the most accurate. The latter principle means that the figures of the employed and the unemployed, that is the estimates, based on a sample of the same size are the more accurate the larger the subgroup they apply to. As the relevant subgroup becomes smaller, random variation due to sampling increases. Therefore e.g. the numbers of the unemployed in different age groups or in different areas are not as reliable as the number of all the unemployed.

Inaccuracy due to sampling is assessed with the standard error of the estimate. The magnitude of the standard error is influenced by the size of the sample and the variance of the variable being investigated. Standard error can be used to calculate the confidence interval , within which the value of the population lies with a certain probability. The 95 per cent confidence interval used in the Labour Force Survey is the interval within which the real value of the characteristic being investigated lies with 95 per cent probability. For instance, if the estimate for the number of unemployed persons in a certain month is 230,000 and its standard error is 7,700, the 95 per cent confidence interval of the number of the unemployed is 230,000 ± 15,100, i.e. 214,900–245,100 persons. The share to be added to the estimate or deducted from it, in this case 15,100, is obtained by multiplying the estimate’s standard error with the 1.96 coefficient of the 95 per cent confidence interval.

Examples of the accuracy of the number of the employed and the unemployed by size of subgroup

To illustrate the magnitude of random variation, examples of the estimates of different numbers of the employed and the unemployed, their 95 per cent confidence intervals and other key figures of reliability are presented in the following tables 1-3. The magnitude of random variation in the examples is a rough estimate of the upper boundary of random variation, when the figure being investigated is a correspondingly large estimate of the number of the employed or the unemployed by gender, age or region . In correspondingly large subgroups by industry, the confidence interval is wider. The examples in table 1 refer to monthly estimates. Tables 2-3 include the corresponding data for quarterly and annual estimates.

Table 1. Examples of the accuracy of monthly estimates of different sizes: the numbers of the employed and the unemployed by gender, age and region. ¹⁾

	Monthly estimate	Monthly estimate's 95% confidence interval	Standard error	Relative standard error
	persons	persons	persons	%
Employed	2 400 000	± 27 800	14 200	0,6
	1 200 000	± 21 000	10 700	0,9
	600 000	± 15 300	7 800	1,3
	300 000	± 11 600	5 900	2,0
	100 000	± 6 700	3 400	3,4
	50 000	± 4 700	2 400	4,8
	10 000	± 2 900	1 500	15,0
Unemployed	230 000	± 15 100	7 700	3,3
	120 000	± 11 800	6 000	5,0
	90 000	± 10 800	5 500	6,1
	60 000	± 9 000	4 600	7,7
	30 000	± 6 900	3 500	11,7
	20 000	± 5 100	2 600	13,0
	10 000	± 3 700	1 900	19,0

1) The data can be used as indicative estimates of the accuracy of comparable numbers of the employed and unemployed by gender, are and region.

We can see from table 1 that if the monthly estimate of the employed in the subgroup is 300,000 persons, the real number of the employed lies, with a probability of 95 per cent, within the range 300,000 ± 11,600 persons. The size of this confidence interval relative to the size of the estimate is clearly larger than the corresponding share in the large estimate on the first row of the table. For estimates of less than 300,000 persons the confidence intervals are relatively even wider.

A comparison of data in tables 1–3 illustrates also that annual and quarterly data are more accurate than monthly data. The 95 per cent confidence interval corresponding to the estimate of the employed in a subgroup of 300,000 persons examined above, that is 300,000 ± 6,700 persons (table 2), is clearly narrower than the confidence interval of the monthly estimate. Annual estimated are even more accurate than quarterly estimates (table 3). This difference in accuracy is, however, not as large as the corresponding difference between monthly and quarterly data.

Table 2. Examples of the accuracy of quarterly estimates of different sizes: the numbers of the employed and the unemployed by gender, age and region. ¹⁾

	Quarterly estimate	Quarterly estimate's 95% confidence interval	Standard error	Relative standard error
	persons	persons	persons	%
Employed	2 400 000	± 16 100	8 200	0,3
	1 200 000	± 12 500	6 400	0,5
	600 000	± 8 800	4 500	0,8
	300 000	± 6 700	3 400	1,1
	100 000	± 4 700	2 400	2,4
	50 000	± 3 900	2 000	4,0
	10 000	± 2 000	1 000	10,0
Unemployed	230 000	± 8 800	4 500	2,0
	120 000	± 6 900	3 500	2,9
	90 000	± 6 100	3 100	3,4
	60 000	± 5 100	2 600	4,3
	30 000	± 3 500	1 800	6,0
	20 000	± 3 100	1 600	8,0
	10 000	± 2 400	1 200	12,0

1) The data can be used as indicative estimates of the accuracy of comparable numbers of the employed and unemployed by gender, are and region.

Table 3. Examples of the accuracy of annual estimates of different sizes: the numbers of the employed and the unemployed by gender, age and region. ¹⁾

	Annual estimate	Annual estimate's 95% confidence interval	Standard error	Relative standard error
	persons	persons	persons	%
Employed	2 400 000	± 15 700	8 000	0,3
	1 200 000	± 11 400	5 800	0,5
	600 000	± 7 800	4 000	0,7
	300 000	± 6 100	3 100	1,0
	100 000	± 3 300	1 700	1,7
	50 000	± 2 500	1 300	2,6
	10 000	± 800	400	4,0
Unemployed	230 000	± 7 100	3 600	1,6
	120 000	± 5 700	2 900	2,4
	90 000	± 4 500	2 300	2,6
	60 000	± 3 500	1 800	3,0
	30 000	± 2 400	1 200	4,0
	20 000	± 2 000	1 000	5,0
	10 000	± 1 600	800	8,0

1) The data can be used as indicative estimates of the accuracy of comparable numbers of the employed and unemployed by gender, are and region.

Statistical description of the reliability of estimation

The estimation procedure of the Labour Force Survey is based on the calibration of weights in which the original sample weights calculated on the basis of the sample design are adjusted with a regression model to get the desired population distributions.

The accuracy of estimates is evaluated on the basis of their standard error. Standard error (the square root of the sample variance) describes how neatly the value of the parameter estimated from the observations is concentrated around the parameter of the population. The magnitude of the standard error is affected by sample design, the number of observations in the relevant population or subgroup, variation due to the distribution of the research variable as well as properties of the mathematical formula.

Key figures of reliability derived from the standard error are the confidence intervals and relative standard error. Confidence interval describes the width of the range in which the real value of the parameter is relative to the estimate calculated from the sample. When calculating the confidence interval, the desired level of risk is fixed. The 5 per cent risk level applied in the Labour Force Survey means that if the samples were drawn again, in 95 cases out of one hundred the real value of the parameter would be within the confidence interval and in 5 cases out of one hundred it would be outside the confidence interval.

Relative standard error (variation coefficient) is the percentage share of the standard error of the estimate. Proportioning the standard error to the estimate’s size removes the effect of the scale of the variable. Hence the values of the relative standard error of different variables and the values of the standard error of the same variable in different subgroups are easy to compare with one another.

In the monthly and quarterly data of the Labour Force Survey, the estimator of the standard error is the variance estimator of the generalised regression estimator (GREG). The statistical accuracy of the annual estimates and its evaluation is also affected by the fact that the sample of the Labour Force Survey changes gradually during the year. In consecutive quarters 60 per cent of the respondents are the same. During one year 90 per cent of the interviewees have been interviewed at least twice. The responses given by the same persons in different interviews during the year correlate to one another if the person’s labour market status does not change between interviews. To account for this co-dependence of responses, the Labour Force Survey uses an approximation of single stage cluster sampling in which a cluster internal variance is calculated for persons interviewed several times during the year. Clusters are formed on the basis of interviewee’s age. Cluster internal variance is zero it the interviewee’s labour market status does not change during the year between different interviews.

For example, the standard error calculated for annual estimate of the unemployed in a subgroup of 230,000 persons is 3,600 persons and the confidence interval is 230,000 ± 7,100 persons. If the interviews on which the annual estimate is based had all been with different persons, the standard error of the estimate of the unemployed would have been 2,300 persons and the confidence interval 230,000 ± 4,500 persons. Interviewing the same persons again in different quarters of the year explains why the difference in the accuracy of the annual and quarterly data of the Labour Force Survey is not as large as could be expected on the basis of the number of interviews conducted.

4. Timeliness and promptness of published data

The results of the Labour Force Survey are released monthly, quarterly and annually. Quarterly and annual results are the averages of monthly results, i.e. they describe the situation on an "average" week during the survey period. Data on labour input are sums of the results of periods. The released data are final. Only seasonal adjustment slightly alters the latest seasonally adjusted monthly results. Monthly data are released approximately three weeks from the end of the survey month. Quarterly data are released simultaneously with the last monthly data of each quarter. Quarterly data are statistically more reliable than monthly data and contain more detailed data on, among other things, employment and labour input by industry and more specific regional data. The most detailed results are published in annual statistics. Quarterly deliveries of data are made to the Eurostat, the Statistical Office of the European Communities, which are used to compile statistics on EU Member States.

5. Accessibility and transparency/clarity of data

The results of the Labour Force Survey are published in the Labour market series of Official Statistics of Finland. The key monthly, quarterly and annual results are released on predefined days on the Internet on the home page of the Labour Force Survey http://tilastokeskus.fi/til/tyti/index_en . The links on the home page lead to, among other things, a description of the statistics, concepts and definitions as well as the free of charge tables from the statistical databases of the Labour Force Survey (StatFin). Data are also available over the Internet from Statistics Finland's chargeable time series database (ASTIKA). Eurostat publishes quarterly and annual Labour Force Survey data on its own website.

The printed annual publication of Labour Force Statistics contains a review of the past statistical reference year, definitions of key concepts, descriptions of the classifications used, time series and annual tables as well as this Quality description of Labour Force Survey. In addition, Labour Force Survey data are published regularly in the Statistical Yearbook of Finland and in the Bulletin of Statistics. Chargeable special compilations can be requested from the Labour Force Survey information service.

Labour Force Survey data are not released outside Statistics Finland in identifiable form (Statistics Act 280/2004, Personal Data Act 523/1999). Data can be released only on the basis of a separate application for licence to use statistical data and without identifiers for scientific research and statistical surveys. Data adjusted for the EU Labour Force Survey are delivered to Eurostat, the Statistical Office of the European Communities without identifiers. The Labour Force Survey data are protected according to the protection class defined in Statistics Finland’s data protection guidelines. A register description can be found (in Finnish) at: http://www.tilastokeskus.fi/meta/rekisteriselosteet/rekisteriseloste_tyovoimatutkimusty81.html

Information service: tyovoimatutkimus@stat.fi and tel. +358 9 17341.

6. Comparability of statistics

A monthly Labour Force Survey, initially called Labour Force Inquiry, has been conducted since 1959. During this time the data content, data collection methods and methodology have been revised on several occasions. A comparable time series of the key data exists since 1989.

Initially, the inquiry with a somewhat limited data content was conducted as a postal survey. In 1976 the data content was expanded and the methodology modernised. During 1977–1993 the survey consisted of a monthly inquiry and supplementary annual interviews conducted over the telephone. The data collection of the monthly inquiry was changed in 1983 from a postal survey to telephone interviews, as a result of which non-response dropped from 30 to 4 per cent.

When Finland joined the European Union the Labour Force Survey was harmonised with the EU Labour Force Survey. At the beginning in 1995–1998, the data for the EU Labour Force Survey were collected as a separate interview survey in March-May. The monthly survey was gradually revised to correspond to the EU Labour Force Survey. The contents of the monthly survey were extended, computer-assisted telephone interviews (CATI) were introduced in the data collection and the concepts and definitions were harmonised to correspond better than before to the EU and ILO guidelines and recommendations. The definition of an unemployed person was revised in May 1998 and the published time series were retrospectively revised to correspond with the new definitions starting from 1989.

In April 1999 the Labour Force Survey’s data content was widened again with the combining of the monthly survey and the EU Labour Force Survey into a single, continuous Labour Force Survey. As of the beginning of 2000 the survey changed over into a continuous survey week, whereas previously data for each month had been collected in one survey week. This changeover affected data on working days and hours worked, which are not fully comparable with earlier data starting from the beginning of the year 2000. Starting from 2003 the data content of the survey widened with the so-called household module which is collected from a subsample. A new data collection questionnaire was introduced in 2008. In consequence of this the data content of the survey became slightly revised and collection of some of the data was started from a subsample, whose data are only used as annual data.

7. Coherence and consistency/uniformity

In addition to the Labour Force Survey Statistics Finland’s statistics related to the labour market include the Job Vacancy Survey, the Quality of Work Life Survey, statistics on labour disputes, statistics on accidents at work as well as register-based employment statistics (RES).

Of these the RES provide data on the labour market activities of the population. The data in them differ from those of the Labour Force Survey due to the data collection method and the definitions of the employed and the unemployed. The RES are based on total data derived from the administrative data of different authorities. The RES data on a person’s activities mainly describe the last week of the year. RES data on unemployment are based on the Ministry of Employment and the Economy’s register of unemployed job seekers. The statistics take good 18 months to complete; preliminary data are ready within about a year. Since the employment statistics represent total data, they offer better regional data (incl. data by municipality) as well as better data on small population groups, e.g. small industries and occupations, than the Labour Force Survey. The concepts of the employment statistics based on administrative registers are not internationally comparable.

Statistics Finland uses the Labour Force Survey data in the compiling of National Accounts. This is among the reasons why the definitions of the key concepts in the Labour Force Survey, such as population, employment and working hours, follow as closely as possible the recommendations for National Accounts (the UN System of National Accounts, SNA, and the European System of Accounts, ESA). The Labour Force Survey definition of the public sector is somewhat different from the classification of sectors in National Accounts. In National Accounts, conscripts are classified as employed according to ILO recommendations, whereas in the Labour Force Survey conscripts are outside the labour force.

The results from the Finnish Labour Force Survey published by Eurostat, the Statistical Office of the European Communities, differ from those published in Finland in that conscripts are not included in the statistics published by Eurostat. In most EU countries conscripts are not included in the target group of the Labour Force Survey, i.e. population living in private households. This causes differences especially in the results concerning the 15 to 24 age group. In the figures published by Finland persons performing their conscript duty are included in the population outside the labour force. In some cases differences can arise from the fact that Eurostat’s figures include the whole population living in private household whereas in Finland the figures only include those between the ages of 15 and 74.

The Ministry of Employment and the Economy also publishes data on unemployed job seekers. The Ministry’s data derive from register-based Employment Service Statistics, which describe the last working day of the month. The definition of unemployed applied in the Employment Service Statistics is based on legislation and administrative orders which make the statistical data internationally incomparable. In the Employment Service Statistics an unemployed person is not expected to seek work as actively as in the Labour Force Survey. There are also differences in the acceptance of students as unemployed. More detailed information about differences between the statistics is available: http://tilastokeskus.fi/til/tyti/tyti_2013-04-04_men_002_en.html .

Source: Labour force survey 2013, November. Statistics Finland

Inquiries: Veli Rajaniemi 09 1734 3434, Joanna Viinikka 09 1734 3796, tyovoimatutkimus@stat.fi

Director in charge: Riitta Harala

---

Updated 20.12.2013