For more in-depth analysis and description of methodology, click here.

The easy availability of government data on the internet allows unprecedented access to a vast array of information that can be useful for policy-related research. Readers, however, should view empirical research that has not been subjected to peer-review with a skeptical eye. Empirical evidence that purports to repudiate the law of demand should be scrutinized especially carefully.

A recent blog post [2] by the Center for Economic Policy Research (CEPR) attempts to reinforce the argument that raising the minimum wage will have little, if any, detrimental effects on employment. Using data from the Bureau of Labor Statistics (BLS), the CEPR empirically demonstrates that 12 out of 13 states that raised their minimum wage in 2014 witnessed employment gains. This blog post was re-blogged by USA Today and numerous other websites in the blogosphere.[3][4][5]

While certainly eye-catching, the CEPR’s analysis bases its conclusion on a flawed methodology and incorrect calculations.

Our examination of minimum wage increases suggests that employment in low wage jobs may have declined by 1.43% over the past 10 months in states that increased their minimum wages in January. While our results are suggestive and not conclusive, we use an approach and methodology that is more consistent with academic studies of minimum wages.

First, while the CEPR chose to analyze employment changes in every state that increased its minimum wage in 2014, we analyze states that raised their minimum wage via new legislation and not those that raised their minimum wage via automatic annual adjustments for inflation. This allows us to consider control and test periods for these states. Using this criterion, the tri-state area states – New Jersey, New York, and Connecticut – remain as our focus.

Furthermore, the CEPR chose to analyze aggregate employment growth in every industry. However, a more thorough analysis requires a more nuanced approach –high wage industries and low wage industries are affected differently by the minimum wage. A higher minimum wage would not greatly affect employment rates in high wage industries but would be expected to have a more substantial impact in low-wage industries, as employers cut headcount in order to adjust to higher mandated wages.

Given these observations, we conducted an analysis of a low wage industry, Limited-Service Restaurants, and its employment growth rates in the tri-state area versus the rest of the U.S. before and after minimum wage increases using BLS data. To control for economic conditions that might affect employment growth, we analyzed employment growth in the Limited-Service Restaurants industry relative to employment growth in a high wage industry, Professional and Business services:

After mandating higher minimum wages, Limited-Service Restaurants in the tri-state area experienced 1.43% less employment growth than in the rest of the country. Our analysis, which compares employment growth in a low wage industry to benchmark growth in a high wage industry, more clearly illustrates the potential detrimental effects of higher minimum wages than does the simple comparison made by the CEPR.

Economists at the CEPR are rightfully concerned about the plight of low wage workers who lack job market skills that employers demand. Low wage workers would benefit from policies that would make them more valuable, at the margin, to their employers. Advocates for a higher minimum wage instead attempt to make these workers more expensive to employers without fundamentally changing their skills or marginal value in the production process. Higher minimum wages will reduce – rather than enhance – economic mobility.

Apart from flaws in methodology, the CEPR’s analysis of the BLS data is inaccurate. We were unable to reproduce the CEPR’s analysis despite using the same data source and methodology. Using the methodology outlined by the CEPR, their results should have looked like this[5]:

Rather than this:

[1] Stephen G. Bronars is a senior economist and Ian Woon is a summer intern in Welch Consulting’s Washington D.C. office.

[2] http://www.cepr.net/index.php/blogs/cepr-blog/2014-job-creation-in-states-that-raised-the-minimum-wage

[3 ]http://mic.com/articles/92983/the-states-that-increased-their-minimum-wage-all-experienced-the-exact-same-thing

[4] http://thinkprogress.org/economy/2014/07/03/3456393/minimum-wage-state-increase-employment/

[5] http://www.eoionline.org/blog/job-creation-faster-in-states-that-raised-the-minimum-wage

[6]These figures reflect the latest (and final) May employment totals released by the BLS on July 17.