HAPLR Logo

Hennen's American Public Library Ratings
The ratings are based on federal data but only the author is responsible for ratings on this site.
haplr-index.com  6014 Spring Street, Racine, WI  53406   USA

Share knowledge, seek wisdom. 

Home    Ratings      Top Libraries    Orders     Samples    Press    
Consulting      FAQ     Book     Presentations     Miscellaneous  


Documented Issues

In their January 15 response on the Feedback section of the LJ Index, Round Two, Lance and Lyons assert that HAPLR "corrected" scores based on the disclosure of faulty data by a prominent library.  They also say they won’t respond to undocumented claims.  How about documented ones?  I have documented certain issues with the correlation matrix for the LJ Index measures and the number of outliers in their Public Internet User data.  

"Correcting" Results

Lance and Lyons assert that I "corrected" their scores based on the disclosure by a prominent library that its Public Internet Use session data were incorrect.  That “prominent library” they referred to in the Feedback section did not voluntarily disclose their erroneous data.  It did so because on November 23, I questioned the data on the LJ Index site.  I noted that very visitor would have had to use a public internet terminal more than 4 times for the reported number to be correct.  I used IMLS edit checks to do so.  I did not “correct” the scores; I demonstrated how changing this one outlier measure affects the scores for ALL libraries in the over $30 Million expenditure category. 

Correlation Matrix

 LJ Index's Lance has said that a proper index consists of variables correlated between 0.60 and 0.80. The LJ Index web site rejects reference queries because the measure did not pass this test.  Attendance and public internet use ALSO fail the test and yet they are included. This is not an undocumented claim.  Anyone can go to the LJ site, download the data and prepare a correlation matrix using Excel.  I have included a Correlation Spreadsheet on this site and users are welcome to see for themselves.

Clearly only visits and circulation (correlated at 0.72) meet the test Lance defined as the test for a "proper" Index. The other correlations are all below 0.60. I do not agree with Lance’s criteria of 0.60 to 0.80, but you would think LJ would. Why violate LJ violate Lance’s rules for an Index without comment?

Measure (n=7,268)

Circulation

Visits

Program Attendance

Computer Use

Circulation

                    1.00

     

Visits

                    0.72

                    1.00

   

Program Attendance

                    0.44

                    0.47

                    1.00

 

Computer Use

                    0.49

                    0.54

                    0.34

                    1.00

 

Outliers Noted

Lyons and Lance say that they cannot identify outliers without time consuming and costly research, but I identified them quite easily by simply dividing Public Internet Use Per Capita by Visits per Capita.  It takes but a few moments with Excel.  Column I in the table below is the result of dividing Public Internet Users per Capita by Visits per Capita and results in Public Internet Users per Visit.  The 70 libraries listed below all reported Public Internet Use sessions at a higher rate than the amount defined by the IMLS edit check criterion of 0.9 per visit.  They were also included in the LJ Index with these outlier numbers. 

IMLS has developed “edit check” parameters for the “Public Internet Terminal Use” question in the national data.  The edit checks alert state data coordinators when numbers are clearly out of range. A second level of edit checking is supposed to occur at the federal level as well.  The process did not work as intended, however.  The edit check is supposed to be triggered when nearly every visitor logs a Public Internet Terminal Use.  Somehow, the federal data retained this unlikely data despite these edit checks.   

Let's put that in perspective.  At 0.9 Public Internet Use sessions per Visit, 9 out of every 10 visitors had to use the Internet equipped computers in the library every time they visited.  According to the data in the table below, some visitors used them two to five times on every visit! 

Despite repeated requests, LJ has not responded by listing these outliers.  Here they are.

A B C D E F G H I
Expenditure Per Capita Category Stars Library City State  LJ Score Awarded   Public Internet Computer Use Per Capita   Visits Per Capita   Public Internet Computer Use Per Visit (Column G divided by Column H) 
$30,000,000 + 5 SAN DIEGO COUNTY LIBRARY SAN DIEGO CA             989          15.69            3.77                            4.17
$5,000,000-$9,999,999 4 CARROLL COUNTY PUBLIC LIBRARY WESTMINSTER MD          1,053            6.66            5.49                            1.21
$1,000,000-$4,999,999 5 DARIEN LIBRARY DARIEN CT          3,136          32.99          19.90                            1.66
$1,000,000-$4,999,999   JAMES PRENDERGAST LIBRARY ASSOCIATION JAMESTOWN NY          1,117            7.96            6.75                            1.18
$1,000,000-$4,999,999   EAST CLEVELAND PUBLIC LIBRARY EAST CLEVELAND OH             952            6.65            4.49                            1.48
$1,000,000-$4,999,999   WEST HARTFORD PUBLIC LIBRARY WEST HARTFORD CT             924            5.92            6.40                            0.93
$1,000,000-$4,999,999   LOVELAND PUBLIC LIBRARY LOVELAND CO             919            6.53            6.71                            0.97
$1,000,000-$4,999,999   MENOMONEE FALLS PUBLIC LIBRARY MENOMONEE FALLS WI             805            6.02            5.56                            1.08
$1,000,000-$4,999,999   SYOSSET PUBLIC LIBRARY SYOSSET NY             750            6.36            2.87                            2.21
$1,000,000-$4,999,999   MILFORD TOWN LIBRARY MILFORD MA             738            4.78            5.03                            0.95
$1,000,000-$4,999,999   CENTRAL MISSISSIPPI REGIONAL LIBRARY BRANDON MS             721            5.39            3.14                            1.72
$1,000,000-$4,999,999   STEUBENVILLE & JEFFERSON COUNTY, PL OF STEUBENVILLE OH             693            3.71            1.94                            1.91
$1,000,000-$4,999,999   BEAUREGARD PARISH DERIDDER LA             692            4.94            3.20                            1.54
$1,000,000-$4,999,999   CHARLESTOWN CLARK COUNTY PUBLIC LIBRARY CHARLESTOWN IN             639            3.18            3.09                            1.03
$1,000,000-$4,999,999   BLOOMINGTON PUBLIC LIBRARY BLOOMINGTON IL             601            3.53            3.35                            1.06
$1,000,000-$4,999,999   ALLEGHENY COUNTY LIBRARY ASSOC PITTSBURGH PA             515            3.60            1.94                            1.86
$1,000,000-$4,999,999   SPEER MEMORIAL LIBRARY MISSION TX             466            2.98            2.93                            1.02
$1,000,000-$4,999,999   CLEVELAND PUBLIC LIBRARY CLEVELAND TN             448            2.61            2.66                            0.98
$1,000,000-$4,999,999   LAKE BLACKSHEAR REGIONAL LIBRARY SYSTEM AMERICUS GA             423            2.38            2.20                            1.08
$1,000,000-$4,999,999   JACKSON-MADISON COUNTY LIBRARY JACKSON TN             391            2.29            1.78                            1.29
$400,000-$999,999 5 NEW CARLISLE PUBLIC LIBRARY NEW CARLISLE OH          4,425          63.01          11.96                            5.27
$400,000-$999,999 5 NEW CARLISLE & OLIVE TOWNSHIP PUBLIC LIBRARY NEW CARLISLE IN          1,902            6.71            6.64                            1.01
$400,000-$999,999   ROSSFORD PUBLIC LIBRARY ROSSFORD OH             993            5.89            6.12                            0.96
$400,000-$999,999   OCTAVIA FELLIN PUBLIC LIBRARY GALLUP NM             730            4.37            4.72                            0.93
$400,000-$999,999   GREAT BEND PUBLIC LIBRARY GREAT BEND KS             719            3.69            4.10                            0.90
$400,000-$999,999   ST. CLAIRSVILLE PUBLIC LIBRARY ST. CLAIRSVILLE OH             705            3.61            3.25                            1.11
$400,000-$999,999   TYNGSBOROUGH PUBLIC LIBRARY TYNGSBOROUGH MA             645            4.84            5.12                            0.95
$400,000-$999,999   MERCER COUNTY DISTRICT  PUBLIC LIBRARY CELINA OH             519            0.54            0.45                            1.20
$400,000-$999,999   CLYDE PUBLIC LIBRARY CLYDE OH             500            1.70            1.48                            1.15
$400,000-$999,999   BUTTE-SILVER BOW PUBLIC LIBRARY BUTTE MT             284            0.54            0.50                            1.09
$200,000-$399,999   LEEDS - JANE CULBRETH LIBRARY LEEDS AL             965            6.91            5.01                            1.38
$200,000-$399,999   LINCOLN COUNTY PUBLIC LIBRARIES LIBBY MT             727            4.78            5.27                            0.91
$200,000-$399,999   SYRACUSE-TURKEY CREEK TOWNSHIP PUBLIC LIBRARY SYRACUSE IN             547            1.64            1.18                            1.39
$100,000-$199,999 4 CHEROKEE PUBLIC LIBRARY CHEROKEE IA          1,714          15.23            8.28                            1.84
$100,000-$199,999   JEMEZ PUEBLO COMMUNITY LIBRARY JEMEZ PUEBLO NM          1,146            6.87            6.56                            1.05
$100,000-$199,999   MERRICK PUBLIC LIBRARY BROOKFIELD MA             774            4.25            4.53                            0.94
$100,000-$199,999   ONAWA PUBLIC LIBRARY ONAWA IA             759            4.40            4.23                            1.04
$100,000-$199,999   DILLON PUBLIC LIBRARY DILLON MT             518            2.61            2.49                            1.05
$100,000-$199,999   F.O.R. STO-ROX LIBRARY MCKEES ROCKS PA             449            2.25            2.09                            1.07
$100,000-$199,999   TOWN OF BERNALILLO PUBLIC LIBRARY BERNALILLO NM             281            0.90            0.34                            2.67
$100,000-$199,999   MACON COUNTY - TUSKEGEE PUBLIC LIBRARY TUSKEGEE AL             266            0.67            0.74                            0.90
$100,000-$199,999   BRADDOCK CARNEGIE LIBRARY BRADDOCK PA             256            0.55            0.57                            0.96
$100,000-$199,999   PRAIRIE CREEK PUBLIC LIBRARY DISTRICT DWIGHT IL             236            0.23            0.21                            1.07
$50,000-$99,999 4 COLUMBUS VILLAGE LIBRARY COLUMBUS NM          1,706          14.12          15.67                            0.90
$50,000-$99,999   ARNOLDS PARK PUBLIC LIBRARY ARNOLDS PARK IA          1,347          10.59            8.83                            1.20
$50,000-$99,999   CHOTEAU/TETON PUBLIC LIBRARY CHOTEAU MT             877            4.76            5.28                            0.90
$50,000-$99,999   KINGSLEY PUBLIC LIBRARY KINGSLEY IA             728            3.60            2.21                            1.63
$50,000-$99,999   GREELEY COUNTY PUBLIC LIBRARY TRIBUNE KS             675            2.62            2.73                            0.96
$50,000-$99,999   WOODBINE CARNEGIE PUBLIC LIBRARY WOODBINE IA             583            1.99            1.23                            1.62
$50,000-$99,999   LAGUNA PUBLIC LIBRARY LAGUNA NM             372            1.79            1.89                            0.95
$50,000-$99,999   OGLESBY PUBLIC LIBRARY DISTRICT OGLESBY IL             359            1.01            0.68                            1.47
$50,000-$99,999   COLORADO RIVER INDIAN TRIBES LIBRARY/ARCHIVES PARKER AZ             340            1.00            0.99                            1.01
$50,000-$99,999   BEENE-PEARSON PUBLIC LIBRARY SOUTH PITTSBURG TN             331            0.53            0.28                            1.90
$50,000-$99,999   CALEDONIA PUBLIC LIBRARY CALEDONIA MN             315            0.36            0.34                            1.07
$50,000-$99,999   EUTAW - JAMES C. POOLE JR. MEMORIAL LIBRARY EUTAW AL             261            0.60            0.55                            1.08
$10,000-$49,999 5 MADISON VALLEY PUBLIC LIBRARY ENNIS MT          2,798            9.86          10.64                            0.93
$10,000-$49,999 5 NORA E. LARABEE MEMORIAL LIBRARY STAFFORD KS          1,916          11.10            8.68                            1.28
$10,000-$49,999 4 PIEDMONT PUBLIC LIBRARY PIEDMONT WV          1,543            8.73            9.70                            0.90
$10,000-$49,999 3 LIED PUBLIC LIBRARY-ESSEX ESSEX IA          1,305            6.61            5.83                            1.13
$10,000-$49,999   GARNAVILLO PUBLIC LIBRARY GARNAVILLO IA          1,140            4.29            4.18                            1.03
$10,000-$49,999   FRANK BERTETTI BENLD PUBLIC LIBRARY BENLD IL             894            3.57            3.24                            1.10
$10,000-$49,999   MOUNDS PUBLIC LIBRARY MOUNDS OK             859            4.84            4.93                            0.98
$10,000-$49,999   KLEMME PUBLIC LIBRARY KLEMME IA             763            3.82            3.23                            1.18
$10,000-$49,999   SULLY AREA LIBRARY ONIDA SD             697            1.99            2.06                            0.97
$10,000-$49,999   GREGORY PUBLIC LIBRARY GREGORY SD             694            2.51            2.73                            0.92
$10,000-$49,999   BOND PUBLIC LIBRARY WENONA IL             604            1.06            0.92                            1.15
$10,000-$49,999   WOLFE CITY PUBLIC LIBRARY WOLFE CITY TX             597            2.59            2.64                            0.98
$10,000-$49,999   TABOR PUBLIC LIBRARY TABOR IA             537            1.93            1.40                            1.38
$10,000-$49,999   BENT NORTHRUP MEMORIAL FAIRFIELD VT             528            2.20            0.66                            3.33
$10,000-$49,999   RIDGELY PUBLIC LIBRARY RIDGELY TN             408            1.19            0.52                            2.30

 

23 January 2010 

 

Home Ratings Order Samples Press FAQ Misc

April 2010

© haplr-index.com
Webmaster: thennen@haplr-index.com