The evidence base: where is it?

The evidence base: where is it? In criminal justice, as in many other areas of publicadministration, politicians and managers increasingly call forevidence-based policy Evidence-based policy is public policy informed by rigorously established objective evidence. It is an extension of the idea of evidence-based medicine to all areas of public policy. (EBP EBP Evidence Based PracticeEBP Enterprise Buyer ProfessionalEBP Education Business PartnershipEBP European Business ProgrammeEBP Efficiency Bandwidth ProductEBP Electronic Billing and PaymentEBP Extended Base PointerEBP Error Back Propagation ). This should raise questions about whatevidence, who will find it and how will it be used. The rising emphasison bibliometrics Bibliometrics is a set of methods used to study or measure texts and information. Citation analysis and content analysis are commonly used bibliometric methods. While bibliometric methods are most often used in the field of library and information science, bibliometrics have wide as the way to measure importance and impact is anotherdevelopment that should raise questions about what is being measured andhow it will be used. The academic research publication model does notfit all aspects of criminology very well, where much work is done by orfor government and non-government organisations, and much ismultidisciplinary. This grey literature has always presented problems inmeeting standards for peer-reviewed, evidence-based evaluation, but isoften all there is--if it can be found. Funding agencies may havestringent requirements for evaluation studies, but how are these reportswritten or structured and what happens to them? How can they be used toinform subsequent practice? Evidence and bibliometrics: simple solutions In April 2008, the Australian Prime Minister (Rudd 2008) addressedhis senior bureaucrats on his government's policy priorities for,and expectations of, the Australian Public Service. The third of hisseven key points called for evidence-based policy. This is good news forthe proponents of this approach like the Campbell Crime and Justicegroup, and indicates a commitment to good, research-based public policydecision making. Also in 2008, the Australian and New Zealand New Zealand(zē`lənd), island country (2005 est. pop. 4,035,000), 104,454 sq mi (270,534 sq km), in the S Pacific Ocean, over 1,000 mi (1,600 km) SE of Australia. The capital is Wellington; the largest city and leading port is Auckland. Society of Criminology(ANZSOC ANZSOC Australian and New Zealand Society of Criminology ) released its list of quality rankings for criminology journalsand publishers (Brown & Daly 2008; Daly 2008) and Cohn andFarrington (2008) updated their work on influential criminologists.Although the particular Research Quality Framework assessment ofAustralian universities for which the ANZSOC ranking was done is nolonger operative, it is expected that bibliometrics will play a part inwhatever replaces it. Ostensibly os��ten��si��ble?adj.Represented or appearing as such; ostensive: His ostensible purpose was charity, but his real goal was popularity. now, armed with these two developments, the approach togood policy is straightforward--at a minimum, the policy maker orpractitioner can go to the best sources to find the evidence about whatworks. However, both raise the question of how this evidence base iscreated, found, shared and used. The value of bibliometrics has long been debated (see Levi 1995),with the Cohn and Farrington article giving a good overview of itshistory in criminology and criminal justice. Its commercial genesis liesin the Institute for Scientific Information, established in 1960 withthe Science citation index Science Citation Index (SCI ?) is a citation index originally produced by the Institute for Scientific Information (ISI) in 1960, which is now owned by Thomson Scientific. and now flourishing in the Web of Knowledgeand other services. Although unlikely to go unchallenged anywhere, thevalue of citation analysis Citation Analysis is the most common method of bibliometrics. Citation analysis uses citations in scholarly works to establish links to other works or other researchers.Co-citation coupling and bibliographic coupling are specific kinds of citation analysis. in science is likely to be less contestedthan in the social sciences. Regardless of how impact analysis might be used to measure academicperformance however, there is a disjunction disjunction/dis��junc��tion/ (-junk��shun)1. the act or state of being disjoined.2. in genetics, the moving apart of bivalent chromosomes at the first anaphase of meiosis. between the literature asidentified in such bibliometric exercises, the standards set insystematic analyses based on the medical template, and the informationcreated and used in policy and +practice not so much for what is found,but for what is missed. The transition of graduates from university topolicy and practice, with their experience limited to academic journaland commercially published monograph literature, particularly to online,instantly accessible literature, and the new emphasis on systematicreviews combine to mean that the complex wealth of experience may bemasked. Further, this narrow academic approach, however rigorous andlaudable, misses several key areas of information, includingmultidisciplinary, foreign language, conference presentations, new orunsuccessful ideas and, particularly, the report literature ('greyliterature'). Not to mention the potential of missed materialcaused by poor citations (Gehanno, Darmoni & Galliard gal��liard?n.1. A spirited dance popular in France in the 16th and 17th centuries.2. The triple-time music for this dance.adj. ArchaicSpirited; lively; gay. 2005)--notonly misspelled (for example, names such as Skrzypiec, Shepherd or evenTilley, all important authors in criminology) but even completelymisnamed. By insisting that the only studies to be trusted are thoseusing the gold standard of academic research that survives the mostrigorous statistical analysis, we are also missing out on theopportunity to provide policy-relevant advice based on other experiencesto governments and other agencies desperate for information about whatworks at a time when the demand for 'what works' reports isunprecedented. For example, of 5,564 articles on problem orientedpolicing (a policing strategy widely implemented in the United States United States,officially United States of America, republic (2005 est. pop. 295,734,000), 3,539,227 sq mi (9,166,598 sq km), North America. The United States is the world's third largest country in population and the fourth largest country in area. ),only 10 met the standard for a Campbell Collaboration review. This is avery small evidence base for a strategy on which large sums of money andamounts of energy have been spent and which is widely promotedinternationally (Weisburd 2008). Are we saying that the other articles,not to mention the countless reports and other evaluations may not beused as their information content cannot be trusted? There may be an element of over-simplification in the PrimeMinister's call--as Grayson and Gomersall (2003: 1) suggest:'As FBP FBP Fructose BisphosphateFBP Filtered Back-Projection (algorithm)FBP Filtered Back ProjectionFBP Federal Bureau of PrisonsFBP Final Boiling PointFBP Friends of the Border PatrolFBP Foreign Buyer ProgramFBP Full Blood Picture has developed it has become abundantly clear that thesimple notion of policy making based on the rational assessment ofresearch evidence is a naive one' given the influence of many otherforces in public policy development. For example, in the hot world oflaw and order politics, a television series about the'success' of zero tolerance The policy of applying laws or penalties to even minor infringements of a code in order to reinforce its overall importance and enhance deterrence.Since the 1980s the phrase zero tolerance has signified a philosophy toward illegal conduct that favors strict imposition of policing in New York New York, state, United StatesNew York,Middle Atlantic state of the United States. It is bordered by Vermont, Massachusetts, Connecticut, and the Atlantic Ocean (E), New Jersey and Pennsylvania (S), Lakes Erie and Ontario and the Canadian province of or aministerial meeting with a travelling police proponent may carry moreweight than any number of well-researched journal articles from the coolrecesses of academic excellence. Further, the short timelines demandedby governments for the often ad hoc For this purpose. Meaning "to this" in Latin, it refers to dealing with special situations as they occur rather than functions that are repeated on a regular basis. See ad hoc query and ad hoc mode. development of policies is scarcelyconsistent with a rigorous investigation of the evidence-basedliterature. In reality, the evidence base continues to be built on shiftingsands of peer-reviewed articles, practitioner/industry journals, books,conference presentations--not to mention the chance contacts andunrecorded knowledge that are the business of the knowledgemanagement/knowledge sharing movement. The grey literature As an illustration of what will be missed in focusing on journalliterature, the Australian Institute of Criminology released a report(Wundersitz 2007) in late 2007 on Australian drug offender diversionprograms, including an overview of their evaluations. One, by chance,was able to undertake a control group comparison. The bulk of the 23evaluations are consultancy reports to government agencies--classic greyliterature. Not being published in the peer reviewed journal literature,neither this report, nor any of the evaluation studies would be pickedup in the academic journal databases. One of the evaluations is in aseries that is now covered in Soclndex, but this issue predatesinclusion. At least five cannot be traced easily on the Internet, ifthey ever were there. As a further illustration, each year, the Australian governmentsand police ministers sponsor the Australian Crime and ViolencePrevention Awards to community-based projects demonstrating goodpractice in the reduction or prevention of violence and other types ofcrime. Forty projects received awards in 2007. Of the four majorcategory winners, I could find general information about only threeonline and no evaluation reports, although one general websitetantalisingly referred to such a report. Expecting academic standardevaluations from the groups that provide programs such as these isunrealistic--the existing paperwork requirements are sufficientlyfrustrating, and seen as taking resources away from the primary targetof providing the service (Ryan, Newton & McGregor-Lowndes 2008). Itis highly unlikely either that rigorous quantitative research Quantitative researchUse of advanced econometric and mathematical valuation models to identify the firms with the best possible prospectives. Antithesis of qualitative research. will bepart of their evaluation or that any evaluations will appear in peerreviewed journal articles. These examples show the need to get the language and practice ofevaluation into what Rock (1995) has called the commonplace internalpractices of policy making. Other calls for the connection are legion,with countless conferences aiming to link theory, policy and practiceand whole journal issues dedicated to bridging science and practice (forexample, American journal of community psychology 2008). Despite its value as a source of information about what works, thegrey literature is notoriously ill-organised, distributed and promoted.It was when it was print based, and continues to be so now that it isonline. One reason is that the dissemination of information is often notthe primary purpose of the report. Reporting to the client, on theproject, or to authority is generally the purpose, and any widerinterest in the report is incidental. In many ways, this material isharder to find out about and track down in an online world, and theunstable nature of many websites makes its long-term availability evenless certain. As De Castro and Salinetti put it (2006: 12), 'grey literaturehas now all rights to be involved among the useful documents to beshared by the global scientific community ... [it has] no longer asupporting role supporting rolen → second r?le msupporting rolen → ruolo non protagonistabut a leading role'. There is even a greyliterature society with an annual conference, which, among its otheractivities, is promoting minimum standards in the production of reports(De Castro & Salinetti 2006) and the development of a newinternational standard for them. In the illicit drugs and alcoholsector, there is a new Australian New AustralianNounAustral an Australian name for a recent immigrant, esp. one from Europe database, the Drug Police ModellingProgram dedicated to the grey literature. This can be found at:http://www.dpmp.unsw.edu.au/DPMPWeb.nsf/page/Bibliography Some long standing, but less commercial, bibliographic databases,such as the National Criminal Justice Reference Service (NCJRS NCJRS National Criminal Justice Reference Service ) andCINCH make a strong point of including the criminal justice greyliterature as a feature of their collections. Multidisciplinary studies Too close a concentration on purely criminology sources may belimiting in a multidisciplinary area like criminology, where relevantarticles will appear in anything from architecture (crime preventionthrough environmental design Crime prevention through environmental design (CPTED) is a multi-disciplinary approach to deterring criminal behavior. CPTED strategies rely upon the ability to influence offender decisions that precede criminal acts. , or CPTED CPTED Crime Prevention Through Environmental Design ) to zoology zoology,branch of biology concerned with the study of animal life. From earliest times animals have been vitally important to man; cave art demonstrates the practical and mystical significance animals held for prehistoric man. (endangered species endangered species,any plant or animal species whose ability to survive and reproduce has been jeopardized by human activities. In 1999 the U.S. government, in accordance with the U.S. trafficking). In Australia, as in Canada and other countries, indigenousstudies is becoming established as a research area with a literature inits own right, and a vital source of information for criminal justiceinterested in local applications. Housing, urban studies, psychology,public health, economics, environment, international relations international relations,study of the relations among states and other political and economic units in the international system. Particular areas of study within the field of international relations include diplomacy and diplomatic history, international law, ,education, law are all areas where relevant information is likely toappear. For example, of two large scale longitudinal studies ofAustralian young people currently looking at criminal/antisocialbehavior, one is based in a criminology school (University of Queensland The University of Queensland (UQ) is the longest-established university in the state of Queensland, Australia, a member of Australia's Group of Eight, and the Sandstone Universities. It is also a founding member of the international Universitas 21 organisation. 2008), the other in a medical research unit (IYDS 2008). This influenceswhere their results are published, with the latter more likely to appearin medical than criminology journals. Similarly, the winners of the 2008 Criminology Prize come fromsurgery and developmental psychobiology psychobiology/psy��cho��bi��ol��o��gy/ (-bi-ol��o-je)1. biopsychology; a field of study examining the relationship between brain and mind, studying the effect of biological influences on psychological functioning or mental and have published primarily inthe medical literature, with Professor Shepherd also represented in thecriminology literature. Multiple sources The work that the Centre for Evidence Based Policy and Practice hasdone in training researchers has revealed the limited ability of many todiscover information outside a narrow range of database sources. AsGrayson and Gomersall (2006: 52) note: Many potential users have extremely limited awareness of the bibliographic services that are available to them ... Reliance on Google is widespread ... Almost all users have very limited searching skills ... Even when using Google, many have never got beyond entering a single term ... Many users give up easily ... Academic users tend to expect immediate access to any useful documents that they find. Another gap in the traditional publishing model occurs in thepublishing bias towards English speaking and US sources. While thelingua franca lingua franca(lĭng`gwə frăng`kə), an auxiliary language, generally of a hybrid and partially developed nature, that is employed over an extensive area by people speaking different and mutually unintelligible tongues in order to of the industry might be English, it is an added burden onthose whose research language is not. However, in the associatedcultural bias towards English and American sources, the lack of coverageof Australian experience is akin to that of European or Canadianresearch. Interestingly, in the journal rankings mentioned earlier, asTable 1 shows, there is less overlap than might be expected betweenANZSOC's top 20 journals of importance and the Cohn and Farringtontop 20 of influence, with only three of the ANZSOC top six appearinganywhere in the other, and nine in common between the two. Between thelanguage and culture gaps we have the twin tyrannies of distance(Blainey 1968) and country of origin. The ineligibility of failed research for publication is anothergap. This is often raised for medical research (Lenzer & Brownlee2008) but must also be true for criminal justice. SureLy asking whatworks implies avoiding what doesn't work. Maybe we should be movingmore to a culture of lessons learned than a concentration on success.There was an interesting article recently, basically reporting anunsuccessful study as advice to governments considering parentalresponsibility legislation (Brank brank?n.A device consisting of a metal frame for the head and a bit to restrain the tongue, formerly used to punish scolds. Usually used in the plural. et al. 2008). Unsuccessful studies canalso always be published in a compendium of what works and whatdoesn't, as a recent RAND report did (Beckett 2008). The supposed saving of the world through the Internet has not yetoccurred, either. Certainly, desktop access to commercially publishedliterature through database services like Ebsco, Sage, Proquest andThomson has made a difference. It is possible to find a known governmentreport, or other known item on the Internet in many cases, but withexpectations that the Internet will be ten times its 2006 size by 2011,and growing at 60% per annum Per annumYearly. (Dale 2008), but around half of the URLsdisappearing within 12 months of being created, and the lack of usefulmetadata on most Web publications, the chances of doing a generalsubject search and achieving an acceptable recall rate are slim. The price of online journal and database subscriptions is a furtherconsideration for many organisations, particularly those not eligiblefor the favourable prices offered to academic institutions. It should beremembered that this online publishing is an industry in its earlystages of development and likely to undergo tectonic upheavals before itsettles. While the open access/open archive movement may yet triumph,and the democratisation Noun 1. democratisation - the action of making something democraticdemocratizationgroup action - action taken by a group of people of knowledge through social networking providenew insights into policy development, they haven't done so yet, sowe are still working our way through the changes. While universitiesmeasure performance based on the traditional publishing avenues, thereis little pressure to change. What can be done? In terms of what is already available, some excellent servicesexist. A small sample of those that aggregate offerings from differentplaces: * databases such as NCJRS and CINCH that do not restrict coverageto journal articles and actively seek grey literature (CINCH isavailable through Informit. NCJRS is at http://www.ncjrs.org/) * Professor Kerner's Criminology-cj news, an e-list of eventsand recent reports * RAND's Promising Practices Network(http://www.promisingpractices.net) * The Australian Policy Online and Policy Pointers e-alerts(http://www.apo. org.au/and www.policypointers.org) * The ESRC ESRC Economic and Social Research Council (UK)ESRC Environmental Sciences Research CenterESRC Engineers & Scientists Resources & Construction (US Army Corps of Engineers)ESRC Exxonmobil Singapore Recreation Club EBPP (Electronic Bill Presentment and Payment) Sending invoices to customers over the Internet. When payment is due, an e-mail is sent with a link to a Web page that contains the billing information and the payment services that are supported. bibliography (http://www.kcl.ac.uk/schools/sspp/interdisciplinary/evidence/biblio/) * The Campbell Collaboration(http://www.campbellcollaboration.org/) In terms of broadening the search for the evidence it is a matterof acknowledging that the evidence base is not as simple as might behoped. There is a group of professionals who are more than ready to workcollaboratively with researchers whether they are called librarians,information specialists, or documentationalists, they have skills toassist. McGowan and Sampson (2005) list the essential elements of asuccessful collaboration as: * understanding the issue * an iterative process * development of a complex strategy that takes into account sourcesand their structures * non-bibliographic database sources * non-database bibliographic sources. In terms of developing useful evidence, everything from the simplesuggested grey literature standard to frameworks for evaluation andreporting, such as Ekblom's 5Is (Ekblom 2003) is worth exploring.The UK's Magenta Magenta, town, ItalyMagenta(mäjān`tä), town (1991 pop. 23,667), Lombardy, N Italy, near Milan. Manufactures include matches, textiles, and machinery. Book (Great Britain. Government Social ResearchUnit 2003) is a handy guide to evaluation. Into the future Within the online academic publishing world, as noted above, thereis a great deal of change and further development taking place, with theopen access/ open archives movement strong in the sciences and spreadingits influence. As Scherlen and Robinson (2008) advocate, given the problems ofpublishing in the key journals, open access is a more 'just'way to promote dissemination of scholarship more widely. They see thesubscription model as a thing of the past. The policy of the US government that reports from government-fundedresearch must be made public and the longer standing one that allgovernment reports must be made available publicly must be applauded.However, the battle is not yet over. While we applaud the democratisation of access to the academicrecord, how far do we also applaud the democratisation of the publicpolicy sphere, as evidenced for many years in talkback talk��back?n.A system of communications links in a television or radio studio that enables directions to be given while a program is being produced. radio, but nowmore widely available through Web 2.0 technologies? What about thesidelining of experts and professionals, as searchers seize on anythingthey find quickly on the Internet as good enough? We also need to find ways to reconcile different types of knowledge(Holgersson, Gottschalk & Dean 2008) and their application. And doesthe development of a probabilistic risk and uncertainty based approach(Bammer & Smithson 2008) to complex social policies haveimplications for an evidencebased outlook? Finally, coming back to theidea of lessons learned--the organic development of knowledge based onexperience--is the call from Nicholas Maxwell(http://www.nick-maxwell.demon.co.uk/) for conversation about wisdom,rather than evidence, going to catch on? Conclusion Although calls for evidence-based policy development are welcome,and should give librarians great hope that the value of our informationservices See Information Systems. and resources will be recognised and supported,over-simplification of approaches to the delivery of information must beavoided. In government policy making, the grey literature is anessential source but, not fitting the standard academic publishingmould, can be too easily missed. Manuscript received January 2009. This paper is based on apresentation to the Stockholm Criminology Symposium, June 2008. This is a refereed paper References All Web resources were accessed on 8 January 2009. Bammer, G & Smithson, M 2008, Uncertainty and riskmultidisciplinary perspectives, Earthscan, London Beckett, MK 2008, Current-generation youth programs what works,what doesn't, and at what cost? RAND, Santa Monica CA.http://rand.org/pubs/occasional papers/2008/RAND OP215.pdf Blainey, G 1968, The tyranny of distance, Macmillan. Melbourne Brank, E et al 2008. 'An experimental juvenile probationprogram', Crime & Delinquency, 54(2), April: 193-224 Brown, M & Daly, K 2008, Australian & New Zealand Societyof Criminology report on criminology bibliometrics development,http://www.anzsoc.org/publications/bibliometrics report.pdf Choose wisely 2008. Demos update e news, 15 April Cohn, E & Farrington, DP 2008, 'Scholarly influence incriminology and criminal justice journals in 1990-2000', Journal ofCriminal Justice, 36:11-21 Dale, A 2008, Call for submissions to Online Information ConferenceLondon 2008 Daly, K 2008, 'Criminology bibliometrics: how do we rank ourjournals?' ANZSOC Newsletter, 5(1), March: 1-2 De Castro, P & Salinetti, S 2006, '"Uniformrequirements" for grey literature: a proposal for the adoption of a"Nancy style"', Publishing Research Quarterly, 22(1):12-17 Drug Policy Modelling Program 2008, DPMP bibliography of greyliterature, http://www.dpmp. unsw.edu.au/DPMPWeb.nsf/page/Bibliography) Ekblom, P 2003, '5Is: a practical tool for transfer andsharing of crime prevention knowledge', Crimereduction website,http://www.crimereduction.homeoffice.gov.uk/ learningzone/5isintro.htm Gehanno, J, Darmoni, S & Gaillard, J 2005, 'Majorinaccuracies in articles citing occupational or environmental medicinepapers and their implications', Journal of the Medical LibraryAssociation, 93(1): 118-121 Giblin, M & Schafer, JA 2008, 'Comprehensive examinationreading lists as indicators of scholar impact and significance',Journal of Criminal Justice, 36: 81-89 Grayson, L & Gomersall, A 2003, A difficult business: findingthe evidence for social science reviews, Working paper (ESRC UK Centrefor Evidence Based Policy and Practice) no. 19, ESRC, London.http://kcl.ac.uk/schools/sspp/interdisciplinary/evidence/publications/wp19.html Grayson, L & Gomersall, A 2006, 'Consumer review appendixto review for JISC JISC Joint Information Systems Committee (UK)JISC Japan Industrial Standards CommitteeJISC Joint Industry Safety Committee of core resource discovery services', quoted inTuck, J 2008, 'From integration to web archiving', inEarnshaw, R & Vince, J (eds), Digital convergence: libraries of thefuture, Springer, London, 2008: 163-171 Great Britain. Government Social Research Unit 2003, The MagentaBook: guidance notes on policy evaluation. HM Treasury, London.http://www.gsr.gov.uk/professional_guidance/ magenta_book/index.asp Grey Literature International Steering Committee 2006, Guidelinesfor the production of scientific and technical reports. how to write anddistribute grey literature, http://eprints. rclis.org/6103/ Holgersson, S, Gottschalk, P & Dean, G 2008 'Knowledgemanagement in law enforcement: knowledge views for patrolling policeofficers', International Journal of Police Science and Management,10(1): 76-99 International Youth Development Study (IYDS) 2008, News &findings, http://www.rch.org.au/ iyds/news.ctm?doc_id=2773 Lenzer, J & Brownlee, S 2008, 'An untold story?'British Medical Journal The British Medical Journal, or BMJ, is one of the most popular and widely-read peer-reviewed general medical journals in the world.[2] It is published by the BMJ Publishing Group Ltd (owned by the British Medical Association), whose other , 336, 8 March: 532-534 Levi, M 1995, 'Theuse and misuse of citations as a measure of influence incriminology', British Journal of Criminology, 35(1): 138-142 McGowan, J & Sampson, M 2005, 'Systematic reviews needsystematic searchers', Journal of the Medical Library Association,93(1), 2005: 74-80 Rock, P 1995, 'The opening stages of criminal justice policymaking', British Journal of Criminology, 35(1): 1-16 Rudd, K 2008, Address to heads of agencies and members of SeniorExecutive Service, Great Hall, Parliament House, Canberra Parliament House is the meeting place of the Parliament of Australia. It is located in Canberra, the capital of Australia. It was opened on 9 May 1988 by the Queen of Australia. [1] Its construction cost was over $1.1 billion. , 30 April2008. http://www.pm.gov.au/media/ Speech/2008/speech_0226.cfm Ryan, C, Newton, C & McGregor-Lowndes, C 2008, How long is apiece of red tape? The paperwork reporting cost of government grants,Australian Centre for Philanthropy and Nonprofit Studies. Scherlen, A & Robinson, M 2008, 'Open access to criminaljustice scholarship: a matter of social justice', Journal ofCriminal Justice Education, 19(1), Mar: 4-21 University of Queensland 2008, Criminology web page.http://www.socialscience.uq.edu.au/ index.html?page=15498&pid=0 Weisburd, D 2008, 'Problem oriented policing, Presentation toStockholm Criminology Symposium, 2008 (unpublished) Wundersitz, J 2007, Criminal justice responses to drug and drugrelated offending. are they working? Technical and background paper no25. Australian Institute of Criminology, Canberra.http://www.aic.gov.au/publications/tbp/tbp025/tbp025.pdf Janet Smith is Manager of Information Services at the AustralianInstitute of Criminology and has a long association with federalgovernment libraries as a librarian or consultant. She has always beeninterested in the provision of information for good decision making andthe role of Australian bibliographic databases in this. Her emailaddress is: JanetSmith@aic.gov.auTable 1: ANZSOC and US top 20 criminology/criminal justice journalsANZSOC top 20 (in order) US top 20 (no order implied)British journal of CriminologycriminologyCrime and justice: a Journal of quantitativereview of research criminologyCriminology Journal of research in crime and delinquencyLaw and society review Journal of interpersonal violencePunishment and society Violence and victimsTheoretical criminology Justice quarterlyAdvances in criminological Journal of criminal justicetheoryAustralian and New Crime and delinquencyZealand journal ofcriminologyCrime and delinquency Criminal justice reviewCriminal justice Federal probationand behaviorCriminology and Australian and New Zealandcriminal justice journal of criminologyJournal of criminal law British journal of criminologysocietyJournal of law and Canadian journal of criminology and criminal justiceJournal of quantitative Crime, law and social changecriminologyJournal of research in Criminologiecrime and delinquencyJustice quarterly Crime and justiceLaw and policy Criminal justice and behaviorLaw and social inquiry International journal of comparative and applied criminal justicePolicing and society International journal of offender therapy and comparative criminologySocial and legal studies Social justiceSources: Brown & Daly 2008; Cohn & Farrington 2008