{"id":3967,"date":"2017-02-24T16:46:01","date_gmt":"2017-02-24T21:46:01","guid":{"rendered":"http:\/\/blog.law.cornell.edu\/voxpop\/?p=3967"},"modified":"2017-02-24T16:46:01","modified_gmt":"2017-02-24T21:46:01","slug":"25-for-25-austlii-1995-what-did-we-think-we-were-doing","status":"publish","type":"post","link":"https:\/\/blog.law.cornell.edu\/voxpop\/2017\/02\/24\/25-for-25-austlii-1995-what-did-we-think-we-were-doing\/","title":{"rendered":"25 for 25: AustLII 1995: What did we think we were doing?"},"content":{"rendered":"

<\/a>From an equally long time ago, and in one of those galaxies so far far away it is sometimes mistaken for the mythical Oz, we received <\/span>Tom Bruce\u2019s call<\/span><\/a> for reflection on the history of free access to legal information. “Here’s what we *thought* we were doing, and here’s what it really turned into”, he suggested, so I have taken him up on that. Andrew Mowbray and I started the Australasian Legal Information Institute (AustLII) in 1995, and our second employee, Philip Chung, now AustLII\u2019s Executive Director, joined us within a year. We are still working together 22 years later.<\/span><\/p>\n

AustLII had a back-story, a preceding decade of collaborative research from 1985, in which Andrew and I were two players in the first wave of \u2018AI and law\u2019 (aka \u2018legal expert systems\u2019). Our \u2018DataLex Project\u2019 research was distinctive in one respect: we insisted that \u2018inferencing systems\u2019 (AI) could not be a closed box, but must be fully integrated with both hypertext and text retrieval (for reasons beyond this post). Andrew wrote our own search engine, hypertext engine, and inferencing engine; we developed applications on IP and on privacy, and had modest commercial success with them in the early 90s. Tools for relatively large-scale automation of mark-up of texts for hypertext and retrieval purposes were a necessary by-product. In that pre-Web era, when few had CD ROM drives, and free access to anything was impractical and unknown, products were distributing on bundles of disks. Our pre-Web ideology of \u2018integrated legal information systems\u2019 is encapsulated in a <\/span>1995 DataLex article<\/span><\/a>. But a commercial publisher pulled the plug on our access to necessary data, and DataLex turned out to have more impact in its non-commercial after-life as AustLII. <\/span><\/p>\n

Meanwhile, in January 1995 Andrew and I (for UTS and UNSW Law Schools) had obtained a grant of AUD $100,000 from the Australian Research Council\u2019s research infrastructure fund, in order to explore the novel proposition that the newly-developing World-Wide-Web could be used to distribute legal information, and for free access, to assist academic legal research. A Sun SPARCstation, one ex-student employee, and a part-time consultant followed. <\/span>Like Peter & Tom<\/span><\/a> we sang from Paul Simon\u2019s text, \u2018let\u2019s get together and call ourselves an Institute\u2019, because it sounded so established.<\/span><\/p>\n

What were we thinking? (and doing)<\/i><\/b><\/p>\n

What were we thinking when we obtained this grant, and put it into practice in that first year? We can reconstruct this somewhat, not simply from faulty memories, but from what we actually did, and from our <\/span>first article about AustLII<\/span><\/a> in 1995, which contained something of a manifesto about the obligations of public bodies to facilitate free access to law. So here are things we did think we were doing in 1995 \u2013\u00a0no doubt we also had some bad ideas, now conveniently forgotten, but these ones have more or less stuck.<\/span><\/p>\n

    \n
  1. End monopolies<\/span><\/i> \u2013\u00a0Australia had been plagued for a decade by private sector and public sector monopolies (backed by Crown copyright) over computerised legal data. Our core principle was (polite) insistence on the <\/span>\u2018right to republish\u2019<\/span><\/a> legislation, cases, and other publicly funded legal information. We appropriated our first large database (Federal legislation), but got away with it. The High Court told the federal government to supply \u2018its cases\u2019 to AustLII, and other courts followed.<\/span><\/li>\n
  2. Rely on collaboration<\/span><\/i> \u2013\u00a0Our <\/span>1995 \u2018manifesto\u2019 insisted<\/span><\/a> that courts and legislative offices should provide the best quality data available to all who wished to republish it. Insistence on collaboration was a survival strategy, because we would never have enough resources to manage any other way. From the start, some courts started to email cases, and adopt protocols for consistent presentation, and eventually all did so. <\/span><\/li>\n
  3. Disrupt publishing<\/span><\/i> \u2013\u00a0Much Australian commercial legal publishing in 1995 was not much more than packaging raw legal materials, with little added value, for obscene prices. We <\/span>stated that<\/span><\/a> we intended to force 2<\/span>nd<\/span>-rate publishing to lift its game (\u2018you can\u2019t compete with free\u2019). It did, and what survived, thrived.<\/span><\/li>\n
  4. Stay independent <\/span><\/i>\u2013\u00a0While we had material support from our two Law Schools, and an ARC start-up grant, we tried from the start to be financially independent of any single source. Within a year we had other funds from a Foundation, and a business group (for industrial law), and were negotiating funding from government agencies. Later, as the funds needed for sustainability became larger, this was much more of a challenge. However, independence meant we could publish any types of content that we could fund, with no one else dictating what was appropriate. A 93 volume Royal Commission report on <\/span>\u2018Aboriginal deaths in custody\u2019<\/span><\/a> for which the federal government had \u2018lost\u2019 the master copy was an early demonstration of this. <\/span><\/li>\n
  5. Automate, integrate, don\u2019t edit<\/span><\/i> \u2013\u00a0The DataLex experience gave us good <\/span>tools for complex automated mark-up<\/span><\/a> of large sets of legislation, cases etc. Collaboration in data supply from official bodies multiplied the effect of this. We edited documents only when unavoidable. Sophisticated hypertexts also distinguished the pioneering work of the LII (Cornell) and LexUM from the chaff of commercial publishers. AustLII <\/span>inherited from DataLex<\/span><\/a> a preoccupation with combining the virtues of hypertext and text retrieval, most apparent from day 1 in the \u2018Noteup\u2019 function.<\/span><\/li>\n
  6. Cater for all audiences <\/span><\/i>\u2013\u00a0Our initial grant\u2019s claim to serve academic research was only ever a half-truth, and <\/span>our intention<\/span><\/a> was to try to build a system that would cater for all audiences from practitioners to researchers to the general public. The LII (Cornell) had already demonstrated that there was a \u2018latent legal market\u2019, an enormous demand for primary legal materials from the public at large. <\/span><\/li>\n
  7. All data types welcome<\/span><\/i> \u2013\u00a0We believed that legislation, cases, treaties, law reform, and some publicly-funded scholarship should all be free access, and a LII should aim to provide them, as its resources allowed. This was a corollary of aiming to \u2018serve all audiences\u2019. In AustLII\u2019s first year we included examples of all of these (and a Royal Commission report), the final element being the Department of Foreign Affairs agreement to partner a <\/span>Treaties Library<\/span><\/a>. It took us much longer to develop serious <\/span>\u2018law for the layperson\u2019 content<\/span><\/a>.<\/span><\/li>\n
  8. \u2018Born digital\u2019 only <\/span><\/i>\u2013\u00a0In 1995 there was already more digital data to gather than AustLII could handle, and scanning\/OCR\u2019ing data from paper was too expensive and low quality, so we ignored it, for more than a decade.<\/span><\/li>\n
  9. \u2018Comprehensiveness\u2019 <\/span><\/i>\u2013 As <\/span>Daniel Poulin says<\/span><\/a> in this series, AustLII was first to aim to create a nationally comprehensive free access system, or to succeed. \u00a0But the initial aims of comprehensiveness were limited to the current legislation of all 9 Australian jurisdictions, and the decisions of the superior courts of each. That took 4 years to achieve. \u00a0Addition of decisions of all lower courts and tribunals, and historical materials, were much later ambitions, still not quite achieved.<\/span><\/li>\n
  10. \u2018Australasian\u2019 but \u2018LII\u2019<\/span><\/i> \u2013 We asked Cornell if we could borrow the \u2018LII\u2019 tag, and had vague notions that we might be part of a larger international movement, but no plans. \u00a0Our 1995 article exaggerates in saying \u2018AustLII is part of the expanding international network of public legal information servers\u2019 \u2013\u00a0we wished! However, the \u2018Australasian\u2019 aim was serious: <\/span>NZLII<\/span><\/a>\u2019s superb content is a major part of AustLII, but PNG content found a better home on <\/span>PacLII<\/span><\/a>.<\/span><\/li>\n
  11. Neutral citations, backdated<\/span><\/i> \u2013 As soon as AustLII started receiving cases, we applied our own \u2018neutral citations\u2019 (blind to medium or publisher) to them, and applied this retrospectively to back-sets, partly so that we could automate the insertion of hypertext links. <\/span>As in Canada<\/span><\/a>, this was a key technical enabler. A couple of years later, the High Court of Australia led the Council of Chief Justices to adopt officially a slight variation of what AustLII had done (and we amended our standard). The neutral citation standard set with \u2018[1998] HCA 1\u2019 has since been \u00a0adopted in many common law countries. AustLII has applied it retrospectively as a parallel citation, for example <\/span>\u2018[1220] EngR 1<\/span><\/a>\u2019 and so on. Later, the value of neutral citations as a common-law-wide interconnector enabled the <\/span>LawCite citator<\/span><\/a>.<\/span><\/li>\n
  12. Reject \u2018value-adding\u2019<\/span><\/i> \u2013 We saw invitations to distinguish \u2018value-added\u2019 (now \u2018freemium\u2019 or chargeable) services \u00a0from \u00a0AustLII\u2019s \u2018basic\u2019 free content as a slippery slope, a recipe for free access always being second rate. So AustLII has stayed 100% free access content, including all technical innovations. <\/span><\/li>\n
  13. \u2018Free\u2019 includes free from surveillance<\/span><\/i> \u2013 Access was and is anonymous with no logins, cookies, advertisements or other surveillance mechanisms beyond logging of IP addresses. We used the <\/span>Robot Exclusion Standard<\/span><\/a> to prevent spidering\/searching of case law by Google etc, and most (not all) other LIIs have done likewise. This has helped establish a reasonable balance between privacy and open justice in many common law jurisdictions. It also helps prevent asset stripping \u2013\u00a0AustLII is a free access publisher, not \u00a0a repository. <\/span><\/li>\n<\/ol>\n

    This \u2018bakers dozen\u2019 aspirations comes from another century, but the issues and questions they address still need consideration by anyone aiming to provide free access to law.<\/span><\/p>\n

    Why we were lucky<\/i><\/b><\/p>\n

    In at least four respects, we did not know how fortunate we were in Australia: the Australian Research Council awarded annual competitive grant funding for development of research infrastructure, not just for research; all Australian law schools were willing to back AustLII as a joint national facility (already in 1995 \u2018supported by the Australian Committee of Law Deans\u2019); UNSW and UTS Law Faculties backed us with both material assistance and academic recognition; later, we obtained charitable status for donations; and our courts never required AustLII to redact cases (contrast Canada and New Zealand), they did it themselves where it was necessary. Our colleagues in other common law jurisdictions were often not so fortunate. <\/span><\/p>\n

    Cornell, LexUM and AustLII were all also fortunate to be better prepared than most commercial or government legal information publishers to take advantage of the explosion of \u00a0public usage of the Internet (and the then-new WWW) in 1994\/5. None of us were \u2018just another publisher\u2019, but were seen as novel developments. Later LIIs did not have this \u2018first mover advantage\u2019, and often operated in far more difficult circumstances in developing countries. <\/span><\/p>\n

    Unimaginables<\/i><\/b><\/p>\n

    Given what AustLII, and free access to law globally, have developed into, what did we <\/span>not<\/span><\/i> imagine, back in 1995? Here are a few key unforseens.<\/span><\/p>\n

    Digitisation from paper did not became financially feasible for AustLII until about 2007. Since then, capturing historical data has become a major part of what AustLII does, with results such as the complete back-sets of <\/span>over 120 non-commercial Australasian law journals<\/span><\/a>, \u00a0and almost <\/span>all Australasian reported cases and annual legislation 1788-1950<\/span><\/a>. The aims of both \u2018horizontal\u2019 comprehensiveness of all current significant sources of law, and \u2018vertical\u2019 comprehensiveness of past sources, is new and no longer seems crazy nor unsustainable.<\/span><\/p>\n

    We did not envisage the scale of what AustLII would need to manage, whether data (currently <\/span>749 Australasian databases<\/span><\/a>, and almost as much again internationally), sources (hundreds of email feeds), page accesses (about 1M per day), or collaborations (daily replication of other LII content), nor the equipment (and funding) demands this scale would pose. Independence allowed us to obtain hundreds of <\/span>funding contributors<\/span><\/a> for maintenance. Innovative developments are still supported by ARC and other grants. The future holds no guarantees, but as Poulin says, history has now demonstrated that sustainable large-scale LII developments are possible.<\/span><\/p>\n

    While AustLII\u2019s initial aims were limited to Australasia, by the late 90s requests for assistance to create similar free access LIIs involved AustLII, LexUM and the LII (Cornell) in various countries. The Free Access to Law Movement (<\/span>FALM<\/span><\/a>) has expanded to nearly 70 members, has directly delivered considerable benefits of free access to law in many countries, and has encouraged governments almost everywhere to accept that free access to legislation and cases is now the norm, in a way that it was not in the early 90s. The delivery of free access content by independent LIIs has, for reasons <\/span>Poulin outlines<\/span><\/a>, turned out to sit more comfortably in common law than in civil law jurisdictions, and no global access to law via a LII framework has emerged. However, although this was not envisaged back in 1995, AustLII has been able to play a coordinating role in a network of collaborating LIIs from many common law jurisdictions, with compatible standards and software, resulting in access via <\/span>CommonLII<\/span><\/a> to nearly 1500 databases, and to the daily interconnection of their citations via <\/span>LawCite<\/span><\/a>. This extent of collaboration was not foreseeable in 1995.<\/span><\/p>\n

    Every free access to law provider has a different story to tell, with different challenges to overcome in environments typically much more difficult than Australia. Somewhere in each of our stories there is a corner reserved for the pioneering contributions of Martin, Bruce and the LII at Cornell. The LII (Cornell) continues to innovate 25 years after they set the wheels in motion. <\/span><\/p>\n

    Graham Greenleaf is Professor of Law & Information Systems at UNSW Australia. He was co-founder of AustLII, with Andrew Mowbray, and Co-Director (with Andrew and Philip Chung) until 2016, and is now Senior Researcher. <\/span><\/i><\/p>\n","protected":false},"excerpt":{"rendered":"

    From an equally long time ago, and in one of those galaxies so far far away it is sometimes mistaken for the mythical Oz, we received Tom Bruce\u2019s call for reflection on the history of free access to legal information. “Here’s what we *thought* we were doing, and here’s what it really turned into”, he […]<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5012],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/posts\/3967"}],"collection":[{"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/comments?post=3967"}],"version-history":[{"count":1,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/posts\/3967\/revisions"}],"predecessor-version":[{"id":3968,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/posts\/3967\/revisions\/3968"}],"wp:attachment":[{"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/media?parent=3967"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/categories?post=3967"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.law.cornell.edu\/voxpop\/wp-json\/wp\/v2\/tags?post=3967"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}