Posts

Showing posts with the label technology

Are Algorithms Required for Ethical Legal Research?

Image
As we are increasingly aware, the ethical Duty of Technology Competence requires lawyers to keep abreast of “changes in the law and its practice, including the benefits and risks associated with relevant technology. ” To date, 35 states have adopted the duty . In a previous post , I highlighted  the risks of blindly relying on algorithmic results  (relevant technology) as a potential violation of the Duty of Technology Competence. We now have case law from Canada focusing on the benefits of using algorithmic results to perform legal research. In fact, this case law may be interpreted as requiring the use of algorithmic results when ethically performing legal research.  In both Cass v. 1410088 Ontario Inc. (“Cass”) and Drummond v. The Cadillac Fairview Corp. Ltd. (“Drummond”) justices of the Ontario Superior Court made comments about artificial intelligence and legal research. The Cass case was a slip and fall in which the defendant prevailed. The plaintiff, who ...

Error of the Day & Maintaining Integrity of Algorithmic Results

Image
If you're into algorithms, you should absolutely subscribe to the MIT Technology Review newsletter called The Algorithm . Earlier this week, the folks at The Algorithm asked "what is AI, exactly?" The answer is reproduced below. The question may seem basic, but the answer is kind of complicated. In the broadest sense, AI refers to machines that can learn, reason, and act for themselves. They can make their own decisions when faced with new situations, in the same way that humans and animals can. As it currently stands, the vast majority of the AI advancements and applications you hear about refer to a category of algorithms known as machine learning. These algorithms use statistics to find patterns in massive amounts of data. They then use those patterns to make predictions on things like what shows you might like on Netflix, what you’re saying when you speak to Alexa, or whether you have cancer based on your MRI. Machine learning, and its subset deep learning...

Algorithms, Fake News, & The Google Generation

Image
At the Ohio Regional Association of Law Libraries (ORALL) Annual Meeting, as I presented on the  duty of technology competence in the algorithmic society , an astute law librarian asked (paraphrasing), "how does fake news play into this?" That question gave rise to a flurry of brain activity, as I considered how Google, for example, ranks relevancy, the rise of fake news, and the ability of users to spot fake news sources -- particularly for legal research. As I was presenting to a group of lawyers at a CLE this week, I polled them asking about the electronic resource that they primarily use for legal research. The overwhelming response was Google. Google uses a trademarked, proprietary – mostly secret – algorithm called PageRank, which assigns each webpage a relevancy score based on factors, such as: The frequency and location of keywords within the webpage. If the keyword only appears once within the body of the page, it will receive a low score for that key...

AI in Teaching; AI in Law

Image
The Chronicle of Higher Education recently published an article discussing how artificial intelligence is changing teaching (sub. req'd). The discussion centered around many of the same themes that we see when discussing artificial intelligence in law. The CHE article asks the common questions: When you’ve got artificial intelligence handling work that is normally done by a human, how does that change the role of the professor? And what is the right balance of technology and teaching? Replace "professor" and "teacher" for "lawyer" and "lawyering," and you get the idea. Like the augmenting argument for law , the argument for teaching goes: They automate some of teaching’s routine tasks, so that professors can do what no machine can — challenge and inspire students to gain a deeper understanding of what they’re learning.  And just like the argument that law will become increasingly reliant on AI raising privacy and ethical concerns , s...

Ravel View for Lexis Advance Visually Showcases Case Data for Faster Searching

Image
Context : Daniel Lewis was just in his second year at Stanford Law School when he had an idea for a different way to do legal research. His idea was to display search results visually, along a cluster map that shows the relationships among cases and their relative importance to each other. Shortly after he graduated in 2012, he and classmate Nicholas Reed had launched the legal research platform derived from his idea, Ravel Law. Last June, five years after its founding, Ravel was acquired by legal research giant LexisNexis. Ravel View for Lexis Advance is here! In the latest iteration of Lexis's push to sift through massive amounts of data and provide meaningful results, Ravel View provides additional metrics and a visual, data-driven view for legal research results. The programmers' constant tweaking of Lexis Advance to aid users is wonderful, but Ravel View showcases a truly innovative step in legal research visualization that meets users where they are likely to look. ...

A Legal Framework for the "Information Apocalypse"

Image
In 2009, a CNN article noted that the law is "at least five years behind technology as it is developing." In late 2016,  Aviv Ovadya was one of the first people to see that there was something fundamentally wrong with the internet. A few weeks before the 2016 election, he presented his concerns to technologists in San Francisco’s Bay Area and warned of an impending crisis of misinformation in a presentation he titled “Infocalypse.” Ovadya saw early what many — including lawmakers, journalists, and Big Tech CEOs — wouldn’t grasp until months later: Our platformed and algorithmically optimized world is vulnerable — to propaganda, to misinformation, to dark targeted advertising from foreign governments — so much so that it threatens to undermine a cornerstone of human discourse: the credibility of fact. Ovadya — now the chief technologist for the University of Michigan’s Center for Social Media Responsibility and a Knight News innovation fellow at the Tow Center for D...

Creatively Harvesting Bluebook Data

Image
As late as 2016, I was ready to join Justice Posner and  give up on The Bluebook . After research into the use of algorithms in the era of big data , however, my thinking has changed. The Chronicle of Higher Education recently ran an article articulating the concerns with following a particular citation style. The problem with the rules-heavy approach to teaching [citation] isn’t just the rigidity with which students are taught those rules or follow them. It’s that too often students are taught rules without any context or justification. That’s just "the way things are." Students are left following rules just because a [law review editor] told them to, none the wiser about their function or history. It’s a recipe for seeing writing as foreign or external — something a student is supposed to do but not necessarily understand. Just follow the rules, kid, and there won’t be any trouble. Instead of taking this approach to citation, the author leads a discussion  not abo...

Empirical Study Shows Algorithmic Bias in Library Discovery Layers

Image
Discussions surrounding algorithmic bias are fairly common . We've even seen discussion of algorithmic bias in  library discovery tools.  Most of this discussion, though, has been theoretical. In what is purportedly the first empirical study to analyze algorithmic bias in library discovery systems, Matthew Reidsma  put ProQuest's Topic Explorer to the test to review potential biases affecting results. More and more academic libraries have invested in discovery layers, the centralized “Google-like” search tool that returns results from different services and providers by searching a centralized index. The move to discovery has been driven by the ascendence of Google as well as libraries' increasing focus on user experience. Unlike the vendor-specific search tools or federated searches of the previous decade, discovery presents a simplified picture of the library research process. It has the familiar single search box, and the results are not broken out by provider or f...

The Importance of Using Reasonable Care When Relying on Algorithms in Law: A Case Study

Image
Given the issues with the "Google Generation" and seeming ease of using algorithms in law, there are increasing challenges in using reasonable care to comply with the newer Duty of Technology Competence .  As noted in a previous post : The Duty of Technology Competence requires lawyers to keep abreast of “changes in the law and its practice, including the benefits and risks associated with relevant technology.” To date, 28 states have adopted the duty. Using reasonable care to understand the benefits and risks associated with relevant technologies is increasingly difficult as society moves beyond the abundance of information that defined the Information Age to increasingly rely on algorithms that sort big data in the Algorithmic Society. However, reasonable care is essential when using algorithms in law. Take the COMPAS risk-assessment tool, for example. Developed by a private company called Equivant (formerly Northpointe), COMPAS—or the Correctional Offender Ma...

Disruption in Law: Algorithms that Doubt Themselves

Image
After learning more about AI systems and their predicted disruption in law and legal research , one of the most compelling arguments against blindly relying on algorithms is the lack of transparency and underlying probability for error.  This may be less of a concern going forward as the MIT Technology Review reports that Google and others are building AI systems that doubt themselves .  Researchers at Uber and Google are working on modifications to the two most popular deep-learning frameworks that will enable them to handle probability. This will provide a way for the smartest AI programs to measure their confidence in a prediction or a decision—essentially, to know when they should doubt themselves. The work reflects the realization that uncertainty is a key aspect of human reasoning and intelligence. Adding it to AI programs could make them smarter and less prone to blunders, says Zoubin Ghahramani, a prominent AI researcher who is a professor a...

The Duty of Tech in the Algorithmic Society

Image
The age of legal tech is upon us. The possibilities are endless, and the potential access to justice benefits have never been greater . One thing is certain: law will never be less technologically oriented than it is today. This certainty may induce excitement or fear, but we all should proceed with reasonable care. In fact, it may be an ethical violation not to. The Duty of Technology Competence requires lawyers to keep abreast of “changes in the law and its practice,  including the benefits and risks associated with relevant technology.” To date, 28 states have adopted the duty. Using reasonable care to understand the benefits and risks associated with relevant technologies is increasingly difficult as society moves beyond the abundance of information that defined the Information Age to increasingly rely on algorithms that sort big data in the Algorithmic Society. The difficulty is in how easily algorithms retrieve "relevant" information. Couple this perceived eas...

Artificial Intelligence in Law Schools: Busting the Silo

Image
As we further consider how to train future lawyers for the Algorithmic Society and develop the quality of thinking, listening, relating, collaborating, and learning that will define smartness in this new age, law schools must reach beyond their storied walls. In law, we must got beyond talking about algorithmic implications to actually help shape algorithmic performance. We need lawyers and programmers to work together to create a sound "machine learning corpus." There's potential for an entirely new subfield to emerge if given the right support. With many law school attached to major research universities, it's a great place to start this cross-pollination and interdisciplinary work. This type of interdisciplinary work would help to satisfy the career aspirations of advanced-degree seekers but also the wishes of many college presidents, deans, and faculty members who see an interdisciplinary professional education as a path to greater relevance, higher enroll...

2018 A Legal Research Odyssey

Image
Law Library Journal has accepted my manuscript for 2018 A Legal Research Odyssey: Artificial Intelligence as Disruptor .  The abstract: Cognitive computing is revolutionizing finance through the ability to combine structured and unstructured data and provide precise market analysis. It is also revolutionizing medicine by providing well-informed options for diagnoses. Analogously, ROSS, a progeny of IBM’s Watson, is set to revolutionize the legal field by bringing cognitive computing to legal research. While ROSS is currently being touted as possessing the requisite sophistication to perform effortless legal research, there is a real danger in a technology like ROSS causing premature disruption. As in medicine and finance, cognitive computing has the power to make legal research more efficient. But the technology is not ready to replace the need for law students to learn sound legal research process and strategy. When done properly, legal research is a highly creative skill t...

Training Lawyers for the Algorithmic Society

Image
After delving deeper into how AI will affect legal research , it's natural to develop a healthy fear about what is being dubbed the "Algorithmic Society." In the Algorithmic Society, we will continue to increasingly rely on algorithms to govern populations. While we're not at a point where algorithms can understand natural language processing akin to the human brain, it's not inconceivable that with technology's exponential rate of acceleration that computers will one day be able to master the highest levels of natural language processing and "think" like a human brain. As computers get closer to thinking like humans, where does that leave us? According to the Harvard Business Review (sub req'd), What is needed is a new definition of being smart, one that promotes higher levels of human thinking and emotional engagement. The new smart will be determined not by what or how you know but by the quality of your thinking, listening, relatin...

Librarians Guiding the Use of Classroom Technology

Image
As librarians, we are often the go-to institutional source for teaching technologies. In law, the faculty often look to us to help train on and maintain these technologies for the benefit of the law school community. And with a 21st Century library's focus on service , we are happy to help. To that end, The Teacher's Guide to Tech 2017 is an invaluable resource. It’s a 265-page digital binder you’ll use all year: Keep it on your desktop, laptop, tablet — even your phone — to help you navigate the tech world with confidence. Like having a tech-savvy friend on call to explain things in plain language, the guide will give you a sense of control over all the options. The guide explains over 150 tools in clear, simple language. All tools are grouped into categories based on what they do. Each section starts with a discussion of classroom applications. Then it takes one tool at a time, explaining what it does, how you can use it in the classroom, what it costs, and what pla...

Law Library Collections as Palimpsest

Image
According to Dictionary.com, Palimpsest is defined as: noun 1. a parchment or the like from which writing has been partially or completely erased to make room for another text In the case of most law libraries, the "other text" is now electronic. As late as 2015, I was still in denial about the transition . Many of my blog posts have centered around the benefits of print ( here , here , here , here ). I still love print, and I still believe that there is a beauty in the serendipity of exploring the stacks. But even physically exploring the stacks is less relevant today. For example, our catalog now shows a preview of the books on the shelf near a book that we are interested in. When performing a search for Divergent Paths by Richard Posner, the following virtual browse display shows the books nearby: Budget constraints coupled with patron preference for electronic access means that our print collections are dwindling. There's no use romanticizing print while...

Law Librarians Who (Know) Code

Image
At a recent talk, it was recommended that law librarians learn enough about coding to understand how coding intersects with the organization and retrieval of information. To ensure that our systems function properly, we should all, at minimum, know what a programming language is, how to talk about it, and what coding can and cannot do. We must understand what coding is, how it relates to libraries, what can reasonably be asked of code, and the threshold concepts that are required to work alongside those who actually write the code. Law librarians understand how the end user interacts with the various retrieval systems. We understand the intersectionality of cases, statutes, and regulations, etc.... As well as best practices for accessibility and the practical search skills of our prospective or practicing lawyers. For a retrieval system to work well, it must be coded with all of these considerations in mind. A programmer, working alone, may not have this wholistic view. Now that ...

Law Libraries Respond to Changes in ABA Reporting

Image
In the seven years that I've been a law librarian, ABA reporting for law libraries has made a fairly dramatic shift from measuring inputs to measuring outputs. Chapter 6 of the Standards, along with most of the Standards, now places an emphasis on outcomes instead of inputs. For libraries, that means an analysis of how well the patrons of a library are being served rather than how much we spend for various activities, and much of the information now required comes from the sabbatical site visits rather than from annual information on expenditures or staff. One of my colleagues recently pointed out that during an ABA site visit, law libraries must highlight how our patrons are being served. As the physical collections shrink, we need to focus more on customer service.   This same colleague opined that, on the horizon, law school administrator's will look at this [measuring outputs only] as another opportunity to slash library budgets particularly in regard to print. Outsid...

A Young Librarian in the Field: Digital Archivist

Image
To go along with a recent blog post on practical considerations for a career is law librarianship , I thought I would highlight a type of librarian that is needed now more than ever. Newsworks profiled a young librarian working as a digital archivist to highlight the librarian of the future. As mentioned in the article, several years ago, Forbes Magazine listed the advanced degrees with the worst job prospects—and a master's in library sciences was No. 1 on the list. Despite that gloomy prediction and some staid image problems, young librarians say their work is relevant in the 21st Century and is as needed now as it has ever been. Jarrett Drake learned librarianship at the University of Michigan School of Information. He's Princeton University's first-ever digital archivist, which is a librarian who preserves things created on computing devices. His job is to figure out how to safeguard ones and zeros, and to do that, he gets help from a $10,000 machine called ...