Triage and expert systems in legal aid:
New tools to assist people in need and the
advocates that serve them
July 23, 2014
Our panel today
Zach Hutchinson
Student and Research Assistant, Georgetown University Law Center
Adam Friedl
Program and Special Initiatives Manager at Pro Bono Net
Donna Dougherty
Attorney-in-Charge at JASA/Legal Services for the Elderly in Queens
Marc Lauritsen
President, Capstone Practice Systems
Liz Keith (Moderator)
Program Director, Pro Bono Net
Takeaways
How can new technologies and
design approaches:
• Aid advocates with legal
screening, triage and analysis
• Help litigants navigate unfamiliar
process
• Support community partnerships
to expand access to assistance
Community approaches
• Neota Logic
• Drools engine
• HotDocs and A2J Author guided
interviews
• Drupal-based options
• HTML / Javascript (for simple,
formulaic tools)
• You tell us!
Resources on other “next generation”
triage and intake initiatives
• 2013 LSNTAP.org training – Beyond Online Intake
• http://www.slideshare.net/LSNTAP/beyond-online-intake-final
• 2014 LSC TIG Conference workshop – Online Triage and Intake: To
Infinity and Beyond
• http://tig.lsc.gov/tig-conference/past-conferences/2014-tig-
conference
• 2014 EJC workshop – Online Intake and Triage Systems
• http://www.americanbar.org/groups/probono_public_service/resour
ces/archive/workshop_archive_20131.html
• 2013 LSC Technology Initiative Grant awards
• http://tig.lsc.gov/sites/lsc.gov/files/TIG/pdfs/TIG-2013grants.pdf
Three Triage and Legal Analysis
Expert Systems Developed at
Georgetown University Law Center
Zach Hutchinson
Student and Research Assistant,
Georgetown University Law Center
EJC Wage Theft App - Triage and Legal Analysis
https://lawstudents.neotalogic.com/a/wagetheft
OAH Unemployment App - Simple Legal Analysis
https://lawstudents.neotalogic.com/a/oah-advisor
MIDAS (Military Discharge App) – Complex Legal Analysis
https://lawstudents.neotalogic.com/a/midas-dec3-2013
Expert Systems Discussion
• Thinking like a programmer – building the app
• Thinking like a lawyer – domain knowledge
• Thinking like a designer – user experience
The DEN
Debt and Eviction Navigator
https://lawstudents.neotalogic.com/a/jasa-den
Donna Dougherty, JASA Legal Services
for the Elderly
Adam Friedl, Pro Bono Net
The Big Idea:
• Enable social workers visiting homebound,
elderly clients to perform legal screenings
• 2 areas of focus (I didn’t want to say “foci”):
• Housing
• Consumer Debt
• Direct clients to appropriate
resources/referrals
Expert Systems
• Screening process designed by substantive
experts
• Interviewer diagnoses client situation and
suggests next steps
• Social worker is on hand to help facilitate and
navigate
Future steps
• Eventually incorporate e-filing
• Broaden subject areas
• Generate Statistical Data, Analysis and
Reports
Tools of Choice
Marc Lauritsen
July 2014
Going beyond
databases,
document assembly,
guided interviews,
and
expert systems
Supporting choice
requires
Databases are great for
• Gathering, storing, and retrieving information
• Searching and finding information
• Not just numbers and texts, but images,
sounds, video, …
• Statistics, reports
Document assembly is great for
• Creating customized documents and forms
• Intelligent questionnaires and checklists
• Information gathering
• Individualized guidance
A2J guided interviews are great for
• Gathering information needed for document
assembly, case intake, or other purposes
• Audio, video, images
• Making online resources more accessible
• Individualized guidance
Expert systems are great for
• Rule-based reasoning
(backward and forward chaining)
• Non-procedural (‘declarative’) knowledge
• Explanation
• Individualized guidance
But
None of these are particularly good
for helping people make choices
Choices involve
competing values and
perspectives
They’re not algorithmic
You can’t look up or compute the answer
Law-related Choices
Clients and Self-helpers
• Ways to deal with legal
problems
• Lawyer/firm selection
• Business decisions
• Entity type
• Hiring/firing
• Employee/contractor
• Compliance, risk
management
• Negotiation and settlement
Professionals
• What position to take, what
advice to give
• Case triage
• Litigation
• Where to file
• What witnesses to call
• What arguments to make
• Business
• What software or hardware
• What vendors/consultants
• Who to hire
Legal Services Contexts
• Which types of cases to accept
• Which particular clients to help, with what forms
of assistance
• Case strategy – what claims to make where; what
arguments/evidence to emphasize
• Contract/settlement negotiation – which package
of terms lets you ‘get to yes’
• Which office technology to adopt
• LSC technology funding priorities
Example: Triage
Factors in play
• Recipient needs, interests, & circumstances
• Nature of ‘stake’ and likelihood of success
• Capacity for self-help
• Provider resources, interests, & circumstances
• Availability
• Priorities / Preferences
• System/Society interests
• Fairness
• Overall impact on just outcomes
• System improvement
Challenges
• Demand greatly exceeds resources
• Complex recipient circumstances
• Changing provider circumstances (resource
availability, priorities)
• Competing views about which kinds of
problems deserve which kinds of assistance
Representation
Online Doc
Assembly
Lsntap triage and expert systems slides
BUT …
Most decisions involve many
“hands”:
• more than two options, and
• more than a couple considerations,
• of varying degrees of importance,
• with people disagreeing both about the relative
importance of considerations and how the options
‘do’ on them.
How can technology help?
32
Aspen Workflow LawBase Practice Manager
(RealLegal)
Practice Master Time Matters
The product
Essential features
Tickler
Conflict checking
Remote access
Reporting
Other product factors
Document mgt
Timekeeping
Custom intake screens
Integration with DA
Relevance to graduates’
practices
Security options
Vendor stability
User community
Other law schools?
Pre-built modules?
Cost
(product & any newly
required software)
The services
Customization
Training
Cost
Other notes
34
Factor
Factor
Factor
Perspective
Perspective
Perspective
Option Option Option
Rating Rating Rating
Rating Rating Rating
Rating Rating Rating
A choicebox
Features
Interface
Ease of
learning
Jane
John
Combined
Ace Acm
e
Apex
7 8 9
Best Good Better
6 7 5
Choosing a case management
system
Totals 1 3 2
Lsntap triage and expert systems slides
US Legal Services Corporation
Opinions
Ideas
Experiences
??
Lsntap triage and expert systems slides
Lsntap triage and expert systems slides
Lsntap triage and expert systems slides
Note: This data is illustrative. See Greacen report for final ratings.
Going Deeper
• A Decision Space for Legal Service Delivery
• Dancing in the Cloud
• Which – a simple HotDocs-based example of
choiceboxing on LawHelp Interactive
[Best viewed in Chrome or IE]
• Preparing Law Students for Choice Jobs
(Presentation at 2014 CALI conference)
• 'Boxing' Choices for Better Dispute Resolution,
Int'l Journal of Online Dispute Resolution (1) 1,
70-92 (2014)
Thank you to our panel!
Zach Hutchinson - zachary.b.hutchinson@gmail.com
Student and Research Assistant, Georgetown University Law Center
Adam Friedl - afriedl@probono.net
Program and Special Initiatives Manager at Pro Bono Net
Donna Dougherty - ddougherty@jasa.org
Attorney-in-Charge at JASA/Legal Services for the Elderly in Queens
Marc Lauritsen – marc@capstonepractice.com
President, Capstone Practice Systems
Liz Keith (Moderator) – lkeith@probono.net
Program Director, Pro Bono Net
THANK YOU FOR ATTENDING TODAY!
Be sure to check out www.lsntap.org for
information regarding the next LSTNAP Community
Training!
Contact Information
Brian Rowe (brianr@nwjustice.org) or via chat on www.lsntap.org
Don’t forget to take our feedback survey!

More Related Content

PPTX
LSC Technology Initiative Grant Conference 2015 | Session Materials - Tools o...
PDF
Katie Shilton, "Participatory Personal Data"
PPT
PPTX
Data as a service: a human-centered design approach/Retha de la Harpe
PPTX
Systemising advice
PPTX
eDiscovery Perspective
PPTX
The Online Court - CTC 2017
PDF
Practical Data Management Plans
LSC Technology Initiative Grant Conference 2015 | Session Materials - Tools o...
Katie Shilton, "Participatory Personal Data"
Data as a service: a human-centered design approach/Retha de la Harpe
Systemising advice
eDiscovery Perspective
The Online Court - CTC 2017
Practical Data Management Plans

Viewers also liked (9)

PDF
Webinar Next Week: Beyond Online Intake: Looking at Triage and Expert Systems
PPTX
How to Create an Intake Form on Lexicata
Webinar Next Week: Beyond Online Intake: Looking at Triage and Expert Systems
How to Create an Intake Form on Lexicata
Ad

Similar to Lsntap triage and expert systems slides (20)

PDF
Doing More with Less: How Technology is Helping Deliver Legal Services
PPTX
Legal Robots
PPT
ILTA 2011 Integration Of Legal Technology
PDF
SNW Fall 2009
PPTX
Using Technology to Help deliver Advice Services
PDF
1115 track 3 gopalan_using our laptop
PPTX
Reading Industry Tea Leaves to Achieve Automation Proof Skills
PPTX
Could the internet transform legal services for people on low incomes? Innov...
PPT
Chapter1
PDF
Introduction to Legal Technology, lecture 7 (2015)
PPT
2009 Ala Region 5 OM01 Technology Management Strategies: Become a Lean, Mean ...
PPT
ILTA 2011 Integration Of Legal Technology
PPT
ILTA 2011 Integration of Legal Technology
PPT
ILTA 2011 Integration Of Legal Technology
PPTX
Machine Intelligence and the Legal Profession - John O. McGinnis - June 2016 ...
PDF
Introduction to Legal Technology, lecture 10 (2015)
PDF
Legal_Tech_Report_2016
PDF
The Internet Generation
PPT
ILTA 2014: LexisNexis Software Company Update
PPSX
The Financial Times Innovative Lawyers – Global Legal Hackathon Challenge
Doing More with Less: How Technology is Helping Deliver Legal Services
Legal Robots
ILTA 2011 Integration Of Legal Technology
SNW Fall 2009
Using Technology to Help deliver Advice Services
1115 track 3 gopalan_using our laptop
Reading Industry Tea Leaves to Achieve Automation Proof Skills
Could the internet transform legal services for people on low incomes? Innov...
Chapter1
Introduction to Legal Technology, lecture 7 (2015)
2009 Ala Region 5 OM01 Technology Management Strategies: Become a Lean, Mean ...
ILTA 2011 Integration Of Legal Technology
ILTA 2011 Integration of Legal Technology
ILTA 2011 Integration Of Legal Technology
Machine Intelligence and the Legal Profession - John O. McGinnis - June 2016 ...
Introduction to Legal Technology, lecture 10 (2015)
Legal_Tech_Report_2016
The Internet Generation
ILTA 2014: LexisNexis Software Company Update
The Financial Times Innovative Lawyers – Global Legal Hackathon Challenge
Ad

More from Legal Services National Technology Assistance Project (LSNTAP) (20)

PPT
Free and Low Cost Technology Tools for Legal Aid
PPTX
PPTX
PDF
Intro to data analysis framework april 25 2017
Free and Low Cost Technology Tools for Legal Aid
Intro to data analysis framework april 25 2017

Recently uploaded (20)

PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
Architecture types and enterprise applications.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
DOCX
search engine optimization ppt fir known well about this
PDF
Five Habits of High-Impact Board Members
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPTX
Benefits of Physical activity for teenagers.pptx
PPTX
observCloud-Native Containerability and monitoring.pptx
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
The various Industrial Revolutions .pptx
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
CloudStack 4.21: First Look Webinar slides
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
Web Crawler for Trend Tracking Gen Z Insights.pptx
A contest of sentiment analysis: k-nearest neighbor versus neural network
Architecture types and enterprise applications.pdf
A novel scalable deep ensemble learning framework for big data classification...
search engine optimization ppt fir known well about this
Five Habits of High-Impact Board Members
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
Enhancing emotion recognition model for a student engagement use case through...
Univ-Connecticut-ChatGPT-Presentaion.pdf
Group 1 Presentation -Planning and Decision Making .pptx
Taming the Chaos: How to Turn Unstructured Data into Decisions
Benefits of Physical activity for teenagers.pptx
observCloud-Native Containerability and monitoring.pptx
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
The various Industrial Revolutions .pptx
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
CloudStack 4.21: First Look Webinar slides
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Assigned Numbers - 2025 - Bluetooth® Document
Web Crawler for Trend Tracking Gen Z Insights.pptx

Lsntap triage and expert systems slides

  • 1. Triage and expert systems in legal aid: New tools to assist people in need and the advocates that serve them July 23, 2014
  • 2. Our panel today Zach Hutchinson Student and Research Assistant, Georgetown University Law Center Adam Friedl Program and Special Initiatives Manager at Pro Bono Net Donna Dougherty Attorney-in-Charge at JASA/Legal Services for the Elderly in Queens Marc Lauritsen President, Capstone Practice Systems Liz Keith (Moderator) Program Director, Pro Bono Net
  • 3. Takeaways How can new technologies and design approaches: • Aid advocates with legal screening, triage and analysis • Help litigants navigate unfamiliar process • Support community partnerships to expand access to assistance
  • 4. Community approaches • Neota Logic • Drools engine • HotDocs and A2J Author guided interviews • Drupal-based options • HTML / Javascript (for simple, formulaic tools) • You tell us!
  • 5. Resources on other “next generation” triage and intake initiatives • 2013 LSNTAP.org training – Beyond Online Intake • http://www.slideshare.net/LSNTAP/beyond-online-intake-final • 2014 LSC TIG Conference workshop – Online Triage and Intake: To Infinity and Beyond • http://tig.lsc.gov/tig-conference/past-conferences/2014-tig- conference • 2014 EJC workshop – Online Intake and Triage Systems • http://www.americanbar.org/groups/probono_public_service/resour ces/archive/workshop_archive_20131.html • 2013 LSC Technology Initiative Grant awards • http://tig.lsc.gov/sites/lsc.gov/files/TIG/pdfs/TIG-2013grants.pdf
  • 6. Three Triage and Legal Analysis Expert Systems Developed at Georgetown University Law Center Zach Hutchinson Student and Research Assistant, Georgetown University Law Center
  • 7. EJC Wage Theft App - Triage and Legal Analysis https://lawstudents.neotalogic.com/a/wagetheft
  • 8. OAH Unemployment App - Simple Legal Analysis https://lawstudents.neotalogic.com/a/oah-advisor
  • 9. MIDAS (Military Discharge App) – Complex Legal Analysis https://lawstudents.neotalogic.com/a/midas-dec3-2013
  • 10. Expert Systems Discussion • Thinking like a programmer – building the app • Thinking like a lawyer – domain knowledge • Thinking like a designer – user experience
  • 11. The DEN Debt and Eviction Navigator https://lawstudents.neotalogic.com/a/jasa-den Donna Dougherty, JASA Legal Services for the Elderly Adam Friedl, Pro Bono Net
  • 12. The Big Idea: • Enable social workers visiting homebound, elderly clients to perform legal screenings • 2 areas of focus (I didn’t want to say “foci”): • Housing • Consumer Debt • Direct clients to appropriate resources/referrals
  • 13. Expert Systems • Screening process designed by substantive experts • Interviewer diagnoses client situation and suggests next steps • Social worker is on hand to help facilitate and navigate
  • 14. Future steps • Eventually incorporate e-filing • Broaden subject areas • Generate Statistical Data, Analysis and Reports
  • 15. Tools of Choice Marc Lauritsen July 2014
  • 16. Going beyond databases, document assembly, guided interviews, and expert systems Supporting choice requires
  • 17. Databases are great for • Gathering, storing, and retrieving information • Searching and finding information • Not just numbers and texts, but images, sounds, video, … • Statistics, reports
  • 18. Document assembly is great for • Creating customized documents and forms • Intelligent questionnaires and checklists • Information gathering • Individualized guidance
  • 19. A2J guided interviews are great for • Gathering information needed for document assembly, case intake, or other purposes • Audio, video, images • Making online resources more accessible • Individualized guidance
  • 20. Expert systems are great for • Rule-based reasoning (backward and forward chaining) • Non-procedural (‘declarative’) knowledge • Explanation • Individualized guidance
  • 21. But None of these are particularly good for helping people make choices
  • 22. Choices involve competing values and perspectives They’re not algorithmic You can’t look up or compute the answer
  • 23. Law-related Choices Clients and Self-helpers • Ways to deal with legal problems • Lawyer/firm selection • Business decisions • Entity type • Hiring/firing • Employee/contractor • Compliance, risk management • Negotiation and settlement Professionals • What position to take, what advice to give • Case triage • Litigation • Where to file • What witnesses to call • What arguments to make • Business • What software or hardware • What vendors/consultants • Who to hire
  • 24. Legal Services Contexts • Which types of cases to accept • Which particular clients to help, with what forms of assistance • Case strategy – what claims to make where; what arguments/evidence to emphasize • Contract/settlement negotiation – which package of terms lets you ‘get to yes’ • Which office technology to adopt • LSC technology funding priorities
  • 26. Factors in play • Recipient needs, interests, & circumstances • Nature of ‘stake’ and likelihood of success • Capacity for self-help • Provider resources, interests, & circumstances • Availability • Priorities / Preferences • System/Society interests • Fairness • Overall impact on just outcomes • System improvement
  • 27. Challenges • Demand greatly exceeds resources • Complex recipient circumstances • Changing provider circumstances (resource availability, priorities) • Competing views about which kinds of problems deserve which kinds of assistance
  • 30. BUT … Most decisions involve many “hands”: • more than two options, and • more than a couple considerations, • of varying degrees of importance, • with people disagreeing both about the relative importance of considerations and how the options ‘do’ on them.
  • 32. 32
  • 33. Aspen Workflow LawBase Practice Manager (RealLegal) Practice Master Time Matters The product Essential features Tickler Conflict checking Remote access Reporting Other product factors Document mgt Timekeeping Custom intake screens Integration with DA Relevance to graduates’ practices Security options Vendor stability User community Other law schools? Pre-built modules? Cost (product & any newly required software) The services Customization Training Cost Other notes
  • 34. 34
  • 35. Factor Factor Factor Perspective Perspective Perspective Option Option Option Rating Rating Rating Rating Rating Rating Rating Rating Rating A choicebox
  • 36. Features Interface Ease of learning Jane John Combined Ace Acm e Apex 7 8 9 Best Good Better 6 7 5 Choosing a case management system
  • 39. US Legal Services Corporation
  • 44. Note: This data is illustrative. See Greacen report for final ratings.
  • 45. Going Deeper • A Decision Space for Legal Service Delivery • Dancing in the Cloud • Which – a simple HotDocs-based example of choiceboxing on LawHelp Interactive [Best viewed in Chrome or IE] • Preparing Law Students for Choice Jobs (Presentation at 2014 CALI conference) • 'Boxing' Choices for Better Dispute Resolution, Int'l Journal of Online Dispute Resolution (1) 1, 70-92 (2014)
  • 46. Thank you to our panel! Zach Hutchinson - zachary.b.hutchinson@gmail.com Student and Research Assistant, Georgetown University Law Center Adam Friedl - afriedl@probono.net Program and Special Initiatives Manager at Pro Bono Net Donna Dougherty - ddougherty@jasa.org Attorney-in-Charge at JASA/Legal Services for the Elderly in Queens Marc Lauritsen – marc@capstonepractice.com President, Capstone Practice Systems Liz Keith (Moderator) – lkeith@probono.net Program Director, Pro Bono Net
  • 47. THANK YOU FOR ATTENDING TODAY! Be sure to check out www.lsntap.org for information regarding the next LSTNAP Community Training!
  • 48. Contact Information Brian Rowe (brianr@nwjustice.org) or via chat on www.lsntap.org Don’t forget to take our feedback survey!