SlideShare a Scribd company logo
The Path to
Flexible Loading
of Patron Records
into Alma
October 6, 2020, ENUG
Linda Salvesen & Ray Schwartz
William Paterson University of New Jersey
1
Introduction
In many cases, a library chooses to have their University’s IT department code the
XML for the patron load. In our case, we wish the flexibility to be able to assign
certain privileges and statistical categories via the patron load as we did with our
Voyager system.
For example, how do we handle staff that are also students? How do we automate
expiring patrons via the patron load—be they students, adjuncts, or staff/faculty
with a termination date? How do we automate the assignment of statistical
categories?
The Cheng Library converted scripts that were used to create the Voyager SIF files
into scripts that create XML files for Alma.
2
Our University Context
● State university of 8,100 undergraduate and 1,700 graduates.
● Over 400 faculty, 800 adjuncts, 1500 staff.
● Primarily we are a teaching university.
● The University’s IT uses Banner for the Student Information
System (SIS) and the Human Resources System (HRS)
3
Our Library Context
● 14 librarians and 14 staff
● The systems unit consists of 2 librarians and 1 computer
specialist
● All librarians are involved in reference, instruction, collection
development and academic department liaison duties.
4
Outline
●Voyager and our setup for patron loads
●Alma the its patron database system
●Our experience moving from the Voyager to Alma patron load
●Some differences between Alma and Voyager patron databases
5
Our Setup for the Voyager Patron Load
● The SIF Format
● Extracts from SIS and HRS
● Load order of patron files
6
The Patron Record Standard Interface File
aka the SIF is a fixed width text file rather
than a delimited text file.
7
8
9
Extracts from SIS and HRS
We asked IT to regularly extract four files from SIS and HRS to a directory which we mount on
the Voyager server.
● Adjuncts
● Staff
● Faculty
● Students
The files are tab-delimited rather than the SIF format. We parse the files using the Unix program
awk into the fixed width format. And we automatically load the files via a scheduled Unix job on
the Voyager server.
10
Tab Delimited Text File
Standard Interface File (SIF)
11
We wanted to be able to automatically expire the privileges of students.
So we set it up to give them one semester grace.
12
… and adjuncts.
13
.. and to automatically expire faculty and staff after their last date of
employment.
14
We wanted to code the various statistical categories with data such as
major, department, and so on.
From students
● Major,
● 2nd major,
● class,
● credits,
● full or part-time,
● college,
● registration date,
● degree.
from staff
● Status (adjunct, faculty,
managerial or staff),
● department,
● college,
● division,
● full or part-time,
● tenured.
In addition to the standard set of fields, we asked IT to extract ...
15
With Voyager, statistical categories could only be 3 characters. So each category
we hardcoded and converted. The awk file would contain over 600 lines of code.
16
Load order of patron files
Since there are individuals that have multiple statuses (e.g., Faculty or
staff that are also students), we load the files in this particular order
● Adjuncts
● Staff
● Faculty
● Students
It was the request from the Head of Circulation to load the students
last so stats could be culled from ALL student circ activity.
17
Alma and its patron database system
● Setting up Integration Profiles and S/FTP definitions
● Coding XML
● Configuring Statistical Categories and their Category Types.
18
How patron load works in Alma
● Patron data is converted to an XML format and then into a zip file by the
Library
● The zip file is loaded onto an S/FTP server deployed by the Library
● An S/FTP Definition is defined in Alma
● An Integration Profile is defined in Alma and scheduled to run at certain
intervals to pick up the zip file from the S/FTP server and process it into the
patron database.
19
Setting up
S/FTP definitions
and Integration Profiles
20
Preparing for the S/FTP Definitions
We have a Red Hat Linux server for the Library so we …
● Mounted the drive with the SIS and HRS extracts.
● Added an S/FTP server with subdirectories for each of
the groups of extracts we would convert to XML.
● Each subdirectory would be a separate S/FTP Definition.
21
List of S/FTP connections
Similar to how we loaded files in Voyager, we divided the files by statuses, and loaded them at different
times.
Similar to how we loaded files in Voyager, we divided the files by statuses, and loaded them at different
times.
22
23
Integration Profile List
24
25
Original script
Modified script
The scripts that build the XML files
26
Whereas the scripts for Voyager took 50 lines of code for the Majors
statistical category, the script for Ex Libris took 3 lines of code. There is no
need to create a 3 character code like for Voyager. Just as long as the code
has no spaces. So a 600 line script becomes less than 160 lines.
27
We needed to change the order of the files loaded.
In doing so, we then needed to create a file of former employees that
are current students and load that file last.
28
Configuring Statistical Categories and their
Category Types
Once the categories have been loaded, you need to …
● Configure the Statistical Categories
● Create Category Types
● And map the Statistical Categories to a Category Type.
● Then one can create a report in Alma Analytics.
Configuring Statistical Categories for Analytics in Ex Libris Knowledge Center
29
30
User Statistical Categories - Code Table
The code for a Statistical Category cannot have spaces
31
Category Types - Code Table
32
Statistical Categories/Types - Mapping Table
Then map a Category to a
Category Type.
A Category cannot be
mapped to more than one
Type.
33
Alma Analytics Example
34
Some Differences between Alma and Voyager
● Not having full access to the database structure of Alma.
● Time limitation of loading Integration Profiles
35
Thank you & Questions
Linda Salvesen
salvesenl@wpunj.edu
Ray Schwartz
schwartzr2@wpunj.edu
36

More Related Content

PPTX
Discovery layer decisions, configurations and strategies
PPTX
Using drill down within alma analytics reports
PPTX
Improving access to special collections by automating descriptive metadata cr...
PPTX
Measure Twice and Cut Once: How a Budget Cut Impacted Subscription Renewals f...
PDF
Talis Aspire Management Reporting - Caroline Thorpe, Sheffield Hallam University
PDF
singly linked_list
PPTX
Applying and Extending Semantic Wikis for Semantic Web Courses
PPTX
Working with SPSS
Discovery layer decisions, configurations and strategies
Using drill down within alma analytics reports
Improving access to special collections by automating descriptive metadata cr...
Measure Twice and Cut Once: How a Budget Cut Impacted Subscription Renewals f...
Talis Aspire Management Reporting - Caroline Thorpe, Sheffield Hallam University
singly linked_list
Applying and Extending Semantic Wikis for Semantic Web Courses
Working with SPSS

What's hot (12)

PPT
Coherance in dissemination- Msis 2007
PPTX
Getting "Fancy" With Your Library Data!
PPTX
Hm306 week 2
PPT
Breaking the Waves: Implementing Coral at UW-Parkside
PDF
ThomasHeissenberger_resume_2_11_2015
PDF
0929 databases
PPTX
Beyond COUNTER Compliant: Ways to Assess E-Resources Reporting Tools
PPTX
The Front Face of the ERM
PDF
Visualizing data
PPT
Data Dictionary
PPTX
Turning the Corner at High Speed: How Collections Metrics Are Changing in a H...
PPTX
From Millennium ERMS to Proquest 360 Resource Manager
Coherance in dissemination- Msis 2007
Getting "Fancy" With Your Library Data!
Hm306 week 2
Breaking the Waves: Implementing Coral at UW-Parkside
ThomasHeissenberger_resume_2_11_2015
0929 databases
Beyond COUNTER Compliant: Ways to Assess E-Resources Reporting Tools
The Front Face of the ERM
Visualizing data
Data Dictionary
Turning the Corner at High Speed: How Collections Metrics Are Changing in a H...
From Millennium ERMS to Proquest 360 Resource Manager
Ad

Similar to The path to flexible loading of patron records (9)

PPTX
Alma_Implementation_slides_May06_2016
PDF
Working with the IFS on System i
PDF
Ibm lotus domino integration using ibm tivoli directory integrator redp4629
PPT
A Strand of Perls: Some Home Grown Utilities
PDF
"If I knew then what I know now"
PDF
Newman, Manoff, and McDonald, "Data, Data Everywhere: Migration and System Po...
PPT
Database management systems cs403 power point slides lecture 05
PDF
Data Visualization: Analyzing your library data
PPT
Mi Acad2009 Print Sfx
Alma_Implementation_slides_May06_2016
Working with the IFS on System i
Ibm lotus domino integration using ibm tivoli directory integrator redp4629
A Strand of Perls: Some Home Grown Utilities
"If I knew then what I know now"
Newman, Manoff, and McDonald, "Data, Data Everywhere: Migration and System Po...
Database management systems cs403 power point slides lecture 05
Data Visualization: Analyzing your library data
Mi Acad2009 Print Sfx
Ad

More from Ray Schwartz (15)

PPTX
Deploying vu find as the discovery layer for voyager, eds, libguides, and oth...
PPTX
Hacking vufind combined search and making bento searching
PPT
Browses
PDF
Vale2017 b13-presentation
PPTX
Doing data visualizations with tableau
PPTX
Doing data visualizations with tableau
PPT
Besides Circulation, How else is the print collection being used? Reporting o...
PPTX
Fetch It! A Custom Voyager service for Holds/Retrieval without using reporter
PPT
Crushing, Blending, and Stretching Data
PPT
Crushing, Blending, and Stretching Data
PPTX
Logging Data on Voyager Transactions that Voyager does NOT Log
PPT
Application of EZProxy logs, Voyager’s Patron Database, MySQL, and ColdFusion...
PPTX
Crushing, Blending, and Stretching Transactional Data
PPTX
Data Warehousing and Mining Data from Library and University Systems for Asse...
PPTX
Data Warehousing and Mining Data from Library and University Systems for Asse...
Deploying vu find as the discovery layer for voyager, eds, libguides, and oth...
Hacking vufind combined search and making bento searching
Browses
Vale2017 b13-presentation
Doing data visualizations with tableau
Doing data visualizations with tableau
Besides Circulation, How else is the print collection being used? Reporting o...
Fetch It! A Custom Voyager service for Holds/Retrieval without using reporter
Crushing, Blending, and Stretching Data
Crushing, Blending, and Stretching Data
Logging Data on Voyager Transactions that Voyager does NOT Log
Application of EZProxy logs, Voyager’s Patron Database, MySQL, and ColdFusion...
Crushing, Blending, and Stretching Transactional Data
Data Warehousing and Mining Data from Library and University Systems for Asse...
Data Warehousing and Mining Data from Library and University Systems for Asse...

Recently uploaded (20)

PDF
Machine learning based COVID-19 study performance prediction
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
A Presentation on Artificial Intelligence
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Getting Started with Data Integration: FME Form 101
PDF
Empathic Computing: Creating Shared Understanding
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
cuic standard and advanced reporting.pdf
PPTX
Spectroscopy.pptx food analysis technology
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Machine learning based COVID-19 study performance prediction
Programs and apps: productivity, graphics, security and other tools
Network Security Unit 5.pdf for BCA BBA.
A Presentation on Artificial Intelligence
The Rise and Fall of 3GPP – Time for a Sabbatical?
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Getting Started with Data Integration: FME Form 101
Empathic Computing: Creating Shared Understanding
Unlocking AI with Model Context Protocol (MCP)
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Big Data Technologies - Introduction.pptx
Group 1 Presentation -Planning and Decision Making .pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
cuic standard and advanced reporting.pdf
Spectroscopy.pptx food analysis technology
Per capita expenditure prediction using model stacking based on satellite ima...
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...

The path to flexible loading of patron records

  • 1. The Path to Flexible Loading of Patron Records into Alma October 6, 2020, ENUG Linda Salvesen & Ray Schwartz William Paterson University of New Jersey 1
  • 2. Introduction In many cases, a library chooses to have their University’s IT department code the XML for the patron load. In our case, we wish the flexibility to be able to assign certain privileges and statistical categories via the patron load as we did with our Voyager system. For example, how do we handle staff that are also students? How do we automate expiring patrons via the patron load—be they students, adjuncts, or staff/faculty with a termination date? How do we automate the assignment of statistical categories? The Cheng Library converted scripts that were used to create the Voyager SIF files into scripts that create XML files for Alma. 2
  • 3. Our University Context ● State university of 8,100 undergraduate and 1,700 graduates. ● Over 400 faculty, 800 adjuncts, 1500 staff. ● Primarily we are a teaching university. ● The University’s IT uses Banner for the Student Information System (SIS) and the Human Resources System (HRS) 3
  • 4. Our Library Context ● 14 librarians and 14 staff ● The systems unit consists of 2 librarians and 1 computer specialist ● All librarians are involved in reference, instruction, collection development and academic department liaison duties. 4
  • 5. Outline ●Voyager and our setup for patron loads ●Alma the its patron database system ●Our experience moving from the Voyager to Alma patron load ●Some differences between Alma and Voyager patron databases 5
  • 6. Our Setup for the Voyager Patron Load ● The SIF Format ● Extracts from SIS and HRS ● Load order of patron files 6
  • 7. The Patron Record Standard Interface File aka the SIF is a fixed width text file rather than a delimited text file. 7
  • 8. 8
  • 9. 9
  • 10. Extracts from SIS and HRS We asked IT to regularly extract four files from SIS and HRS to a directory which we mount on the Voyager server. ● Adjuncts ● Staff ● Faculty ● Students The files are tab-delimited rather than the SIF format. We parse the files using the Unix program awk into the fixed width format. And we automatically load the files via a scheduled Unix job on the Voyager server. 10
  • 11. Tab Delimited Text File Standard Interface File (SIF) 11
  • 12. We wanted to be able to automatically expire the privileges of students. So we set it up to give them one semester grace. 12
  • 14. .. and to automatically expire faculty and staff after their last date of employment. 14
  • 15. We wanted to code the various statistical categories with data such as major, department, and so on. From students ● Major, ● 2nd major, ● class, ● credits, ● full or part-time, ● college, ● registration date, ● degree. from staff ● Status (adjunct, faculty, managerial or staff), ● department, ● college, ● division, ● full or part-time, ● tenured. In addition to the standard set of fields, we asked IT to extract ... 15
  • 16. With Voyager, statistical categories could only be 3 characters. So each category we hardcoded and converted. The awk file would contain over 600 lines of code. 16
  • 17. Load order of patron files Since there are individuals that have multiple statuses (e.g., Faculty or staff that are also students), we load the files in this particular order ● Adjuncts ● Staff ● Faculty ● Students It was the request from the Head of Circulation to load the students last so stats could be culled from ALL student circ activity. 17
  • 18. Alma and its patron database system ● Setting up Integration Profiles and S/FTP definitions ● Coding XML ● Configuring Statistical Categories and their Category Types. 18
  • 19. How patron load works in Alma ● Patron data is converted to an XML format and then into a zip file by the Library ● The zip file is loaded onto an S/FTP server deployed by the Library ● An S/FTP Definition is defined in Alma ● An Integration Profile is defined in Alma and scheduled to run at certain intervals to pick up the zip file from the S/FTP server and process it into the patron database. 19
  • 20. Setting up S/FTP definitions and Integration Profiles 20
  • 21. Preparing for the S/FTP Definitions We have a Red Hat Linux server for the Library so we … ● Mounted the drive with the SIS and HRS extracts. ● Added an S/FTP server with subdirectories for each of the groups of extracts we would convert to XML. ● Each subdirectory would be a separate S/FTP Definition. 21
  • 22. List of S/FTP connections Similar to how we loaded files in Voyager, we divided the files by statuses, and loaded them at different times. Similar to how we loaded files in Voyager, we divided the files by statuses, and loaded them at different times. 22
  • 23. 23
  • 25. 25
  • 26. Original script Modified script The scripts that build the XML files 26
  • 27. Whereas the scripts for Voyager took 50 lines of code for the Majors statistical category, the script for Ex Libris took 3 lines of code. There is no need to create a 3 character code like for Voyager. Just as long as the code has no spaces. So a 600 line script becomes less than 160 lines. 27
  • 28. We needed to change the order of the files loaded. In doing so, we then needed to create a file of former employees that are current students and load that file last. 28
  • 29. Configuring Statistical Categories and their Category Types Once the categories have been loaded, you need to … ● Configure the Statistical Categories ● Create Category Types ● And map the Statistical Categories to a Category Type. ● Then one can create a report in Alma Analytics. Configuring Statistical Categories for Analytics in Ex Libris Knowledge Center 29
  • 30. 30
  • 31. User Statistical Categories - Code Table The code for a Statistical Category cannot have spaces 31
  • 32. Category Types - Code Table 32
  • 33. Statistical Categories/Types - Mapping Table Then map a Category to a Category Type. A Category cannot be mapped to more than one Type. 33
  • 35. Some Differences between Alma and Voyager ● Not having full access to the database structure of Alma. ● Time limitation of loading Integration Profiles 35
  • 36. Thank you & Questions Linda Salvesen salvesenl@wpunj.edu Ray Schwartz schwartzr2@wpunj.edu 36