Resume Classification with Term Attention Embeddings
0 likes90 views
The document discusses the classification of resumes using context-aware transformer models for competence-level prediction and resume-job description matching, detailing the dataset and methods used. It outlines previous work and novel approaches such as section trimming, pruning, and encoding, and presents results and error analysis of the models. The current work aims to enhance the datasets and methodologies for better prediction and matching in clinical and research roles.
Resume Classification with Term Attention Embeddings
- 1. Resume Classification with Term Attention Embeddings Emory NLP Weekly 9/9/2020 Xiangjue Dong
- 2. Outline • Previous Work • Introduction • Approaches • Results • Error Analysis • Current Work • Introduction • Approaches • Reference
- 4. Introduction – Dataset Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 5. Introduction – Dataset • Applications: 24,933 (A). • Remove duplicated resumes within the same level: 9,286 (B). • Remove duplicated resumes across all levels; Retrain only the resumes to the highest level: 6,492 (C). • Discarded unstructured ones: 5,362 (Br), 3,425 (Cr). Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 6. Introduction – Tasks • Competence-Level Classification - Multiclass Classification Task • Given a resume, decide which level of CRC positions that the corresponding applicant is suitable for. • Labels: CRC1, CRC2, CRC3, CRC4, NQ • Resume-to-Job_Description Matching - Binary Classification Task • Given a resume and a CRC job description, decide whether the applicant is suitable for that job • Labels: accept, reject Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 7. Approaches – Competence-Level Classification • Whole-Context: Section Trimming (Baseline) • Context-Aware: Section Pruning • Context-Aware: Chunk Segmenting • Context-Aware: Section Encoding Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 8. Whole-Context: Section Trimming Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 9. Context-Aware: Section Pruning Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 10. Context-Aware: Section Pruning Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models • Remove all stop words; • Remove all words with frequencies top 5%; • Remove all words with frequencies top 30%.
- 11. Context-Aware: Section Pruning Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 12. Context-Aware: Chunk Segmenting Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 13. Context-Aware: Chunk Segmenting Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 14. Context-Aware: Section Encoding Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 15. Resume-to-Job_Description Matching • Whole-Context: Sec./Desc. Trimming (Baseline) • Context-Aware: Chunk Segmenting + Section Encoding + Desc. Embedding • Context-Aware: Multi-Head Attention Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 16. Whole-Context: Sec./Desc. Trimming Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 17. Context-Aware: Chunk Segmenting + Section Encoding + Desc. Embedding Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 18. Context-Aware: Multi-Head Attention Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 19. Context-Aware: Multi-Head Attention Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 20. Results - Competence-Level Classification Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 21. Results - Resume-to-Job_Description Matching Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 22. Error Analysis • It’s unable to identify clinical research experience. • It can’t identify dates of experience. • It can’t distinguish adjacent CRC positions. Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
- 23. Current Work
- 24. Introduction – New Dataset • CRC (2020) • CRN (2020)
- 25. Introduction – New Dataset Statistics CRN-1 CRN-2 CNR-3 Total CRN (2020) 69 242 19 330 CRC-1 CRC-2 CRC-3 CRC-4 CRC-QM Total CRC (2020) 11485 7180 1396 479 83 20623
- 27. Glossary of Terms • Clinical Settings • Hospital • Clinic • Doctor/Physician Office
- 28. Glossary of Terms • Clinical Settings • Clinical Roles • Patient Service(s) Coordinator, • Patient Care Coordinator, • Clinical Coordinator, • Unit Secretary • Clinical Service Representative, • Medical Scribe, Medical Secretary, • Pharmacy Technician, • Phlebotomist, • Tumor Registrar • Pre/Post Award Administrator • Internship in a scientific or health related area (1000 documented hours).
- 29. Glossary of Terms • Clinical Settings • Clinical Roles • Clinical Research Experience • clinical research coordinator; • clinical research associate; • clinical research assistant; • research interviewer; • research assistant; • clinical research manager; • clinical research supervisor.
- 30. Glossary of Terms • Clinical Settings • Clinical Roles • Clinical Research Experience • Bachelor’s Degrees in scientific or health related fields+ • Biology; Psychology; Epidemiology; Chemistry; Biomedical Science; Neuroscience; Behavioral Science; Social Work; Microbiology; Nutrition/Food; Public Health; Health Promotion and Global Health; Complementary and Alternative Health; Community Wellness .
- 31. Glossary of Terms • Clinical Settings • Clinical Roles • Clinical Research Experience • Bachelor’s Degrees in scientific or health related fields+ • Bachelor’s Degrees in non-scientific or non-health related fields • Business Management; • Healthcare Management; • Healthcare Administration; • Informatics; • Gender and Global Health
- 32. Glossary of Terms • Clinical Settings • Clinical Roles • Clinical Research Experience • Bachelor’s Degrees in scientific or health related fields+ • Bachelor’s Degrees in non-scientific or non-health related fields • Laboratory Research- Including animal and industry research- nonclinical • laboratory specialist; laboratory assistant; laboratory scientist; some PhD fields are identifiable as laboratory research – chemistry, biotechnology, etc.
- 33. Glossary of Terms • Clinical Settings • Clinical Roles • Clinical Research Experience • Bachelor’s Degrees in scientific or health related fields+ • Bachelor’s Degrees in non-scientific or non-health related fields • Laboratory Research- Including animal and industry research- nonclinical • Technical Diploma • LPN, • Medical Assistant
- 35. Timeline – By end of September • Parse the resume using tools to prepare the data • Generate the statistics table of this year’s data • Divide data into 20 batches for annotation • Build models
- 36. Reference • Changmao et al. 2020. Competence-Level Prediction and Resume- Job_Description Matching Using Context-Aware Transformer Models