New paper on protein language model interpretability with Alp Tartıcı and Russ Altman

View profile for Gowri Nayar

Ph.D. @ Stanford University | Biomedical data science

🚀 Excited to share a new paper on making protein language models more interpretable with Alp Tartıcı and Russ Altman! “Paying attention to attention: High attention sites as indicators of protein family and function in language models.” In this work, we highlight how attention weights can be turned into biologically meaningful insights: •⁠ ⁠Define High Attention sites from ESM-2 that spotlight residues tied to family & function •⁠ ⁠Show High Attention sites align with biologically important positions (e.g., active/functional sites) •⁠ ⁠Release High Attention annotations for the human proteome Now published in PLOS Computational Biology. 🔗 Open access: https://lnkd.in/gvn_ZBEb #Bioinformatics #ProteinLanguageModels #Interpretability #AIinBiology #Proteomics #ComputationalBiology #ESM2

  • diagram
Krithi Bala

Scientific Lead, Discovery Bioinformatics at Lilly Oncology

1w

Congrats!!!! 🎉

Like
Reply
Issah Samori

PhD Candidate at Stanford University | ChEM-H Chemistry-Biology Interface (CBI) Fellow | Summer First Fellow

2w

Congrats Gowri Nayar and Alp Tartıcı

Like
Reply

Congratulations Gowri and Alp !

See more comments

To view or add a comment, sign in

Explore content categories