🚀 Excited to share a new paper on making protein language models more interpretable with Alp Tartıcı and Russ Altman! “Paying attention to attention: High attention sites as indicators of protein family and function in language models.” In this work, we highlight how attention weights can be turned into biologically meaningful insights: • Define High Attention sites from ESM-2 that spotlight residues tied to family & function • Show High Attention sites align with biologically important positions (e.g., active/functional sites) • Release High Attention annotations for the human proteome Now published in PLOS Computational Biology. 🔗 Open access: https://lnkd.in/gvn_ZBEb #Bioinformatics #ProteinLanguageModels #Interpretability #AIinBiology #Proteomics #ComputationalBiology #ESM2
Congrats Gowri Nayar and Alp Tartıcı
Congratulations Gowri and Alp !
Scientific Lead, Discovery Bioinformatics at Lilly Oncology
1wCongrats!!!! 🎉