The document discusses developing active learning algorithms to jointly discover rare categories and learn to classify them from data. It proposes a unified active learning model that adapts query criteria online to discover new categories and learn classification simultaneously. It also proposes combining generative and discriminative classifiers, switching between them as learning progresses. The approach is evaluated on standard datasets and shown to outperform existing methods.