This document proposes a centralized class specific dictionary learning framework for physical activity recognition using wearable sensors. It incorporates a class specific regularizer term into the dictionary pair learning objective function to make sparse codes belonging to the same class more concentrated. This improves classification performance. The framework involves learning a synthesis dictionary and analysis dictionary jointly. It extracts time-domain features from acceleration and heart rate sensor data. Experimental results on activity recognition datasets demonstrate the framework outperforms state-of-the-art methods using only simple features, achieving competitive results to approaches using more complex, domain-specific features.