Building good feature representations and learning hidden source models typically requires large sample sizes. In many applications, however, the size of the sample at an individual data holder may not be sufficient. One such application is neuroimaging analyses for mental health disorders - there are many individual research groups, each with a moderate number of subjects. Pooling such data can enable efficient feature learning, but privacy concerns prevent sharing the underlying data. We propose a model for private feature learning in which the data holders share differentially private views of their respective datasets to enable collaborative learning of a joint feature map. We give an example of such an algorithm for independent component analysis (ICA) - a popular blind source separation algorithm used in neuroimaging analyses. Our algorithm is a differentially private version of the recently proposed distributed joint ICA algorithm. We evaluate the performance of this method on simulated functional magnetic resonance imaging (fMRI) data.