Neuroimaging is an essential tool for the diagnosis of cognitive brain disorders along with the EEG measurements. EEG and fMRI are the two crucial modalities which reflect the functional activity inside the brain. EEG is easy to apply and provides high temporal resolution but has poor spatial resolution. Contrarily, fMRI has a higher spatial resolution while having a poor temporal resolution. In this study, multi modal data sets obtained from Event Related fMRI and EEG measurements are analyzed using SPM and LORETA based dipole source reconstruction techniques, respectively. It has been demonstrated that the generator of N170 component of ERP which is located at superior temporal region is in agreement with the SPM results of fMRI. The results imply that the joint use of fMRI and ERP data helps identifying the physiological and hemodynamic correlates of face recognition by estimating the underlying functional activity in a fine temporal and spatial resolution.