@frodef is it a very large source you are trying to record? If that is the case you might try recording a scene with that source on it or use a scale filter on the source to get the resolution down.
Otherwise please provide an OBS log of a session in which the source recording is used.