I find people with this opinion generally have no solid sense of self or identity. I think you can work on that issue regardless of any mental disability or physical abnormality you might perceive in yourself.
Romantic relationships are something tangible that can be understood and lack of them are definitive clear demonstrations of often deeper issues.
The problem arises when you attribute the problem to be simply not having a relationship, ignoring the deeper underlying issues.
I am not saying that romantic relationships aren't important, but if you think they are so important it consumes your mind you have other problems that you probably can work on,
but if you focus all your attention on relationships you won't make progress on the more important parts of life such as self-actualization, development of passion, pursuit of meaningful goals, understanding of self, being comfortable in ones self. All of these are internal problems that can be fixed internally with no reference to an outer observer. So no claim about the world being against you can defend.