Is there any difference between an oil filter and fuel filter excluding size and fit?

A fuel filter will be able to stop much smaller particles of dirt and such. If the oil filter was that fine, it would clog right away.Is there any difference between an oil filter and fuel filter excluding size and fit?
The specific gravity of oil is way thicker than fuel. So the oil filter must pass much bigger molecules than a fuel filter. That means the crap going to an oil filter can pass a larger particle than the crap going to a fuel filter.