Linseed oil doesn't 'dry' - it oxidises. Contact with oxygen in air causes it to change chemically, becoming hard, like a varnish. That is why a thick coat of oil becomes gluey... It will harden over time.
Linseed oil is also a fire risk, as rags can catch fire - especially on hot days. Take extra care when throwing rags in the bin. It is best to wash them. Or throw them where there isn't a risk if they do start smouldering.
Bookmarks