Are sets, in an abstract sense, one of the most fundamental objects in contemporary mathematics?

Actually, yes and no.

The equivalence relation lies deeper within the knowledge representation and it’s foundation.

There are other knowledge prerequisites which lie even deeper within the knowledge substrate than the equivalence relation.

The concepts of a boundary, of quantity, membership, reflexivity, symmetry, transitivity, and relation are some examples.

http://bit.ly/2wPV7RN