In your examples the direction seems to be the same. Or, more specifically, in regards to the verb the direction is the same.
idk if there are regional exceptions, but in general borrow and lend seem more akin to learn and teach, respectively. The have an implicit direction: (from, in the case of borrow; to in the case of lend).
I teached something from you today or I will learn you calculus in extracurricular classes don't work.
In Spanish it is disambiguated in a similar way as you were mentioning (to me, to you)
"Alquilo" translates literally to rent, so not really the same:
- Me alquilas un piso. (you rent me a flat)
- Te alquilo un piso. (I rent you a flat)
I think a better translation to borrow/lend is "prestar/dejar:
- Me prestas/dejas un lápiz. (you lend me a pencil/I borrow a pencil from you)
- Te presto/dejo un lápiz. (I lend you a pencil/You borrow a pencil from me)
Language is interesting!