Recursive functions are functions that call themselves to solve problems by breaking them down into simpler, similar subproblems. Each recursive call works on a smaller piece of the overall task, and a clearly defined base case stops the recursion once the simplest instance is reached, ensuring the process eventually terminates. This concept mirrors philosophical ideas of self-reference and reductionism, where complex wholes are understood in terms of simpler, self-similar parts.