From causality to time and back