The Cross-Domain Transfer Problem: Why Your Study Platform Should Already Know What You Know
Cross-domain transfer is one of the oldest open problems in machine learning. It shows up in the literature under a dozen names — transfer learning, multi-task learning, domain adaptation, meta-learning, foundation models, representation transfer — and it's been the subject of thousands of papers since the early 1990s. Hinton wrote about it, LeCun wrote about it, Bengio wrote about it, every major ML lab has multiple research lines dedicated to it. The general problem is well-trodden academic territory.