It’s also just really hard unless you live off packaged meals or only eat thing that are isolated. Something like a curry cooked in kitchen and shared among a family is a complete black box as to who got how many calories. Maybe one person got a different ratio of rice to curry. Or this family likes a sweeter type of curry etc
Your metabolism is a system. Like any system, data about its inputs and outputs can be gathered if you would but measure it. Make getting accurate portion sizes a part of your daily routine.