I think that is one of the largest failings of the English language since context isn't always easily established or even maintained with a statement. Which is why people in different parts of the country utilize different words, or "you" plus anither word such as "all", "guys", "people", etc... to make up for this failing.