"The point" of a conversation is the main idea that a person wants to talk about. In many kinds of conversations, including requests, stories, and discussions, people expect a "point", which is the main idea:
To "get to" the point is to start talking about the main topic that you want to discuss.
If you tell someone to "get to the point", it may sound rude:
A: So, you know, it's, like, well...
B: Hurry up and get to the point!
It's common to include the word "straight":
I like to get straight to the point.