No, they do not because in some cases it reaches a local minima or a local optima point. You will not reach the global optima point. This is governed by the data and the starting conditions.
Source

Thank you for sharing such a good information. Very informative and effective post.
cyber security course

This is not a question about local minima. There answer is Yes and No. They are never equal but quite close.  Batch GD: Optimum Solution SGD: Good but not optimum Bini-Batch GD: in-between the other two