A bale forming apparatus and a bale forming method are provided. A bale is formed in a bale forming chamber. A bale pushing device pushes the bale away from an outlet onto a bale supporting construction. A guiding element is pivoted into a guiding position. The guiding element in the guiding position contributes to guide a bale forming mechanism such that a bale forming device a chamber is also provided when the bale is on the bale supporting construction. A new bale is formed in the provided bale forming chamber. The bale pushing device is pivoted around the pivoting axis in a pushing direction and backwards and performs a reciprocating movement. Pivoting the bale pushing device in the pushing direction causes the guiding element to be pushed and pivoted into the guiding position.