Jesus baptized.

On the day of Pentecost, Peter preached to the people, “Repent, and be baptized every one of you in the name of Jesus Christ for the remission of sins…”

When did Peter and the rest of the apostles get baptized in Jesus name, and who baptized them?

Jesus baptized them.

"After these things came Jesus and his disciples into the land of Judaea; and there he tarried with them, and baptized." - John 3:22 KJV

When did the rest of those that received the Holy Ghost in the upper room get baptized in Jesus name?

Looking back,

Some of John the Baptist’s disciples came questioning him. They apparently were concerned because Jesus’ ministry was growing. Jesus was baptizing.

"And they came unto John, and said unto him, Rabbi, he that was with thee beyond Jordan, to whom thou barest witness, behold, the same baptizeth, and all men come to him." - John 3:26 KJV

Jesus’ disciples also baptized.

"When therefore the Lord knew how the Pharisees had heard that Jesus made and baptized more disciples than John, (Though Jesus himself baptized not, but his disciples,) He left Judaea, and departed again into Galilee." - John 4:1-3 KJV

Thus, on the day of Pentecost, all the disciples of Jesus gathered in the upper room that received the Holy Ghost were already baptized in Jesus name. There were probably about a hundred and twenty disciples there all together. (Acts 1:15)

After Peter preached the gospel message, about three thousand MORE were baptized and ADDED to the disciples.

"Then they that gladly received his word were baptized: and the same day there were added unto them about three thousand souls." - Acts 2:41 KJV

"…And the Lord added to the church daily such as should be saved." - Acts 2:47 KJV