Since entering politics in 2004, this is the first time the primary opponent of Prime Minister Narendra Modi has held a constitutional position.
Mr. Gandhi will now serve as a check on the prime minister by serving on committees that choose important people.
Congress gained 99 seats in the most recent general election, but since 2014, no opposition party has captured 10% of the 543 members needed to win the position.
With the support of friends, Mr. Modi is still in office, but his party was unable to secure a majority following two landslide victories.
Mr. Gandhi will make sure the administration was always held accountable, according to the Congress party.
His nomination, according to some observers, marks a turning moment for India’s democracy. The ruling Bharatiya Janata Party (BJP), which the opposition accuses of being dictatorial, disputes these accusations.
Political analyst Neerja Chowdhury told the BBC that “this is going to be a turbulent parliament and the opposition is going to take the government to task.”
The position would put Mr. Gandhi’s leadership abilities to the test, according to Ms. Chowdhury.
Despite having served as an MP for five times and been involved in politics for over 25 years, he has never held the position of minister or won a party general election.