On 22 February 1942, upon his graduation from the Royal Military College, Sharma was commissioned into the 8th Battalion, 19th Hyderabad Regiment, of the British Indian Army. During World War II, he saw action against the Japanese in Burma during the Arakan Campaign. At that time he served under the command of Colonel K. S. Thimmayya, who would later rise to the rank of general and become Chief of the Army Staff from 1957 to 1961. Sharma was mentioned in despatches for his actions during the fighting of the Arakan Campaign. Throughout his military career, Sharma was greatly influenced by his uncle Captain K. D. Vasudeva's gallantry in action. Vasudeva also served with the 8th Battalion, participating in the Malayan Campaign during which he died aiding hundreds of soldiers under his command to survive from the Japanese offensive.
On 27 October 1947, a batch of troops of the Indian Army was deployed in response to the invasion by Pakistan on 22 October into the Kashmir Valley. On 31 October, D Company of 4th Battalion of Kumaon Regiment, under the command of Sharma, was airlifted to Srinagar. During this time, his left hand was in a plaster cast as a result of injuries sustained previously on the hockey field, but he insisted on being with his company in combat and was subsequently given permission to go. On 3 November, a batch of three companies was deployed to the Badgam area on patrol duties. Their objective was to check the infiltrators moving toward Srinagar from the north. As there was no enemy movement, two of the three deployed companies returned to Srinagar at 2:00pm. However, Sharma's D Company, was ordered to stay in position until 3:00pm. At 2:35pm, Sharma's company was fired upon from the local resident houses in Badgam but counter-fire was not ordered to avoid injuring or killing innocent civilians. Suddenly, a tribal lashkar of 700 infiltrators approached Badgam from the direction of Gulmarg. D Company was soon surrounded from three sides and sustained heavy casualties from mortar fire. Sharma realized the importance of holding onto his position as both the city of Srinagar and the airport would be vulnerable if lost. Under heavy fire, and outnumbered by a ratio of seven to one, he urged his company to fight bravely, often exposing himself to the enemy fire as he ran from one post to the other. When heavy casualties adversely affected the company's firing power, Sharma took upon himself the task of distributing ammunition to his men, operating light machine guns. While busy fighting the infiltrators, a mortar shell exploded on a pile of ammunition near him. Before he succumbed to his injuries, he transmitted a message to his brigade's headquarters which read: By the time a relief company, from the 1st Battalion of the Kumaon Regiment, reached Badgam, the position held by Sharma's company had been overrun. However, the 200 casualties suffered by the tribal infiltrators caused them to lose the impetus to advance. This bought time for Indian forces to fly into Srinagar airfield and block all routes of ingress to Srinagar itself. During the battle, along with Sharma, one junior commissioned officer and 20 other ranks of D company were killed. Sharma's body was recovered three days later. Though it was disfigured beyond recognition, his body was identified by means of the leather holster of his pistol and a few pages of Bhagavad Gita in his chest pocket.
Param Vir Chakra
On 21 June 1950, Sharma's award of the Param Vir Chakra, for his actions on 3 November 1947 in defending the Srinagar airport, was gazetted. This was the first time the honour had been awarded since its inception. Coincidentally, Savitri Khanolkar, the mother-in-law of Sharma's brother, was the designer of the Param Vir Chakra. The official citation reads:
The first episode of the TV series on the lives of Param Vir Chakra winners, Param Vir Chakra covered Sharma's actions of 3 November 1947. In that episode, his part was played by Farooque Sheikh. The episode was directed by Chetan Anand.