Prince Harry, Prince William and Queen Elizabeth.Photo: Tim Graham Photo Library via Getty

Queen Elizabeth II Laughs With Her Grandsons Prince William And Prince Harry On The Balcony Of Buckingham Palace After The Trooping The Colour Parade. Wearing Formal Morning Suits But Without The Traditional Top Hats The Young Princes Joined Other Members Of The Royal Family For This Occasion To Mark The Queen’s Official Birthday.

“The chiefs have an audience with The Queen once or twice a year. You need to have done your homework,” he recalled. “She’s very wise — I used to tell my staff, see if you can get the midday slot. Um, because after half an hour or 40 minutes, the Queen would ring a small bell and ‘Time for a Sherry, I think, CGS.”

“What goes on in those audiences and who says what to whom, remains for the two people involved,” he continued. “And I will break the rule, uh, about not divulging what goes on on this one occasion when she was very clear — she said, ‘My grandsons have taken my shilling, therefore they must do their duty.’ And that was that.”

Jackson added that withPrince Williamas second in line to the throne at the time, the risk of him serving on the frontlines was deemed “too great.” However, he said “the risk was acceptable” forPrince Harry.

Prince William.Tim Graham Picture Library/Getty

In this Clarence House handout picture, Prince William sits in a cockpit trainer during a week he spent at RAF Cranwell, November 2007, in Sleaford, Lincolnshire, England. The Prince was undertaking pre-training tests prior to the start of his attachment at RAF Cranwell where he will begin an intensive RAF course to learn how to fly.

Prince Harry, now 38, graduated from the Royal Military Academy Sandhurst in 2005 and served in the British Armed Forces for a decade. He rose to the rank of Captain,deploying twice to Afghanistanand completing elite training to fly Apache helicopters.

Prince Harrywrote extensively about his military experience in his memoirSpare, released earlier this year, saying that he wanted to leave the war in Afghanistanwith his “conscience intact.”

Prince William and Prince Harry.Chris Jackson/Getty

TRH Prince William and Prince Harry pose in front of a Griffin helicopter during a photocall at RAF Shawbury on June 18, 2009 in Shawbury, England. Both the Princes are currently on their military helicopter training courses at RAF Shawbury. The base is home of the Defence Helicopter Flying School. Prince William’s course will remain at Shawbury until 2010 while Prince Harry will remain at the base until Autumn 2009.

Can’t get enough ofPEOPLE’s Royals coverage?Sign up for our free Royals newsletterto get the latest updates on Kate Middleton, Meghan Markle and more!

Inan exclusive interview with PEOPLEsurrounding the release of his book, the Duke of Sussex addressed how he reconciles the ethical impacts of war.

“I don’t know that you ever fully reconcile the painful elements of being at war. This is something each soldier has to confront, and in the nearly two decades of working alongside service personnel and veterans, I’ve listened to their stories and have shared mine,” Harry told PEOPLE.

“In these conversations, we often talk about the parts of our service that haunt us — the lives lost, the lives taken. But also the parts of our service that heal us and the lives we’ve saved,” he added.

“It’s a duty, a job and a service to our country — and having done two tours of duty in Afghanistan for my country, I’ve done all I could to be the best soldier I was trained to be,“Prince Harrysaid.“There’s truly no right or wrong way to try and navigate these feelings, but I know from my own healing journey that silence has been the least effective remedy. Expressing and detailing my experience is how I chose to deal with it, in the hopes it would help others.”

source: people.com