Simon Cowell Says ‘I Feel Empty’ After Liam Payne’s Death: ‘Left Us Too Soon’

Simon Cowell is paying tribute to Liam Payne after the One Direction singer’s death at age 31.

Payne was pronounced dead after falling multiple stories at the CasaSur Palermo Hotel in Buenos Aires, Argentina on Wednesday, Oct. 16, Policía Federal Argentina confirmed to PEOPLE. 

As tributes continue to pour in around the world, One Direction’s co-creator Cowell, 65 — who helped launch the band’s career on The X Factor U.K. back in 2010 — shared a statement to Instagram on Oct. 18.

“You never really know how you feel about someone until a moment like this happens,” he wrote. “Liam, I am devastated. Heartbroken. And I feel empty. And I want you to know how much love and respect I have for you. Every tear I have shed is a memory of you.”

“This is so difficult to put into words right now,” added Cowell. “I went outside today, and I thought about so many times we had together. I wanted to let you know what I would always say to the thousands of people who would always ask me. What is Liam like?”

He explained, “And I would tell them you were kind, funny, sweet, thoughtful, talented, humble, focused. And how much you loved music. And how much love you genuinely had for the fans.”

Cowell recalled working with Payne on The X Factor. “I had to tell you when you were 14 that this wasn’t your time. And we both made a promise that we would meet again. A lot of people would have given up. You didn’t,” he said. “You came back and within months the whole world knew Liam. And you never forgot the fans. I watched you spending so much time with people who had wanted to meet you. You really cared.”

The Syco Records founder then spoke about spending time with the “Strip That Down” musician last year — “Not for a meeting. Just to sit and talk,” he explained.

“And we reminisced about all of the fun times we had together. And how proud you were to be a Dad. After you left, I was reminded that you were still the sweet, kind boy I had met all of those years ago. I have met your son, Bear. He has your smile and that twinkle in his eye that you have,” said Cowell. “And he will be so proud of everything you have achieved. And how you achieved it.”

To conclude the note, the former American Idol judge spoke about One Direction. “I always thought of the 5 of you in the band as brothers. And regarding their messages today I believe you were,” wrote Cowell. “And now Liam, I can see the effect you had on so many people. Because you left too soon.”

“Rest in peace my friend,” he said. “And I am sending my love, thoughts and prayers to your family.”

Cowell and X Factor guest judge, Nicole Scherzinger, played a major role in forming One Direction after Payne, Harry Styles, Zayn Malik, Niall Horan and Louis Tomlinson all auditioned for the show separately.

Despite coming third, they went on to become one of the biggest pop groups in the world. After The X Factor, Cowell ended up signing the band to his former record label, Syco Music.

Payne had previously auditioned for the show two years prior to One Direction’s success, singing “Fly Me to the Moon” by Frank Sinatra in front of judges Cowell, Louis Walsh and Cheryl. Years later, Payne welcomed his now-7-year-old son, Bear Grey, with the latter. 

He didn’t get through as a 14-year-old student that year, but received a standing ovation when he returned in 2010 and sang “Cry Me A River” by Michael Bublé at the age of 16.

Following news of Payne’s death, Cowell and the Britain’s Got Talent team announced they were canceling Thursday’s auditions in the U.K. seaside town of Blackpool.

“Due to the tragic passing of Liam Payne, BGT has decided to postpone today’s auditions in Blackpool,” Applause Store, who offer free audience tickets to the event, said in an Instagram Stories post.

“We apologize for any inconvenience this may cause,” the message added.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

Cowell was among multiple X Factor stars paying tribute to Payne following his death.

Host Dermot O’Leary posted a black and white photo from their time on the show on Instagram, alongside the caption: “The worst news. I remember him as a 14 year old turning up to audition on The X Factor, and blowing us away singing Sinatra. He just loved to sing.”

“He was always a joy, had time for everyone, polite, grateful, and was always humble,” he added. “Sending love and prayers to his family. Dx.”