Well, the first time I've heard of Harry Potter was when I was 6, and I only started with the movies. My parents were watching the 1st and 2nd movies. When we reached the part of the mandrakes, I hid under the blanket.

I took a little peek some minutes or hour later and I saw the hug. It's glued in my mind until now.
When I was 11, I finally got to watch the whole 3rd movie at 2008 thanks to one channel. I don't have that fear of Mandrakes anymore. And then I watched and enjoyed the 3rd movie with thanks to Professor Lupin, the funny Monster Book of Monsters, and I quite liked the Harry/Hermione scenes in it. So I shook off my fear of Harry Potter and liked it, but not to the max, yet. And then at Christmas season last year, I bought the PoA book. And then I completely started loving Harry/Hermione. Add the facts I read too many fanfictions of them, watch too many vids of them together, look at pictures of them, read and watch their scenes in the books and movies over and over again, and think of them.
And what got me into them? Well, the hug was cute, but it's not really the main reason why. When I finished PoA, I noticed how great they affect each other. She's always by his side, helping him in various ways, and she understands him. He appreciates her and doesn't mind how bookish she is, and like her, he understands her. It was a total magnet for me, their trust and bond. And when I finally bought all the books, I liked how Hermione managed to say Voldemort's name for Harry. And there's a lot more H/Hr moments that got me glued. And the 'But I don't think you're ugly' moment was sweet.

And I thought reading the hints of R/Hr and H/G would make me change. But turns out, I fell even more in love with H/Hr, no matter how many times I've read Ginny kissing Harry or Ron getting jealous because of Hermione (which were once each, and I will barely read those if I repeat the book). I embrace fanon and squeeze it tightly.