You and I are in the same boat. My hands are so small, I have to buy children's gloves, or make them myself.
I've found I was able to handle an alto recorder after years and years of only playing soprano recorder. It wasn't too bad because I've played piano for most of my life, so my fingers are pre-stretched. With the tenor, though I could stretch my fingers to play it, I still needed a double key for the last hole, and I ran into one more problem. I have short arms, and playing a tenor was making my right wrist bend painfully. I finally sucked it up and purchased a bent-neck tenor, and I found it to be one of the best purchases. I have a maple Moeck Rottenburgh bent neck tenor, and it's pretty much the only tenor recorder I play now (I also own a plastic Aulos one, which is not too bad to play, but painful after more than a few minutes). I also recently purchased a used bass recorder. It has metal bocal, like a bassoon, and keys for the last holes for each hand. I've only tested it, as I'm airing it out, then I have to clean and oil it properly (the previous owner did not), but I can definitely play it. I can't play very fast, but I can still play accurately.
In the last several months, I've learned how to handle low whistles with a super modified piper's grip that I came up with because I couldn't even do a regular piper's grip. I can use fingertips on the left hand, but I have to do piper's grip on the right hand. And I have to be picky about hole distances and whistle length, so I'm always asking the whistle makers for the sizes of their instruments before I buy them.
I'd like to know what key your whistle is in. If you are a recorder player, the easiest whistles to start on would be high D (like soprano) and alto G. Those have similar fingering to the recorders, though they are in diatonic major keys, unlike the recorders which give you the whole chromatic scale. On some of my alto whistles, where I don't want to use the piper's grip but can't quite reach the third whole with my ring finger, I'll end up using my pinky finger. I'm also really sorry that people are mocking you for doing something that should be considered impressive. Really, you don't know what you can achieve unless you give it a try. I didn't think I could handle low D, and it took a lot of convincing from members here and The Session to give the piper's grip a try, and I'm glad I finally listened to them.