I started with my first worm bin in May of 2019. It took for ever to be able to harvest worm castings. (8 or 9 months) My worms didn't die, they didn't seem to increase in population. I was quite disappointed. I wasn't sure if I was doing something wrong, or the hype on the internet was misleading. In end of February beginning of March of 2020 I pulled out 50 worms of different sizes and put them in a very small bucket (maybe 2 gallon size?) The bedding was made up of shredded cardboard, compost, and some 2 year old wood chips. I kept it moist and just put a box on top. The plan was to give the worms to my friend, so I wasn't worried about it not being big enough, or about no holes in the bottom, being too damp, ect. ect. Covid hit and instead of having the worms in there temp home for a day or two they were in there for a couple of months. At that point my friend decided not to take the worms. I bought and set up a second bin. What I discovered were tons of worms! I was amazed how many there were. Some of the answer may be close proximity. But I noticed the bin was kind of wet in at least 1/2 to 3/4 from the bottom. I started to rethink and do more research. What I decided was I was keeping my bedding to dry. I think the damp sponge is off. You don't want the worms swimming, but now that I keep my bin more wet, there are a lot more worms and I can harvest the worm castings about ever 3 months.
For the most part I think you are doing most everything right. I would take the advise given and not dig around in the bin any more then you have to. Try a little more water. I see on the internet people feed there worms every day, but I don't know how they don't have smelly slimy bins. I feed mine once a week. That seem to be when they start getting low on food scraps. I think adding food scraps is relative and just something you have to experiment with until you figure what works for you. I haven't tried high protein, sound interesting, maybe something to try. I have read about rice, and in the info I got with my worms from Uncle Jim's Worm Farm said worms love corn meal. They don't get this stuff often, but I figure a varied diet is good for the worms and probably beneficial to the castings. I'm going to attach a video I watched that drove home I wasn't using enough water in my bin. Good luck.
PS If you have to many food scraps for warm, you could always get a couple of chickens. They eat almost anything and give you egg. Just a thought.