Not sure if this will help, or further discourage you, but it's honest, accurate, and what you probably need to hear:
Your expectations are probably, more like definitely, unreasonable for only FFing two times. I too was (and still am) a reasonably good UL spinner angler for Trout. I fish spinners for Trout several times a year, often in high and dirty water conditions, and most of the time these outings are my best producing days of the year, numbers wise anyway. If that’s what’s most important to you in your fishing and what you get the most enjoyment from, then just keep doing it. There is nothing that “looks better” or is “cooler” superficially about FFing. It’s just a different method to catch fish, with different equipment. Some, like me, have found it enjoyable to catch fish using different methods and equipment sometimes. Everyone has their own reasons to fish the way they like though.
With that out of the way, I’ll say this…Since I’ve learned to FFish, there’s times where I can definitely catch more fish with a fly rod than a spinning rod…low/clear water, during a big hatch, or on small, steep Brookie streams where it’s hard to work a spinner effectively in a bathtub size pool. Bottom line, there’s a place for both. That being said, sometimes I just feel like spin fishing, or just feel like fly fishing, regardless of the conditions. Sometimes one just has more appeal than the other to me on a given day, so that’s what I do. Who cares.
In your case, it sounds like you're pretty effective with a spinning rod right now. You need to take the time, lower your expectations, and learn how to FFish. There’s skills that translate from one to the other, but they’re different enough that most people struggle at first with a fly rod when converting from spin fishing. That’s normal.
My guess is you were nowhere near as effective with a spinner when you first started. I’ve taken guys spinner fishing for the first time and they couldn’t keep a cast in the water, nonetheless put it in a spot where they’d likely catch a fish. It takes practice, and so does FFing. Youtube videos, guides, fishing with someone, etc will all help, but nothing beats personal experience on the stream.
If it’s something you want to do, you just gotta commit to doing it, and learning it. There's no one fly, or even one technique that is the magic ticket. For one year, I committed to not spinner fishing at all. If I was going fishing, I was FFing that year. By the end of the year, I was halfway decent at FFing, but good enough that I could catch fish most times when conditions were reasonable and other (better than me) FFers were catching fish. What I learned was that I enjoyed FFing, and learning something new. I recognized I was learning and getting better, and wanted to keep learning and getting better. So for several years I very rarely spin fished, just because I wanted to FFish instead. It's only been more recently I've been spin fishing more again.
Not that my experience was the same as everyone, but as a reasonable baseline...
It took me about 2 months and 6 or 8 outings until I caught a fish.
It took about one year until I truly had a good day FFing.
It took me 2 or 3 years until I felt like I was comfortable doing it, and could catch more fish (in the right conditions) with a fly rod than a spinning rod. Fishing warmwater streams for Bass and Sunfish helped a lot with my casting and line management, and I generally found it easier to catch fish there than Trout at first.
I'm still not very good comparatively to a lot of guys on this site.