My hardest gym I faced is Pewter City's Gym in Pokemon Yellow. It was very hard and atrocious to see that my starter Pikachu is my only Pokemon that has a higher level than Brock's (but still weaker), and my others are at a very low level.