a little + ADJECTIVE | ADVERB – English Grammar Profiler
At A2, in the Oxford Learner’s Dictionary, the adverbial phrase:
a little (bit) = to a small degree
Although ‘a little‘ exists in the EGP, there is no entry for it to modify an adjective unless it contains ‘a (little) BIT’ + COMPARATIVE at B1. We checked the EVP and found that it exists modifying an adjective at B2. There is also nothing specific about ‘a little’ modifying other adverbs.
Expanded in iWeb:

a little _JJ
1 A LITTLE EXTRA 48606 2 A LITTLE DIFFERENT 45216 3 A LITTLE NERVOUS 10624 4 A LITTLE HIGHER 10480
5 A LITTLE TRICKY 9939
That makes it a little tricky.
listen
6 A LITTLE HARD 9032 7 A LITTLE EASIER 8678 8 A LITTLE DIFFICULT 8232 9 A LITTLE LONGER 7892 10 A LITTLE DISAPPOINTED 7802 11 A LITTLE BIGGER 7248 12 A LITTLE CONFUSING 7082 13 A LITTLE WEIRD 7043 14 A LITTLE CRAZY 6884 15 A LITTLE LATE 6230 16 A LITTLE HARDER 6206 17 A LITTLE ODD 6161 18 A LITTLE SURPRISED 6153 19 A LITTLE STRANGE 6143 20 A LITTLE SMALLER 5960 21 A LITTLE OLDER 5902 22 A LITTLE LOWER 5655 23 A LITTLE CONCERNED 5632 24 A LITTLE BETTER 5559 25 A LITTLE SLOW 5412 26 A LITTLE HIGH 5328 27 A LITTLE SHORT 5169 28 A LITTLE LARGER 5026 29 A LITTLE ROUGH 4713
30 A LITTLE PRICEY 4685
a little more _JJ
1 A LITTLE MORE DIFFICULT 5315
This is going to be a little more difficult than I thought.
listen
2 A LITTLE MORE COMPLICATED 5148 3 A LITTLE MORE EXPENSIVE 3780 4 A LITTLE MORE COMPLEX 2353 5 A LITTLE MORE INTERESTING 2134 6 A LITTLE MORE FUN 1941 7 A LITTLE MORE COMFORTABLE 1626 8 A LITTLE MORE CHALLENGING 1592 9 A LITTLE MORE CREATIVE 1063 10 A LITTLE MORE SPECIFIC 1030 11 A LITTLE MORE SPECIAL 978 12 A LITTLE MORE AGGRESSIVE 828 13 A LITTLE MORE SERIOUS 797 14 A LITTLE MORE TRICKY 778 15 A LITTLE MORE EXCITING 764 16 A LITTLE MORE ADVENTUROUS 716 17 A LITTLE MORE RELAXED 707 18 A LITTLE MORE ADVANCED 697 19 A LITTLE MORE CAREFUL 678 20 A LITTLE MORE SUBTLE 662 21 A LITTLE MORE PERSONAL 660 22 A LITTLE MORE FLEXIBLE 643 23 A LITTLE MORE SOPHISTICATED 558 24 A LITTLE MORE CLEAR 545 25 A LITTLE MORE LIGHT 545 26 A LITTLE MORE FORGIVING 540 27 A LITTLE MORE OPEN 530 28 A LITTLE MORE CONFIDENT 514 29 A LITTLE MORE UNIQUE 512
30 A LITTLE MORE BEARABLE 486
Also, note ‘a little bit’ at A2:
I‘m afraid Ash is feeling a little bit under the weather.
Shaun of the Dead