I get annoyed with the jungler when:
1). They stay in jungle while teamfights/towers are going down right next to them
2). They never even make an appearance in a pushed lane. I'm not saying "OMG GANKS NOW!", I mean when the lane is at our tower, even if you cant actually gank just come let the enemy know you're there. They'll play a little more passive and maybe let your guys farm more.
3). They stay in the jungle long after the laning phase is over.
4). They call a gank, you go in for this gank, they walk away. I've died SO many times because they've pinged for me to go for someone. I get into position to land some CC, hit it, dive in and all of a sudden I'm by myself and gonna die because "Ooohh wraiths are up again!".
5). Junglers that do not understand that landing CC isnt always point and click. I play skill shot champs usually. That means I have to actually predict where they are going to be AND have a clear shot. Bare in mind that the opponent has been trying to dodge these all game now, so when they see me suddenly move they probably know thats what I'm going for. But some junglers will go ape shit on you if you miss 1 skill shot.
6). Junglers who do not share buffs later in game. I know they need early buffs, I dont expect them. But by the 4th blue spawn, you should probably be giving that to someone else.
Bare in mind, this is nothing against junglers in general. These are just particular things they do that annoy me.
On the flip side, heres some stuff the laners do in relation to junglers that annoy me.
1). The jungler comes in, pings for the gank, does everything he is supposed to do. Then the laners sit under the tower or recall. The jungler gets eaten alive, and is usually given some choice messages like "Omg nub jungle!".
2). When people are "helping" leash blue. Sure get in a couple hits if you can, but LEAVE before it gets close to dying! The jungler NEEDS that exp. Or worse yet, when someone just takes the jungler's buff right off the bat. That should be in the "Report user" section.
3). People call for ganks. The jungler is like "Ok, OMW" but is still like at wolves. The lane is like "BANZAI!!!" and jumps in waaaay before the jungler can get there. Again, they will blame the jungler for not having magical teleportation powers.
4). People who think it's the jungler's (or supports for that matter) sole duty to ward. Sure sometimes the jungler is nice and pops a ward in river for you, but thats not his job. Actually... it is. And the supports. And the AD carry. And the tank. And the AP. And that

ing roaming Shaco. It's everyone's job.
5). People who get mad at the jungler for farming their lane WHILE THEY ARE DEAD! Omg, seriously? I've seen some vids of high elo players (looking at you Hotshot) who die, the jungler comes and covers the lane, and they get pissed! THey are keeping the minions off your tower, and they need all the farm they can get. Every minion the tower kills is wasted gold. Just because it's your lane, doesnt mean noone else can farm it.