CentOS 6 eth0 /proc/interrupts on Amazon EC2 sticky?

S1m0n · Post by **S1m0n** » 2015/09/01 00:23:05

Hello, I'm running CentOS 6 on an Amazon EC2 box with 32 cores. I noticed via /proc/interrupts (see below) that eth0 is sticky to CPU0. I believe however that network performance improves if it's not sticky and that newer OSs do not having this stickiness. Am I correct? And if so, how can I change the config to avoid the stickiness? Thanks, S1mon

Code: Select all

# cat /proc/interrupts 
           CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7       CPU8       CPU9       CPU10      CPU11      CPU12      CPU13      CPU14      CPU15      CPU16      CPU17      CPU18      CPU19      CPU20      CPU21      CPU22      CPU23      CPU24      CPU25      CPU26      CPU27      CPU28      CPU29      CPU30      CPU31      
362: 1783125536          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     eth0
363:  483538770          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     blkif
364:  485974509          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     blkif
365:  339627475          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     blkif
366:        557          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     hvc_console
367:        467          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   xen-dyn-event     xenbus
368:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      15632  xen-percpu-ipi       callfuncsingle31
369:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug31
370:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       7428  xen-percpu-ipi       callfunc31
371:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   71801016  xen-percpu-ipi       resched31
372:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  147577713  xen-percpu-virq      timer31
373:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      17020          0  xen-percpu-ipi       callfuncsingle30
374:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug30
375:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       8264          0  xen-percpu-ipi       callfunc30
376:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   81114079          0  xen-percpu-ipi       resched30
377:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  169179935          0  xen-percpu-virq      timer30
378:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      17820          0          0  xen-percpu-ipi       callfuncsingle29
379:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug29
380:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      10273          0          0  xen-percpu-ipi       callfunc29
381:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  103231308          0          0  xen-percpu-ipi       resched29
382:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  213687353          0          0  xen-percpu-virq      timer29
383:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      18968          0          0          0  xen-percpu-ipi       callfuncsingle28
384:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug28
385:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      14296          0          0          0  xen-percpu-ipi       callfunc28
386:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  136722649          0          0          0  xen-percpu-ipi       resched28
387:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  281284318          0          0          0  xen-percpu-virq      timer28
388:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      19609          0          0          0          0  xen-percpu-ipi       callfuncsingle27
389:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug27
390:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      21574          0          0          0          0  xen-percpu-ipi       callfunc27
391:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  182807946          0          0          0          0  xen-percpu-ipi       resched27
392:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  385472746          0          0          0          0  xen-percpu-virq      timer27
393:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      19925          0          0          0          0          0  xen-percpu-ipi       callfuncsingle26
394:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug26
395:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      34245          0          0          0          0          0  xen-percpu-ipi       callfunc26
396:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  232946969          0          0          0          0          0  xen-percpu-ipi       resched26
397:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  517327064          0          0          0          0          0  xen-percpu-virq      timer26
398:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      19209          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle25
399:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug25
400:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      61765          0          0          0          0          0          0  xen-percpu-ipi       callfunc25
401:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  269997494          0          0          0          0          0          0  xen-percpu-ipi       resched25
402:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  714582285          0          0          0          0          0          0  xen-percpu-virq      timer25
403:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      18533          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle24
404:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug24
405:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     113796          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc24
406:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  279916071          0          0          0          0          0          0          0  xen-percpu-ipi       resched24
407:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  943569012          0          0          0          0          0          0          0  xen-percpu-virq      timer24
408:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      17684          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle23
409:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug23
410:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     191166          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc23
411:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  232381016          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched23
412:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 1081532929          0          0          0          0          0          0          0          0  xen-percpu-virq      timer23
413:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      20227          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle22
414:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug22
415:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     252806          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc22
416:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  171979401          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched22
417:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  502060001          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer22
418:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      24126          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle21
419:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug21
420:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     259491          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc21
421:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  161421089          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched21
422:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  426400073          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer21
423:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      29528          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle20
424:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug20
425:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     261698          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc20
426:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  158031628          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched20
427:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  407039990          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer20
428:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      35595          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle19
429:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug19
430:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0     264675          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc19
431:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  154322358          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched19
432:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  389572159          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer19
433:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      43825          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle18
...
520:          0     565882          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc1
521:          0 3292900174          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched1
522:          0 3114072147          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer1
523:      64642          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfuncsingle0
524:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      debug0
525:     544424          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       callfunc0
526: 2018541308          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-ipi       resched0
527: 1799599053          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0  xen-percpu-virq      timer0
NMI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Non-maskable interrupts
LOC:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Local timer interrupts
SPU:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Spurious interrupts
PMI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Performance monitoring interrupts
IWI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IRQ work interrupts
RES: 2018541309 3292900174 1256562149 4176642094 3080623762 2294522641 1729088856 1301116231  951323935  704301221  537522855  422987084  349912538  300617039  262878548  233489823  188674327  172590936  160070394  154322358  158031628  161421089  171979401  232381016  279916071  269997494  232946969  182807946  136722649  103231308   81114079   71801016   Rescheduling interrupts
CAL:     609066    2547942    4353439    4150854    3123094    2157505    1374937    1173881     944689     771760     656436     546806     463360     409894     373754     349511     331244     317679     310095     300270     291226     283617     273033     208850     132329      80974      54170      41183      33264      28093      25284      23060   Function call interrupts
TLB:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   TLB shootdowns
TRM:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Thermal event interrupts
THR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Threshold APIC interrupts
MCE:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Machine check exceptions
MCP:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Machine check polls
ERR:          0
MIS:          0

[/size]

avij · Post by **avij** » 2015/09/01 05:30:43

Perhaps you should install the irqbalance package?

S1m0n · Post by **S1m0n** » 2015/09/04 23:28:20

FYI irqbalance appears to be already installed and working... so does that mean that irqbalance is not the solution to the problem?

Code: Select all

$ ps jfax | egrep irq
    2     4     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/0]
    2     9     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/1]
    2    13     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/2]
    2    17     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/3]
    2    21     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/4]
    2    25     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/5]
    2    29     0     0 ?           -1 S        0   0:03  \_ [ksoftirqd/6]
    2    33     0     0 ?           -1 S        0   0:04  \_ [ksoftirqd/7]
    1  1132  1132  1132 ?           -1 Ss       0   0:20 irqbalance --pid=/var/run/irqbalance.pid
10540   615   614 10540 pts/0      614 S+    2525   0:00  |           \_ grep -E irq

CentOS

CentOS 6 eth0 /proc/interrupts on Amazon EC2 sticky?

CentOS 6 eth0 /proc/interrupts on Amazon EC2 sticky?

Re: CentOS 6 eth0 /proc/interrupts on Amazon EC2 sticky?

Re: CentOS 6 eth0 /proc/interrupts on Amazon EC2 sticky?