I have a problem. It appeared maybe a week ago. I don't know why (obviously)
I have 200 machines running on centos 6.5 and a spacewalk server to manage them.
Every commands from spacewalk are working well. But now I can't update my clients anymore (from the client with yum update or from spacewalk)
This is the error messages :
From client :
Code: Select all
root@feutre25-l:/var/log# yum update
Modules complémentaires chargés : fastestmirror, refresh-packagekit, rhnplugin, security
This system is receiving updates from RHN Classic or Red Hat Satellite.
Configuration du processus de mise à jour
Loading mirror speeds from cached hostfile
* base: mirror.ibcp.fr
* extras: ftp.rezopole.net
* updates: mirror.ibcp.fr
Résolution des dépendances
--> Lancement de la transaction de test
---> Package bash.x86_64 0:4.1.2-33.el6 will be mis à jour
---> Package bash.x86_64 0:4.1.2-33.el6_7.1 will be an update
---> Package db4.x86_64 0:4.7.25-19.el6_6 will be mis à jour
---> Package db4.x86_64 0:4.7.25-20.el6_7 will be an update
---> Package db4-cxx.x86_64 0:4.7.25-19.el6_6 will be mis à jour
---> Package db4-cxx.x86_64 0:4.7.25-20.el6_7 will be an update
---> Package db4-devel.x86_64 0:4.7.25-19.el6_6 will be mis à jour
---> Package db4-devel.x86_64 0:4.7.25-20.el6_7 will be an update
---> Package db4-utils.x86_64 0:4.7.25-19.el6_6 will be mis à jour
---> Package db4-utils.x86_64 0:4.7.25-20.el6_7 will be an update
---> Package device-mapper.x86_64 0:1.02.95-3.el6_7.2 will be mis à jour
---> Package device-mapper.x86_64 0:1.02.95-3.el6_7.3 will be an update
---> Package device-mapper-event.x86_64 0:1.02.95-3.el6_7.2 will be mis à jour
---> Package device-mapper-event.x86_64 0:1.02.95-3.el6_7.3 will be an update
---> Package device-mapper-event-libs.x86_64 0:1.02.95-3.el6_7.2 will be mis à jour
---> Package device-mapper-event-libs.x86_64 0:1.02.95-3.el6_7.3 will be an update
---> Package device-mapper-libs.x86_64 0:1.02.95-3.el6_7.2 will be mis à jour
---> Package device-mapper-libs.x86_64 0:1.02.95-3.el6_7.3 will be an update
---> Package firefox.x86_64 0:38.2.1-1.el6.centos will be mis à jour
---> Package firefox.x86_64 0:38.3.0-2.el6.centos will be an update
---> Package glibc.x86_64 0:2.12-1.166.el6_7.1 will be mis à jour
---> Package glibc.x86_64 0:2.12-1.166.el6_7.3 will be an update
---> Package glibc-common.x86_64 0:2.12-1.166.el6_7.1 will be mis à jour
---> Package glibc-common.x86_64 0:2.12-1.166.el6_7.3 will be an update
---> Package glibc-devel.x86_64 0:2.12-1.166.el6_7.1 will be mis à jour
---> Package glibc-devel.x86_64 0:2.12-1.166.el6_7.3 will be an update
---> Package glibc-headers.x86_64 0:2.12-1.166.el6_7.1 will be mis à jour
---> Package glibc-headers.x86_64 0:2.12-1.166.el6_7.3 will be an update
---> Package initscripts.x86_64 0:9.03.49-1.el6.centos will be mis à jour
---> Package initscripts.x86_64 0:9.03.49-1.el6.centos.1 will be an update
---> Package kernel.x86_64 0:2.6.32-573.7.1.el6 will be installé
---> Package kernel-firmware.noarch 0:2.6.32-573.3.1.el6 will be mis à jour
---> Package kernel-firmware.noarch 0:2.6.32-573.7.1.el6 will be an update
---> Package kernel-headers.x86_64 0:2.6.32-573.3.1.el6 will be mis à jour
---> Package kernel-headers.x86_64 0:2.6.32-573.7.1.el6 will be an update
---> Package lvm2.x86_64 0:2.02.118-3.el6_7.2 will be mis à jour
---> Package lvm2.x86_64 0:2.02.118-3.el6_7.3 will be an update
---> Package lvm2-libs.x86_64 0:2.02.118-3.el6_7.2 will be mis à jour
---> Package lvm2-libs.x86_64 0:2.02.118-3.el6_7.3 will be an update
---> Package openldap.x86_64 0:2.4.40-5.el6 will be mis à jour
---> Package openldap.x86_64 0:2.4.40-6.el6_7 will be an update
---> Package procps.x86_64 0:3.2.8-33.el6 will be mis à jour
---> Package procps.x86_64 0:3.2.8-34.el6_7 will be an update
---> Package rng-tools.x86_64 0:5-1.el6 will be mis à jour
---> Package rng-tools.x86_64 0:5-2.el6_7 will be an update
---> Package selinux-policy.noarch 0:3.7.19-279.el6_7.5 will be mis à jour
---> Package selinux-policy.noarch 0:3.7.19-279.el6_7.6 will be an update
---> Package selinux-policy-targeted.noarch 0:3.7.19-279.el6_7.5 will be mis à jour
---> Package selinux-policy-targeted.noarch 0:3.7.19-279.el6_7.6 will be an update
--> Résolution des dépendances terminée
Dépendances résolues
=============================================================================================================================================================================================================================
Paquet Architecture Version Dépôt Taille
=============================================================================================================================================================================================================================
Installation:
kernel x86_64 2.6.32-573.7.1.el6 centos6-updates-x86_64 30 M
Mise à jour:
bash x86_64 4.1.2-33.el6_7.1 centos6-updates-x86_64 908 k
db4 x86_64 4.7.25-20.el6_7 centos6-updates-x86_64 563 k
db4-cxx x86_64 4.7.25-20.el6_7 centos6-updates-x86_64 588 k
db4-devel x86_64 4.7.25-20.el6_7 centos6-updates-x86_64 6.6 M
db4-utils x86_64 4.7.25-20.el6_7 centos6-updates-x86_64 130 k
device-mapper x86_64 1.02.95-3.el6_7.3 centos6-updates-x86_64 176 k
device-mapper-event x86_64 1.02.95-3.el6_7.3 centos6-updates-x86_64 124 k
device-mapper-event-libs x86_64 1.02.95-3.el6_7.3 centos6-updates-x86_64 118 k
device-mapper-libs x86_64 1.02.95-3.el6_7.3 centos6-updates-x86_64 223 k
firefox x86_64 38.3.0-2.el6.centos centos6-updates-x86_64 70 M
glibc x86_64 2.12-1.166.el6_7.3 centos6-updates-x86_64 3.8 M
glibc-common x86_64 2.12-1.166.el6_7.3 centos6-updates-x86_64 14 M
glibc-devel x86_64 2.12-1.166.el6_7.3 centos6-updates-x86_64 986 k
glibc-headers x86_64 2.12-1.166.el6_7.3 centos6-updates-x86_64 615 k
initscripts x86_64 9.03.49-1.el6.centos.1 centos6-updates-x86_64 945 k
kernel-firmware noarch 2.6.32-573.7.1.el6 centos6-updates-x86_64 18 M
kernel-headers x86_64 2.6.32-573.7.1.el6 centos6-updates-x86_64 3.9 M
lvm2 x86_64 2.02.118-3.el6_7.3 centos6-updates-x86_64 856 k
lvm2-libs x86_64 2.02.118-3.el6_7.3 centos6-updates-x86_64 941 k
openldap x86_64 2.4.40-6.el6_7 updates 283 k
procps x86_64 3.2.8-34.el6_7 centos6-updates-x86_64 217 k
rng-tools x86_64 5-2.el6_7 centos6-updates-x86_64 32 k
selinux-policy noarch 3.7.19-279.el6_7.6 centos6-updates-x86_64 882 k
selinux-policy-targeted noarch 3.7.19-279.el6_7.6 centos6-updates-x86_64 3.1 M
Résumé de la transaction
=============================================================================================================================================================================================================================
Installation de 1 paquet(s)
Mise à jour de 24 paquet(s)
Taille totale : 158 M
Taille totale des téléchargements : 158 M
Est-ce correct [o/N] : o
Téléchargement des paquets :
Erreur durant le téléchargement des paquets :
procps-3.2.8-34.el6_7.x86_64: failed to retrieve getPackage/procps-3.2.8-34.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
rng-tools-5-2.el6_7.x86_64: failed to retrieve getPackage/rng-tools-5-2.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
device-mapper-event-libs-1.02.95-3.el6_7.3.x86_64: failed to retrieve getPackage/device-mapper-event-libs-1.02.95-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
device-mapper-libs-1.02.95-3.el6_7.3.x86_64: failed to retrieve getPackage/device-mapper-libs-1.02.95-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
bash-4.1.2-33.el6_7.1.x86_64: failed to retrieve getPackage/bash-4.1.2-33.el6_7.1.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
kernel-firmware-2.6.32-573.7.1.el6.noarch: failed to retrieve getPackage/kernel-firmware-2.6.32-573.7.1.el6.noarch.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
db4-cxx-4.7.25-20.el6_7.x86_64: failed to retrieve getPackage/db4-cxx-4.7.25-20.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
device-mapper-1.02.95-3.el6_7.3.x86_64: failed to retrieve getPackage/device-mapper-1.02.95-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
glibc-common-2.12-1.166.el6_7.3.x86_64: failed to retrieve getPackage/glibc-common-2.12-1.166.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
selinux-policy-targeted-3.7.19-279.el6_7.6.noarch: failed to retrieve getPackage/selinux-policy-targeted-3.7.19-279.el6_7.6.noarch.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
initscripts-9.03.49-1.el6.centos.1.x86_64: failed to retrieve getPackage/initscripts-9.03.49-1.el6.centos.1.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
glibc-2.12-1.166.el6_7.3.x86_64: failed to retrieve getPackage/glibc-2.12-1.166.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
kernel-headers-2.6.32-573.7.1.el6.x86_64: failed to retrieve getPackage/kernel-headers-2.6.32-573.7.1.el6.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
glibc-headers-2.12-1.166.el6_7.3.x86_64: failed to retrieve getPackage/glibc-headers-2.12-1.166.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
db4-devel-4.7.25-20.el6_7.x86_64: failed to retrieve getPackage/db4-devel-4.7.25-20.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
lvm2-2.02.118-3.el6_7.3.x86_64: failed to retrieve getPackage/lvm2-2.02.118-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
kernel-2.6.32-573.7.1.el6.x86_64: failed to retrieve getPackage/kernel-2.6.32-573.7.1.el6.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
selinux-policy-3.7.19-279.el6_7.6.noarch: failed to retrieve getPackage/selinux-policy-3.7.19-279.el6_7.6.noarch.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
firefox-38.3.0-2.el6.centos.x86_64: failed to retrieve getPackage/firefox-38.3.0-2.el6.centos.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
db4-4.7.25-20.el6_7.x86_64: failed to retrieve getPackage/db4-4.7.25-20.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
db4-utils-4.7.25-20.el6_7.x86_64: failed to retrieve getPackage/db4-utils-4.7.25-20.el6_7.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
glibc-devel-2.12-1.166.el6_7.3.x86_64: failed to retrieve getPackage/glibc-devel-2.12-1.166.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
device-mapper-event-1.02.95-3.el6_7.3.x86_64: failed to retrieve getPackage/device-mapper-event-1.02.95-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
lvm2-libs-2.02.118-3.el6_7.3.x86_64: failed to retrieve getPackage/lvm2-libs-2.02.118-3.el6_7.3.x86_64.rpm from centos6-updates-x86_64
error was [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error"
And the result on server side (in httpd logs) :
Code: Select all
==> access_log <==
192.168.10.165 - - [02/Oct/2015:10:42:19 +0200] "GET /XMLRPC/GET-REQ/epel6-x86_64/repodata/repomd.xml HTTP/1.1" 500 2846 "-" "rhn.rpclib.py/2.5.72-1.el6"
==> error_log <==
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] mod_wsgi (pid=22999): Exception occurred processing WSGI script '/usr/share/rhn/wsgi/xmlrpc.py'.
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] Traceback (most recent call last):
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/share/rhn/wsgi/xmlrpc.py", line 22, in application
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return wsgiHandler.handle(environ, start_response, "xmlrpc", "server.xmlrpc")
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/share/rhn/wsgi/wsgiHandler.py", line 45, in handle
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] ret = appServ(req)
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheHandler.py", line 185, in handler
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] ret = self._req_processor.auth_client()
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheRequest.py", line 390, in auth_client
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return apacheAuth.auth_client()
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheAuth.py", line 165, in auth_client
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] username = token['X-RHN-Auth-User-Id']
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/rhn/UserDictCase.py", line 44, in __getitem__
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return self.data[key]
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] KeyError: 'x-rhn-auth-user-id'
==> access_log <==
192.168.10.165 - - [02/Oct/2015:10:42:19 +0200] "GET /XMLRPC/GET-REQ/spacewalk-client-x86_64/repodata/repomd.xml HTTP/1.1" 500 2846 "-" "rhn.rpclib.py/2.5.72-1.el6"
192.168.10.165 - - [02/Oct/2015:10:42:19 +0200] "POST /XMLRPC HTTP/1.1" 200 1774 "-" "rhn.rpclib.py/2.5.72-1.el6"
==> error_log <==
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] mod_wsgi (pid=22362): Exception occurred processing WSGI script '/usr/share/rhn/wsgi/xmlrpc.py'.
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] Traceback (most recent call last):
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/share/rhn/wsgi/xmlrpc.py", line 22, in application
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return wsgiHandler.handle(environ, start_response, "xmlrpc", "server.xmlrpc")
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/share/rhn/wsgi/wsgiHandler.py", line 45, in handle
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] ret = appServ(req)
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheHandler.py", line 185, in handler
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] ret = self._req_processor.auth_client()
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheRequest.py", line 390, in auth_client
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return apacheAuth.auth_client()
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheAuth.py", line 165, in auth_client
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] username = token['X-RHN-Auth-User-Id']
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] File "/usr/lib/python2.6/site-packages/rhn/UserDictCase.py", line 44, in __getitem__
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] return self.data[key]
[Fri Oct 02 10:42:19 2015] [error] [client 192.168.10.165] KeyError: 'x-rhn-auth-user-id'
Can someone help me on this issue ?