php-fpm pool CPU & RAM hohe Auslastung

[p0se]

Hallo,

wie auch Speedysurf php-fpm pool 100% CPU habe ich seit kurzem hohe CPU und Ram last auf meinem Server durch php-fpm.

Im direkten Vergleich habe ich allerdings dauerhaft hohe Last.
Das ganze läuft nun seit letztem Samstag so.






in meinem Fall handelt es sich um zwei verschiedene Domains und auch zwei verschiedene Kunden. Wobei sich eine Domain anscheinend von alleine geheilt hat. Dementsprechend gehe ich jetzt nur von einer Domain aus.

Auf (beiden) Systemen läuft Shopware. Da ich mir einen neuen Server zugelegt habe, habe ich alle meine Webseiten kurz nach Neujahr am 05.01 umgezogen. Anfangs gab es keine Problem. Da auf beiden Shopware Seiten die Cronjobs nicht richtig funktioniert haben, habe ich diese einmal neu angelegt und danach haben diese wieder richtig funktioniert. Seit dem habe ich Probleme. Ob das zusammen hängt weiß ich nicht.

Hier mal ein Beispiel.

31169 kunde    20   0  517532  54012  38264 R 100,0  0,3   1:32.17 php-fpm: pool domain.de

31168 kunde    20   0  517532  54016  38264 S  86,0  0,3   0:54.85 php-fpm: pool domain.de

31971 kunde    20   0  517404  51528  35912 S  90,0  0,3   0:33.08 php-fpm: pool domain.de

Gestern habe ich den php slow log aktiviert.

[php-fpm-pool-settings]
slowlog = /var/log/slowlog/domain.de/slow.log
request_slowlog_timeout = 3s

Hier mal die letzten 5 Ausgaben.

[14-Jan-2019 19:00:05]  [pool domain.de] pid 31834
script_filename = /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php
[0x00007fe0b7420110] exec() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/doctrine/dbal/lib/Doctrine/DBAL/Connection.php:1012
[0x00007fe0b7420030] executeUpdate() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Bundle/SearchBundleDBAL/SearchTerm/SearchIndexer.php:223
[0x00007fe0b741fe50] build() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Bundle/SearchBundleDBAL/SearchTerm/SearchIndexer.php:103
[0x00007fe0b741fd70] validate() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Bundle/SearchBundleDBAL/SearchTerm/SearchTermQueryBuilder.php:78
[0x00007fe0b741fcd0] __construct() /var/www/vhosts/domain.de/httpdocs/domain.de/var/cache/production_201812030839/proxies/ShopwareProductionada003a4d172d01d6ca159a699d0c915ee959e4aProjectContainer.php:5837
[0x00007fe0b741fc40] getShopwareSearchdbal_SearchQueryBuilderDbalService() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/dependency-injection/Container.php:306
[0x00007fe0b741fb00] get() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:211
[0x00007fe0b741fa20] doLoad() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:143
[0x00007fe0b741f990] get() /var/www/vhosts/domain.de/httpdocs/domain.de/var/cache/production_201812030839/proxies/ShopwareProductionada003a4d172d01d6ca159a699d0c915ee959e4aProjectContainer.php:5825
[0x00007fe0b741f8a0] getShopwareSearchdbal_SearchConditionHandlerDbalService() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/dependency-injection/Container.php:306
[0x00007fe0b741f760] get() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:211
[0x00007fe0b741f680] doLoad() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:143
[0x00007fe0b741f5f0] get() /var/www/vhosts/domain.de/httpdocs/domain.de/var/cache/production_201812030839/proxies/ShopwareProductionada003a4d172d01d6ca159a699d0c915ee959e4aProjectContainer.php:5668
[0x00007fe09d499f80] {closure}() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Bundle/SearchBundleDBAL/QueryBuilderFactory.php:82
[0x00007fe0b741f580] iterator_to_array() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Bundle/SearchBundleDBAL/QueryBuilderFactory.php:82
[0x00007fe0b741f4d0] __construct() /var/www/vhosts/domain.de/httpdocs/domain.de/var/cache/production_201812030839/proxies/ShopwareProductionada003a4d172d01d6ca159a699d0c915ee959e4aProjectContainer.php:5660
[0x00007fe0b741f440] getShopwareSearchdbal_DbalQueryBuilderFactoryService() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/dependency-injection/Container.php:306
[0x00007fe0b741f300] get() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:211
[0x00007fe0b741f220] doLoad() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/DependencyInjection/Container.php:143
[0x00007fe0b741f190] get() /var/www/vhosts/domain.de/httpdocs/domain.de/var/cache/production_201812030839/proxies/ShopwareProductionada003a4d172d01d6ca159a699d0c915ee959e4aProjectContainer.php:5318

[14-Jan-2019 20:29:03]  [pool domain.de] pid 24477
script_filename = /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php
[0x00007fe0b741e050] is_file() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:677
[0x00007fe0b741def0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dd90] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dc30] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dad0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:311
[0x00007fe0b741da40] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Core.php:463
[0x00007fe0b741d9b0] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/CacheManager.php:186
[0x00007fe0b741d940] clearConfigCache() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Controllers/Backend/Cache.php:251
[0x00007fe0b741d8d0] clearDirectAction() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Action.php:193
[0x00007fe0b741d800] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Dispatcher/Default.php:549
[0x00007fe0b741d6a0] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Front.php:222
[0x00007fe0b741d600] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Kernel.php:202
[0x00007fe0b741d520] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/SubRequestHandler.php:102
[0x00007fe0b741d3b0] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:448
[0x00007fe0b741d2f0] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:268
[0x00007fe0b741d250] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:238
[0x00007fe0b741d1d0] pass() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:105
[0x00007fe0b741d120] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php:122

[14-Jan-2019 20:30:21]  [pool domain.de] pid 23476
script_filename = /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php
[0x00007fe0b741e050] is_file() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:677
[0x00007fe0b741def0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dd90] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dc30] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dad0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:311
[0x00007fe0b741da40] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Core.php:463
[0x00007fe0b741d9b0] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/CacheManager.php:186
[0x00007fe0b741d940] clearConfigCache() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Controllers/Backend/Cache.php:251
[0x00007fe0b741d8d0] clearDirectAction() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Action.php:193
[0x00007fe0b741d800] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Dispatcher/Default.php:549
[0x00007fe0b741d6a0] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Front.php:222
[0x00007fe0b741d600] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Kernel.php:202
[0x00007fe0b741d520] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/SubRequestHandler.php:102
[0x00007fe0b741d3b0] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:448
[0x00007fe0b741d2f0] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:268
[0x00007fe0b741d250] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:238
[0x00007fe0b741d1d0] pass() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:105
[0x00007fe0b741d120] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php:122

[14-Jan-2019 20:30:24]  [pool domain.de] pid 23515
script_filename = /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php
[0x00007fe0b741e050] is_file() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:677
[0x00007fe0b741def0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dd90] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dc30] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dad0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:311
[0x00007fe0b741da40] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Core.php:463
[0x00007fe0b741d9b0] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/CacheManager.php:186
[0x00007fe0b741d940] clearConfigCache() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Controllers/Backend/Cache.php:251
[0x00007fe0b741d8d0] clearDirectAction() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Action.php:193
[0x00007fe0b741d800] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Dispatcher/Default.php:549
[0x00007fe0b741d6a0] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Front.php:222
[0x00007fe0b741d600] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Kernel.php:202
[0x00007fe0b741d520] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/SubRequestHandler.php:102
[0x00007fe0b741d3b0] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:448
[0x00007fe0b741d2f0] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:268
[0x00007fe0b741d250] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:238
[0x00007fe0b741d1d0] pass() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:105
[0x00007fe0b741d120] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php:122

[14-Jan-2019 20:30:27]  [pool domain.de] pid 24477
script_filename = /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php
[0x00007fe0b741e050] is_file() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:677
[0x00007fe0b741def0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dd90] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dc30] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:747
[0x00007fe0b741dad0] _clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Backend/File.php:311
[0x00007fe0b741da40] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Zend/Cache/Core.php:463
[0x00007fe0b741d9b0] clean() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/CacheManager.php:186
[0x00007fe0b741d940] clearConfigCache() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Controllers/Backend/Cache.php:251
[0x00007fe0b741d8d0] clearDirectAction() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Action.php:193
[0x00007fe0b741d800] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Dispatcher/Default.php:549
[0x00007fe0b741d6a0] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Library/Enlight/Controller/Front.php:222
[0x00007fe0b741d600] dispatch() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Kernel.php:202
[0x00007fe0b741d520] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/SubRequestHandler.php:102
[0x00007fe0b741d3b0] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:448
[0x00007fe0b741d2f0] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:268
[0x00007fe0b741d250] forward() /var/www/vhosts/domain.de/httpdocs/domain.de/vendor/symfony/http-kernel/HttpCache/HttpCache.php:238
[0x00007fe0b741d1d0] pass() /var/www/vhosts/domain.de/httpdocs/domain.de/engine/Shopware/Components/HttpCache/AppCache.php:105
[0x00007fe0b741d120] handle() /var/www/vhosts/domain.de/httpdocs/domain.de/shopware.php:122

Hat jemand eine Idee wie ich weiter verfahren kann?
Teilweise sind die "laggs" auf dem ganzen Server spürbar was natürlich sehr nervig ist.