May 21 03:17:30.547370 ip-10-0-131-76 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 03:17:30.547383 ip-10-0-131-76 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 03:17:30.547390 ip-10-0-131-76 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 03:17:30.547624 ip-10-0-131-76 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 03:17:41.788067 ip-10-0-131-76 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 03:17:41.788085 ip-10-0-131-76 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e4ba9983ad474720b72cc11e3c1843c4 --
May 21 03:20:10.648139 ip-10-0-131-76 systemd[1]: Starting Kubernetes Kubelet...
May 21 03:20:11.142818 ip-10-0-131-76 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 03:20:11.142818 ip-10-0-131-76 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 03:20:11.142818 ip-10-0-131-76 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 03:20:11.142818 ip-10-0-131-76 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 03:20:11.142818 ip-10-0-131-76 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 03:20:11.146596 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.146515    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 03:20:11.152623 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152608    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 03:20:11.152623 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152623    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152629    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152633    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152636    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152639    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152642    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152644    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152658    2558 feature_gate.go:328] unrecognized feature gate: Example
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152661    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152664    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152667    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152669    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152671    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152674    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152677    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152679    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152682    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152684    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152687    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152690    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 03:20:11.152687 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152693    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152696    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152699    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152701    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152704    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152706    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152709    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152711    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152714    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152716    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152719    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152721    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152723    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152726    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152728    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152731    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152733    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152736    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152739    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 03:20:11.153189 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152751    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152760    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152763    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152766    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152768    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152771    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152773    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152775    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152778    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152780    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152782    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152785    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152787    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152789    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152792    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152795    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152798    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152800    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152803    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152805    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 03:20:11.153638 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152808    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152811    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152815    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152818    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152821    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152823    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152829    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152832    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152834    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152837    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152839    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152860    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152863    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152865    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152873    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152877    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152879    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152882    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152884    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 03:20:11.154212 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152887    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152889    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152892    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152894    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152896    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152899    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.152902    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153334    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153340    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153343    2558 feature_gate.go:328] unrecognized feature gate: Example
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153345    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153348    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153351    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153353    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153355    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153358    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153360    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153363    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153366    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153368    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 03:20:11.154662 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153371    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153373    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153376    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153378    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153380    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153383    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153385    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153393    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153396    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153398    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153400    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153403    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153406    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153408    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153410    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153413    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153415    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153418    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153420    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153422    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 03:20:11.155187 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153426    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153429    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153431    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153434    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153437    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153439    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153441    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153444    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153446    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153449    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153451    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153454    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153456    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153458    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153461    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153463    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153465    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153468    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153470    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153472    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 03:20:11.155678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153480    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153483    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153485    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153488    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153491    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153493    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153498    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153501    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153503    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153506    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153508    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153511    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153514    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153517    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153519    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153521    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153524    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153527    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153530    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 03:20:11.156171 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153533    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153537    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153541    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153544    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153547    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153550    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153553    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153555    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153558    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153560    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153563    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153565    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153567    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.153570    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154538    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154547    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154555    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154560    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154565    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154568    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154572    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 03:20:11.156628 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154576    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154579    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154582    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154586    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154590    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154593    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154596    2558 flags.go:64] FLAG: --cgroup-root=""
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154599    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154601    2558 flags.go:64] FLAG: --client-ca-file=""
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154604    2558 flags.go:64] FLAG: --cloud-config=""
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154607    2558 flags.go:64] FLAG: --cloud-provider="external"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154610    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154617    2558 flags.go:64] FLAG: --cluster-domain=""
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154619    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154622    2558 flags.go:64] FLAG: --config-dir=""
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154625    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154628    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154632    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154635    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154638    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154641    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154643    2558 flags.go:64] FLAG: --contention-profiling="false"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154646    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154649    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154652    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 03:20:11.157157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154655    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154665    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154669    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154672    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154675    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154678    2558 flags.go:64] FLAG: --enable-server="true"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154680    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154687    2558 flags.go:64] FLAG: --event-burst="100"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154690    2558 flags.go:64] FLAG: --event-qps="50"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154693    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154696    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154699    2558 flags.go:64] FLAG: --eviction-hard=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154703    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154705    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154708    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154711    2558 flags.go:64] FLAG: --eviction-soft=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154714    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154717    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154719    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154722    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154725    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154727    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154730    2558 flags.go:64] FLAG: --feature-gates=""
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154734    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154736    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 03:20:11.157759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154739    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154743    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154746    2558 flags.go:64] FLAG: --healthz-port="10248"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154748    2558 flags.go:64] FLAG: --help="false"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154751    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-131-76.ec2.internal"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154754    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154757    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154759    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154762    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154771    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154775    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154778    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154781    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154783    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154786    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154789    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154792    2558 flags.go:64] FLAG: --kube-reserved=""
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154795    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154798    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154801    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154803    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154806    2558 flags.go:64] FLAG: --lock-file=""
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154809    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154812    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 03:20:11.158371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154815    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154820    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154822    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154825    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154828    2558 flags.go:64] FLAG: --logging-format="text"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154831    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154834    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154837    2558 flags.go:64] FLAG: --manifest-url=""
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154840    2558 flags.go:64] FLAG: --manifest-url-header=""
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154860    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154864    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154867    2558 flags.go:64] FLAG: --max-pods="110"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154870    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154873    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154876    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154878    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154881    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154884    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154893    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154901    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154904    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154907    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154910    2558 flags.go:64] FLAG: --pod-cidr=""
May 21 03:20:11.158965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154912    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154922    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154925    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154928    2558 flags.go:64] FLAG: --pods-per-core="0"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154931    2558 flags.go:64] FLAG: --port="10250"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154934    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154937    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d8b72ac3f34f5662"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154940    2558 flags.go:64] FLAG: --qos-reserved=""
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154943    2558 flags.go:64] FLAG: --read-only-port="10255"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154946    2558 flags.go:64] FLAG: --register-node="true"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154949    2558 flags.go:64] FLAG: --register-schedulable="true"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154952    2558 flags.go:64] FLAG: --register-with-taints=""
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154955    2558 flags.go:64] FLAG: --registry-burst="10"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154958    2558 flags.go:64] FLAG: --registry-qps="5"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154961    2558 flags.go:64] FLAG: --reserved-cpus=""
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154963    2558 flags.go:64] FLAG: --reserved-memory=""
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154967    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154970    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154973    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154975    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154978    2558 flags.go:64] FLAG: --runonce="false"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154981    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154984    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154986    2558 flags.go:64] FLAG: --seccomp-default="false"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154989    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154992    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 03:20:11.159515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154995    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.154998    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155006    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155009    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155012    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155015    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155018    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155023    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155025    2558 flags.go:64] FLAG: --system-cgroups=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155028    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155033    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155036    2558 flags.go:64] FLAG: --tls-cert-file=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155039    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155046    2558 flags.go:64] FLAG: --tls-min-version=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155048    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155051    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155054    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155057    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155059    2558 flags.go:64] FLAG: --v="2"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155063    2558 flags.go:64] FLAG: --version="false"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155067    2558 flags.go:64] FLAG: --vmodule=""
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155071    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.155074    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155192    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155196    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 03:20:11.160179 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155199    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155202    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155205    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155207    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155210    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155212    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155214    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155217    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155220    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155222    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155231    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155233    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155236    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155238    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155241    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155244    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155246    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155248    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155251    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155253    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 03:20:11.160788 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155256    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155258    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155260    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155263    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155265    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155268    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155270    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155272    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155275    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155277    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155280    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155282    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155284    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155286    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155290    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155293    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155296    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155298    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155300    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 03:20:11.161302 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155303    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155307    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155309    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155312    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155320    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155322    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155325    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155328    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155330    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155332    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155335    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155337    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155340    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155342    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155344    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155347    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155349    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155352    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155354    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155357    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 03:20:11.161767 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155359    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155361    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155364    2558 feature_gate.go:328] unrecognized feature gate: Example
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155366    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155368    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155371    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155373    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155375    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155378    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155380    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155383    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155385    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155388    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155392    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155394    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155397    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155399    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155407    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155410    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155414    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 03:20:11.162341 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155417    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 03:20:11.163140 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155420    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 03:20:11.163140 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155423    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 03:20:11.163140 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155425    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 03:20:11.163140 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.155428    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 03:20:11.163140 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.156234    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 03:20:11.164365 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.164347    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 03:20:11.164396 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.164367    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 03:20:11.164428 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164421    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 03:20:11.164428 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164427    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164430    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164433    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164436    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164439    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164442    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164445    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164447    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164450    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164452    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164455    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164457    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164460    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164463    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164465    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164468    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164471    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164473    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164477    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164479    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 03:20:11.164482 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164482    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164484    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164487    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164490    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164492    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164495    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164497    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164500    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164502    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164505    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164507    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164510    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164512    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164514    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164517    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164519    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164522    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164524    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164526    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164529    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 03:20:11.165032 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164531    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164534    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164542    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164545    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164547    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164550    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164552    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164554    2558 feature_gate.go:328] unrecognized feature gate: Example
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164557    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164560    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164563    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164567    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164570    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164572    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164575    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164578    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164582    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164586    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164590    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 03:20:11.165516 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164593    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164595    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164598    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164600    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164603    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164605    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164608    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164610    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164613    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164615    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164618    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164620    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164623    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164625    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164627    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164630    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164634    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164636    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164639    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164641    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 03:20:11.166040 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164644    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164646    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164649    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164651    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164653    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164656    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.164661    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164767    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164773    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164776    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164779    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164782    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164785    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164788    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164790    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164793    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 03:20:11.166522 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164795    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164798    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164800    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164803    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164805    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164808    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164810    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164812    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164815    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164817    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164821    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164824    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164827    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164830    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164833    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164836    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164838    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164863    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164866    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 03:20:11.166933 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164868    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164871    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164873    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164876    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164879    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164882    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164884    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164887    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164890    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164892    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164895    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164897    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164900    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164903    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164905    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164908    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164910    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164912    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164915    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164917    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 03:20:11.167402 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164920    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164923    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164925    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164927    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164930    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164932    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164935    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164938    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164940    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164943    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164945    2558 feature_gate.go:328] unrecognized feature gate: Example
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164947    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164950    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164952    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164955    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164957    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164960    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164963    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164966    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 03:20:11.167898 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164968    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164972    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164975    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164978    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164980    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164983    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164985    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164987    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164990    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164992    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164995    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164997    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.164999    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165002    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165004    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165007    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165009    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165012    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 03:20:11.168397 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:11.165014    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 03:20:11.168858 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.165019    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 03:20:11.168858 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.165813    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 03:20:11.170768 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.170754    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 03:20:11.171857 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.171833    2558 server.go:1019] "Starting client certificate rotation"
May 21 03:20:11.171962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.171944    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 03:20:11.171996 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.171985    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 03:20:11.198994 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.198977    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 03:20:11.203512 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.203493    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 03:20:11.221300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.221228    2558 log.go:25] "Validated CRI v1 runtime API"
May 21 03:20:11.228702 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.228687    2558 log.go:25] "Validated CRI v1 image API"
May 21 03:20:11.230067 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.230052    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 03:20:11.231322 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.231304    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 03:20:11.234671 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.234653    2558 fs.go:135] Filesystem UUIDs: map[731bdb25-6b29-499e-ab67-4254bbfb0f13:/dev/nvme0n1p4 76387965-0280-4f51-be44-a1008238a0d9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 21 03:20:11.234723 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.234671    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 03:20:11.238900 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.238780    2558 manager.go:217] Machine: {Timestamp:2026-05-21 03:20:11.238278016 +0000 UTC m=+0.459761046 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100338 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23472b6b431ee17c9e1e6c614f3313 SystemUUID:ec23472b-6b43-1ee1-7c9e-1e6c614f3313 BootID:e4ba9983-ad47-4720-b72c-c11e3c1843c4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:fb:95:50:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:fb:95:50:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:00:a9:bc:4b:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 03:20:11.239713 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.239703    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 03:20:11.239788 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.239776    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 03:20:11.241963 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.241942    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 03:20:11.242093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.241966    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 03:20:11.242143 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.242103    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 21 03:20:11.242143 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.242112    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 21 03:20:11.242143 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.242120    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 03:20:11.243050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.243040    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 03:20:11.243665 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.243631    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q56gr"
May 21 03:20:11.245594 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.245583    2558 state_mem.go:36] "Initialized new in-memory state store"
May 21 03:20:11.245715 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.245706    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 03:20:11.248549 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.248540    2558 kubelet.go:491] "Attempting to sync node with API server"
May 21 03:20:11.248585 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.248554    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 03:20:11.248585 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.248565    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 03:20:11.248585 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.248575    2558 kubelet.go:397] "Adding apiserver pod source"
May 21 03:20:11.248585 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.248582    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 03:20:11.249808 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.249796    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 03:20:11.249857 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.249816    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 03:20:11.251547 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.251532    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q56gr"
May 21 03:20:11.253463 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.253442    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 03:20:11.255771 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.255757    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 03:20:11.256759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256734    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 03:20:11.256759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256761    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256767    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256773    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256781    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256787    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256792    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256797    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256804    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256810    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 03:20:11.256899 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.256818    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 03:20:11.257250 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.257240    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 03:20:11.258167 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.258158    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 03:20:11.258167 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.258167    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 03:20:11.261501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.261487    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 03:20:11.261587 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.261525    2558 server.go:1295] "Started kubelet"
May 21 03:20:11.261625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.261582    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 03:20:11.261705 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.261650    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 03:20:11.261738 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.261724    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 03:20:11.262240 ip-10-0-131-76 systemd[1]: Started Kubernetes Kubelet.
May 21 03:20:11.262503 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.262471    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:11.262503 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.262488    2558 server.go:317] "Adding debug handlers to kubelet server"
May 21 03:20:11.265180 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.265160    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 03:20:11.267778 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.267761    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:11.268563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.268546    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-76.ec2.internal" not found
May 21 03:20:11.272308 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.272287    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 03:20:11.272903 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.272889    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 03:20:11.273260 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273124    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 03:20:11.273260 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273138    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 03:20:11.273260 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273247    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 03:20:11.273424 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273285    2558 reconstruct.go:97] "Volume reconstruction finished"
May 21 03:20:11.273424 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273293    2558 reconciler.go:26] "Reconciler: start to sync state"
May 21 03:20:11.273595 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273533    2558 factory.go:55] Registering systemd factory
May 21 03:20:11.273595 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273584    2558 factory.go:223] Registration of the systemd container factory successfully
May 21 03:20:11.273883 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273867    2558 factory.go:153] Registering CRI-O factory
May 21 03:20:11.273947 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273886    2558 factory.go:223] Registration of the crio container factory successfully
May 21 03:20:11.273947 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273936    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 03:20:11.274050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273955    2558 factory.go:103] Registering Raw factory
May 21 03:20:11.274050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.273971    2558 manager.go:1196] Started watching for new ooms in manager
May 21 03:20:11.274050 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.274006    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-76.ec2.internal\" not found"
May 21 03:20:11.274787 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.274766    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 03:20:11.275066 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.275053    2558 manager.go:319] Starting recovery of all containers
May 21 03:20:11.275781 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.275759    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:11.277346 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.277325    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-76.ec2.internal\" not found" node="ip-10-0-131-76.ec2.internal"
May 21 03:20:11.283380 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.283231    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-76.ec2.internal" not found
May 21 03:20:11.285229 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.285213    2558 manager.go:324] Recovery completed
May 21 03:20:11.288982 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.288970    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 03:20:11.290681 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.290665    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasSufficientMemory"
May 21 03:20:11.290747 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.290698    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasNoDiskPressure"
May 21 03:20:11.290747 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.290708    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasSufficientPID"
May 21 03:20:11.291183 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.291168    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 03:20:11.291183 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.291180    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 03:20:11.291275 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.291196    2558 state_mem.go:36] "Initialized new in-memory state store"
May 21 03:20:11.295036 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.295024    2558 policy_none.go:49] "None policy: Start"
May 21 03:20:11.295084 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.295041    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 03:20:11.295084 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.295051    2558 state_mem.go:35] "Initializing new in-memory state store"
May 21 03:20:11.329382 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329368    2558 manager.go:341] "Starting Device Plugin manager"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.329402    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329412    2558 server.go:85] "Starting device plugin registration server"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329605    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329614    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329703    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329789    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.329799    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.330413    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.330451    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-76.ec2.internal\" not found"
May 21 03:20:11.353484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.342333    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-76.ec2.internal" not found
May 21 03:20:11.406062 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.406002    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 03:20:11.407320 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.407302    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 03:20:11.407320 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.407321    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 03:20:11.407452 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.407335    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 03:20:11.407452 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.407341    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 03:20:11.407452 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.407374    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 03:20:11.409574 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.409558    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:11.430567 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.430550    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 03:20:11.431475 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.431449    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasSufficientMemory"
May 21 03:20:11.431563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.431480    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasNoDiskPressure"
May 21 03:20:11.431563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.431497    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeHasSufficientPID"
May 21 03:20:11.431563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.431526    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-76.ec2.internal"
May 21 03:20:11.445717 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.445697    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-76.ec2.internal"
May 21 03:20:11.445717 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:11.445716    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-76.ec2.internal\": node \"ip-10-0-131-76.ec2.internal\" not found"
May 21 03:20:11.508467 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.508433    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"]
May 21 03:20:11.512775 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.512758    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.512876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.512758    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.539366 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.539344    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.543625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.543611    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.557047 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.557032    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 03:20:11.559584 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.559570    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 03:20:11.574617 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.574601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.574687 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.574626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19944451ad6e4844bce6c2c9d20bf29a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-76.ec2.internal\" (UID: \"19944451ad6e4844bce6c2c9d20bf29a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.574687 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.574644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675290    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675317    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675334    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19944451ad6e4844bce6c2c9d20bf29a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-76.ec2.internal\" (UID: \"19944451ad6e4844bce6c2c9d20bf29a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675477 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675369    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19944451ad6e4844bce6c2c9d20bf29a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-76.ec2.internal\" (UID: \"19944451ad6e4844bce6c2c9d20bf29a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675477 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675390    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.675477 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.675406    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c056fce815e360251683a0041141bafe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal\" (UID: \"c056fce815e360251683a0041141bafe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.859530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.859497    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal"
May 21 03:20:11.862071 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:11.862056    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal"
May 21 03:20:12.171200 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.171131    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 03:20:12.171893 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.171254    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 03:20:12.171893 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.171270    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 03:20:12.171893 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.171324    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 03:20:12.249429 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.249401    2558 apiserver.go:52] "Watching apiserver"
May 21 03:20:12.253284 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.253244    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 03:15:11 +0000 UTC" deadline="2028-02-15 08:24:50.140448894 +0000 UTC"
May 21 03:20:12.253284 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.253277    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15245h4m37.887175715s"
May 21 03:20:12.257029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.257008    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 03:20:12.257363 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.257342    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wxwjc","kube-system/konnectivity-agent-bt7dg","openshift-image-registry/node-ca-nbbcs","openshift-multus/multus-5zwbq","openshift-network-operator/iptables-alerter-nqkc9","openshift-ovn-kubernetes/ovnkube-node-h8c7x","kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv","openshift-cluster-node-tuning-operator/tuned-l57b4","openshift-dns/node-resolver-vd8vg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal","openshift-multus/multus-additional-cni-plugins-m78d8","openshift-multus/network-metrics-daemon-fv9tm"]
May 21 03:20:12.261399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.261378    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:12.261492 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.261440    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:12.266504 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.266484    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.268890 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.268869    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kkfnr\""
May 21 03:20:12.268979 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.268897    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 03:20:12.268979 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.268873    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 03:20:12.269326 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.269309    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.272030 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.271836    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8tq2p\""
May 21 03:20:12.272579 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272332    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 03:20:12.272579 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272461    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 03:20:12.272779 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272758    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 03:20:12.272861 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272824    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 03:20:12.272931 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272918    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.272994 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.272979    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.275406 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.275388    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.275547 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.275524    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 03:20:12.276056 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276036    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 03:20:12.276133 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276084    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 03:20:12.276133 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276094    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-97flt\""
May 21 03:20:12.276597 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276578    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clx5z\""
May 21 03:20:12.276597 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276589    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 03:20:12.276736 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276606    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 03:20:12.276736 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276638    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 03:20:12.276736 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.276639    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 03:20:12.277489 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.277473    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 03:20:12.277665 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.277651    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 03:20:12.278201 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.278184    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.279118 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279092    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279092    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tt2q2\""
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279142    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279155    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11e2a2eb-33a6-469e-86a2-51af9e78a823-host\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279142    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 03:20:12.279213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-k8s-cni-cncf-io\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-bin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-kubelet\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-node-log\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-netns\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-netns\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-ovn\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-log-socket\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11e2a2eb-33a6-469e-86a2-51af9e78a823-serviceca\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-os-release\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-etc-kubernetes\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkkh\" (UniqueName: \"kubernetes.io/projected/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-kube-api-access-8xkkh\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-iptables-alerter-script\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-slash\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-agent-certs\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwcs\" (UniqueName: \"kubernetes.io/projected/11e2a2eb-33a6-469e-86a2-51af9e78a823-kube-api-access-xcwcs\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-system-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-socket-dir-parent\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-multus\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-conf-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-daemon-config\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-multus-certs\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-kubelet\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-systemd-units\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.279801 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-var-lib-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-etc-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-env-overrides\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-hostroot\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-config\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-konnectivity-ca\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7dm\" (UniqueName: \"kubernetes.io/projected/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-kube-api-access-dw7dm\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-netd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovn-node-metrics-cert\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.279976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-script-lib\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dxrz\" (UniqueName: \"kubernetes.io/projected/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-kube-api-access-5dxrz\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cnibin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cni-binary-copy\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-host-slash\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.280399 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-systemd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-bin\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280173    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280217    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s6zgd\""
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280446    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 03:20:12.280839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.280496    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 03:20:12.281086 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.281069    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.283750 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.283734    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.284184 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.284164    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zvfz\""
May 21 03:20:12.284258 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.284230    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 03:20:12.284308 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.284264    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 03:20:12.285937 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.285921    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 03:20:12.286029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.285929    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfzg8\""
May 21 03:20:12.286029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.285952    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 03:20:12.286393 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.286377    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.287079 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.287061    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 03:20:12.289433 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.289417    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.289490 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.289469    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:12.290574 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.290560    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 03:20:12.290676 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.290662    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-whh2n\""
May 21 03:20:12.291092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.291078    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 03:20:12.312224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.312206    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s2k6b"
May 21 03:20:12.316914 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.316900    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s2k6b"
May 21 03:20:12.374508 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.374490    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 03:20:12.380394 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.380464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380408    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-etc-kubernetes\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380426    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkkh\" (UniqueName: \"kubernetes.io/projected/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-kube-api-access-8xkkh\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkhz\" (UniqueName: \"kubernetes.io/projected/611e0764-fecb-45e3-a837-4854accebfec-kube-api-access-9lkhz\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.380464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-sys-fs\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-systemd\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380490    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-agent-certs\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380507    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwcs\" (UniqueName: \"kubernetes.io/projected/11e2a2eb-33a6-469e-86a2-51af9e78a823-kube-api-access-xcwcs\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380490    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-etc-kubernetes\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380542    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-system-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380574    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-multus\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380590    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-daemon-config\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.380608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380595    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-system-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380615    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-etc-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380645    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-multus\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380653    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380698    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgl7g\" (UniqueName: \"kubernetes.io/projected/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-kube-api-access-xgl7g\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380666    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-etc-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380732    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-hostroot\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380762    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-konnectivity-ca\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380780    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7dm\" (UniqueName: \"kubernetes.io/projected/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-kube-api-access-dw7dm\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380795    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovn-node-metrics-cert\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380879    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-script-lib\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380889    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-hostroot\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380908    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dxrz\" (UniqueName: \"kubernetes.io/projected/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-kube-api-access-5dxrz\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysconfig\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380992    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cnibin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381014 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.380970    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381019    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cni-binary-copy\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381046    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-systemd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4stm\" (UniqueName: \"kubernetes.io/projected/03aeb780-f839-4667-a99e-9d4e48f99dbf-kube-api-access-g4stm\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cnibin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-var-lib-kubelet\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-tuned\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381129    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-systemd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381177    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11e2a2eb-33a6-469e-86a2-51af9e78a823-host\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381202    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-bin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381226    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-daemon-config\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381244    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-kubelet\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381286    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-cni-bin\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381290    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-kubelet\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381289    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11e2a2eb-33a6-469e-86a2-51af9e78a823-host\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.381770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381312    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-konnectivity-ca\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-host\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9lp\" (UniqueName: \"kubernetes.io/projected/e299d2ff-3ad7-4715-9f89-355947812e8a-kube-api-access-hs9lp\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381400    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381426    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-ovn\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381453    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-log-socket\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381455    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-script-lib\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381492    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-cni-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381500    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-log-socket\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-ovn\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381524    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381550    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-cnibin\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381601    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11e2a2eb-33a6-469e-86a2-51af9e78a823-serviceca\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381624    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-os-release\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381650    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-iptables-alerter-script\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381674    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-slash\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.382530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e0764-fecb-45e3-a837-4854accebfec-tmp-dir\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-registration-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381748    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-tmp\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381775    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-socket-dir-parent\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381787    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-os-release\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381801    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-conf-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381833    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-multus-certs\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381878    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-var-lib-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381902    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381931    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-env-overrides\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/611e0764-fecb-45e3-a837-4854accebfec-hosts-file\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.381998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-modprobe-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382019    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-kubelet\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382059    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-cni-binary-copy\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382059    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-systemd-units\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-run\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.383224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382131    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-slash\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382144    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-config\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-conf\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-sys\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-lib-modules\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382286    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-netd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-socket-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8v9f\" (UniqueName: \"kubernetes.io/projected/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kube-api-access-w8v9f\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382393    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-host-slash\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11e2a2eb-33a6-469e-86a2-51af9e78a823-serviceca\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382438    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382467    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-bin\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382525    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-k8s-cni-cncf-io\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-var-lib-kubelet\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382564    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-systemd-units\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.383707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382582    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-env-overrides\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382596    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-node-log\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382632    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-host-slash\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382667    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-bin\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-k8s-cni-cncf-io\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382692    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-cni-netd\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382705    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-run-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382736    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-multus-certs\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382753    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-var-lib-openvswitch\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382786    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-socket-dir-parent\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-kubernetes\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382832    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-multus-conf-dir\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382834    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-os-release\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382908    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-node-log\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382936    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-netns\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.382967    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-netns\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383008    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-host-run-netns\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.384359 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-device-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383048    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-host-run-netns\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383114    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovnkube-config\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.383243    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-iptables-alerter-script\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.384305    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-ovn-node-metrics-cert\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.384939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.384460    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc-agent-certs\") pod \"konnectivity-agent-bt7dg\" (UID: \"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc\") " pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.390239 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.390220    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:12.390348 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.390245    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:12.390348 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.390258    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:12.390453 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.390397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:12.890300019 +0000 UTC m=+2.111783038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:12.392528 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.392498    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dxrz\" (UniqueName: \"kubernetes.io/projected/afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46-kube-api-access-5dxrz\") pod \"ovnkube-node-h8c7x\" (UID: \"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.392660 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.392643    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkkh\" (UniqueName: \"kubernetes.io/projected/b5375448-e2f5-48e4-9e5a-bb75d3961bcc-kube-api-access-8xkkh\") pod \"multus-5zwbq\" (UID: \"b5375448-e2f5-48e4-9e5a-bb75d3961bcc\") " pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.392972 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.392958    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7dm\" (UniqueName: \"kubernetes.io/projected/a6e19f00-c7c8-4a59-a54c-a8e9570f09a0-kube-api-access-dw7dm\") pod \"iptables-alerter-nqkc9\" (UID: \"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0\") " pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.393108 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.393089    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwcs\" (UniqueName: \"kubernetes.io/projected/11e2a2eb-33a6-469e-86a2-51af9e78a823-kube-api-access-xcwcs\") pod \"node-ca-nbbcs\" (UID: \"11e2a2eb-33a6-469e-86a2-51af9e78a823\") " pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.431195 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.431166    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19944451ad6e4844bce6c2c9d20bf29a.slice/crio-e61a3106d4efbc73c57da07048ce4d8054d55068802744d224b7fac2032d6127 WatchSource:0}: Error finding container e61a3106d4efbc73c57da07048ce4d8054d55068802744d224b7fac2032d6127: Status 404 returned error can't find the container with id e61a3106d4efbc73c57da07048ce4d8054d55068802744d224b7fac2032d6127
May 21 03:20:12.431434 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.431417    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc056fce815e360251683a0041141bafe.slice/crio-ad39fcb09465d9939fa2698a1949f26fc5f9f3b6e2555ed58e93ed7ec64c7002 WatchSource:0}: Error finding container ad39fcb09465d9939fa2698a1949f26fc5f9f3b6e2555ed58e93ed7ec64c7002: Status 404 returned error can't find the container with id ad39fcb09465d9939fa2698a1949f26fc5f9f3b6e2555ed58e93ed7ec64c7002
May 21 03:20:12.435008 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.434994    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 03:20:12.483753 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483734    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.483830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483761    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-kubernetes\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.483830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483777    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-os-release\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.483830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483795    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-device-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.483830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483811    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483834    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483860    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-kubernetes\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483876    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkhz\" (UniqueName: \"kubernetes.io/projected/611e0764-fecb-45e3-a837-4854accebfec-kube-api-access-9lkhz\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483896    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-os-release\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-device-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483923    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483922    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483946    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-sys-fs\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483978    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-sys-fs\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.483985    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-systemd\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484021    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgl7g\" (UniqueName: \"kubernetes.io/projected/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-kube-api-access-xgl7g\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-systemd\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484052    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484076    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysconfig\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484106    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4stm\" (UniqueName: \"kubernetes.io/projected/03aeb780-f839-4667-a99e-9d4e48f99dbf-kube-api-access-g4stm\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.484117    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484129    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-var-lib-kubelet\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.484167    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:12.98414684 +0000 UTC m=+2.205629862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484152    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-tuned\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484188    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysconfig\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484202    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484229    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484234    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-var-lib-kubelet\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484252    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-host\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484259    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484278    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9lp\" (UniqueName: \"kubernetes.io/projected/e299d2ff-3ad7-4715-9f89-355947812e8a-kube-api-access-hs9lp\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484317    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484322    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-host\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484337    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.484637 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484342    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-cnibin\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484342    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484382    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e0764-fecb-45e3-a837-4854accebfec-tmp-dir\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484383    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e299d2ff-3ad7-4715-9f89-355947812e8a-cnibin\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484440    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-registration-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484463    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-tmp\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484498    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/611e0764-fecb-45e3-a837-4854accebfec-hosts-file\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484513    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-registration-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484521    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-modprobe-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484547    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-run\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484575    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484582    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-modprobe-d\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484598    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/611e0764-fecb-45e3-a837-4854accebfec-hosts-file\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484605    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-conf\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484628    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-sys\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484635    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-run\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484648    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e0764-fecb-45e3-a837-4854accebfec-tmp-dir\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.485395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484675    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-sys\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484695    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-lib-modules\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484720    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-socket-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484753    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8v9f\" (UniqueName: \"kubernetes.io/projected/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kube-api-access-w8v9f\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484754    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-sysctl-conf\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484800    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-lib-modules\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484875    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.484874    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e22e9ce-8890-4393-9ac0-e543390ca9b6-socket-dir\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.485252    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.485902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.485319    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e299d2ff-3ad7-4715-9f89-355947812e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.486420 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.486398    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-etc-tuned\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.486490 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.486455    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-tmp\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.498079 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.498061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9lp\" (UniqueName: \"kubernetes.io/projected/e299d2ff-3ad7-4715-9f89-355947812e8a-kube-api-access-hs9lp\") pod \"multus-additional-cni-plugins-m78d8\" (UID: \"e299d2ff-3ad7-4715-9f89-355947812e8a\") " pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.498268 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.498249    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgl7g\" (UniqueName: \"kubernetes.io/projected/d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d-kube-api-access-xgl7g\") pod \"tuned-l57b4\" (UID: \"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d\") " pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.498352 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.498339    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkhz\" (UniqueName: \"kubernetes.io/projected/611e0764-fecb-45e3-a837-4854accebfec-kube-api-access-9lkhz\") pod \"node-resolver-vd8vg\" (UID: \"611e0764-fecb-45e3-a837-4854accebfec\") " pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.498485 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.498469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4stm\" (UniqueName: \"kubernetes.io/projected/03aeb780-f839-4667-a99e-9d4e48f99dbf-kube-api-access-g4stm\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.499134 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.499121    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8v9f\" (UniqueName: \"kubernetes.io/projected/3e22e9ce-8890-4393-9ac0-e543390ca9b6-kube-api-access-w8v9f\") pod \"aws-ebs-csi-driver-node-vq6gv\" (UID: \"3e22e9ce-8890-4393-9ac0-e543390ca9b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.605371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.605341    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:12.612049 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.612024    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3a52c0_9c67_48ad_b3c7_dacbf46ac0bc.slice/crio-8fda3247014d0ccd1e278429bc6c7bd1f71c16953f29c54def2026af04760ab6 WatchSource:0}: Error finding container 8fda3247014d0ccd1e278429bc6c7bd1f71c16953f29c54def2026af04760ab6: Status 404 returned error can't find the container with id 8fda3247014d0ccd1e278429bc6c7bd1f71c16953f29c54def2026af04760ab6
May 21 03:20:12.625919 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.625900    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbbcs"
May 21 03:20:12.631867 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.631826    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e2a2eb_33a6_469e_86a2_51af9e78a823.slice/crio-ed5246c0f1fced0c436ddab1dabcb78e08e2fba25d84ff1965e1bbf5348fb3fa WatchSource:0}: Error finding container ed5246c0f1fced0c436ddab1dabcb78e08e2fba25d84ff1965e1bbf5348fb3fa: Status 404 returned error can't find the container with id ed5246c0f1fced0c436ddab1dabcb78e08e2fba25d84ff1965e1bbf5348fb3fa
May 21 03:20:12.643222 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.643201    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5zwbq"
May 21 03:20:12.648535 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.648514    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5375448_e2f5_48e4_9e5a_bb75d3961bcc.slice/crio-789bdb07d9f6586a80e112efdb2ca57b6f19459a65eb647befdbeb135ae07150 WatchSource:0}: Error finding container 789bdb07d9f6586a80e112efdb2ca57b6f19459a65eb647befdbeb135ae07150: Status 404 returned error can't find the container with id 789bdb07d9f6586a80e112efdb2ca57b6f19459a65eb647befdbeb135ae07150
May 21 03:20:12.656413 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.656390    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nqkc9"
May 21 03:20:12.661408 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.661382    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e19f00_c7c8_4a59_a54c_a8e9570f09a0.slice/crio-8265eed587e9a38ad80b471b63f0cd13eb46edb4dbb779d27bb3b2abef6396a4 WatchSource:0}: Error finding container 8265eed587e9a38ad80b471b63f0cd13eb46edb4dbb779d27bb3b2abef6396a4: Status 404 returned error can't find the container with id 8265eed587e9a38ad80b471b63f0cd13eb46edb4dbb779d27bb3b2abef6396a4
May 21 03:20:12.669361 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.669344    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:12.674312 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.674291    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe6c3c0_5c85_4a3c_a27a_67d3e16c6b46.slice/crio-99787740f655b33dfc2f06dafce3e1070b53f07af6f63db3c26d90930c54e1aa WatchSource:0}: Error finding container 99787740f655b33dfc2f06dafce3e1070b53f07af6f63db3c26d90930c54e1aa: Status 404 returned error can't find the container with id 99787740f655b33dfc2f06dafce3e1070b53f07af6f63db3c26d90930c54e1aa
May 21 03:20:12.690071 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.690054    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv"
May 21 03:20:12.695282 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.695261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e22e9ce_8890_4393_9ac0_e543390ca9b6.slice/crio-46f9b11ccff71b51f147c4e8d87c5b5ce6e86715aa6f365983acc35ca109581a WatchSource:0}: Error finding container 46f9b11ccff71b51f147c4e8d87c5b5ce6e86715aa6f365983acc35ca109581a: Status 404 returned error can't find the container with id 46f9b11ccff71b51f147c4e8d87c5b5ce6e86715aa6f365983acc35ca109581a
May 21 03:20:12.700121 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.700107    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l57b4"
May 21 03:20:12.705678 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.705653    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36fd140_a740_4ae1_9e6f_24aa4a8d4c4d.slice/crio-9109a4668ca10ff4916e579ddf455acadd6dffa525eaf32e6931799f6aeb9eb1 WatchSource:0}: Error finding container 9109a4668ca10ff4916e579ddf455acadd6dffa525eaf32e6931799f6aeb9eb1: Status 404 returned error can't find the container with id 9109a4668ca10ff4916e579ddf455acadd6dffa525eaf32e6931799f6aeb9eb1
May 21 03:20:12.714354 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.714341    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd8vg"
May 21 03:20:12.718838 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.718819    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m78d8"
May 21 03:20:12.720131 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.720112    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611e0764_fecb_45e3_a837_4854accebfec.slice/crio-961b8bd9c773e631310bdf848b15fda9fa4ff9a45a62ee95e5dcd3468c2e0adb WatchSource:0}: Error finding container 961b8bd9c773e631310bdf848b15fda9fa4ff9a45a62ee95e5dcd3468c2e0adb: Status 404 returned error can't find the container with id 961b8bd9c773e631310bdf848b15fda9fa4ff9a45a62ee95e5dcd3468c2e0adb
May 21 03:20:12.724455 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:12.724436    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode299d2ff_3ad7_4715_9f89_355947812e8a.slice/crio-5c67b3d1f405f4a696cc3906644107f4c30acbdb1d52aadd024a8fa05a1791bc WatchSource:0}: Error finding container 5c67b3d1f405f4a696cc3906644107f4c30acbdb1d52aadd024a8fa05a1791bc: Status 404 returned error can't find the container with id 5c67b3d1f405f4a696cc3906644107f4c30acbdb1d52aadd024a8fa05a1791bc
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.988008    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:12.988063    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988134    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988187    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988207    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988207    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:13.988187757 +0000 UTC m=+3.209670796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988221    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:12.988553 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:12.988268    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:13.988252458 +0000 UTC m=+3.209735490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:13.115428 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.115398    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:13.317876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.317781    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:15:12 +0000 UTC" deadline="2027-12-23 18:09:33.041501306 +0000 UTC"
May 21 03:20:13.317876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.317815    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13958h49m19.723689767s"
May 21 03:20:13.425296 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.425239    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal" event={"ID":"c056fce815e360251683a0041141bafe","Type":"ContainerStarted","Data":"ad39fcb09465d9939fa2698a1949f26fc5f9f3b6e2555ed58e93ed7ec64c7002"}
May 21 03:20:13.428863 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.428824    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal" event={"ID":"19944451ad6e4844bce6c2c9d20bf29a","Type":"ContainerStarted","Data":"e61a3106d4efbc73c57da07048ce4d8054d55068802744d224b7fac2032d6127"}
May 21 03:20:13.432608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.432570    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerStarted","Data":"5c67b3d1f405f4a696cc3906644107f4c30acbdb1d52aadd024a8fa05a1791bc"}
May 21 03:20:13.440442 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.440420    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:13.452763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.452654    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd8vg" event={"ID":"611e0764-fecb-45e3-a837-4854accebfec","Type":"ContainerStarted","Data":"961b8bd9c773e631310bdf848b15fda9fa4ff9a45a62ee95e5dcd3468c2e0adb"}
May 21 03:20:13.467689 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.467617    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l57b4" event={"ID":"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d","Type":"ContainerStarted","Data":"9109a4668ca10ff4916e579ddf455acadd6dffa525eaf32e6931799f6aeb9eb1"}
May 21 03:20:13.472213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.472171    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5zwbq" event={"ID":"b5375448-e2f5-48e4-9e5a-bb75d3961bcc","Type":"ContainerStarted","Data":"789bdb07d9f6586a80e112efdb2ca57b6f19459a65eb647befdbeb135ae07150"}
May 21 03:20:13.489880 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.489824    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbbcs" event={"ID":"11e2a2eb-33a6-469e-86a2-51af9e78a823","Type":"ContainerStarted","Data":"ed5246c0f1fced0c436ddab1dabcb78e08e2fba25d84ff1965e1bbf5348fb3fa"}
May 21 03:20:13.493403 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.493344    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv" event={"ID":"3e22e9ce-8890-4393-9ac0-e543390ca9b6","Type":"ContainerStarted","Data":"46f9b11ccff71b51f147c4e8d87c5b5ce6e86715aa6f365983acc35ca109581a"}
May 21 03:20:13.503211 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.503148    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"99787740f655b33dfc2f06dafce3e1070b53f07af6f63db3c26d90930c54e1aa"}
May 21 03:20:13.522330 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.522290    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqkc9" event={"ID":"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0","Type":"ContainerStarted","Data":"8265eed587e9a38ad80b471b63f0cd13eb46edb4dbb779d27bb3b2abef6396a4"}
May 21 03:20:13.534787 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.534753    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bt7dg" event={"ID":"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc","Type":"ContainerStarted","Data":"8fda3247014d0ccd1e278429bc6c7bd1f71c16953f29c54def2026af04760ab6"}
May 21 03:20:13.629252 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.629173    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 03:20:13.995897 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.995803    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:13.995897 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:13.995871    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:13.996105 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996035    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:13.996105 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996053    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:13.996105 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996065    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:13.996238 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996120    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:15.996102356 +0000 UTC m=+5.217585389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:13.996564 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996541    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:13.996659 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:13.996601    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:15.996585189 +0000 UTC m=+5.218068211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:14.318076 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:14.317988    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:15:12 +0000 UTC" deadline="2027-12-25 03:13:29.056614021 +0000 UTC"
May 21 03:20:14.318076 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:14.318025    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13991h53m14.738592419s"
May 21 03:20:14.408393 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:14.408365    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:14.408573 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:14.408493    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:14.409065 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:14.409042    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:14.409176 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:14.409159    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:16.014001 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:16.013965    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:16.014435 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:16.014019    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:16.014435 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014173    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:16.014435 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014194    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:16.014435 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014207    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:16.014435 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014270    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:20.014248537 +0000 UTC m=+9.235731557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:16.014723 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014709    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:16.014777 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.014761    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:20.014743614 +0000 UTC m=+9.236226649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:16.408518 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:16.408445    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:16.408654 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.408542    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:16.408860 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:16.408834    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:16.408932 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:16.408921    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:18.409054 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:18.408335    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:18.409054 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:18.408453    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:18.409054 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:18.408907    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:18.409054 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:18.409007    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:20.045601 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:20.045542    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:20.045601 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:20.045596    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.045726    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.045744    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.045756    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.045805    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:28.045788392 +0000 UTC m=+17.267271428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.045979    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:20.046123 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.046039    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:28.046021081 +0000 UTC m=+17.267504115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:20.408004 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:20.407930    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:20.408155 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.408053    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:20.408396 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:20.408375    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:20.408504 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:20.408479    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:22.408879 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:22.408251    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:22.408879 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:22.408269    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:22.408879 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:22.408380    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:22.408879 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:22.408822    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:24.408315 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:24.408281    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:24.408731 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:24.408289    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:24.408731 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:24.408409    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:24.408731 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:24.408461    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:26.408008 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:26.407972    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:26.408511 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:26.408109    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:26.408511 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:26.408178    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:26.408511 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:26.408308    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:28.105417 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:28.105380    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:28.105431    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105552    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105624    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.10560644 +0000 UTC m=+33.327089459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105557    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105674    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105688    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:28.105956 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.105755    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.105738716 +0000 UTC m=+33.327221773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:28.408006 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:28.407924    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:28.408006 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:28.407995    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:28.408203 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.408139    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:28.408252 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:28.408218    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:30.408317 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:30.408092    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:30.408317 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:30.408104    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:30.408317 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:30.408200    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:30.408317 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:30.408256    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:32.408115 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:32.408089    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:32.408427 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:32.408093    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:32.408427 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:32.408176    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:32.408427 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:32.408276    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:33.581734 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.581550    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbbcs" event={"ID":"11e2a2eb-33a6-469e-86a2-51af9e78a823","Type":"ContainerStarted","Data":"94d06b31c0b9d6ad23d3b1a348f16e5a76687e4efa17a14f866a34ad40e813cc"}
May 21 03:20:33.583057 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.583030    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv" event={"ID":"3e22e9ce-8890-4393-9ac0-e543390ca9b6","Type":"ContainerStarted","Data":"32ecce401a154b16e388b87b450c4133b4be64d7f2808119c84c757184d3551c"}
May 21 03:20:33.587524 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587500    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"3a4f83071433aac3e76d1b8686e050ac0bf2f0450c241987f1247e7a0d1082c3"}
May 21 03:20:33.587630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587532    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"de08e0070ed762dde5d694993c8bcdc5b64e14cb5ea94ec9733db5a7f97c5b5a"}
May 21 03:20:33.587630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587552    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"2e95be524f1881de3b0bda21550e63af2d2260022bd569853560d4ade4debfbc"}
May 21 03:20:33.587630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587565    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"ce36dc0bc8c8be2a769da529deee3fb1708d5d0e09bcd995edd16cec98d963b4"}
May 21 03:20:33.587630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587578    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"c782636e53eb2c92756250fafe1492d333e4fdea5281d15aeb1d52a793c21566"}
May 21 03:20:33.587630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.587590    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"a86d728047a618f919295179114341733f96bd4aaad3126738fb47b0906efe11"}
May 21 03:20:33.589172 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.589147    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bt7dg" event={"ID":"9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc","Type":"ContainerStarted","Data":"68242ae6d23c6f9ed05624fbf9832f04c1c5e4f504c0be59d5e1114a1705d2bc"}
May 21 03:20:33.590743 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.590719    2558 generic.go:358] "Generic (PLEG): container finished" podID="c056fce815e360251683a0041141bafe" containerID="e2e9fd9c66af812dabb8b861cf24cfb8d42f047659d8ff7a046efd720f2037c7" exitCode=0
May 21 03:20:33.590835 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.590794    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal" event={"ID":"c056fce815e360251683a0041141bafe","Type":"ContainerDied","Data":"e2e9fd9c66af812dabb8b861cf24cfb8d42f047659d8ff7a046efd720f2037c7"}
May 21 03:20:33.592056 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.592034    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal" event={"ID":"19944451ad6e4844bce6c2c9d20bf29a","Type":"ContainerStarted","Data":"5b725e0b1c45e322a657b8c7bb99eb33fab7d84731eebb261f51d9a528305ccf"}
May 21 03:20:33.593402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.593380    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="8d719eebcc01359ef727ad1f733195735ff39f6fb0a9cd68e330409cce3af61a" exitCode=0
May 21 03:20:33.593495 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.593451    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"8d719eebcc01359ef727ad1f733195735ff39f6fb0a9cd68e330409cce3af61a"}
May 21 03:20:33.594945 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.594924    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd8vg" event={"ID":"611e0764-fecb-45e3-a837-4854accebfec","Type":"ContainerStarted","Data":"477ac607ebe333f9ad291a124d63ced4f632684c970702ca39405cf9cede4d40"}
May 21 03:20:33.596454 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.596374    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l57b4" event={"ID":"d36fd140-a740-4ae1-9e6f-24aa4a8d4c4d","Type":"ContainerStarted","Data":"0aafc8663bab2e4f313cbf8c422d9ffd98db3ab08811b5ef8a35d70b3f70e259"}
May 21 03:20:33.596521 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.596439    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nbbcs" podStartSLOduration=2.838132936 podStartE2EDuration="22.596424555s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.633487988 +0000 UTC m=+1.854971006" lastFinishedPulling="2026-05-21 03:20:32.3917796 +0000 UTC m=+21.613262625" observedRunningTime="2026-05-21 03:20:33.595773173 +0000 UTC m=+22.817256229" watchObservedRunningTime="2026-05-21 03:20:33.596424555 +0000 UTC m=+22.817907596"
May 21 03:20:33.597593 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.597563    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5zwbq" event={"ID":"b5375448-e2f5-48e4-9e5a-bb75d3961bcc","Type":"ContainerStarted","Data":"1ebf2f0df1e7e113d4feec6b805b2d91e4d64d283bf3ba1f3496d6a05f826b23"}
May 21 03:20:33.610134 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.610089    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-vd8vg" podStartSLOduration=2.941517445 podStartE2EDuration="22.610076732s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.721474634 +0000 UTC m=+1.942957653" lastFinishedPulling="2026-05-21 03:20:32.390033919 +0000 UTC m=+21.611516940" observedRunningTime="2026-05-21 03:20:33.60995151 +0000 UTC m=+22.831434550" watchObservedRunningTime="2026-05-21 03:20:33.610076732 +0000 UTC m=+22.831559771"
May 21 03:20:33.640113 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.640034    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bt7dg" podStartSLOduration=3.0331042520000002 podStartE2EDuration="22.640016722s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.613624337 +0000 UTC m=+1.835107355" lastFinishedPulling="2026-05-21 03:20:32.220536797 +0000 UTC m=+21.442019825" observedRunningTime="2026-05-21 03:20:33.63944198 +0000 UTC m=+22.860925020" watchObservedRunningTime="2026-05-21 03:20:33.640016722 +0000 UTC m=+22.861499765"
May 21 03:20:33.694221 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.694183    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-76.ec2.internal" podStartSLOduration=22.694171718 podStartE2EDuration="22.694171718s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:20:33.675416007 +0000 UTC m=+22.896899052" watchObservedRunningTime="2026-05-21 03:20:33.694171718 +0000 UTC m=+22.915654758"
May 21 03:20:33.694323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.694299    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l57b4" podStartSLOduration=3.087948647 podStartE2EDuration="22.694293974s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.707196356 +0000 UTC m=+1.928679374" lastFinishedPulling="2026-05-21 03:20:32.313541665 +0000 UTC m=+21.535024701" observedRunningTime="2026-05-21 03:20:33.693253454 +0000 UTC m=+22.914736488" watchObservedRunningTime="2026-05-21 03:20:33.694293974 +0000 UTC m=+22.915777014"
May 21 03:20:33.711462 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:33.711427    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5zwbq" podStartSLOduration=2.968640164 podStartE2EDuration="22.711417194s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.650018727 +0000 UTC m=+1.871501749" lastFinishedPulling="2026-05-21 03:20:32.392795746 +0000 UTC m=+21.614278779" observedRunningTime="2026-05-21 03:20:33.710701198 +0000 UTC m=+22.932184237" watchObservedRunningTime="2026-05-21 03:20:33.711417194 +0000 UTC m=+22.932900233"
May 21 03:20:34.361630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.361605    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 03:20:34.407857 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.407819    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:34.407998 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.407821    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:34.408064 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:34.407943    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:34.408157 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:34.408070    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:34.600767 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.600711    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal" event={"ID":"c056fce815e360251683a0041141bafe","Type":"ContainerStarted","Data":"596a38cb20ed2b71384c30d4992e3959d59ed32980fc324305092b566765400b"}
May 21 03:20:34.602517 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.602493    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv" event={"ID":"3e22e9ce-8890-4393-9ac0-e543390ca9b6","Type":"ContainerStarted","Data":"badbef4f81c6f7861cfdfb17249d376583ad871bc10e0eae3f1a5325e90334f8"}
May 21 03:20:34.604017 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.603994    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nqkc9" event={"ID":"a6e19f00-c7c8-4a59-a54c-a8e9570f09a0","Type":"ContainerStarted","Data":"d7107d653ff7bc74847a2dd904531f05ca9702898b956c7cb217a3ae75b0f30a"}
May 21 03:20:34.615121 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.615066    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-76.ec2.internal" podStartSLOduration=23.615051021 podStartE2EDuration="23.615051021s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:20:34.614804493 +0000 UTC m=+23.836287533" watchObservedRunningTime="2026-05-21 03:20:34.615051021 +0000 UTC m=+23.836534063"
May 21 03:20:34.627720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:34.627686    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nqkc9" podStartSLOduration=3.893277226 podStartE2EDuration="23.627674755s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.662835504 +0000 UTC m=+1.884318522" lastFinishedPulling="2026-05-21 03:20:32.397233031 +0000 UTC m=+21.618716051" observedRunningTime="2026-05-21 03:20:34.62736813 +0000 UTC m=+23.848851184" watchObservedRunningTime="2026-05-21 03:20:34.627674755 +0000 UTC m=+23.849157794"
May 21 03:20:35.342861 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:35.342740    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T03:20:34.361627652Z","UUID":"f1ae8b39-4d3d-4fc8-9cf6-fc22aa42705d","Handler":null,"Name":"","Endpoint":""}
May 21 03:20:35.344383 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:35.344359    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 03:20:35.344513 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:35.344390    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 03:20:35.609999 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:35.609915    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"78573e6995b4d8b4a54228668e3c2561f038811c2a173d961442fdf9a51a4720"}
May 21 03:20:36.407495 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:36.407469    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:36.407670 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:36.407475    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:36.407670 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:36.407566    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:36.407670 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:36.407663    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:36.613406 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:36.613365    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv" event={"ID":"3e22e9ce-8890-4393-9ac0-e543390ca9b6","Type":"ContainerStarted","Data":"55410f393107a8ac6a395fb470b6d7dccab7d7d3a6ce3b9d9b03d3867e6f3d89"}
May 21 03:20:36.629812 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:36.629757    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vq6gv" podStartSLOduration=2.622244174 podStartE2EDuration="25.629740289s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.696691121 +0000 UTC m=+1.918174142" lastFinishedPulling="2026-05-21 03:20:35.704187229 +0000 UTC m=+24.925670257" observedRunningTime="2026-05-21 03:20:36.629395425 +0000 UTC m=+25.850878458" watchObservedRunningTime="2026-05-21 03:20:36.629740289 +0000 UTC m=+25.851223328"
May 21 03:20:37.556840 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:37.556808    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:37.557450 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:37.557427    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:38.408668 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.408531    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:38.409209 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.408531    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:38.409209 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:38.408792    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:38.409209 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:38.408813    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:38.620267 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.620193    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" event={"ID":"afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46","Type":"ContainerStarted","Data":"092c02eab9449d5e6f7aa04b9eb220362e765be6339d1b914219467a1aae7833"}
May 21 03:20:38.620466 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.620439    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:38.620466 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.620469    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:38.620623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.620482    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:38.622281 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.622258    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="b71677675d6d5126bd1f4761f964f3390b83d2880551f3b8faf8d522cd521a21" exitCode=0
May 21 03:20:38.622397 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.622299    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"b71677675d6d5126bd1f4761f964f3390b83d2880551f3b8faf8d522cd521a21"}
May 21 03:20:38.636024 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.635992    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:38.636120 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.636106    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:20:38.648600 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:38.648566    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x" podStartSLOduration=7.650334182 podStartE2EDuration="27.648556375s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.675823455 +0000 UTC m=+1.897306473" lastFinishedPulling="2026-05-21 03:20:32.674045643 +0000 UTC m=+21.895528666" observedRunningTime="2026-05-21 03:20:38.648080198 +0000 UTC m=+27.869563238" watchObservedRunningTime="2026-05-21 03:20:38.648556375 +0000 UTC m=+27.870039414"
May 21 03:20:40.055382 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.055229    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fv9tm"]
May 21 03:20:40.055873 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.055507    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:40.055873 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:40.055638    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:40.057203 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.057181    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxwjc"]
May 21 03:20:40.057338 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.057266    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:40.057373 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:40.057332    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:40.627451 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.627420    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="4532a6152dc4da55b1e42de69a0bf6abe31dfb3bf3a862ab78f4285ce19bd28c" exitCode=0
May 21 03:20:40.627617 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:40.627507    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"4532a6152dc4da55b1e42de69a0bf6abe31dfb3bf3a862ab78f4285ce19bd28c"}
May 21 03:20:41.408350 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:41.408321    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:41.408690 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:41.408421    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:41.408690 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:41.408496    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:41.408690 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:41.408582    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:42.106710 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:42.106686    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:42.107201 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:42.107181    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 03:20:42.107597 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:42.107576    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bt7dg"
May 21 03:20:42.633247 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:42.633208    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="17b2bfc2714a8abbb61e8de2c43f0c024e5b5daae1e5aa963b972b0ee89a0ae2" exitCode=0
May 21 03:20:42.633759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:42.633299    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"17b2bfc2714a8abbb61e8de2c43f0c024e5b5daae1e5aa963b972b0ee89a0ae2"}
May 21 03:20:43.407830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:43.407794    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:43.408025 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:43.407838    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:43.408025 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:43.407955    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:43.408176 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:43.408095    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:44.119027 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:44.118995    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:44.119080    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119162    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119183    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119193    2558 projected.go:194] Error preparing data for projected volume kube-api-access-mqr22 for pod openshift-network-diagnostics/network-check-target-wxwjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119225    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119248    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22 podName:ea94780c-111e-4535-8d0e-7f2776bb3518 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:16.119233399 +0000 UTC m=+65.340716422 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqr22" (UniqueName: "kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22") pod "network-check-target-wxwjc" (UID: "ea94780c-111e-4535-8d0e-7f2776bb3518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 03:20:44.119454 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:44.119280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs podName:03aeb780-f839-4667-a99e-9d4e48f99dbf nodeName:}" failed. No retries permitted until 2026-05-21 03:21:16.119261607 +0000 UTC m=+65.340744625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs") pod "network-metrics-daemon-fv9tm" (UID: "03aeb780-f839-4667-a99e-9d4e48f99dbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 03:20:45.408742 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:45.408551    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:45.409283 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:45.408632    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:45.409283 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:45.408832    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fv9tm" podUID="03aeb780-f839-4667-a99e-9d4e48f99dbf"
May 21 03:20:45.409283 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:45.408931    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxwjc" podUID="ea94780c-111e-4535-8d0e-7f2776bb3518"
May 21 03:20:46.604230 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.604202    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-76.ec2.internal" event="NodeReady"
May 21 03:20:46.604663 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.604321    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 03:20:46.649200 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.649166    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gbs"]
May 21 03:20:46.654125 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.654103    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.655192 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.655170    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dh2q"]
May 21 03:20:46.656943 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.656924    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 03:20:46.657032 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.656939    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pm6r8\""
May 21 03:20:46.657032 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.656924    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 03:20:46.657302 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.657285    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 03:20:46.658627 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.658608    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.659004 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.658974    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gbs"]
May 21 03:20:46.661124 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.661100    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 03:20:46.661124 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.661120    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 03:20:46.661298 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.661278    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-znmrr\""
May 21 03:20:46.666010 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.665976    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dh2q"]
May 21 03:20:46.738692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.738876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-config-volume\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.738876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9plh\" (UniqueName: \"kubernetes.io/projected/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-kube-api-access-r9plh\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.738876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738807    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5j5p\" (UniqueName: \"kubernetes.io/projected/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-kube-api-access-d5j5p\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.738876 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.739063 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.738931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-tmp-dir\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.761970 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.761942    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"]
May 21 03:20:46.765331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.765315    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"
May 21 03:20:46.768206 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.768184    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hfzwn\""
May 21 03:20:46.768303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.768281    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 03:20:46.768422 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.768402    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 03:20:46.774775 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.774741    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"]
May 21 03:20:46.839217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839192    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.839334 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839243    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-config-volume\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.839334 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839267    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9plh\" (UniqueName: \"kubernetes.io/projected/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-kube-api-access-r9plh\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.839334 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88n8\" (UniqueName: \"kubernetes.io/projected/8825c2dd-8e1d-482c-b592-5495feeed41e-kube-api-access-q88n8\") pod \"network-check-source-7f44b6dd87-p455n\" (UID: \"8825c2dd-8e1d-482c-b592-5495feeed41e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"
May 21 03:20:46.839455 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839336    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5j5p\" (UniqueName: \"kubernetes.io/projected/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-kube-api-access-d5j5p\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.839455 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839375    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.839455 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:46.839385    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 03:20:46.839455 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839401    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-tmp-dir\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.839455 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:46.839446    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert podName:6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.339426027 +0000 UTC m=+36.560909054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert") pod "ingress-canary-n2gbs" (UID: "6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1") : secret "canary-serving-cert" not found
May 21 03:20:46.839673 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:46.839657    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 03:20:46.839715 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839684    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-tmp-dir\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.839715 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:46.839709    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls podName:6e5e8f12-cdd6-4a51-97cf-4394fc18eeba nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.339692404 +0000 UTC m=+36.561175426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls") pod "dns-default-4dh2q" (UID: "6e5e8f12-cdd6-4a51-97cf-4394fc18eeba") : secret "dns-default-metrics-tls" not found
May 21 03:20:46.839814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.839785    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-config-volume\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.850796 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.850774    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9plh\" (UniqueName: \"kubernetes.io/projected/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-kube-api-access-r9plh\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:46.851027 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.851007    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5j5p\" (UniqueName: \"kubernetes.io/projected/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-kube-api-access-d5j5p\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:46.940033 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.939958    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q88n8\" (UniqueName: \"kubernetes.io/projected/8825c2dd-8e1d-482c-b592-5495feeed41e-kube-api-access-q88n8\") pod \"network-check-source-7f44b6dd87-p455n\" (UID: \"8825c2dd-8e1d-482c-b592-5495feeed41e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"
May 21 03:20:46.948232 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:46.948204    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88n8\" (UniqueName: \"kubernetes.io/projected/8825c2dd-8e1d-482c-b592-5495feeed41e-kube-api-access-q88n8\") pod \"network-check-source-7f44b6dd87-p455n\" (UID: \"8825c2dd-8e1d-482c-b592-5495feeed41e\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"
May 21 03:20:47.075900 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.075865    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"
May 21 03:20:47.343217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.343185    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:47.343412 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.343288    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:47.343412 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:47.343330    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 03:20:47.343412 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:47.343407    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert podName:6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:48.343390985 +0000 UTC m=+37.564874007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert") pod "ingress-canary-n2gbs" (UID: "6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1") : secret "canary-serving-cert" not found
May 21 03:20:47.343570 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:47.343422    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 03:20:47.343570 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:47.343483    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls podName:6e5e8f12-cdd6-4a51-97cf-4394fc18eeba nodeName:}" failed. No retries permitted until 2026-05-21 03:20:48.34346778 +0000 UTC m=+37.564950814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls") pod "dns-default-4dh2q" (UID: "6e5e8f12-cdd6-4a51-97cf-4394fc18eeba") : secret "dns-default-metrics-tls" not found
May 21 03:20:47.408264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.408232    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:20:47.408264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.408262    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:20:47.412496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.412473    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 03:20:47.413020 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.412696    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\""
May 21 03:20:47.413020 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:47.412755    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\""
May 21 03:20:48.266741 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.266713    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n"]
May 21 03:20:48.350603 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:48.350577    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8825c2dd_8e1d_482c_b592_5495feeed41e.slice/crio-28b52bd44f179c06a2e66a462e28fc438bfa4e539281469a420c61684683a088 WatchSource:0}: Error finding container 28b52bd44f179c06a2e66a462e28fc438bfa4e539281469a420c61684683a088: Status 404 returned error can't find the container with id 28b52bd44f179c06a2e66a462e28fc438bfa4e539281469a420c61684683a088
May 21 03:20:48.351866 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.351634    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:48.351866 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.351693    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:48.351866 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:48.351793    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 03:20:48.351866 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:48.351793    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 03:20:48.352064 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:48.351891    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls podName:6e5e8f12-cdd6-4a51-97cf-4394fc18eeba nodeName:}" failed. No retries permitted until 2026-05-21 03:20:50.351870948 +0000 UTC m=+39.573353981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls") pod "dns-default-4dh2q" (UID: "6e5e8f12-cdd6-4a51-97cf-4394fc18eeba") : secret "dns-default-metrics-tls" not found
May 21 03:20:48.352064 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:48.351913    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert podName:6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:50.351903037 +0000 UTC m=+39.573386055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert") pod "ingress-canary-n2gbs" (UID: "6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1") : secret "canary-serving-cert" not found
May 21 03:20:48.646909 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.646667    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n" event={"ID":"8825c2dd-8e1d-482c-b592-5495feeed41e","Type":"ContainerStarted","Data":"28b52bd44f179c06a2e66a462e28fc438bfa4e539281469a420c61684683a088"}
May 21 03:20:48.648957 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.648931    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="12d1e2b26098cd36099fc082c7ef3e87414a1697f2e81306a720b76c8a63463b" exitCode=0
May 21 03:20:48.649055 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.648965    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"12d1e2b26098cd36099fc082c7ef3e87414a1697f2e81306a720b76c8a63463b"}
May 21 03:20:48.667260 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.667240    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"]
May 21 03:20:48.677333 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.677313    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"
May 21 03:20:48.680083 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.680061    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"]
May 21 03:20:48.680235 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.680204    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 03:20:48.680235 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.680227    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qb9sb\""
May 21 03:20:48.680394 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.680258    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 03:20:48.754450 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.754424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxb8r\" (UniqueName: \"kubernetes.io/projected/54a2778e-235a-4326-8900-5f588a137147-kube-api-access-gxb8r\") pod \"migrator-b985f5d89-k8qfv\" (UID: \"54a2778e-235a-4326-8900-5f588a137147\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"
May 21 03:20:48.854989 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.854954    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxb8r\" (UniqueName: \"kubernetes.io/projected/54a2778e-235a-4326-8900-5f588a137147-kube-api-access-gxb8r\") pod \"migrator-b985f5d89-k8qfv\" (UID: \"54a2778e-235a-4326-8900-5f588a137147\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"
May 21 03:20:48.864194 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.864166    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxb8r\" (UniqueName: \"kubernetes.io/projected/54a2778e-235a-4326-8900-5f588a137147-kube-api-access-gxb8r\") pod \"migrator-b985f5d89-k8qfv\" (UID: \"54a2778e-235a-4326-8900-5f588a137147\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"
May 21 03:20:48.988638 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:48.988571    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"
May 21 03:20:49.122478 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:49.122450    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv"]
May 21 03:20:49.126599 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:49.126565    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a2778e_235a_4326_8900_5f588a137147.slice/crio-8c4ba7a0e7a5a7bf199dcbb2e7de4edebf8d6cac2ba6a24b87d5eb945a8bfae5 WatchSource:0}: Error finding container 8c4ba7a0e7a5a7bf199dcbb2e7de4edebf8d6cac2ba6a24b87d5eb945a8bfae5: Status 404 returned error can't find the container with id 8c4ba7a0e7a5a7bf199dcbb2e7de4edebf8d6cac2ba6a24b87d5eb945a8bfae5
May 21 03:20:49.652435 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:49.652406    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv" event={"ID":"54a2778e-235a-4326-8900-5f588a137147","Type":"ContainerStarted","Data":"8c4ba7a0e7a5a7bf199dcbb2e7de4edebf8d6cac2ba6a24b87d5eb945a8bfae5"}
May 21 03:20:49.655762 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:49.655737    2558 generic.go:358] "Generic (PLEG): container finished" podID="e299d2ff-3ad7-4715-9f89-355947812e8a" containerID="385b3f5255cb9eb66351aa0b97d28733035220c74fb69f16491c6e438423d734" exitCode=0
May 21 03:20:49.655906 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:49.655778    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerDied","Data":"385b3f5255cb9eb66351aa0b97d28733035220c74fb69f16491c6e438423d734"}
May 21 03:20:50.365620 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:50.365587    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:50.365778 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:50.365641    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:50.365778 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:50.365740    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 03:20:50.365778 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:50.365754    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 03:20:50.365951 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:50.365796    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert podName:6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:54.365779019 +0000 UTC m=+43.587262043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert") pod "ingress-canary-n2gbs" (UID: "6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1") : secret "canary-serving-cert" not found
May 21 03:20:50.365951 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:50.365825    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls podName:6e5e8f12-cdd6-4a51-97cf-4394fc18eeba nodeName:}" failed. No retries permitted until 2026-05-21 03:20:54.365810647 +0000 UTC m=+43.587293666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls") pod "dns-default-4dh2q" (UID: "6e5e8f12-cdd6-4a51-97cf-4394fc18eeba") : secret "dns-default-metrics-tls" not found
May 21 03:20:50.661496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:50.661418    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m78d8" event={"ID":"e299d2ff-3ad7-4715-9f89-355947812e8a","Type":"ContainerStarted","Data":"480af77e440a03311c500e087fb62ad10a6979992a3020de11eb6a9fdd5bd3dc"}
May 21 03:20:50.683997 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:50.683951    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m78d8" podStartSLOduration=4.030022108 podStartE2EDuration="39.683937422s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.725878924 +0000 UTC m=+1.947361947" lastFinishedPulling="2026-05-21 03:20:48.379794233 +0000 UTC m=+37.601277261" observedRunningTime="2026-05-21 03:20:50.682188848 +0000 UTC m=+39.903671888" watchObservedRunningTime="2026-05-21 03:20:50.683937422 +0000 UTC m=+39.905420464"
May 21 03:20:51.886981 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:51.886958    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd8vg_611e0764-fecb-45e3-a837-4854accebfec/dns-node-resolver/0.log"
May 21 03:20:52.667206 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.667169    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n" event={"ID":"8825c2dd-8e1d-482c-b592-5495feeed41e","Type":"ContainerStarted","Data":"638cc6df36c1c01bc231fa87dfa782de3c63b2f12166498ad11d944bfd98a0c9"}
May 21 03:20:52.668777 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.668753    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv" event={"ID":"54a2778e-235a-4326-8900-5f588a137147","Type":"ContainerStarted","Data":"29c466853d0c9a914523e9338bedadb008ef7a7e84ae61687780fb68c5360e9d"}
May 21 03:20:52.668777 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.668780    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv" event={"ID":"54a2778e-235a-4326-8900-5f588a137147","Type":"ContainerStarted","Data":"aaada18d085e8c916e93a1f11d1d583a0a6b4b1b826b60461ce7d4b928f3423f"}
May 21 03:20:52.682235 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.682185    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p455n" podStartSLOduration=3.311256896 podStartE2EDuration="6.682140793s" podCreationTimestamp="2026-05-21 03:20:46 +0000 UTC" firstStartedPulling="2026-05-21 03:20:48.357195555 +0000 UTC m=+37.578678577" lastFinishedPulling="2026-05-21 03:20:51.728079456 +0000 UTC m=+40.949562474" observedRunningTime="2026-05-21 03:20:52.681014137 +0000 UTC m=+41.902497176" watchObservedRunningTime="2026-05-21 03:20:52.682140793 +0000 UTC m=+41.903623834"
May 21 03:20:52.700416 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.700350    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-k8qfv" podStartSLOduration=2.098313018 podStartE2EDuration="4.700334489s" podCreationTimestamp="2026-05-21 03:20:48 +0000 UTC" firstStartedPulling="2026-05-21 03:20:49.128859884 +0000 UTC m=+38.350342917" lastFinishedPulling="2026-05-21 03:20:51.730881367 +0000 UTC m=+40.952364388" observedRunningTime="2026-05-21 03:20:52.699912359 +0000 UTC m=+41.921395399" watchObservedRunningTime="2026-05-21 03:20:52.700334489 +0000 UTC m=+41.921817530"
May 21 03:20:52.886312 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:52.886284    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbbcs_11e2a2eb-33a6-469e-86a2-51af9e78a823/node-ca/0.log"
May 21 03:20:53.073652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.073623    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hsxx7"]
May 21 03:20:53.087083 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.087059    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hsxx7"]
May 21 03:20:53.087228 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.087167    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.089626 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.089596    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 03:20:53.089768 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.089636    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 03:20:53.089768 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.089653    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 03:20:53.089971 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.089956    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rbdwt\""
May 21 03:20:53.090790 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.090771    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 03:20:53.187283 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.187257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-key\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.187398 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.187336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-cabundle\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.187398 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.187390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc74v\" (UniqueName: \"kubernetes.io/projected/66ec5a64-481a-4b7f-bf75-70b9a08229ed-kube-api-access-fc74v\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.288116 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.288076    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-cabundle\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.288276 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.288133    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc74v\" (UniqueName: \"kubernetes.io/projected/66ec5a64-481a-4b7f-bf75-70b9a08229ed-kube-api-access-fc74v\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.288276 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.288250    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-key\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.288908 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.288889    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-cabundle\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.291680 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.291664    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66ec5a64-481a-4b7f-bf75-70b9a08229ed-signing-key\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.296393 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.296374    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc74v\" (UniqueName: \"kubernetes.io/projected/66ec5a64-481a-4b7f-bf75-70b9a08229ed-kube-api-access-fc74v\") pod \"service-ca-67d667c7d-hsxx7\" (UID: \"66ec5a64-481a-4b7f-bf75-70b9a08229ed\") " pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.395772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.395695    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hsxx7"
May 21 03:20:53.534625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.534593    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hsxx7"]
May 21 03:20:53.537599 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:20:53.537576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ec5a64_481a_4b7f_bf75_70b9a08229ed.slice/crio-16b035c3bbbc9e273a4e5a0acec130525d8a9b1c76dc38085660bbb99e543b32 WatchSource:0}: Error finding container 16b035c3bbbc9e273a4e5a0acec130525d8a9b1c76dc38085660bbb99e543b32: Status 404 returned error can't find the container with id 16b035c3bbbc9e273a4e5a0acec130525d8a9b1c76dc38085660bbb99e543b32
May 21 03:20:53.672184 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.672089    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hsxx7" event={"ID":"66ec5a64-481a-4b7f-bf75-70b9a08229ed","Type":"ContainerStarted","Data":"16b035c3bbbc9e273a4e5a0acec130525d8a9b1c76dc38085660bbb99e543b32"}
May 21 03:20:53.887863 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:53.887817    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-k8qfv_54a2778e-235a-4326-8900-5f588a137147/migrator/0.log"
May 21 03:20:54.087369 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:54.087336    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-k8qfv_54a2778e-235a-4326-8900-5f588a137147/graceful-termination/0.log"
May 21 03:20:54.397262 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:54.397185    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:20:54.397262 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:54.397232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:20:54.397489 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:54.397336    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 03:20:54.397489 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:54.397407    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls podName:6e5e8f12-cdd6-4a51-97cf-4394fc18eeba nodeName:}" failed. No retries permitted until 2026-05-21 03:21:02.397388704 +0000 UTC m=+51.618871723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls") pod "dns-default-4dh2q" (UID: "6e5e8f12-cdd6-4a51-97cf-4394fc18eeba") : secret "dns-default-metrics-tls" not found
May 21 03:20:54.397489 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:54.397339    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 03:20:54.397654 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:20:54.397513    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert podName:6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:02.397491249 +0000 UTC m=+51.618974274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert") pod "ingress-canary-n2gbs" (UID: "6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1") : secret "canary-serving-cert" not found
May 21 03:20:56.680204 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:56.680163    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hsxx7" event={"ID":"66ec5a64-481a-4b7f-bf75-70b9a08229ed","Type":"ContainerStarted","Data":"49deda93cb85433c96843cddff4f615d50b12873b506e408ff4c75cee83c6e4f"}
May 21 03:20:56.695164 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:20:56.695114    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-hsxx7" podStartSLOduration=1.083140134 podStartE2EDuration="3.695095707s" podCreationTimestamp="2026-05-21 03:20:53 +0000 UTC" firstStartedPulling="2026-05-21 03:20:53.539990929 +0000 UTC m=+42.761473946" lastFinishedPulling="2026-05-21 03:20:56.151946488 +0000 UTC m=+45.373429519" observedRunningTime="2026-05-21 03:20:56.694673129 +0000 UTC m=+45.916156170" watchObservedRunningTime="2026-05-21 03:20:56.695095707 +0000 UTC m=+45.916578747"
May 21 03:21:02.452475 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.452439    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:21:02.452877 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.452485    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:21:02.455019 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.454994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5e8f12-cdd6-4a51-97cf-4394fc18eeba-metrics-tls\") pod \"dns-default-4dh2q\" (UID: \"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba\") " pod="openshift-dns/dns-default-4dh2q"
May 21 03:21:02.455092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.455079    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1-cert\") pod \"ingress-canary-n2gbs\" (UID: \"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1\") " pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:21:02.567092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.567066    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2gbs"
May 21 03:21:02.573880 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.573841    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dh2q"
May 21 03:21:02.693862 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.693816    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2gbs"]
May 21 03:21:02.709239 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:02.709185    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dh2q"]
May 21 03:21:02.714528 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:02.714500    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6840ae4a_ba67_4ce2_a81d_dc097a0ce8f1.slice/crio-0409aec939160c5d6e9960e300609606b50ef2112652fff3083ad81d219f13ec WatchSource:0}: Error finding container 0409aec939160c5d6e9960e300609606b50ef2112652fff3083ad81d219f13ec: Status 404 returned error can't find the container with id 0409aec939160c5d6e9960e300609606b50ef2112652fff3083ad81d219f13ec
May 21 03:21:02.715222 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:02.715145    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5e8f12_cdd6_4a51_97cf_4394fc18eeba.slice/crio-fd5cc37ff079500a6149b0e68c49ce14a996fa4a602f299a425cdc5189e1603f WatchSource:0}: Error finding container fd5cc37ff079500a6149b0e68c49ce14a996fa4a602f299a425cdc5189e1603f: Status 404 returned error can't find the container with id fd5cc37ff079500a6149b0e68c49ce14a996fa4a602f299a425cdc5189e1603f
May 21 03:21:03.695108 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:03.695057    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dh2q" event={"ID":"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba","Type":"ContainerStarted","Data":"fd5cc37ff079500a6149b0e68c49ce14a996fa4a602f299a425cdc5189e1603f"}
May 21 03:21:03.696700 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:03.696634    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2gbs" event={"ID":"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1","Type":"ContainerStarted","Data":"0409aec939160c5d6e9960e300609606b50ef2112652fff3083ad81d219f13ec"}
May 21 03:21:05.703568 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.703530    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dh2q" event={"ID":"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba","Type":"ContainerStarted","Data":"33452793ed25adbaa715754adfe3f239e28f93f0725ddef9d640e6d59761e037"}
May 21 03:21:05.704012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.703575    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dh2q" event={"ID":"6e5e8f12-cdd6-4a51-97cf-4394fc18eeba","Type":"ContainerStarted","Data":"38fb9b31cc1d381c7e1c83ae1dd591fb8e16d271e94b4b4fb3c7180eef8f3ac4"}
May 21 03:21:05.704012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.703640    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dh2q"
May 21 03:21:05.704910 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.704887    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2gbs" event={"ID":"6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1","Type":"ContainerStarted","Data":"2da790c8838c7e67dc448e30b9fb575b38fbf2939264630b324fe09689eac94c"}
May 21 03:21:05.721034 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.720990    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4dh2q" podStartSLOduration=17.502140521 podStartE2EDuration="19.720978822s" podCreationTimestamp="2026-05-21 03:20:46 +0000 UTC" firstStartedPulling="2026-05-21 03:21:02.71705181 +0000 UTC m=+51.938534836" lastFinishedPulling="2026-05-21 03:21:04.935890104 +0000 UTC m=+54.157373137" observedRunningTime="2026-05-21 03:21:05.720044016 +0000 UTC m=+54.941527058" watchObservedRunningTime="2026-05-21 03:21:05.720978822 +0000 UTC m=+54.942461863"
May 21 03:21:05.735812 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:05.735776    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n2gbs" podStartSLOduration=17.51325487 podStartE2EDuration="19.735765164s" podCreationTimestamp="2026-05-21 03:20:46 +0000 UTC" firstStartedPulling="2026-05-21 03:21:02.716516481 +0000 UTC m=+51.937999516" lastFinishedPulling="2026-05-21 03:21:04.939026778 +0000 UTC m=+54.160509810" observedRunningTime="2026-05-21 03:21:05.735112459 +0000 UTC m=+54.956595499" watchObservedRunningTime="2026-05-21 03:21:05.735765164 +0000 UTC m=+54.957248205"
May 21 03:21:10.647046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:10.647015    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8c7x"
May 21 03:21:14.148190 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.148155    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vczrs"]
May 21 03:21:14.151228 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.151195    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.154965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.154942    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 03:21:14.154965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.154957    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 03:21:14.155153 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.154958    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 03:21:14.155153 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.154949    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2pfl\""
May 21 03:21:14.155251 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.155230    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 03:21:14.161877 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.161838    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vczrs"]
May 21 03:21:14.246698 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.246669    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"]
May 21 03:21:14.248660 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.248645    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.251577 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.251550    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 03:21:14.251694 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.251573    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 03:21:14.251941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.251916    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jqqbv\""
May 21 03:21:14.258366 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.258327    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"]
May 21 03:21:14.260538 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.260522    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"]
May 21 03:21:14.260619 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.260608    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.263275 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.263259    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 03:21:14.263812 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.263794    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 03:21:14.263969 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.263899    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gx7m\""
May 21 03:21:14.263969 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.263899    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 03:21:14.271538 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.271515    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 03:21:14.272061 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.272041    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"]
May 21 03:21:14.328608 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.328583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.328716 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.328618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-data-volume\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.328792 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.328733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-crio-socket\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.328792 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.328778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.328923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.328812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khtm\" (UniqueName: \"kubernetes.io/projected/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-api-access-7khtm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.429692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-image-registry-private-configuration\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.429692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-tls\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.429692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-ca-trust-extracted\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.429692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2hzl\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-kube-api-access-w2hzl\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.429923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429782    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-crio-socket\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.429923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429815    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.429923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30d6da9c-fb77-43de-8920-75043c338d9a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.429923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429882    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7khtm\" (UniqueName: \"kubernetes.io/projected/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-api-access-7khtm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.429923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-trusted-ca\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.430160 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429942    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-crio-socket\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.430160 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.429951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-bound-sa-token\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.430160 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430029    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.430160 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30d6da9c-fb77-43de-8920-75043c338d9a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.430327 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-certificates\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.430327 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-installation-pull-secrets\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.430327 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430287    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-data-volume\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.430436 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430364    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.430527 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.430510    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-data-volume\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.432543 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.432526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.438704 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.438681    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khtm\" (UniqueName: \"kubernetes.io/projected/5e5a7368-535f-4f6c-bd46-3deab2a9cabf-kube-api-access-7khtm\") pod \"insights-runtime-extractor-vczrs\" (UID: \"5e5a7368-535f-4f6c-bd46-3deab2a9cabf\") " pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.460639 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.460616    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vczrs"
May 21 03:21:14.530640 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530603    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30d6da9c-fb77-43de-8920-75043c338d9a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.530640 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530638    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-trusted-ca\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.530869 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530656    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-bound-sa-token\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.530869 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530675    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30d6da9c-fb77-43de-8920-75043c338d9a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.530869 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530840    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-certificates\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530891    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-installation-pull-secrets\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530925    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-image-registry-private-configuration\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530953    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-tls\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.530977    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-ca-trust-extracted\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.531004    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2hzl\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-kube-api-access-w2hzl\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531609 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.531584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30d6da9c-fb77-43de-8920-75043c338d9a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.531712 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.531584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-trusted-ca\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.531712 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.531650    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-ca-trust-extracted\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.532315 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.532292    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-certificates\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.533786 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.533761    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-image-registry-private-configuration\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.534154 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.534128    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-installation-pull-secrets\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.534234 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.534173    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30d6da9c-fb77-43de-8920-75043c338d9a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-c2kpk\" (UID: \"30d6da9c-fb77-43de-8920-75043c338d9a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.534294 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.534236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-registry-tls\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.538609 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.538583    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-bound-sa-token\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.540029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.539991    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2hzl\" (UniqueName: \"kubernetes.io/projected/3b11a1c5-93d3-43aa-b6ba-c11d997c6165-kube-api-access-w2hzl\") pod \"image-registry-5cbfc89b9c-f7n4b\" (UID: \"3b11a1c5-93d3-43aa-b6ba-c11d997c6165\") " pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.559947 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.559925    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"
May 21 03:21:14.568703 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.568684    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:14.584923 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.584897    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vczrs"]
May 21 03:21:14.589021 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:14.588991    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5a7368_535f_4f6c_bd46_3deab2a9cabf.slice/crio-fe8feb00ea8527ce2993fff9c2f8d2d1aeb375191c277b8493612a6c57bcdfd0 WatchSource:0}: Error finding container fe8feb00ea8527ce2993fff9c2f8d2d1aeb375191c277b8493612a6c57bcdfd0: Status 404 returned error can't find the container with id fe8feb00ea8527ce2993fff9c2f8d2d1aeb375191c277b8493612a6c57bcdfd0
May 21 03:21:14.691457 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.691382    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk"]
May 21 03:21:14.695489 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:14.695455    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d6da9c_fb77_43de_8920_75043c338d9a.slice/crio-df43f1053dcd6af81b381fdff3dbf2270a38bdb6b2bdbb579b73a823ffdef8d3 WatchSource:0}: Error finding container df43f1053dcd6af81b381fdff3dbf2270a38bdb6b2bdbb579b73a823ffdef8d3: Status 404 returned error can't find the container with id df43f1053dcd6af81b381fdff3dbf2270a38bdb6b2bdbb579b73a823ffdef8d3
May 21 03:21:14.717463 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.717438    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"]
May 21 03:21:14.720309 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:14.720292    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b11a1c5_93d3_43aa_b6ba_c11d997c6165.slice/crio-61431e02984ecf69edbcbe2ebc54d036801424ed73df42f48ebc4f8b9f0e3c0b WatchSource:0}: Error finding container 61431e02984ecf69edbcbe2ebc54d036801424ed73df42f48ebc4f8b9f0e3c0b: Status 404 returned error can't find the container with id 61431e02984ecf69edbcbe2ebc54d036801424ed73df42f48ebc4f8b9f0e3c0b
May 21 03:21:14.734528 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.734500    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk" event={"ID":"30d6da9c-fb77-43de-8920-75043c338d9a","Type":"ContainerStarted","Data":"df43f1053dcd6af81b381fdff3dbf2270a38bdb6b2bdbb579b73a823ffdef8d3"}
May 21 03:21:14.735592 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.735571    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b" event={"ID":"3b11a1c5-93d3-43aa-b6ba-c11d997c6165","Type":"ContainerStarted","Data":"61431e02984ecf69edbcbe2ebc54d036801424ed73df42f48ebc4f8b9f0e3c0b"}
May 21 03:21:14.736909 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.736881    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vczrs" event={"ID":"5e5a7368-535f-4f6c-bd46-3deab2a9cabf","Type":"ContainerStarted","Data":"819521d91d623f7858ca5195c94fd624da623594c1c38f86c7c62f5687589689"}
May 21 03:21:14.736991 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:14.736918    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vczrs" event={"ID":"5e5a7368-535f-4f6c-bd46-3deab2a9cabf","Type":"ContainerStarted","Data":"fe8feb00ea8527ce2993fff9c2f8d2d1aeb375191c277b8493612a6c57bcdfd0"}
May 21 03:21:15.711294 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:15.711204    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dh2q"
May 21 03:21:15.742515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:15.742467    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b" event={"ID":"3b11a1c5-93d3-43aa-b6ba-c11d997c6165","Type":"ContainerStarted","Data":"602cdcd6bce5c3d7e9ff59f72fbd2a14986172b19d98f7673da2960f0e272ec7"}
May 21 03:21:15.742674 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:15.742627    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:15.744635 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:15.744609    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vczrs" event={"ID":"5e5a7368-535f-4f6c-bd46-3deab2a9cabf","Type":"ContainerStarted","Data":"c227c7c2afb2c93ed60be1e221461ec9cbec0294ba703410447d882629ea7136"}
May 21 03:21:15.763638 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:15.763589    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b" podStartSLOduration=1.763571419 podStartE2EDuration="1.763571419s" podCreationTimestamp="2026-05-21 03:21:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:21:15.762240773 +0000 UTC m=+64.983723815" watchObservedRunningTime="2026-05-21 03:21:15.763571419 +0000 UTC m=+64.985054442"
May 21 03:21:16.144768 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.144723    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:21:16.144957 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.144807    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:21:16.147204 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.147178    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 03:21:16.147914 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.147894    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqr22\" (UniqueName: \"kubernetes.io/projected/ea94780c-111e-4535-8d0e-7f2776bb3518-kube-api-access-mqr22\") pod \"network-check-target-wxwjc\" (UID: \"ea94780c-111e-4535-8d0e-7f2776bb3518\") " pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:21:16.157720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.157697    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03aeb780-f839-4667-a99e-9d4e48f99dbf-metrics-certs\") pod \"network-metrics-daemon-fv9tm\" (UID: \"03aeb780-f839-4667-a99e-9d4e48f99dbf\") " pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:21:16.224389 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.224360    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\""
May 21 03:21:16.229438 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.229414    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\""
May 21 03:21:16.232300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.232281    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fv9tm"
May 21 03:21:16.237986 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.237967    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:21:16.381485 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.381450    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fv9tm"]
May 21 03:21:16.388759 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:16.388699    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03aeb780_f839_4667_a99e_9d4e48f99dbf.slice/crio-d127e0d9319e6d6d80c68650fd83ff388ad801a98abdd6b9558b7a988546c683 WatchSource:0}: Error finding container d127e0d9319e6d6d80c68650fd83ff388ad801a98abdd6b9558b7a988546c683: Status 404 returned error can't find the container with id d127e0d9319e6d6d80c68650fd83ff388ad801a98abdd6b9558b7a988546c683
May 21 03:21:16.399703 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.399649    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxwjc"]
May 21 03:21:16.403383 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:16.403358    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea94780c_111e_4535_8d0e_7f2776bb3518.slice/crio-acad24d923449aeb9dd4424a96611ddd9cd55899ecad9bd0b44dc4256841ccd5 WatchSource:0}: Error finding container acad24d923449aeb9dd4424a96611ddd9cd55899ecad9bd0b44dc4256841ccd5: Status 404 returned error can't find the container with id acad24d923449aeb9dd4424a96611ddd9cd55899ecad9bd0b44dc4256841ccd5
May 21 03:21:16.749196 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.749158    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk" event={"ID":"30d6da9c-fb77-43de-8920-75043c338d9a","Type":"ContainerStarted","Data":"1dc36b38e19e6b1c73a5781158f4000ec593e209bd802c3d9c89a6862fa99d3e"}
May 21 03:21:16.751155 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.751125    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxwjc" event={"ID":"ea94780c-111e-4535-8d0e-7f2776bb3518","Type":"ContainerStarted","Data":"3039b768c91c0c95343ffc83c273b412a43f8937a5674797c0d4862b6fabf0f5"}
May 21 03:21:16.751275 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.751172    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxwjc" event={"ID":"ea94780c-111e-4535-8d0e-7f2776bb3518","Type":"ContainerStarted","Data":"acad24d923449aeb9dd4424a96611ddd9cd55899ecad9bd0b44dc4256841ccd5"}
May 21 03:21:16.751275 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.751231    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:21:16.752229 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.752194    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fv9tm" event={"ID":"03aeb780-f839-4667-a99e-9d4e48f99dbf","Type":"ContainerStarted","Data":"d127e0d9319e6d6d80c68650fd83ff388ad801a98abdd6b9558b7a988546c683"}
May 21 03:21:16.764593 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.764547    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-c2kpk" podStartSLOduration=1.621585725 podStartE2EDuration="2.764532406s" podCreationTimestamp="2026-05-21 03:21:14 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.697439264 +0000 UTC m=+63.918922283" lastFinishedPulling="2026-05-21 03:21:15.84038593 +0000 UTC m=+65.061868964" observedRunningTime="2026-05-21 03:21:16.763169618 +0000 UTC m=+65.984652659" watchObservedRunningTime="2026-05-21 03:21:16.764532406 +0000 UTC m=+65.986015451"
May 21 03:21:16.777060 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:16.777022    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wxwjc" podStartSLOduration=65.777008182 podStartE2EDuration="1m5.777008182s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:21:16.776534596 +0000 UTC m=+65.998017640" watchObservedRunningTime="2026-05-21 03:21:16.777008182 +0000 UTC m=+65.998491223"
May 21 03:21:17.756626 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:17.756587    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vczrs" event={"ID":"5e5a7368-535f-4f6c-bd46-3deab2a9cabf","Type":"ContainerStarted","Data":"8cc3070e21c7e7acf15cd49f93aaf22206cc5c6a9c653f780f6c0cbde0fdfd62"}
May 21 03:21:17.772985 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:17.772939    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vczrs" podStartSLOduration=1.437062524 podStartE2EDuration="3.772922635s" podCreationTimestamp="2026-05-21 03:21:14 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.661811631 +0000 UTC m=+63.883294651" lastFinishedPulling="2026-05-21 03:21:16.997671743 +0000 UTC m=+66.219154762" observedRunningTime="2026-05-21 03:21:17.772479716 +0000 UTC m=+66.993962756" watchObservedRunningTime="2026-05-21 03:21:17.772922635 +0000 UTC m=+66.994405676"
May 21 03:21:18.763536 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.763502    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fv9tm" event={"ID":"03aeb780-f839-4667-a99e-9d4e48f99dbf","Type":"ContainerStarted","Data":"0431b31386bcc3f4fa18bb84a2eb7cc3cffc44170a100eef3f3b2bc56e743ee4"}
May 21 03:21:18.763536 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.763537    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fv9tm" event={"ID":"03aeb780-f839-4667-a99e-9d4e48f99dbf","Type":"ContainerStarted","Data":"dffc9f44f09d1da64a5ad83ae00ecd65604270b155f552c738cf9cbcb23af746"}
May 21 03:21:18.781356 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.781259    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fv9tm" podStartSLOduration=66.008029704 podStartE2EDuration="1m7.781244698s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:21:16.391037013 +0000 UTC m=+65.612520031" lastFinishedPulling="2026-05-21 03:21:18.164252005 +0000 UTC m=+67.385735025" observedRunningTime="2026-05-21 03:21:18.781072371 +0000 UTC m=+68.002555414" watchObservedRunningTime="2026-05-21 03:21:18.781244698 +0000 UTC m=+68.002727740"
May 21 03:21:18.833914 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.833882    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"]
May 21 03:21:18.851404 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.851382    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"]
May 21 03:21:18.851536 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.851478    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:18.855348 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.855329    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 21 03:21:18.855458 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.855379    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7dzgc\""
May 21 03:21:18.966314 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:18.966281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/faff6f53-2edb-4e1a-9624-a2a79fea7b60-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-st4d6\" (UID: \"faff6f53-2edb-4e1a-9624-a2a79fea7b60\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:19.067623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:19.067560    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/faff6f53-2edb-4e1a-9624-a2a79fea7b60-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-st4d6\" (UID: \"faff6f53-2edb-4e1a-9624-a2a79fea7b60\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:19.070018 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:19.069996    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/faff6f53-2edb-4e1a-9624-a2a79fea7b60-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-st4d6\" (UID: \"faff6f53-2edb-4e1a-9624-a2a79fea7b60\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:19.160596 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:19.160572    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:19.278280 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:19.278239    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"]
May 21 03:21:19.282114 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:19.282093    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaff6f53_2edb_4e1a_9624_a2a79fea7b60.slice/crio-7c662c527727deecccaace39795a1dad97e51c09add960d30c91976371ea55a4 WatchSource:0}: Error finding container 7c662c527727deecccaace39795a1dad97e51c09add960d30c91976371ea55a4: Status 404 returned error can't find the container with id 7c662c527727deecccaace39795a1dad97e51c09add960d30c91976371ea55a4
May 21 03:21:19.767012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:19.766977    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6" event={"ID":"faff6f53-2edb-4e1a-9624-a2a79fea7b60","Type":"ContainerStarted","Data":"7c662c527727deecccaace39795a1dad97e51c09add960d30c91976371ea55a4"}
May 21 03:21:21.775499 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:21.775459    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6" event={"ID":"faff6f53-2edb-4e1a-9624-a2a79fea7b60","Type":"ContainerStarted","Data":"ba016930c116d76d3af381c620c2dc2b57efe4c90065ce9f1ad2eec30332ae55"}
May 21 03:21:21.776095 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:21.775729    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:21.780198 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:21.780177    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6"
May 21 03:21:21.794471 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:21.794421    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-st4d6" podStartSLOduration=2.16827116 podStartE2EDuration="3.794408833s" podCreationTimestamp="2026-05-21 03:21:18 +0000 UTC" firstStartedPulling="2026-05-21 03:21:19.286497383 +0000 UTC m=+68.507980410" lastFinishedPulling="2026-05-21 03:21:20.912635052 +0000 UTC m=+70.134118083" observedRunningTime="2026-05-21 03:21:21.790944478 +0000 UTC m=+71.012427520" watchObservedRunningTime="2026-05-21 03:21:21.794408833 +0000 UTC m=+71.015891873"
May 21 03:21:22.898364 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.898327    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"]
May 21 03:21:22.900666 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.900649    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:22.903291 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.903269    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 03:21:22.904438 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.904420    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 03:21:22.904504 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.904476    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 03:21:22.904779 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.904757    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 03:21:22.904862 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.904792    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kdpcs\""
May 21 03:21:22.904862 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.904794    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 03:21:22.910962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.910773    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"]
May 21 03:21:22.997179 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.997151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:22.997303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.997188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ff8fad-6fa8-47ea-b620-62bcf19c2699-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:22.997303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.997221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:22.997303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:22.997241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvkh\" (UniqueName: \"kubernetes.io/projected/46ff8fad-6fa8-47ea-b620-62bcf19c2699-kube-api-access-qnvkh\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.098053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.098015    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.098053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.098057    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ff8fad-6fa8-47ea-b620-62bcf19c2699-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.098248 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.098092    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.098248 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.098111    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvkh\" (UniqueName: \"kubernetes.io/projected/46ff8fad-6fa8-47ea-b620-62bcf19c2699-kube-api-access-qnvkh\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.098775 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.098750    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ff8fad-6fa8-47ea-b620-62bcf19c2699-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.100638 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.100620    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.100753 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.100639    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ff8fad-6fa8-47ea-b620-62bcf19c2699-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.105867 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.105815    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvkh\" (UniqueName: \"kubernetes.io/projected/46ff8fad-6fa8-47ea-b620-62bcf19c2699-kube-api-access-qnvkh\") pod \"prometheus-operator-7779bbdd78-pzrz7\" (UID: \"46ff8fad-6fa8-47ea-b620-62bcf19c2699\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.210235 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.210159    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"
May 21 03:21:23.346768 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.346738    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7"]
May 21 03:21:23.349729 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:23.349698    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ff8fad_6fa8_47ea_b620_62bcf19c2699.slice/crio-956b3891f3eeb17b18d2dde9108e108b98ed0f7ad2cb03375c074fe78dcaaa8d WatchSource:0}: Error finding container 956b3891f3eeb17b18d2dde9108e108b98ed0f7ad2cb03375c074fe78dcaaa8d: Status 404 returned error can't find the container with id 956b3891f3eeb17b18d2dde9108e108b98ed0f7ad2cb03375c074fe78dcaaa8d
May 21 03:21:23.781410 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:23.781285    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7" event={"ID":"46ff8fad-6fa8-47ea-b620-62bcf19c2699","Type":"ContainerStarted","Data":"956b3891f3eeb17b18d2dde9108e108b98ed0f7ad2cb03375c074fe78dcaaa8d"}
May 21 03:21:24.785911 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:24.785865    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7" event={"ID":"46ff8fad-6fa8-47ea-b620-62bcf19c2699","Type":"ContainerStarted","Data":"510d4fdeb293abf0ba54a85906f1db8800284cfada7e52194b2443cb3b72d1dc"}
May 21 03:21:24.785911 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:24.785904    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7" event={"ID":"46ff8fad-6fa8-47ea-b620-62bcf19c2699","Type":"ContainerStarted","Data":"1cbd0dff3213fcf4bba1833e8f0b5168cb846846ccb4e6ae5f84a5f228f7cfc9"}
May 21 03:21:24.802263 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:24.802218    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-pzrz7" podStartSLOduration=1.6827073179999998 podStartE2EDuration="2.802204699s" podCreationTimestamp="2026-05-21 03:21:22 +0000 UTC" firstStartedPulling="2026-05-21 03:21:23.351587084 +0000 UTC m=+72.573070101" lastFinishedPulling="2026-05-21 03:21:24.471084461 +0000 UTC m=+73.692567482" observedRunningTime="2026-05-21 03:21:24.800887806 +0000 UTC m=+74.022370846" watchObservedRunningTime="2026-05-21 03:21:24.802204699 +0000 UTC m=+74.023687739"
May 21 03:21:26.242305 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.242257    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"]
May 21 03:21:26.246629 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.246600    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.250593 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.250567    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 03:21:26.250777 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.250759    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rhthv\""
May 21 03:21:26.250895 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.250800    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 03:21:26.250895 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.250806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 03:21:26.259413 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.259378    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"]
May 21 03:21:26.265713 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.265690    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nswjd"]
May 21 03:21:26.269203 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.269184    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.271600 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.271584    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 03:21:26.271939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.271917    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 03:21:26.272027 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.272007    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 03:21:26.272113 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.271920    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xgvrr\""
May 21 03:21:26.321307 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzr86\" (UniqueName: \"kubernetes.io/projected/3a5ab151-e3b8-4091-a51c-c5965d944ef1-kube-api-access-xzr86\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321410 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321410 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321410 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-textfile\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-wtmp\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-metrics-client-ca\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321760 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-tls\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321760 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-sys\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321760 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a660b6e8-8990-4a75-90d9-71b12b603a60-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321760 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rw5\" (UniqueName: \"kubernetes.io/projected/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-api-access-p2rw5\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.321760 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-root\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.321962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.321775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.422822 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422792    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.422952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422835    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.422952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422881    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-textfile\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.422952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422911    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-wtmp\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.422952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422938    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422968    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-metrics-client-ca\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.422997    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423025    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-tls\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-sys\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423065    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-wtmp\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423081    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a660b6e8-8990-4a75-90d9-71b12b603a60-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.423148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423132    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rw5\" (UniqueName: \"kubernetes.io/projected/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-api-access-p2rw5\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423173    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-root\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423202    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzr86\" (UniqueName: \"kubernetes.io/projected/3a5ab151-e3b8-4091-a51c-c5965d944ef1-kube-api-access-xzr86\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423245    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-textfile\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423258    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.423464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423417    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a660b6e8-8990-4a75-90d9-71b12b603a60-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.423965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.423566    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-root\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.424062 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.424036    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a5ab151-e3b8-4091-a51c-c5965d944ef1-sys\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.424149 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.424117    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.424289 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.424262    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.424453 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.424225    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ab151-e3b8-4091-a51c-c5965d944ef1-metrics-client-ca\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.424786 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.424760    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a660b6e8-8990-4a75-90d9-71b12b603a60-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.425905 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.425883    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.426150 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.426131    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-tls\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.426807 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.426783    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.427091 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.427073    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5ab151-e3b8-4091-a51c-c5965d944ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.430505 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.430479    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rw5\" (UniqueName: \"kubernetes.io/projected/a660b6e8-8990-4a75-90d9-71b12b603a60-kube-api-access-p2rw5\") pod \"kube-state-metrics-54fd6bc5c4-mm4hx\" (UID: \"a660b6e8-8990-4a75-90d9-71b12b603a60\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.430970 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.430951    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzr86\" (UniqueName: \"kubernetes.io/projected/3a5ab151-e3b8-4091-a51c-c5965d944ef1-kube-api-access-xzr86\") pod \"node-exporter-nswjd\" (UID: \"3a5ab151-e3b8-4091-a51c-c5965d944ef1\") " pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.556248 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.556223    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"
May 21 03:21:26.578663 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.578642    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nswjd"
May 21 03:21:26.589000 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:26.588965    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5ab151_e3b8_4091_a51c_c5965d944ef1.slice/crio-b6688549fd302cb56222f5c3d107cdae73492a26129de2ddd0927d3570c1ed4f WatchSource:0}: Error finding container b6688549fd302cb56222f5c3d107cdae73492a26129de2ddd0927d3570c1ed4f: Status 404 returned error can't find the container with id b6688549fd302cb56222f5c3d107cdae73492a26129de2ddd0927d3570c1ed4f
May 21 03:21:26.692688 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.692660    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx"]
May 21 03:21:26.695690 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:26.695661    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda660b6e8_8990_4a75_90d9_71b12b603a60.slice/crio-a22c52ce2df0c2303cf247a5c6777867e8125f47615959f370bd80d7d22402fa WatchSource:0}: Error finding container a22c52ce2df0c2303cf247a5c6777867e8125f47615959f370bd80d7d22402fa: Status 404 returned error can't find the container with id a22c52ce2df0c2303cf247a5c6777867e8125f47615959f370bd80d7d22402fa
May 21 03:21:26.791685 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.791657    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx" event={"ID":"a660b6e8-8990-4a75-90d9-71b12b603a60","Type":"ContainerStarted","Data":"a22c52ce2df0c2303cf247a5c6777867e8125f47615959f370bd80d7d22402fa"}
May 21 03:21:26.792636 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:26.792615    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nswjd" event={"ID":"3a5ab151-e3b8-4091-a51c-c5965d944ef1","Type":"ContainerStarted","Data":"b6688549fd302cb56222f5c3d107cdae73492a26129de2ddd0927d3570c1ed4f"}
May 21 03:21:27.297587 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.297550    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:21:27.301641 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.301618    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.304306 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.304267    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 03:21:27.304412 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.304333    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 03:21:27.304547 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.304533    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 03:21:27.304719 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.304703    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 03:21:27.305184 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305135    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 03:21:27.305277 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305200    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 03:21:27.305277 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305256    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 03:21:27.305537 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305521    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 03:21:27.305583 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305566    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 03:21:27.305648 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.305526    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59sbt\""
May 21 03:21:27.314264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.314239    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plzq7\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330444    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.330814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.330660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.431728 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431684    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.431925 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431793    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.431925 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431875    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.431925 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431902    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431948    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.431978    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432031    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plzq7\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432080    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432286 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432110    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432286 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432141    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432286 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432286 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432195    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.432286 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432229    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.433006 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.432671    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.433006 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:21:27.432722    2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 21 03:21:27.433006 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:21:27.432793    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls podName:8efae4b5-ca05-445e-aba9-7b4a482b7605 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:27.93277325 +0000 UTC m=+77.154256271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605") : secret "alertmanager-main-tls" not found
May 21 03:21:27.434471 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.434444    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.434789 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.434765    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.439436 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.439409    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.440398 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.440357    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.440516 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.440484    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.440694 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.440668    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plzq7\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.440887 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.440868    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.441007 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.440966    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.441551 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.441428    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.441551 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.441513    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.443672 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.443648    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.801400 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.801361    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nswjd" event={"ID":"3a5ab151-e3b8-4091-a51c-c5965d944ef1","Type":"ContainerStarted","Data":"ac00bd602a280134518bf9b12831d8f1b7b6a4421baf6501ca92853d30584716"}
May 21 03:21:27.938181 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.938102    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:27.941038 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:27.941013    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:28.219270 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.219233    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:21:28.283668 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.283606    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d4f7648b8-g95kx"]
May 21 03:21:28.289081 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.289059    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.291730 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.291709    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 03:21:28.292245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292046    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 03:21:28.292245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292046    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 03:21:28.292245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292096    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5k0iefj5njv2n\""
May 21 03:21:28.292245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292152    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nntcd\""
May 21 03:21:28.292423 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292355    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 03:21:28.292495 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.292355    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 03:21:28.299426 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.299384    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4f7648b8-g95kx"]
May 21 03:21:28.343568 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343718 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343718 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343640    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343718 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f89c6e93-24dc-4844-ac03-504c7f7af1e7-metrics-client-ca\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343718 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-grpc-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343937 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343764    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343937 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.343937 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.343887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rh7b\" (UniqueName: \"kubernetes.io/projected/f89c6e93-24dc-4844-ac03-504c7f7af1e7-kube-api-access-9rh7b\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.368571 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.368537    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:21:28.372096 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:28.372069    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efae4b5_ca05_445e_aba9_7b4a482b7605.slice/crio-b6d44ad3e6f0b0b1e7f02e64ac900975463e38e22c5029f0bf2e72298af7212d WatchSource:0}: Error finding container b6d44ad3e6f0b0b1e7f02e64ac900975463e38e22c5029f0bf2e72298af7212d: Status 404 returned error can't find the container with id b6d44ad3e6f0b0b1e7f02e64ac900975463e38e22c5029f0bf2e72298af7212d
May 21 03:21:28.445029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.444965    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445006    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445181 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445042    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f89c6e93-24dc-4844-ac03-504c7f7af1e7-metrics-client-ca\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445181 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445080    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-grpc-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445181 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445116    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445181 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445164    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445762 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445194    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rh7b\" (UniqueName: \"kubernetes.io/projected/f89c6e93-24dc-4844-ac03-504c7f7af1e7-kube-api-access-9rh7b\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.445762 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.445346    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.446087 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.446038    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f89c6e93-24dc-4844-ac03-504c7f7af1e7-metrics-client-ca\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448075 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448021    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448176 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448120    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448407 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448382    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-grpc-tls\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448529 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448508    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448580 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448533    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.448863 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.448821    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f89c6e93-24dc-4844-ac03-504c7f7af1e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.453384 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.453359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rh7b\" (UniqueName: \"kubernetes.io/projected/f89c6e93-24dc-4844-ac03-504c7f7af1e7-kube-api-access-9rh7b\") pod \"thanos-querier-d4f7648b8-g95kx\" (UID: \"f89c6e93-24dc-4844-ac03-504c7f7af1e7\") " pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.600601 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.600568    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:28.728793 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.728555    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4f7648b8-g95kx"]
May 21 03:21:28.731070 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:28.731041    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89c6e93_24dc_4844_ac03_504c7f7af1e7.slice/crio-f025cf273354a4a2d87c0bc04c64903dff71223510b2825823831fde12166a8a WatchSource:0}: Error finding container f025cf273354a4a2d87c0bc04c64903dff71223510b2825823831fde12166a8a: Status 404 returned error can't find the container with id f025cf273354a4a2d87c0bc04c64903dff71223510b2825823831fde12166a8a
May 21 03:21:28.806102 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.806064    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx" event={"ID":"a660b6e8-8990-4a75-90d9-71b12b603a60","Type":"ContainerStarted","Data":"855da224c8e072c7f958e1f9804a0a4bc7d0c24b2ddb2fb73df0fd60ba4ab1d8"}
May 21 03:21:28.806102 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.806107    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx" event={"ID":"a660b6e8-8990-4a75-90d9-71b12b603a60","Type":"ContainerStarted","Data":"c9162dd101eba60d8b5c76737f8897928ebde61c23d762c496bec3aaf9b3eff8"}
May 21 03:21:28.806264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.806121    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx" event={"ID":"a660b6e8-8990-4a75-90d9-71b12b603a60","Type":"ContainerStarted","Data":"b63caf96d6111da6167883a2f9badb851aeda2c41faaee5c6daed8f8135454b4"}
May 21 03:21:28.807153 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.807129    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"f025cf273354a4a2d87c0bc04c64903dff71223510b2825823831fde12166a8a"}
May 21 03:21:28.808171 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.808141    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"b6d44ad3e6f0b0b1e7f02e64ac900975463e38e22c5029f0bf2e72298af7212d"}
May 21 03:21:28.809535 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.809512    2558 generic.go:358] "Generic (PLEG): container finished" podID="3a5ab151-e3b8-4091-a51c-c5965d944ef1" containerID="ac00bd602a280134518bf9b12831d8f1b7b6a4421baf6501ca92853d30584716" exitCode=0
May 21 03:21:28.809627 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.809572    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nswjd" event={"ID":"3a5ab151-e3b8-4091-a51c-c5965d944ef1","Type":"ContainerDied","Data":"ac00bd602a280134518bf9b12831d8f1b7b6a4421baf6501ca92853d30584716"}
May 21 03:21:28.822625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:28.822545    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-mm4hx" podStartSLOduration=1.485343834 podStartE2EDuration="2.822531283s" podCreationTimestamp="2026-05-21 03:21:26 +0000 UTC" firstStartedPulling="2026-05-21 03:21:26.697504456 +0000 UTC m=+75.918987474" lastFinishedPulling="2026-05-21 03:21:28.034691892 +0000 UTC m=+77.256174923" observedRunningTime="2026-05-21 03:21:28.821994807 +0000 UTC m=+78.043477847" watchObservedRunningTime="2026-05-21 03:21:28.822531283 +0000 UTC m=+78.044014325"
May 21 03:21:29.197366 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.197331    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-gpcjf"]
May 21 03:21:29.201864 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.201119    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:29.204142 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.204115    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 03:21:29.204258 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.204122    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gdslk\""
May 21 03:21:29.204258 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.204211    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 03:21:29.218886 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.216427    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-gpcjf"]
May 21 03:21:29.253021 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.252995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6hh\" (UniqueName: \"kubernetes.io/projected/9194a384-c067-4863-b4ff-399edad0df50-kube-api-access-fj6hh\") pod \"downloads-57bd96b888-gpcjf\" (UID: \"9194a384-c067-4863-b4ff-399edad0df50\") " pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:29.354318 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.354279    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6hh\" (UniqueName: \"kubernetes.io/projected/9194a384-c067-4863-b4ff-399edad0df50-kube-api-access-fj6hh\") pod \"downloads-57bd96b888-gpcjf\" (UID: \"9194a384-c067-4863-b4ff-399edad0df50\") " pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:29.364170 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.364138    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6hh\" (UniqueName: \"kubernetes.io/projected/9194a384-c067-4863-b4ff-399edad0df50-kube-api-access-fj6hh\") pod \"downloads-57bd96b888-gpcjf\" (UID: \"9194a384-c067-4863-b4ff-399edad0df50\") " pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:29.513189 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.513149    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:29.815464 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.815432    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"}
May 21 03:21:29.816419 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.816397    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-gpcjf"]
May 21 03:21:29.817688 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.817660    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nswjd" event={"ID":"3a5ab151-e3b8-4091-a51c-c5965d944ef1","Type":"ContainerStarted","Data":"9cdc252bd45cf89090f53581d68a6b20313bc7ec8b31728c7b7d70c507893471"}
May 21 03:21:29.817777 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.817701    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nswjd" event={"ID":"3a5ab151-e3b8-4091-a51c-c5965d944ef1","Type":"ContainerStarted","Data":"aaf91374f0647bd79d78cb2ccc9d61b23940b16d08537fe19a8b48548dd17ac9"}
May 21 03:21:29.819393 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:29.819368    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9194a384_c067_4863_b4ff_399edad0df50.slice/crio-cd97cfed8e9a8880bfb6515e3d3b644098cfe412833e8abb6ed9abb133b220f4 WatchSource:0}: Error finding container cd97cfed8e9a8880bfb6515e3d3b644098cfe412833e8abb6ed9abb133b220f4: Status 404 returned error can't find the container with id cd97cfed8e9a8880bfb6515e3d3b644098cfe412833e8abb6ed9abb133b220f4
May 21 03:21:29.840376 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:29.840335    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nswjd" podStartSLOduration=2.817403005 podStartE2EDuration="3.840322804s" podCreationTimestamp="2026-05-21 03:21:26 +0000 UTC" firstStartedPulling="2026-05-21 03:21:26.590802557 +0000 UTC m=+75.812285576" lastFinishedPulling="2026-05-21 03:21:27.613722355 +0000 UTC m=+76.835205375" observedRunningTime="2026-05-21 03:21:29.839056094 +0000 UTC m=+79.060539137" watchObservedRunningTime="2026-05-21 03:21:29.840322804 +0000 UTC m=+79.061805843"
May 21 03:21:30.824143 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:30.823280    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0" exitCode=0
May 21 03:21:30.824143 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:30.823664    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"}
May 21 03:21:30.825407 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:30.825373    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-gpcjf" event={"ID":"9194a384-c067-4863-b4ff-399edad0df50","Type":"ContainerStarted","Data":"cd97cfed8e9a8880bfb6515e3d3b644098cfe412833e8abb6ed9abb133b220f4"}
May 21 03:21:31.831058 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:31.831007    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"c73fe21f9839198c1f469aa977870ce0055d3b8796e0f8d67ddaf163d5b6a3e9"}
May 21 03:21:31.831058 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:31.831056    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"e14de33a01f4f179e6eda8377b9a6aa39ee30d447be0259f4b55835101c3a701"}
May 21 03:21:31.831490 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:31.831070    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"4658b1b79e4b9cd8a5d513b0bc6aecb7791b3c584884bc7483659ab75a65cc6d"}
May 21 03:21:32.473163 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.470939    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:21:32.476751 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.476730    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.481044    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.481088    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.481312    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482444    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482500    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482723    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482726    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1l2fbunmgu443\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482445    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h2sh6\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.482966    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.483151    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.483155    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.483307    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 03:21:32.484501 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.483387    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 03:21:32.486499 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.486115    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 03:21:32.487453 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.487309    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:21:32.489641 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.489623    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltbl\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.586993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.587862 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.587862 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.585942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686524 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686462    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltbl\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686531    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686560    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686586    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686611    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686863 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686816    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686948 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686892    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.686948 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686921    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687051 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686956    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687051 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.686984    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687051 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687017    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687051 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687042    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687237 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687103    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687237 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687143    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687237 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687174    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687237 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687211    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687416 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687240    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687416 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687272    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.687834 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.687732    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693136 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.688394    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693136 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.688699    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693136 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.689049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693136 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.689635    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693136 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.693068    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.693510    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.693630 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.693585    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.694540 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.694056    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.694540 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.694174    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.694540 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.694485    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.694734 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.694649    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.695314 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.695284    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.695390 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.695350    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.695390 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.695362    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.697264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.696310    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.697581 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.697559    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.698673 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.698519    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltbl\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl\") pod \"prometheus-k8s-0\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.825429 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.825043    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:32.840612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.840461    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"12d65207d9e54d00ecb3c392712618699d955550d240c46799de28d3dce59e61"}
May 21 03:21:32.840612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.840502    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"7475e0bd87563e09b607ab796222abd0b3cdf1a8ade3bc918d4d2d9af0e186c9"}
May 21 03:21:32.840612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.840516    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" event={"ID":"f89c6e93-24dc-4844-ac03-504c7f7af1e7","Type":"ContainerStarted","Data":"eced89375bf0fced5e7669f96491f5d8a2b2b30c300d301678cce86daef86b9a"}
May 21 03:21:32.841401 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.841381    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:32.844645 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.844576    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"}
May 21 03:21:32.844645 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.844607    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"}
May 21 03:21:32.844645 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.844622    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"}
May 21 03:21:32.844645 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.844635    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"}
May 21 03:21:32.862700 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.862648    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx" podStartSLOduration=1.159572698 podStartE2EDuration="4.862628765s" podCreationTimestamp="2026-05-21 03:21:28 +0000 UTC" firstStartedPulling="2026-05-21 03:21:28.733040743 +0000 UTC m=+77.954523761" lastFinishedPulling="2026-05-21 03:21:32.436096795 +0000 UTC m=+81.657579828" observedRunningTime="2026-05-21 03:21:32.861131482 +0000 UTC m=+82.082614521" watchObservedRunningTime="2026-05-21 03:21:32.862628765 +0000 UTC m=+82.084111806"
May 21 03:21:32.988092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:32.988064    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:21:32.990219 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:21:32.990150    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83f8e8e_457c_4653_832d_15c4cef98888.slice/crio-b42526eff37b1a892333c62f3ed602f304d800266d3c9d5225431440005af569 WatchSource:0}: Error finding container b42526eff37b1a892333c62f3ed602f304d800266d3c9d5225431440005af569: Status 404 returned error can't find the container with id b42526eff37b1a892333c62f3ed602f304d800266d3c9d5225431440005af569
May 21 03:21:33.850102 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.850068    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c" exitCode=0
May 21 03:21:33.850544 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.850158    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"}
May 21 03:21:33.850544 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.850203    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"b42526eff37b1a892333c62f3ed602f304d800266d3c9d5225431440005af569"}
May 21 03:21:33.853513 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.853487    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"}
May 21 03:21:33.853601 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.853517    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerStarted","Data":"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"}
May 21 03:21:33.905552 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:33.905500    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.839415943 podStartE2EDuration="6.905485566s" podCreationTimestamp="2026-05-21 03:21:27 +0000 UTC" firstStartedPulling="2026-05-21 03:21:28.374099624 +0000 UTC m=+77.595582656" lastFinishedPulling="2026-05-21 03:21:32.440169248 +0000 UTC m=+81.661652279" observedRunningTime="2026-05-21 03:21:33.903778153 +0000 UTC m=+83.125261440" watchObservedRunningTime="2026-05-21 03:21:33.905485566 +0000 UTC m=+83.126968636"
May 21 03:21:36.760175 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:36.760138    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cbfc89b9c-f7n4b"
May 21 03:21:37.872300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:37.872226    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"}
May 21 03:21:37.872300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:37.872262    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"}
May 21 03:21:37.872300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:37.872271    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"}
May 21 03:21:37.872300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:37.872279    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"}
May 21 03:21:37.872300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:37.872287    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"}
May 21 03:21:38.861619 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:38.861591    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d4f7648b8-g95kx"
May 21 03:21:38.879234 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:38.879202    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerStarted","Data":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"}
May 21 03:21:38.911508 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:38.909678    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.353627753 podStartE2EDuration="6.9096606s" podCreationTimestamp="2026-05-21 03:21:32 +0000 UTC" firstStartedPulling="2026-05-21 03:21:33.851570249 +0000 UTC m=+83.073053272" lastFinishedPulling="2026-05-21 03:21:37.407603101 +0000 UTC m=+86.629086119" observedRunningTime="2026-05-21 03:21:38.908600978 +0000 UTC m=+88.130084019" watchObservedRunningTime="2026-05-21 03:21:38.9096606 +0000 UTC m=+88.131143643"
May 21 03:21:42.825702 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:42.825664    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:21:46.909145 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:46.909118    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-gpcjf" event={"ID":"9194a384-c067-4863-b4ff-399edad0df50","Type":"ContainerStarted","Data":"640b1e1db9fb79b2a407b430cd4c75d9a0303a2238e0b01c76e1c882ca87272b"}
May 21 03:21:46.909450 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:46.909317    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:46.910835 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:46.910808    2558 patch_prober.go:28] interesting pod/downloads-57bd96b888-gpcjf container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" start-of-body=
May 21 03:21:46.910939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:46.910891    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-gpcjf" podUID="9194a384-c067-4863-b4ff-399edad0df50" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused"
May 21 03:21:46.927407 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:46.927366    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-gpcjf" podStartSLOduration=0.950914713 podStartE2EDuration="17.927355386s" podCreationTimestamp="2026-05-21 03:21:29 +0000 UTC" firstStartedPulling="2026-05-21 03:21:29.821805709 +0000 UTC m=+79.043288742" lastFinishedPulling="2026-05-21 03:21:46.798246397 +0000 UTC m=+96.019729415" observedRunningTime="2026-05-21 03:21:46.925110297 +0000 UTC m=+96.146593338" watchObservedRunningTime="2026-05-21 03:21:46.927355386 +0000 UTC m=+96.148838462"
May 21 03:21:47.759513 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:47.759467    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wxwjc"
May 21 03:21:47.931761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:47.931734    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-gpcjf"
May 21 03:21:54.683383 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:21:54.683346    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2gbs_6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1/serve-healthcheck-canary/0.log"
May 21 03:22:32.825919 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:32.825883    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:32.845066 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:32.845028    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:33.073568 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:33.073542    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:46.534942 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.534906    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:46.535734 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535519    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="alertmanager" containerID="cri-o://be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44" gracePeriod=120
May 21 03:22:46.535830 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535545    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-metric" containerID="cri-o://42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df" gracePeriod=120
May 21 03:22:46.535901 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535550    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-web" containerID="cri-o://ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6" gracePeriod=120
May 21 03:22:46.535944 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535577    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy" containerID="cri-o://8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9" gracePeriod=120
May 21 03:22:46.535987 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535596    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="config-reloader" containerID="cri-o://0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176" gracePeriod=120
May 21 03:22:46.535987 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:46.535605    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="prom-label-proxy" containerID="cri-o://daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca" gracePeriod=120
May 21 03:22:47.106157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106124    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca" exitCode=0
May 21 03:22:47.106157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106149    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9" exitCode=0
May 21 03:22:47.106157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106155    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176" exitCode=0
May 21 03:22:47.106157 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106161    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44" exitCode=0
May 21 03:22:47.106402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106180    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"}
May 21 03:22:47.106402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106207    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"}
May 21 03:22:47.106402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106216    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"}
May 21 03:22:47.106402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.106225    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"}
May 21 03:22:47.780305 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.780285    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:47.938046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.937970    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938009    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938043    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938246 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938224    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plzq7\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938289 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938275    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938330 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938307    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938384 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938359    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938384 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938358    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 03:22:47.938487 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938403    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938487 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938433    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938487 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938468    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938648 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938510    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938648 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938547    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.938648 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938583    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out\") pod \"8efae4b5-ca05-445e-aba9-7b4a482b7605\" (UID: \"8efae4b5-ca05-445e-aba9-7b4a482b7605\") "
May 21 03:22:47.939303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938833    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-main-db\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:47.939303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.938881    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:47.939303 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.939261    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:47.941186 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.941155    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.941302 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.941160    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7" (OuterVolumeSpecName: "kube-api-access-plzq7") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "kube-api-access-plzq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:22:47.941939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.941912    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.942263 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.942238    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:22:47.942263 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.942379    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out" (OuterVolumeSpecName: "config-out") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 03:22:47.942263 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.942370    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.942615 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.942597    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.942679 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.942635    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume" (OuterVolumeSpecName: "config-volume") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.947435 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.947408    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:47.953750 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:47.953726    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config" (OuterVolumeSpecName: "web-config") pod "8efae4b5-ca05-445e-aba9-7b4a482b7605" (UID: "8efae4b5-ca05-445e-aba9-7b4a482b7605"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:48.040012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.039977    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040003    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-web-config\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040014    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-tls-assets\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040022    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efae4b5-ca05-445e-aba9-7b4a482b7605-metrics-client-ca\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040032    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040042    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-out\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040051    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040076    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-main-tls\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040087    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plzq7\" (UniqueName: \"kubernetes.io/projected/8efae4b5-ca05-445e-aba9-7b4a482b7605-kube-api-access-plzq7\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040095    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-cluster-tls-config\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040104    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.040217 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.040112    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8efae4b5-ca05-445e-aba9-7b4a482b7605-config-volume\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:48.111780 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111746    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df" exitCode=0
May 21 03:22:48.111780 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111775    2558 generic.go:358] "Generic (PLEG): container finished" podID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerID="ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6" exitCode=0
May 21 03:22:48.111962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111806    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"}
May 21 03:22:48.111962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111837    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"}
May 21 03:22:48.111962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111864    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.111962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111874    2558 scope.go:117] "RemoveContainer" containerID="daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"
May 21 03:22:48.111962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.111874    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8efae4b5-ca05-445e-aba9-7b4a482b7605","Type":"ContainerDied","Data":"b6d44ad3e6f0b0b1e7f02e64ac900975463e38e22c5029f0bf2e72298af7212d"}
May 21 03:22:48.125738 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.125720    2558 scope.go:117] "RemoveContainer" containerID="42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"
May 21 03:22:48.132280 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.132264    2558 scope.go:117] "RemoveContainer" containerID="8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"
May 21 03:22:48.138268 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.138248    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:48.139990 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.139953    2558 scope.go:117] "RemoveContainer" containerID="ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"
May 21 03:22:48.142195 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.142176    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:48.146705 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.146684    2558 scope.go:117] "RemoveContainer" containerID="0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"
May 21 03:22:48.153049 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.153031    2558 scope.go:117] "RemoveContainer" containerID="be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"
May 21 03:22:48.161571 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.161548    2558 scope.go:117] "RemoveContainer" containerID="607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"
May 21 03:22:48.167370 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167351    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:48.167660 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167648    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy"
May 21 03:22:48.167709 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167661    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy"
May 21 03:22:48.167709 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167673    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="prom-label-proxy"
May 21 03:22:48.167709 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167680    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="prom-label-proxy"
May 21 03:22:48.167709 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167702    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="config-reloader"
May 21 03:22:48.167709 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167708    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="config-reloader"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167715    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-metric"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167720    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-metric"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167730    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="init-config-reloader"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167735    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="init-config-reloader"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167742    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="alertmanager"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167747    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="alertmanager"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167756    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-web"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167764    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-web"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167919    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-metric"
May 21 03:22:48.167941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167935    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="alertmanager"
May 21 03:22:48.168323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167959    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy"
May 21 03:22:48.168323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167969    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="config-reloader"
May 21 03:22:48.168323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167982    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="prom-label-proxy"
May 21 03:22:48.168323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.167992    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" containerName="kube-rbac-proxy-web"
May 21 03:22:48.168919 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.168904    2558 scope.go:117] "RemoveContainer" containerID="daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"
May 21 03:22:48.169179 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.169151    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca\": container with ID starting with daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca not found: ID does not exist" containerID="daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"
May 21 03:22:48.169245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169178    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"} err="failed to get container status \"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca\": rpc error: code = NotFound desc = could not find container \"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca\": container with ID starting with daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca not found: ID does not exist"
May 21 03:22:48.169245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169212    2558 scope.go:117] "RemoveContainer" containerID="42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"
May 21 03:22:48.169466 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.169449    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df\": container with ID starting with 42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df not found: ID does not exist" containerID="42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"
May 21 03:22:48.169519 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169472    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"} err="failed to get container status \"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df\": rpc error: code = NotFound desc = could not find container \"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df\": container with ID starting with 42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df not found: ID does not exist"
May 21 03:22:48.169519 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169488    2558 scope.go:117] "RemoveContainer" containerID="8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"
May 21 03:22:48.169724 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.169710    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9\": container with ID starting with 8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9 not found: ID does not exist" containerID="8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"
May 21 03:22:48.169765 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169728    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"} err="failed to get container status \"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9\": rpc error: code = NotFound desc = could not find container \"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9\": container with ID starting with 8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9 not found: ID does not exist"
May 21 03:22:48.169765 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.169741    2558 scope.go:117] "RemoveContainer" containerID="ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"
May 21 03:22:48.170029 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.170002    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6\": container with ID starting with ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6 not found: ID does not exist" containerID="ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"
May 21 03:22:48.170076 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170034    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"} err="failed to get container status \"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6\": rpc error: code = NotFound desc = could not find container \"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6\": container with ID starting with ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6 not found: ID does not exist"
May 21 03:22:48.170076 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170048    2558 scope.go:117] "RemoveContainer" containerID="0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"
May 21 03:22:48.170265 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.170240    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176\": container with ID starting with 0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176 not found: ID does not exist" containerID="0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"
May 21 03:22:48.170363 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170272    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"} err="failed to get container status \"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176\": rpc error: code = NotFound desc = could not find container \"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176\": container with ID starting with 0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176 not found: ID does not exist"
May 21 03:22:48.170363 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170293    2558 scope.go:117] "RemoveContainer" containerID="be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"
May 21 03:22:48.170488 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.170473    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44\": container with ID starting with be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44 not found: ID does not exist" containerID="be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"
May 21 03:22:48.170535 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170492    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"} err="failed to get container status \"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44\": rpc error: code = NotFound desc = could not find container \"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44\": container with ID starting with be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44 not found: ID does not exist"
May 21 03:22:48.170535 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170506    2558 scope.go:117] "RemoveContainer" containerID="607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"
May 21 03:22:48.170680 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:48.170664    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0\": container with ID starting with 607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0 not found: ID does not exist" containerID="607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"
May 21 03:22:48.170739 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170688    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"} err="failed to get container status \"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0\": rpc error: code = NotFound desc = could not find container \"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0\": container with ID starting with 607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0 not found: ID does not exist"
May 21 03:22:48.170739 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170709    2558 scope.go:117] "RemoveContainer" containerID="daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"
May 21 03:22:48.170921 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170903    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca"} err="failed to get container status \"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca\": rpc error: code = NotFound desc = could not find container \"daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca\": container with ID starting with daf0ffadfaa15c2e59151a46d3d87ad6989e518bb9216279ea4b7c748b6df5ca not found: ID does not exist"
May 21 03:22:48.170978 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.170921    2558 scope.go:117] "RemoveContainer" containerID="42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"
May 21 03:22:48.171146 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171128    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df"} err="failed to get container status \"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df\": rpc error: code = NotFound desc = could not find container \"42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df\": container with ID starting with 42bd6f9fa54f256e8c6b04313e19629ff5e93204d3539f21316531985380d0df not found: ID does not exist"
May 21 03:22:48.171195 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171147    2558 scope.go:117] "RemoveContainer" containerID="8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"
May 21 03:22:48.171326 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171306    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9"} err="failed to get container status \"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9\": rpc error: code = NotFound desc = could not find container \"8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9\": container with ID starting with 8d5998b4e68f2af5d7c74cc4ec9ee40982f94e22c6ca3042ee6cff06772939d9 not found: ID does not exist"
May 21 03:22:48.171371 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171328    2558 scope.go:117] "RemoveContainer" containerID="ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"
May 21 03:22:48.171534 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171516    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6"} err="failed to get container status \"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6\": rpc error: code = NotFound desc = could not find container \"ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6\": container with ID starting with ed4cc811a1bafaabeea4c65a05f4998d98af8e43dd83e55a381476efdc1fbcf6 not found: ID does not exist"
May 21 03:22:48.171577 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171536    2558 scope.go:117] "RemoveContainer" containerID="0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"
May 21 03:22:48.171761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171744    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176"} err="failed to get container status \"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176\": rpc error: code = NotFound desc = could not find container \"0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176\": container with ID starting with 0e78b1a93842f45f6a438fc44fa718aefeab5853f7b56ab069a5d9422268d176 not found: ID does not exist"
May 21 03:22:48.171824 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.171763    2558 scope.go:117] "RemoveContainer" containerID="be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"
May 21 03:22:48.172030 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.172013    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44"} err="failed to get container status \"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44\": rpc error: code = NotFound desc = could not find container \"be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44\": container with ID starting with be0b5e8e2e82870f69c06692c0534b8aa28d98eefae04b33de716048b4419b44 not found: ID does not exist"
May 21 03:22:48.172077 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.172033    2558 scope.go:117] "RemoveContainer" containerID="607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"
May 21 03:22:48.172253 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.172226    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0"} err="failed to get container status \"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0\": rpc error: code = NotFound desc = could not find container \"607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0\": container with ID starting with 607f093a23bd7c1497bf5994acbf6003d179343166064fcc05e24d31877680a0 not found: ID does not exist"
May 21 03:22:48.173019 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.173001    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.175422 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175408    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 03:22:48.175422 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175414    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 03:22:48.175671 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175649    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 03:22:48.175740 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175660    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 03:22:48.175740 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175662    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 03:22:48.175989 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.175973    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 03:22:48.176066 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.176051    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 03:22:48.176131 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.176054    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 03:22:48.176131 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.176102    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59sbt\""
May 21 03:22:48.180656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.180637    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 03:22:48.234056 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.233979    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:48.341915 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.341878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.341915 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.341919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-web-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.341940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvq4v\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-kube-api-access-vvq4v\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.341960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-out\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342215 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342215 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342215 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-volume\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342215 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342326 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342326 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.342326 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.342290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.442939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.442915    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-volume\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.442939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.442944    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.442967    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.442986    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443009    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443068    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443098    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-web-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443127    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvq4v\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-kube-api-access-vvq4v\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443159    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443204    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-out\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443259    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443324 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443297    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443363    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.443900 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.443840    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446490 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446386    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446490 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446386    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446639 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446489    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446639 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446490    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-web-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446639 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446820 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446800    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-volume\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446902 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446824    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.446980 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446962    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-config-out\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.447033 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.446963    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.448367 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.448351    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.451129 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.451112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvq4v\" (UniqueName: \"kubernetes.io/projected/eef4b5df-e1b2-4562-ae5a-e73652ee3aee-kube-api-access-vvq4v\") pod \"alertmanager-main-0\" (UID: \"eef4b5df-e1b2-4562-ae5a-e73652ee3aee\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.482618 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.482601    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 03:22:48.615991 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:48.615968    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 03:22:48.617709 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:22:48.617675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef4b5df_e1b2_4562_ae5a_e73652ee3aee.slice/crio-b3a4e7828268c4d244d6db5bf9ca92b783d86adbe2801d0b302db92edd0fd398 WatchSource:0}: Error finding container b3a4e7828268c4d244d6db5bf9ca92b783d86adbe2801d0b302db92edd0fd398: Status 404 returned error can't find the container with id b3a4e7828268c4d244d6db5bf9ca92b783d86adbe2801d0b302db92edd0fd398
May 21 03:22:49.116687 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:49.116652    2558 generic.go:358] "Generic (PLEG): container finished" podID="eef4b5df-e1b2-4562-ae5a-e73652ee3aee" containerID="01a6e9252057eb6a9b36306848554d80c2c5253338c0415e20c2f1edeb97c7a6" exitCode=0
May 21 03:22:49.117149 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:49.116742    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerDied","Data":"01a6e9252057eb6a9b36306848554d80c2c5253338c0415e20c2f1edeb97c7a6"}
May 21 03:22:49.117149 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:49.116790    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"b3a4e7828268c4d244d6db5bf9ca92b783d86adbe2801d0b302db92edd0fd398"}
May 21 03:22:49.416891 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:49.416836    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8efae4b5-ca05-445e-aba9-7b4a482b7605" path="/var/lib/kubelet/pods/8efae4b5-ca05-445e-aba9-7b4a482b7605/volumes"
May 21 03:22:50.124114 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124078    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"ea06e19143e57292885bdf0b89a0b7b151880c33e3aa725ab8d9f6eba189436c"}
May 21 03:22:50.124431 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124121    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"549b03e0174774e3523963c5811165d02ef7aa71cff1a5b6635308d2e7de45ec"}
May 21 03:22:50.124431 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124135    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"580a5277b816d214babecd49624da5c5729d28c4da750adcfba14c07bf0a24b0"}
May 21 03:22:50.124431 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124147    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"3918b4c17e1a57b703a803b1370e93fa5e351a1d27648b412a938d2292a88997"}
May 21 03:22:50.124431 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124158    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"070a1b8def877eeb39f263f3ad30003f93cae48f0ed8ab3cb51972dd4f00824c"}
May 21 03:22:50.124431 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.124170    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eef4b5df-e1b2-4562-ae5a-e73652ee3aee","Type":"ContainerStarted","Data":"721f75d02d73e2e5e1c686ee00788e8174bbc608ea31f4234f0a6951c5dc7e1d"}
May 21 03:22:50.150981 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.150920    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.15090164 podStartE2EDuration="2.15090164s" podCreationTimestamp="2026-05-21 03:22:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:22:50.150513349 +0000 UTC m=+159.371996414" watchObservedRunningTime="2026-05-21 03:22:50.15090164 +0000 UTC m=+159.372384681"
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.747697    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748317    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="prometheus" containerID="cri-o://12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f" gracePeriod=600
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748673    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-thanos" containerID="cri-o://eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3" gracePeriod=600
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748768    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy" containerID="cri-o://9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1" gracePeriod=600
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748833    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-web" containerID="cri-o://1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0" gracePeriod=600
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748917    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="thanos-sidecar" containerID="cri-o://b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c" gracePeriod=600
May 21 03:22:50.749053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:50.748973    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="config-reloader" containerID="cri-o://cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f" gracePeriod=600
May 21 03:22:51.013604 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.013569    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.130784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130753    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3" exitCode=0
May 21 03:22:51.130784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130774    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1" exitCode=0
May 21 03:22:51.130784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130782    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0" exitCode=0
May 21 03:22:51.130784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130788    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c" exitCode=0
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130795    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f" exitCode=0
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130805    2558 generic.go:358] "Generic (PLEG): container finished" podID="d83f8e8e-457c-4653-832d-15c4cef98888" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f" exitCode=0
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130896    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130939    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130952    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130962    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130970    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130970    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130978    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.130990    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d83f8e8e-457c-4653-832d-15c4cef98888","Type":"ContainerDied","Data":"b42526eff37b1a892333c62f3ed602f304d800266d3c9d5225431440005af569"}
May 21 03:22:51.131285 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.131006    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.140675 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.139968    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.147697 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.147673    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.154269 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.154250    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.160456 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.160440    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.164484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164467    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164559 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164496    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164559 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164512    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164559 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164543    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164708 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164658    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164708 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164696    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164735    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164814 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164772    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164813    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164879    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.164968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164908    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:51.164968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164922    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164983    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165009    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltbl\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.164916    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165057    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165113    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165143    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165179    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165206    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets\") pod \"d83f8e8e-457c-4653-832d-15c4cef98888\" (UID: \"d83f8e8e-457c-4653-832d-15c4cef98888\") "
May 21 03:22:51.165720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165489    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.165720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165509    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.165720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.165534    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:51.167218 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.167189    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 03:22:51.167635 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.167607    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:51.167819 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.167789    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.168235 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.168209    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:22:51.168458 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.168381    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.168578 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.168553    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:22:51.168924 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.168900    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.169101 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.169042    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.169696 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.169667    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out" (OuterVolumeSpecName: "config-out") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 03:22:51.169803 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.169778    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.170161 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.170133    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.170667 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.170643    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl" (OuterVolumeSpecName: "kube-api-access-8ltbl") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "kube-api-access-8ltbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:22:51.170755 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.170733    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.170985 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.170959    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config" (OuterVolumeSpecName: "config") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.171504 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.171479    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.176460 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.176441    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.181291 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.181270    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config" (OuterVolumeSpecName: "web-config") pod "d83f8e8e-457c-4653-832d-15c4cef98888" (UID: "d83f8e8e-457c-4653-832d-15c4cef98888"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 03:22:51.183031 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183009    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.183337 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.183304    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.183413 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183344    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.183413 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183362    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.183634 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.183616    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.183677 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183639    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.183677 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183664    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.183946 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.183923    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.184029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183945    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.184029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.183960    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.184209 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.184188    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.184250 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184218    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.184250 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184236    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.184456 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.184440    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.184506 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184459    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.184506 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184472    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.184693 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.184678    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.184733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184698    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.184733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184720    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.184960 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:22:51.184945    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.184999 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184964    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.184999 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.184976    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.185174 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185156    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.185219 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185176    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.185363 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185345    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.185400 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185364    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.185539 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185512    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.185539 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185538    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.185745 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185726    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.185745 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185746    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.185981 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185963    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.186027 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.185981    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.186198 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186179    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.186245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186198    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.186416 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186400    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.186462 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186417    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.186607 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186592    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.186607 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186606    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.186808 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186792    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.186879 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.186808    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.187016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187000    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.187109 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187016    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.187231 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187213    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.187231 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187230    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.187457 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187440    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.187502 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187458    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.187663 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187646    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.187663 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187662    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.187956 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187937    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.187956 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.187956    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.188167 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188151    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.188238 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188168    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.188395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188375    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.188395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188395    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.188610 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188592    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.188650 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188611    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.188834 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188818    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.188914 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.188834    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.189087 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189068    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.189087 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189086    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.189290 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189263    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.189328 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189293    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.189484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189460    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.189484 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189481    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.189710 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189680    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.189755 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189711    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.189947 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189930    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.189988 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.189948    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.190121 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.190177 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190122    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.190311 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190296    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.190311 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190310    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.190541 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190522    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.190612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190543    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.190763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190746    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.190804 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190764    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.190985 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190970    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.191029 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.190987    2558 scope.go:117] "RemoveContainer" containerID="eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"
May 21 03:22:51.191194 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191173    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3"} err="failed to get container status \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": rpc error: code = NotFound desc = could not find container \"eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3\": container with ID starting with eec317fc176e00713ea193160822810a08603da4cd680e707e35f6f45cbe17e3 not found: ID does not exist"
May 21 03:22:51.191238 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191194    2558 scope.go:117] "RemoveContainer" containerID="9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"
May 21 03:22:51.191407 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191392    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1"} err="failed to get container status \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": rpc error: code = NotFound desc = could not find container \"9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1\": container with ID starting with 9725719cc284bd6fb485fdb029ae287549872d96563c19c9272055d84a778bd1 not found: ID does not exist"
May 21 03:22:51.191446 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191407    2558 scope.go:117] "RemoveContainer" containerID="1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"
May 21 03:22:51.191606 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191588    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0"} err="failed to get container status \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": rpc error: code = NotFound desc = could not find container \"1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0\": container with ID starting with 1a5bd6985113d0481749f224d8c6f36e96d20735656381c28e533c9836f3cdc0 not found: ID does not exist"
May 21 03:22:51.191662 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191606    2558 scope.go:117] "RemoveContainer" containerID="b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"
May 21 03:22:51.191815 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191799    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c"} err="failed to get container status \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": rpc error: code = NotFound desc = could not find container \"b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c\": container with ID starting with b3d83d7662c31ee44d1fa940fa771a263075c0f67f07502f1e08be4fea18cc0c not found: ID does not exist"
May 21 03:22:51.191870 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.191816    2558 scope.go:117] "RemoveContainer" containerID="cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"
May 21 03:22:51.192022 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.192007    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f"} err="failed to get container status \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": rpc error: code = NotFound desc = could not find container \"cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f\": container with ID starting with cc3e178611893c9eb98b31edf5b7427d9cc5ffc7686bc72d76e1d065d17f578f not found: ID does not exist"
May 21 03:22:51.192068 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.192023    2558 scope.go:117] "RemoveContainer" containerID="12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"
May 21 03:22:51.192222 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.192199    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f"} err="failed to get container status \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": rpc error: code = NotFound desc = could not find container \"12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f\": container with ID starting with 12812f8de4298f4023926e3934b607ebd4881ca72ef6fab137a2ef521bbf133f not found: ID does not exist"
May 21 03:22:51.192263 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.192222    2558 scope.go:117] "RemoveContainer" containerID="498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"
May 21 03:22:51.192458 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.192435    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c"} err="failed to get container status \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": rpc error: code = NotFound desc = could not find container \"498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c\": container with ID starting with 498008aefde87648b761b9f21e5f5925eda10eeccfa4dfed60dfc87b289bdd0c not found: ID does not exist"
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266065    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-db\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266095    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-config\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266109    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-web-config\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266125    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltbl\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-kube-api-access-8ltbl\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266139    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266155    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-configmap-metrics-client-ca\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266170    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266186    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266200    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d83f8e8e-457c-4653-832d-15c4cef98888-tls-assets\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266215    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-metrics-client-certs\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266230    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-kube-rbac-proxy\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266261    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266294    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d83f8e8e-457c-4653-832d-15c4cef98888-secret-grpc-tls\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266311    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266326    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f8e8e-457c-4653-832d-15c4cef98888-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.266395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.266341    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d83f8e8e-457c-4653-832d-15c4cef98888-config-out\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:22:51.450713 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.450683    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:51.456042 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.456018    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:51.479974 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.479946    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:51.480270 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480253    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-thanos"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480273    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-thanos"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480286    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="prometheus"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480294    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="prometheus"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480309    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="init-config-reloader"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480318    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="init-config-reloader"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480328    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-web"
May 21 03:22:51.480336 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480336    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-web"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="thanos-sidecar"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480366    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="thanos-sidecar"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480376    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480383    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480402    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="config-reloader"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480411    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="config-reloader"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480482    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-web"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480496    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480509    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="thanos-sidecar"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480519    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="prometheus"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480529    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="config-reloader"
May 21 03:22:51.480656 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.480540    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" containerName="kube-rbac-proxy-thanos"
May 21 03:22:51.488385 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.488356    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.491459 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.491440    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 03:22:51.491796 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.491780    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 03:22:51.491896 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.491824    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 03:22:51.492147 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492004    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h2sh6\""
May 21 03:22:51.492147 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492057    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 03:22:51.492147 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492076    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 03:22:51.492147 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492131    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1l2fbunmgu443\""
May 21 03:22:51.492372 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492298    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 03:22:51.492372 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492333    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 03:22:51.492533 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492514    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 03:22:51.492968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492547    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 03:22:51.492968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492615    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 03:22:51.492968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.492678    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 03:22:51.494752 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.494733    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 03:22:51.498093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.498071    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:51.498880 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.498835    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 03:22:51.669564 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669564 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669564 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669727 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669727 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76rkm\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-kube-api-access-76rkm\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669727 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config-out\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669727 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669727 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669903 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669903 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669903 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.669903 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670012 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.669999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670119 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.670022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-web-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.670119 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.670041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.770937 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.770915    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.770959    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.770982    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771022    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771050 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771261 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-web-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771261 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771095    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771261 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771121    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771684 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771663    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771708    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771757    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771898 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771784    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76rkm\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-kube-api-access-76rkm\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771898 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771826    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config-out\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.771898 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771881    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.772048 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771908    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.772048 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771935    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.772486 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.771665    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.772583 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.772560    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.773068 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.772947    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.773234 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.773215    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.773319 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.773295    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.774763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.774221    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.774763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.774524    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.775616 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.775588    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b77dbe72-76c9-4b71-88d7-9d59bb3babec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.775694 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.775650    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.775759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.775689    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.776213 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.776181    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.776292 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.776242    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.776725 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.776699    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.776917 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.776894    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config-out\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.777638 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.777611    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.778054 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.778033    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-web-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.778418 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.778355    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.778498 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.778419    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-config\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.778935 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.778919    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b77dbe72-76c9-4b71-88d7-9d59bb3babec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.781770 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.781748    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76rkm\" (UniqueName: \"kubernetes.io/projected/b77dbe72-76c9-4b71-88d7-9d59bb3babec-kube-api-access-76rkm\") pod \"prometheus-k8s-0\" (UID: \"b77dbe72-76c9-4b71-88d7-9d59bb3babec\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.800780 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.800763    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:22:51.932643 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:51.932346    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 03:22:51.935667 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:22:51.935615    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77dbe72_76c9_4b71_88d7_9d59bb3babec.slice/crio-990e0cfb0082efd07330f8248c3f7c88767ce6ab7a460ce433aa4e01fb421828 WatchSource:0}: Error finding container 990e0cfb0082efd07330f8248c3f7c88767ce6ab7a460ce433aa4e01fb421828: Status 404 returned error can't find the container with id 990e0cfb0082efd07330f8248c3f7c88767ce6ab7a460ce433aa4e01fb421828
May 21 03:22:52.136860 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:52.136822    2558 generic.go:358] "Generic (PLEG): container finished" podID="b77dbe72-76c9-4b71-88d7-9d59bb3babec" containerID="c75481a599ce4fab47cc83e1ffa46374e7fb98cc115843514cf66cbe5fb7d20e" exitCode=0
May 21 03:22:52.137281 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:52.136943    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerDied","Data":"c75481a599ce4fab47cc83e1ffa46374e7fb98cc115843514cf66cbe5fb7d20e"}
May 21 03:22:52.137281 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:52.136984    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"990e0cfb0082efd07330f8248c3f7c88767ce6ab7a460ce433aa4e01fb421828"}
May 21 03:22:53.147602 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147570    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"23cf31d576e907f349f6623ae1ada69260d29351274b971b117ddf08e4a4d24c"}
May 21 03:22:53.147602 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147603    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"675b83c1cbf6a5faffbfabee4ecc3e01c3a9b7d555bb432e667e8aa50b817334"}
May 21 03:22:53.148028 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147612    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"82668f4c31c5350a454f9e5b282efdc8476955385734469cac16b8dd8910c7f2"}
May 21 03:22:53.148028 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147621    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"c0c79ed8d36fe1fe80a7e58906371366c46c2e41056b27ad035c1c7c85e65600"}
May 21 03:22:53.148028 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147629    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"a3938fe906e0b39d102f5ef7c4e9a6b90da77821202e48120baab5aca5a28753"}
May 21 03:22:53.148028 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.147636    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b77dbe72-76c9-4b71-88d7-9d59bb3babec","Type":"ContainerStarted","Data":"3c72e6ad0b0543c1f235749683650844b9cf9ba68f4cbb6d02367974924bde9e"}
May 21 03:22:53.175144 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.175101    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.17508739 podStartE2EDuration="2.17508739s" podCreationTimestamp="2026-05-21 03:22:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:22:53.1726278 +0000 UTC m=+162.394110840" watchObservedRunningTime="2026-05-21 03:22:53.17508739 +0000 UTC m=+162.396570430"
May 21 03:22:53.411839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:53.411754    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83f8e8e-457c-4653-832d-15c4cef98888" path="/var/lib/kubelet/pods/d83f8e8e-457c-4653-832d-15c4cef98888/volumes"
May 21 03:22:56.801597 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:22:56.801558    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:23:05.690778 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.690743    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b8qds"]
May 21 03:23:05.695362 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.695345    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.697800 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.697774    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 03:23:05.701901 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.701876    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8qds"]
May 21 03:23:05.785811 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.785779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-dbus\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.785968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.785837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-kubelet-config\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.785968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.785894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80643220-b6c2-46b4-9799-da8e36cee769-original-pull-secret\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.886524 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.886496    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-dbus\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.886618 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.886540    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-kubelet-config\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.886618 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.886557    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80643220-b6c2-46b4-9799-da8e36cee769-original-pull-secret\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.886705 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.886624    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-kubelet-config\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.886705 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.886659    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80643220-b6c2-46b4-9799-da8e36cee769-dbus\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:05.888950 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:05.888931    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80643220-b6c2-46b4-9799-da8e36cee769-original-pull-secret\") pod \"global-pull-secret-syncer-b8qds\" (UID: \"80643220-b6c2-46b4-9799-da8e36cee769\") " pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:06.005455 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:06.005433    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8qds"
May 21 03:23:06.128984 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:06.128953    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8qds"]
May 21 03:23:06.131750 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:23:06.131720    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80643220_b6c2_46b4_9799_da8e36cee769.slice/crio-cd2e7c5fe0fb74e379b0367c269aec894efee33afaf15726bf9e08d7798896ca WatchSource:0}: Error finding container cd2e7c5fe0fb74e379b0367c269aec894efee33afaf15726bf9e08d7798896ca: Status 404 returned error can't find the container with id cd2e7c5fe0fb74e379b0367c269aec894efee33afaf15726bf9e08d7798896ca
May 21 03:23:06.189332 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:06.189302    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8qds" event={"ID":"80643220-b6c2-46b4-9799-da8e36cee769","Type":"ContainerStarted","Data":"cd2e7c5fe0fb74e379b0367c269aec894efee33afaf15726bf9e08d7798896ca"}
May 21 03:23:10.205786 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:10.205749    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8qds" event={"ID":"80643220-b6c2-46b4-9799-da8e36cee769","Type":"ContainerStarted","Data":"aff1099d866f0527dc72d684273cbcd85057522b18b3f46789e8e9b8c98aa322"}
May 21 03:23:10.225632 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:10.225580    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8qds" podStartSLOduration=1.329055185 podStartE2EDuration="5.225566113s" podCreationTimestamp="2026-05-21 03:23:05 +0000 UTC" firstStartedPulling="2026-05-21 03:23:06.13382727 +0000 UTC m=+175.355310288" lastFinishedPulling="2026-05-21 03:23:10.030338191 +0000 UTC m=+179.251821216" observedRunningTime="2026-05-21 03:23:10.223502265 +0000 UTC m=+179.444985306" watchObservedRunningTime="2026-05-21 03:23:10.225566113 +0000 UTC m=+179.447049153"
May 21 03:23:51.801424 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:51.801391    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:23:51.817447 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:51.817415    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:23:52.351717 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:23:52.351691    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 03:24:04.792423 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.792385    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-m92c2"]
May 21 03:24:04.797079 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.797054    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.799519 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.799495    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 03:24:04.799643 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.799495    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dgt42\""
May 21 03:24:04.800786 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.800763    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 03:24:04.802595 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.802572    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-m92c2"]
May 21 03:24:04.856763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.856739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-bound-sa-token\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.856895 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.856782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpzr8\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-kube-api-access-cpzr8\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.957513 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.957489    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-bound-sa-token\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.957615 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.957528    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpzr8\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-kube-api-access-cpzr8\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.969239 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.969219    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-bound-sa-token\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:04.969506 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:04.969489    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpzr8\" (UniqueName: \"kubernetes.io/projected/d7626443-14f8-46ae-8ffc-bc66e5ada613-kube-api-access-cpzr8\") pod \"cert-manager-79c8d999ff-m92c2\" (UID: \"d7626443-14f8-46ae-8ffc-bc66e5ada613\") " pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:05.116968 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:05.116903    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-m92c2"
May 21 03:24:05.240734 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:05.240712    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-m92c2"]
May 21 03:24:05.243629 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:24:05.243599    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7626443_14f8_46ae_8ffc_bc66e5ada613.slice/crio-2479b0a5fc037de5bc59975afdb3555f5366b4a56b8e28e06c1a783f0e540ca8 WatchSource:0}: Error finding container 2479b0a5fc037de5bc59975afdb3555f5366b4a56b8e28e06c1a783f0e540ca8: Status 404 returned error can't find the container with id 2479b0a5fc037de5bc59975afdb3555f5366b4a56b8e28e06c1a783f0e540ca8
May 21 03:24:05.375206 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:05.375134    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-m92c2" event={"ID":"d7626443-14f8-46ae-8ffc-bc66e5ada613","Type":"ContainerStarted","Data":"2479b0a5fc037de5bc59975afdb3555f5366b4a56b8e28e06c1a783f0e540ca8"}
May 21 03:24:08.385809 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:08.385724    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-m92c2" event={"ID":"d7626443-14f8-46ae-8ffc-bc66e5ada613","Type":"ContainerStarted","Data":"c98b900b0d31f07a3dee30dd7800307b70807fff6148673d9d108e1b77242488"}
May 21 03:24:08.401515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:08.401462    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-m92c2" podStartSLOduration=1.594580455 podStartE2EDuration="4.401448513s" podCreationTimestamp="2026-05-21 03:24:04 +0000 UTC" firstStartedPulling="2026-05-21 03:24:05.245501196 +0000 UTC m=+234.466984213" lastFinishedPulling="2026-05-21 03:24:08.052369253 +0000 UTC m=+237.273852271" observedRunningTime="2026-05-21 03:24:08.399321445 +0000 UTC m=+237.620804486" watchObservedRunningTime="2026-05-21 03:24:08.401448513 +0000 UTC m=+237.622931552"
May 21 03:24:11.681831 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.681794    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"]
May 21 03:24:11.685524 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.685502    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.688076 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.688046    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 03:24:11.688333 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.688313    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 03:24:11.689312 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.689288    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 03:24:11.689414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.689313    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 03:24:11.689414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.689332    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 03:24:11.689414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.689288    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qlxqj\""
May 21 03:24:11.693535 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.693515    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"]
May 21 03:24:11.705485 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.705462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/476dd059-1d94-4815-8384-9073a5dc9274-manager-config\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.705573 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.705500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4ds\" (UniqueName: \"kubernetes.io/projected/476dd059-1d94-4815-8384-9073a5dc9274-kube-api-access-2b4ds\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.705573 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.705538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.705573 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.705561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.806408 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.806380    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4ds\" (UniqueName: \"kubernetes.io/projected/476dd059-1d94-4815-8384-9073a5dc9274-kube-api-access-2b4ds\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.806565 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.806436    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.806565 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.806456    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.806565 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.806502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/476dd059-1d94-4815-8384-9073a5dc9274-manager-config\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.807178 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.807146    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/476dd059-1d94-4815-8384-9073a5dc9274-manager-config\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.809142 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.809119    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.810614 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.810593    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/476dd059-1d94-4815-8384-9073a5dc9274-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.817552 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.817524    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4ds\" (UniqueName: \"kubernetes.io/projected/476dd059-1d94-4815-8384-9073a5dc9274-kube-api-access-2b4ds\") pod \"lws-controller-manager-79478bfc9c-68j4m\" (UID: \"476dd059-1d94-4815-8384-9073a5dc9274\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:11.995390 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:11.995367    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:12.118642 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:12.118622    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"]
May 21 03:24:12.120475 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:24:12.120445    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476dd059_1d94_4815_8384_9073a5dc9274.slice/crio-7aaf130cbed0d955b659706efff9ce17546f1116de8a9c8cc29f4a28c467e3d2 WatchSource:0}: Error finding container 7aaf130cbed0d955b659706efff9ce17546f1116de8a9c8cc29f4a28c467e3d2: Status 404 returned error can't find the container with id 7aaf130cbed0d955b659706efff9ce17546f1116de8a9c8cc29f4a28c467e3d2
May 21 03:24:12.397904 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:12.397796    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m" event={"ID":"476dd059-1d94-4815-8384-9073a5dc9274","Type":"ContainerStarted","Data":"7aaf130cbed0d955b659706efff9ce17546f1116de8a9c8cc29f4a28c467e3d2"}
May 21 03:24:15.411984 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:15.411943    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m" event={"ID":"476dd059-1d94-4815-8384-9073a5dc9274","Type":"ContainerStarted","Data":"1654f91db6d5084af1638a04a0f21c2c08aeda259e6bb99bd35fbdcf2bc122d6"}
May 21 03:24:15.412385 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:15.411993    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:15.426598 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:15.426546    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m" podStartSLOduration=2.035691288 podStartE2EDuration="4.426531284s" podCreationTimestamp="2026-05-21 03:24:11 +0000 UTC" firstStartedPulling="2026-05-21 03:24:12.122483616 +0000 UTC m=+241.343966641" lastFinishedPulling="2026-05-21 03:24:14.513323618 +0000 UTC m=+243.734806637" observedRunningTime="2026-05-21 03:24:15.424775944 +0000 UTC m=+244.646258985" watchObservedRunningTime="2026-05-21 03:24:15.426531284 +0000 UTC m=+244.648014323"
May 21 03:24:18.868490 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.868456    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"]
May 21 03:24:18.872446 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.872421    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:18.875901 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.875878    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 03:24:18.876018 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.875906    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 03:24:18.876176 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.876155    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 03:24:18.876295 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.876223    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 03:24:18.876386 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.876353    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rz5x\""
May 21 03:24:18.885328 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.885305    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"]
May 21 03:24:18.964408 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.964382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:18.964523 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.964425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:18.964523 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:18.964467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5sd9\" (UniqueName: \"kubernetes.io/projected/1cb097ef-2985-458d-ba25-30e95a2f4b24-kube-api-access-s5sd9\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.065652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.065625    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.065759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.065662    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5sd9\" (UniqueName: \"kubernetes.io/projected/1cb097ef-2985-458d-ba25-30e95a2f4b24-kube-api-access-s5sd9\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.065759 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.065717    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.068169 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.068150    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.068256 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.068201    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb097ef-2985-458d-ba25-30e95a2f4b24-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.073560 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.073540    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5sd9\" (UniqueName: \"kubernetes.io/projected/1cb097ef-2985-458d-ba25-30e95a2f4b24-kube-api-access-s5sd9\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-wxkjs\" (UID: \"1cb097ef-2985-458d-ba25-30e95a2f4b24\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.182878 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.182788    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:19.324021 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.323992    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"]
May 21 03:24:19.328102 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:24:19.328077    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb097ef_2985_458d_ba25_30e95a2f4b24.slice/crio-7259fb3704dd9ecff09adb87ae554518d78bf76e2574ccda79acd39047ae7228 WatchSource:0}: Error finding container 7259fb3704dd9ecff09adb87ae554518d78bf76e2574ccda79acd39047ae7228: Status 404 returned error can't find the container with id 7259fb3704dd9ecff09adb87ae554518d78bf76e2574ccda79acd39047ae7228
May 21 03:24:19.422223 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:19.422192    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs" event={"ID":"1cb097ef-2985-458d-ba25-30e95a2f4b24","Type":"ContainerStarted","Data":"7259fb3704dd9ecff09adb87ae554518d78bf76e2574ccda79acd39047ae7228"}
May 21 03:24:22.434200 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:22.434164    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs" event={"ID":"1cb097ef-2985-458d-ba25-30e95a2f4b24","Type":"ContainerStarted","Data":"eadb8dc6a256d814122f15959cc0f7c1f8ab69e6f0f00bb70b32941337763b82"}
May 21 03:24:22.434746 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:22.434332    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:22.455314 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:22.455269    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs" podStartSLOduration=1.9823543369999999 podStartE2EDuration="4.455256332s" podCreationTimestamp="2026-05-21 03:24:18 +0000 UTC" firstStartedPulling="2026-05-21 03:24:19.329899632 +0000 UTC m=+248.551382650" lastFinishedPulling="2026-05-21 03:24:21.802801624 +0000 UTC m=+251.024284645" observedRunningTime="2026-05-21 03:24:22.452716876 +0000 UTC m=+251.674199939" watchObservedRunningTime="2026-05-21 03:24:22.455256332 +0000 UTC m=+251.676739372"
May 21 03:24:26.415580 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:26.415494    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-68j4m"
May 21 03:24:33.438707 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:33.438679    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-wxkjs"
May 21 03:24:42.203319 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.203290    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-hb92j"]
May 21 03:24:42.250116 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.250076    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-hb92j"]
May 21 03:24:42.250248 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.250152    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.252797 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.252777    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 03:24:42.253963 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.253945    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 03:24:42.254066 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.253970    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bnxsw\""
May 21 03:24:42.254294 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.254267    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 03:24:42.254403 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.254298    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 03:24:42.355522 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.355497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28247289-774f-44e7-9719-5d3c47356096-tmp\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.355649 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.355538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28247289-774f-44e7-9719-5d3c47356096-tls-certs\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.355649 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.355635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkn9\" (UniqueName: \"kubernetes.io/projected/28247289-774f-44e7-9719-5d3c47356096-kube-api-access-qnkn9\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.456837 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.456779    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28247289-774f-44e7-9719-5d3c47356096-tmp\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.456837 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.456813    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28247289-774f-44e7-9719-5d3c47356096-tls-certs\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.456982 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.456890    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkn9\" (UniqueName: \"kubernetes.io/projected/28247289-774f-44e7-9719-5d3c47356096-kube-api-access-qnkn9\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.458988 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.458963    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28247289-774f-44e7-9719-5d3c47356096-tmp\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.459227 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.459210    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28247289-774f-44e7-9719-5d3c47356096-tls-certs\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.464503 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.464479    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkn9\" (UniqueName: \"kubernetes.io/projected/28247289-774f-44e7-9719-5d3c47356096-kube-api-access-qnkn9\") pod \"kube-auth-proxy-5749999c66-hb92j\" (UID: \"28247289-774f-44e7-9719-5d3c47356096\") " pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.559470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.559439    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j"
May 21 03:24:42.683515 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:42.683415    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5749999c66-hb92j"]
May 21 03:24:42.686400 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:24:42.686370    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28247289_774f_44e7_9719_5d3c47356096.slice/crio-44d2e52bf1a9739fe801d186dfa46ad88bc59a233f863c04f25c99d13f71a40d WatchSource:0}: Error finding container 44d2e52bf1a9739fe801d186dfa46ad88bc59a233f863c04f25c99d13f71a40d: Status 404 returned error can't find the container with id 44d2e52bf1a9739fe801d186dfa46ad88bc59a233f863c04f25c99d13f71a40d
May 21 03:24:43.498612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:43.498569    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j" event={"ID":"28247289-774f-44e7-9719-5d3c47356096","Type":"ContainerStarted","Data":"44d2e52bf1a9739fe801d186dfa46ad88bc59a233f863c04f25c99d13f71a40d"}
May 21 03:24:46.510471 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:46.510435    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j" event={"ID":"28247289-774f-44e7-9719-5d3c47356096","Type":"ContainerStarted","Data":"4583be9835325a622132b4ec15d34928dcf8389023dec7151c6fe64e70971c80"}
May 21 03:24:46.526467 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:24:46.526417    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5749999c66-hb92j" podStartSLOduration=1.612438237 podStartE2EDuration="4.526402755s" podCreationTimestamp="2026-05-21 03:24:42 +0000 UTC" firstStartedPulling="2026-05-21 03:24:42.688632532 +0000 UTC m=+271.910115554" lastFinishedPulling="2026-05-21 03:24:45.602597055 +0000 UTC m=+274.824080072" observedRunningTime="2026-05-21 03:24:46.525386487 +0000 UTC m=+275.746869530" watchObservedRunningTime="2026-05-21 03:24:46.526402755 +0000 UTC m=+275.747885837"
May 21 03:25:11.302470 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:25:11.302444    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 21 03:27:26.364028 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.363953    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:26.367205 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.367190    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.369684 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.369655    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 03:27:26.369802 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.369687    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 03:27:26.369802 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.369687    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2trq2\""
May 21 03:27:26.371165 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.370916    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 03:27:26.373246 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.373226    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:26.466031 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.465999    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:26.478859 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.478827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.478978 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.478904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lc6b\" (UniqueName: \"kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.580266 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.580241    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.580380 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.580310    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lc6b\" (UniqueName: \"kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.581051 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.581014    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.587912 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.587888    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lc6b\" (UniqueName: \"kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b\") pod \"limitador-limitador-7d549b5b-87ll5\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") " pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.678411 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.678347    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:26.809673 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.809648    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:26.811954 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:27:26.811923    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cd2125_b2e9_4088_b722_12b166c3350b.slice/crio-9b718484651d4b2574ab25e19ab0cf56b267a56676a3f9f8abfd3b51c237884d WatchSource:0}: Error finding container 9b718484651d4b2574ab25e19ab0cf56b267a56676a3f9f8abfd3b51c237884d: Status 404 returned error can't find the container with id 9b718484651d4b2574ab25e19ab0cf56b267a56676a3f9f8abfd3b51c237884d
May 21 03:27:26.813930 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:26.813906    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 03:27:27.034941 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:27.034908    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" event={"ID":"57cd2125-b2e9-4088-b722-12b166c3350b","Type":"ContainerStarted","Data":"9b718484651d4b2574ab25e19ab0cf56b267a56676a3f9f8abfd3b51c237884d"}
May 21 03:27:30.046264 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:30.046231    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" event={"ID":"57cd2125-b2e9-4088-b722-12b166c3350b","Type":"ContainerStarted","Data":"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"}
May 21 03:27:30.046619 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:30.046338    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:30.062036 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:30.061996    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" podStartSLOduration=1.2858264130000001 podStartE2EDuration="4.061984685s" podCreationTimestamp="2026-05-21 03:27:26 +0000 UTC" firstStartedPulling="2026-05-21 03:27:26.814107521 +0000 UTC m=+436.035590553" lastFinishedPulling="2026-05-21 03:27:29.590265805 +0000 UTC m=+438.811748825" observedRunningTime="2026-05-21 03:27:30.060717965 +0000 UTC m=+439.282201026" watchObservedRunningTime="2026-05-21 03:27:30.061984685 +0000 UTC m=+439.283467770"
May 21 03:27:41.051463 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:41.051433    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:41.357094 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:41.357013    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:41.357241 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:41.357203    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" podUID="57cd2125-b2e9-4088-b722-12b166c3350b" containerName="limitador" containerID="cri-o://af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94" gracePeriod=30
May 21 03:27:41.902715 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:41.902694    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:42.008093 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.008070    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file\") pod \"57cd2125-b2e9-4088-b722-12b166c3350b\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") "
May 21 03:27:42.008239 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.008138    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lc6b\" (UniqueName: \"kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b\") pod \"57cd2125-b2e9-4088-b722-12b166c3350b\" (UID: \"57cd2125-b2e9-4088-b722-12b166c3350b\") "
May 21 03:27:42.008408 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.008386    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file" (OuterVolumeSpecName: "config-file") pod "57cd2125-b2e9-4088-b722-12b166c3350b" (UID: "57cd2125-b2e9-4088-b722-12b166c3350b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 03:27:42.010423 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.010399    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b" (OuterVolumeSpecName: "kube-api-access-9lc6b") pod "57cd2125-b2e9-4088-b722-12b166c3350b" (UID: "57cd2125-b2e9-4088-b722-12b166c3350b"). InnerVolumeSpecName "kube-api-access-9lc6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:27:42.087829 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.087798    2558 generic.go:358] "Generic (PLEG): container finished" podID="57cd2125-b2e9-4088-b722-12b166c3350b" containerID="af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94" exitCode=0
May 21 03:27:42.088170 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.087895    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5"
May 21 03:27:42.088170 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.087904    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" event={"ID":"57cd2125-b2e9-4088-b722-12b166c3350b","Type":"ContainerDied","Data":"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"}
May 21 03:27:42.088170 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.087947    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-87ll5" event={"ID":"57cd2125-b2e9-4088-b722-12b166c3350b","Type":"ContainerDied","Data":"9b718484651d4b2574ab25e19ab0cf56b267a56676a3f9f8abfd3b51c237884d"}
May 21 03:27:42.088170 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.087964    2558 scope.go:117] "RemoveContainer" containerID="af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"
May 21 03:27:42.096325 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.096310    2558 scope.go:117] "RemoveContainer" containerID="af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"
May 21 03:27:42.096591 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:27:42.096571    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94\": container with ID starting with af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94 not found: ID does not exist" containerID="af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"
May 21 03:27:42.096653 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.096598    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94"} err="failed to get container status \"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94\": rpc error: code = NotFound desc = could not find container \"af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94\": container with ID starting with af6b878eb47583d94224a94088348f8140e4ac7a62b16211645d4e539d643e94 not found: ID does not exist"
May 21 03:27:42.108700 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.108676    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:42.108798 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.108711    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57cd2125-b2e9-4088-b722-12b166c3350b-config-file\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:27:42.108798 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.108730    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lc6b\" (UniqueName: \"kubernetes.io/projected/57cd2125-b2e9-4088-b722-12b166c3350b-kube-api-access-9lc6b\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:27:42.110344 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:42.110323    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-87ll5"]
May 21 03:27:43.412457 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:43.412420    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57cd2125-b2e9-4088-b722-12b166c3350b" path="/var/lib/kubelet/pods/57cd2125-b2e9-4088-b722-12b166c3350b/volumes"
May 21 03:27:46.210111 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.210071    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mx5gg"]
May 21 03:27:46.210611 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.210591    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cd2125-b2e9-4088-b722-12b166c3350b" containerName="limitador"
May 21 03:27:46.210692 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.210614    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cd2125-b2e9-4088-b722-12b166c3350b" containerName="limitador"
May 21 03:27:46.210748 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.210720    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="57cd2125-b2e9-4088-b722-12b166c3350b" containerName="limitador"
May 21 03:27:46.215609 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.215584    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.218321 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.218294    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 03:27:46.218570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.218541    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t6pqc\""
May 21 03:27:46.220514 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.220491    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mx5gg"]
May 21 03:27:46.341027 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.341000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-data\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.341187 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.341045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zlf5\" (UniqueName: \"kubernetes.io/projected/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-kube-api-access-7zlf5\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.442187 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.442157    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-data\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.442314 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.442201    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zlf5\" (UniqueName: \"kubernetes.io/projected/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-kube-api-access-7zlf5\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.442539 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.442521    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-data\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.450086 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.450061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zlf5\" (UniqueName: \"kubernetes.io/projected/046d9f07-5bc9-49a8-9803-4d6bea09d3e5-kube-api-access-7zlf5\") pod \"postgres-68c4fbbd6f-mx5gg\" (UID: \"046d9f07-5bc9-49a8-9803-4d6bea09d3e5\") " pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.527610 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.527590    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:46.654243 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:46.654219    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mx5gg"]
May 21 03:27:46.656903 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:27:46.656871    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046d9f07_5bc9_49a8_9803_4d6bea09d3e5.slice/crio-7c831228f1c4ae12702af92ee7a01fbeeab239a2c80e5176e5d770ffc844dd55 WatchSource:0}: Error finding container 7c831228f1c4ae12702af92ee7a01fbeeab239a2c80e5176e5d770ffc844dd55: Status 404 returned error can't find the container with id 7c831228f1c4ae12702af92ee7a01fbeeab239a2c80e5176e5d770ffc844dd55
May 21 03:27:47.105896 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:47.105863    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mx5gg" event={"ID":"046d9f07-5bc9-49a8-9803-4d6bea09d3e5","Type":"ContainerStarted","Data":"7c831228f1c4ae12702af92ee7a01fbeeab239a2c80e5176e5d770ffc844dd55"}
May 21 03:27:52.124572 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:52.124535    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mx5gg" event={"ID":"046d9f07-5bc9-49a8-9803-4d6bea09d3e5","Type":"ContainerStarted","Data":"b34fbb968c41c6dcca697aa886e749edeacf172f13b04ca10ac243e1fbff5049"}
May 21 03:27:52.124962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:52.124660    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:27:52.139567 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:52.139517    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-mx5gg" podStartSLOduration=0.834990389 podStartE2EDuration="6.139504774s" podCreationTimestamp="2026-05-21 03:27:46 +0000 UTC" firstStartedPulling="2026-05-21 03:27:46.658142039 +0000 UTC m=+455.879625056" lastFinishedPulling="2026-05-21 03:27:51.962656419 +0000 UTC m=+461.184139441" observedRunningTime="2026-05-21 03:27:52.138747485 +0000 UTC m=+461.360230538" watchObservedRunningTime="2026-05-21 03:27:52.139504774 +0000 UTC m=+461.360987814"
May 21 03:27:58.157534 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:27:58.157497    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-mx5gg"
May 21 03:28:03.419930 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.419897    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mbj6r"]
May 21 03:28:03.480092 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.480056    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mbj6r"]
May 21 03:28:03.480234 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.480125    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:03.483091 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.483066    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h48fc\""
May 21 03:28:03.483232 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.483112    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 03:28:03.584089 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.584055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrl27\" (UniqueName: \"kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27\") pod \"maas-controller-68fb5d86bc-mbj6r\" (UID: \"896e6c2d-90fa-4196-98cf-e7397850285e\") " pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:03.685462 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.685398    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrl27\" (UniqueName: \"kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27\") pod \"maas-controller-68fb5d86bc-mbj6r\" (UID: \"896e6c2d-90fa-4196-98cf-e7397850285e\") " pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:03.689087 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.689068    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mbj6r"]
May 21 03:28:03.689268 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:28:03.689251    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rrl27], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-68fb5d86bc-mbj6r" podUID="896e6c2d-90fa-4196-98cf-e7397850285e"
May 21 03:28:03.697021 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:03.696994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrl27\" (UniqueName: \"kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27\") pod \"maas-controller-68fb5d86bc-mbj6r\" (UID: \"896e6c2d-90fa-4196-98cf-e7397850285e\") " pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:04.163731 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:04.163699    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:04.168879 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:04.168839    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:04.291228 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:04.291199    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrl27\" (UniqueName: \"kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27\") pod \"896e6c2d-90fa-4196-98cf-e7397850285e\" (UID: \"896e6c2d-90fa-4196-98cf-e7397850285e\") "
May 21 03:28:04.293366 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:04.293340    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27" (OuterVolumeSpecName: "kube-api-access-rrl27") pod "896e6c2d-90fa-4196-98cf-e7397850285e" (UID: "896e6c2d-90fa-4196-98cf-e7397850285e"). InnerVolumeSpecName "kube-api-access-rrl27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:28:04.391721 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:04.391696    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrl27\" (UniqueName: \"kubernetes.io/projected/896e6c2d-90fa-4196-98cf-e7397850285e-kube-api-access-rrl27\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:28:05.166822 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:05.166791    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mbj6r"
May 21 03:28:05.194993 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:05.194967    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mbj6r"]
May 21 03:28:05.198589 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:05.198562    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mbj6r"]
May 21 03:28:05.413456 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:05.413414    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="896e6c2d-90fa-4196-98cf-e7397850285e" path="/var/lib/kubelet/pods/896e6c2d-90fa-4196-98cf-e7397850285e/volumes"
May 21 03:28:18.333733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.333686    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:28:18.353513 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.353489    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:28:18.353655 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.353590    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:18.356220 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.356199    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 03:28:18.356337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.356227    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h48fc\""
May 21 03:28:18.398589 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.398559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5fh\" (UniqueName: \"kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh\") pod \"maas-controller-54b789f958-2m4sg\" (UID: \"494cc66d-4851-47e6-b816-5ac6b5080a66\") " pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:18.499481 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.499344    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5fh\" (UniqueName: \"kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh\") pod \"maas-controller-54b789f958-2m4sg\" (UID: \"494cc66d-4851-47e6-b816-5ac6b5080a66\") " pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:18.507112 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.507090    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5fh\" (UniqueName: \"kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh\") pod \"maas-controller-54b789f958-2m4sg\" (UID: \"494cc66d-4851-47e6-b816-5ac6b5080a66\") " pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:18.666778 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.666699    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:18.795783 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:18.795758    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:28:18.798063 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:28:18.798036    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494cc66d_4851_47e6_b816_5ac6b5080a66.slice/crio-cb8e0e0f34a72e6ca9c4928fab84489a1ef68eb66aa17e22991c6f1b412dbfc9 WatchSource:0}: Error finding container cb8e0e0f34a72e6ca9c4928fab84489a1ef68eb66aa17e22991c6f1b412dbfc9: Status 404 returned error can't find the container with id cb8e0e0f34a72e6ca9c4928fab84489a1ef68eb66aa17e22991c6f1b412dbfc9
May 21 03:28:19.218107 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:19.218067    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-2m4sg" event={"ID":"494cc66d-4851-47e6-b816-5ac6b5080a66","Type":"ContainerStarted","Data":"cb8e0e0f34a72e6ca9c4928fab84489a1ef68eb66aa17e22991c6f1b412dbfc9"}
May 21 03:28:21.226962 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:21.226919    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-2m4sg" event={"ID":"494cc66d-4851-47e6-b816-5ac6b5080a66","Type":"ContainerStarted","Data":"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"}
May 21 03:28:21.227346 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:21.227061    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:28:21.243208 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:21.243162    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54b789f958-2m4sg" podStartSLOduration=1.031757193 podStartE2EDuration="3.243148323s" podCreationTimestamp="2026-05-21 03:28:18 +0000 UTC" firstStartedPulling="2026-05-21 03:28:18.799795874 +0000 UTC m=+488.021278892" lastFinishedPulling="2026-05-21 03:28:21.011187002 +0000 UTC m=+490.232670022" observedRunningTime="2026-05-21 03:28:21.241926862 +0000 UTC m=+490.463409903" watchObservedRunningTime="2026-05-21 03:28:21.243148323 +0000 UTC m=+490.464631363"
May 21 03:28:32.236461 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:28:32.236432    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:29:08.793223 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.793146    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"]
May 21 03:29:08.796834 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.796817    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.800798 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.800656    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rnlvz\""
May 21 03:29:08.800955 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.800900    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 03:29:08.800955 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.800906    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 03:29:08.801191 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.801170    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 03:29:08.802812 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.802788    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"]
May 21 03:29:08.818177 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.818287 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.818287 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.818408 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.818408 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jltzx\" (UniqueName: \"kubernetes.io/projected/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kube-api-access-jltzx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.818506 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.818416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919300 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919274    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919415 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919303    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919415 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919338    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919415 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919365    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919415 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919382    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jltzx\" (UniqueName: \"kubernetes.io/projected/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kube-api-access-jltzx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919415 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919406    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919838 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919806    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919872    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.919952 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.919894    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.921717 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.921695    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.922017 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.921997    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:08.927317 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:08.927297    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jltzx\" (UniqueName: \"kubernetes.io/projected/e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f-kube-api-access-jltzx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xngmr\" (UID: \"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:09.107928 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:09.107873    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:09.235687 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:09.235660    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"]
May 21 03:29:09.238076 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:29:09.238048    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57c4e11_f3f4_4fba_8bb9_6157d6ceec7f.slice/crio-47838fbc6b6f27daf21b9c82fb0c42ec1fa06207678448a86d5914c6bfd3bd8e WatchSource:0}: Error finding container 47838fbc6b6f27daf21b9c82fb0c42ec1fa06207678448a86d5914c6bfd3bd8e: Status 404 returned error can't find the container with id 47838fbc6b6f27daf21b9c82fb0c42ec1fa06207678448a86d5914c6bfd3bd8e
May 21 03:29:09.385562 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:09.385482    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr" event={"ID":"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f","Type":"ContainerStarted","Data":"47838fbc6b6f27daf21b9c82fb0c42ec1fa06207678448a86d5914c6bfd3bd8e"}
May 21 03:29:15.418976 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:15.418899    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr" event={"ID":"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f","Type":"ContainerStarted","Data":"f0f9fdae5b8964d688230bce89117fa5427545f5ee4fe64f5f5b33dbcf074589"}
May 21 03:29:20.426245 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:20.426213    2558 generic.go:358] "Generic (PLEG): container finished" podID="e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f" containerID="f0f9fdae5b8964d688230bce89117fa5427545f5ee4fe64f5f5b33dbcf074589" exitCode=0
May 21 03:29:20.426570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:20.426258    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr" event={"ID":"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f","Type":"ContainerDied","Data":"f0f9fdae5b8964d688230bce89117fa5427545f5ee4fe64f5f5b33dbcf074589"}
May 21 03:29:22.436254 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:22.436208    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr" event={"ID":"e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f","Type":"ContainerStarted","Data":"11330d1272b61bbdcb83c62d27f804b56f6bec2260b80f66807f281821581940"}
May 21 03:29:22.436654 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:22.436458    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:22.457435 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:22.457385    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr" podStartSLOduration=2.198436953 podStartE2EDuration="14.457372093s" podCreationTimestamp="2026-05-21 03:29:08 +0000 UTC" firstStartedPulling="2026-05-21 03:29:09.239816274 +0000 UTC m=+538.461299292" lastFinishedPulling="2026-05-21 03:29:21.498751415 +0000 UTC m=+550.720234432" observedRunningTime="2026-05-21 03:29:22.455178327 +0000 UTC m=+551.676661376" watchObservedRunningTime="2026-05-21 03:29:22.457372093 +0000 UTC m=+551.678855132"
May 21 03:29:32.168153 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.168116    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"]
May 21 03:29:32.175020 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.175001    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.177554 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.177530    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 03:29:32.180669 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.180641    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"]
May 21 03:29:32.320394 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.320551 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72x7q\" (UniqueName: \"kubernetes.io/projected/c7608918-8601-46e0-b974-997985d1212f-kube-api-access-72x7q\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.320551 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7608918-8601-46e0-b974-997985d1212f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.320652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.320652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.320652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.320623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421481 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421415    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421481 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421465    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72x7q\" (UniqueName: \"kubernetes.io/projected/c7608918-8601-46e0-b974-997985d1212f-kube-api-access-72x7q\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421489    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7608918-8601-46e0-b974-997985d1212f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421525    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421543    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421652 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421566    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421885 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421836    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.421931 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421875    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.422005 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.421987    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.423762 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.423741    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7608918-8601-46e0-b974-997985d1212f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.424040 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.424023    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7608918-8601-46e0-b974-997985d1212f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.429510 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.429486    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72x7q\" (UniqueName: \"kubernetes.io/projected/c7608918-8601-46e0-b974-997985d1212f-kube-api-access-72x7q\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt\" (UID: \"c7608918-8601-46e0-b974-997985d1212f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.486530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.486497    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:32.615174 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:32.615151    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"]
May 21 03:29:32.617689 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:29:32.617662    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7608918_8601_46e0_b974_997985d1212f.slice/crio-cb837a4c5593f28be999c6af0cebab2bcd70e8b2428949a87adde68ca557b9b1 WatchSource:0}: Error finding container cb837a4c5593f28be999c6af0cebab2bcd70e8b2428949a87adde68ca557b9b1: Status 404 returned error can't find the container with id cb837a4c5593f28be999c6af0cebab2bcd70e8b2428949a87adde68ca557b9b1
May 21 03:29:33.452072 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:33.452043    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xngmr"
May 21 03:29:33.470649 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:33.470610    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt" event={"ID":"c7608918-8601-46e0-b974-997985d1212f","Type":"ContainerStarted","Data":"27bb4fcbfb26df01ec805f30fe8007dcfb6c2f7f8eb87abe074fa41f506aa0bf"}
May 21 03:29:33.470649 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:33.470651    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt" event={"ID":"c7608918-8601-46e0-b974-997985d1212f","Type":"ContainerStarted","Data":"cb837a4c5593f28be999c6af0cebab2bcd70e8b2428949a87adde68ca557b9b1"}
May 21 03:29:38.488317 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:38.488286    2558 generic.go:358] "Generic (PLEG): container finished" podID="c7608918-8601-46e0-b974-997985d1212f" containerID="27bb4fcbfb26df01ec805f30fe8007dcfb6c2f7f8eb87abe074fa41f506aa0bf" exitCode=0
May 21 03:29:38.488689 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:38.488351    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt" event={"ID":"c7608918-8601-46e0-b974-997985d1212f","Type":"ContainerDied","Data":"27bb4fcbfb26df01ec805f30fe8007dcfb6c2f7f8eb87abe074fa41f506aa0bf"}
May 21 03:29:39.172660 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.172621    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"]
May 21 03:29:39.176212 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.176196    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.178634 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.178614    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 03:29:39.183986 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.183963    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"]
May 21 03:29:39.286196 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.286337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.286337 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.286420 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.286420 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6brk\" (UniqueName: \"kubernetes.io/projected/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kube-api-access-r6brk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.286495 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.286447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd26c94-89a9-4868-bb42-fdf2d031d61e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.387920 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.387883    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388090 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.387966    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388090 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.387985    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388090 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388013    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388090 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388032    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6brk\" (UniqueName: \"kubernetes.io/projected/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kube-api-access-r6brk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388301 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388094    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd26c94-89a9-4868-bb42-fdf2d031d61e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388405 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388373    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388482 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388389    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.388482 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.388421    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.390432 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.390406    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dd26c94-89a9-4868-bb42-fdf2d031d61e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.390674 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.390656    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dd26c94-89a9-4868-bb42-fdf2d031d61e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.399046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.399018    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6brk\" (UniqueName: \"kubernetes.io/projected/7dd26c94-89a9-4868-bb42-fdf2d031d61e-kube-api-access-r6brk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8\" (UID: \"7dd26c94-89a9-4868-bb42-fdf2d031d61e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.486414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.486334    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:39.495355 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.495312    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt" event={"ID":"c7608918-8601-46e0-b974-997985d1212f","Type":"ContainerStarted","Data":"396816a91c301b011c8c20bc8f2fd46bdd564c61c23beddb4136ae325b4f1f16"}
May 21 03:29:39.495686 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.495624    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:39.514746 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.514686    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt" podStartSLOduration=7.324391078 podStartE2EDuration="7.514659908s" podCreationTimestamp="2026-05-21 03:29:32 +0000 UTC" firstStartedPulling="2026-05-21 03:29:38.488957771 +0000 UTC m=+567.710440789" lastFinishedPulling="2026-05-21 03:29:38.679226602 +0000 UTC m=+567.900709619" observedRunningTime="2026-05-21 03:29:39.512750435 +0000 UTC m=+568.734233474" watchObservedRunningTime="2026-05-21 03:29:39.514659908 +0000 UTC m=+568.736142948"
May 21 03:29:39.620343 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:39.620277    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"]
May 21 03:29:39.623098 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:29:39.623073    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd26c94_89a9_4868_bb42_fdf2d031d61e.slice/crio-9e3e08657f9d77c6a22d6b97e197af4ce7e363df841c7c6bff117fdd54bcc626 WatchSource:0}: Error finding container 9e3e08657f9d77c6a22d6b97e197af4ce7e363df841c7c6bff117fdd54bcc626: Status 404 returned error can't find the container with id 9e3e08657f9d77c6a22d6b97e197af4ce7e363df841c7c6bff117fdd54bcc626
May 21 03:29:40.501141 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:40.501107    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8" event={"ID":"7dd26c94-89a9-4868-bb42-fdf2d031d61e","Type":"ContainerStarted","Data":"171d44c96af0f774d5113ef06b2fa300f6119896de6130e9b5bbd88bc976e6ca"}
May 21 03:29:40.501646 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:40.501149    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8" event={"ID":"7dd26c94-89a9-4868-bb42-fdf2d031d61e","Type":"ContainerStarted","Data":"9e3e08657f9d77c6a22d6b97e197af4ce7e363df841c7c6bff117fdd54bcc626"}
May 21 03:29:42.179579 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.179545    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"]
May 21 03:29:42.183023 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.183002    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.185437 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.185414    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 03:29:42.192361 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.192341    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"]
May 21 03:29:42.315935 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.315901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.316104 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.315999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.316104 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.316026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674f2fcc-8f53-4fd2-94dc-433779d3f181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.316277 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.316130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.316277 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.316178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzdv\" (UniqueName: \"kubernetes.io/projected/674f2fcc-8f53-4fd2-94dc-433779d3f181-kube-api-access-pgzdv\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.316277 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.316209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417282 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417246    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417282 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417286    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674f2fcc-8f53-4fd2-94dc-433779d3f181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417502 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417324    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417502 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417348    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzdv\" (UniqueName: \"kubernetes.io/projected/674f2fcc-8f53-4fd2-94dc-433779d3f181-kube-api-access-pgzdv\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417502 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417366    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.417650 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.417510    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.418185 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.418109    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.418331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.418283    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.418331 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.418319    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.426010 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.425982    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzdv\" (UniqueName: \"kubernetes.io/projected/674f2fcc-8f53-4fd2-94dc-433779d3f181-kube-api-access-pgzdv\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.428452 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.428425    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674f2fcc-8f53-4fd2-94dc-433779d3f181-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.429525 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.429500    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674f2fcc-8f53-4fd2-94dc-433779d3f181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw\" (UID: \"674f2fcc-8f53-4fd2-94dc-433779d3f181\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.495505 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.495485    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:42.632613 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:42.632585    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"]
May 21 03:29:42.634532 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:29:42.634502    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674f2fcc_8f53_4fd2_94dc_433779d3f181.slice/crio-5188d6ff68efc92367dc349ba22658daed762807546ecac6235dbd7bb1163f0a WatchSource:0}: Error finding container 5188d6ff68efc92367dc349ba22658daed762807546ecac6235dbd7bb1163f0a: Status 404 returned error can't find the container with id 5188d6ff68efc92367dc349ba22658daed762807546ecac6235dbd7bb1163f0a
May 21 03:29:43.514572 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:43.514529    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw" event={"ID":"674f2fcc-8f53-4fd2-94dc-433779d3f181","Type":"ContainerStarted","Data":"50c590088099dc5a46ca5ff9a07a5f3ee6cf3a55b8a968ed373a2518f30609d8"}
May 21 03:29:43.514572 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:43.514573    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw" event={"ID":"674f2fcc-8f53-4fd2-94dc-433779d3f181","Type":"ContainerStarted","Data":"5188d6ff68efc92367dc349ba22658daed762807546ecac6235dbd7bb1163f0a"}
May 21 03:29:48.533739 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:48.533705    2558 generic.go:358] "Generic (PLEG): container finished" podID="674f2fcc-8f53-4fd2-94dc-433779d3f181" containerID="50c590088099dc5a46ca5ff9a07a5f3ee6cf3a55b8a968ed373a2518f30609d8" exitCode=0
May 21 03:29:48.534197 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:48.533775    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw" event={"ID":"674f2fcc-8f53-4fd2-94dc-433779d3f181","Type":"ContainerDied","Data":"50c590088099dc5a46ca5ff9a07a5f3ee6cf3a55b8a968ed373a2518f30609d8"}
May 21 03:29:48.535282 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:48.535262    2558 generic.go:358] "Generic (PLEG): container finished" podID="7dd26c94-89a9-4868-bb42-fdf2d031d61e" containerID="171d44c96af0f774d5113ef06b2fa300f6119896de6130e9b5bbd88bc976e6ca" exitCode=0
May 21 03:29:48.535360 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:48.535295    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8" event={"ID":"7dd26c94-89a9-4868-bb42-fdf2d031d61e","Type":"ContainerDied","Data":"171d44c96af0f774d5113ef06b2fa300f6119896de6130e9b5bbd88bc976e6ca"}
May 21 03:29:49.540535 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.540501    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8" event={"ID":"7dd26c94-89a9-4868-bb42-fdf2d031d61e","Type":"ContainerStarted","Data":"176b44cb9f4692a1c13701a2579b34876671bf1f31b4c4310341c07ef33d7dd8"}
May 21 03:29:49.541024 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.540733    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:29:49.542159 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.542125    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw" event={"ID":"674f2fcc-8f53-4fd2-94dc-433779d3f181","Type":"ContainerStarted","Data":"64b456d24ed21619b144981754a328d8dd0db6ca3ecb5938ef1b496412c6cd40"}
May 21 03:29:49.542355 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.542339    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:29:49.558723 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.558677    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8" podStartSLOduration=10.315372028 podStartE2EDuration="10.558663732s" podCreationTimestamp="2026-05-21 03:29:39 +0000 UTC" firstStartedPulling="2026-05-21 03:29:48.535771942 +0000 UTC m=+577.757254959" lastFinishedPulling="2026-05-21 03:29:48.779063644 +0000 UTC m=+578.000546663" observedRunningTime="2026-05-21 03:29:49.556074656 +0000 UTC m=+578.777557697" watchObservedRunningTime="2026-05-21 03:29:49.558663732 +0000 UTC m=+578.780146772"
May 21 03:29:49.572045 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:49.571972    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw" podStartSLOduration=7.348692464 podStartE2EDuration="7.571956665s" podCreationTimestamp="2026-05-21 03:29:42 +0000 UTC" firstStartedPulling="2026-05-21 03:29:48.534441136 +0000 UTC m=+577.755924155" lastFinishedPulling="2026-05-21 03:29:48.757705338 +0000 UTC m=+577.979188356" observedRunningTime="2026-05-21 03:29:49.571668198 +0000 UTC m=+578.793151239" watchObservedRunningTime="2026-05-21 03:29:49.571956665 +0000 UTC m=+578.793439708"
May 21 03:29:50.513512 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:50.513482    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt"
May 21 03:29:54.165096 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.165057    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"]
May 21 03:29:54.171469 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.171446    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.174521 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.174497    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 03:29:54.176820 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.176799    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"]
May 21 03:29:54.227439 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.227439 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.227623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5jb\" (UniqueName: \"kubernetes.io/projected/1dbe8a73-ae24-463f-ad0d-ad943651c689-kube-api-access-qm5jb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.227623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.227623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dbe8a73-ae24-463f-ad0d-ad943651c689-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.227623 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.227599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328407 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328370    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5jb\" (UniqueName: \"kubernetes.io/projected/1dbe8a73-ae24-463f-ad0d-ad943651c689-kube-api-access-qm5jb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328441    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328476    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dbe8a73-ae24-463f-ad0d-ad943651c689-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328563 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328517    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328722 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328598    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328722 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328994 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328964    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.328994 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.328986    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.329117 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.329020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.331053 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.331032    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dbe8a73-ae24-463f-ad0d-ad943651c689-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.331696 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.331674    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dbe8a73-ae24-463f-ad0d-ad943651c689-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.336437 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.336416    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5jb\" (UniqueName: \"kubernetes.io/projected/1dbe8a73-ae24-463f-ad0d-ad943651c689-kube-api-access-qm5jb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh\" (UID: \"1dbe8a73-ae24-463f-ad0d-ad943651c689\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.483414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.483341    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:29:54.614452 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:54.614424    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"]
May 21 03:29:54.615968 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:29:54.615937    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbe8a73_ae24_463f_ad0d_ad943651c689.slice/crio-32d939f1550cf8b510469347e7921ee09d6d745827dd1973a834cdeebe356f43 WatchSource:0}: Error finding container 32d939f1550cf8b510469347e7921ee09d6d745827dd1973a834cdeebe356f43: Status 404 returned error can't find the container with id 32d939f1550cf8b510469347e7921ee09d6d745827dd1973a834cdeebe356f43
May 21 03:29:55.563660 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:55.563627    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh" event={"ID":"1dbe8a73-ae24-463f-ad0d-ad943651c689","Type":"ContainerStarted","Data":"63a30c134bc40575d52533d39f53d0dbfdca3223617a82562e8697b4e9ec766e"}
May 21 03:29:55.564089 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:29:55.563668    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh" event={"ID":"1dbe8a73-ae24-463f-ad0d-ad943651c689","Type":"ContainerStarted","Data":"32d939f1550cf8b510469347e7921ee09d6d745827dd1973a834cdeebe356f43"}
May 21 03:30:00.557530 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:00.557500    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8"
May 21 03:30:00.558382 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:00.558365    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw"
May 21 03:30:00.582016 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:00.581983    2558 generic.go:358] "Generic (PLEG): container finished" podID="1dbe8a73-ae24-463f-ad0d-ad943651c689" containerID="63a30c134bc40575d52533d39f53d0dbfdca3223617a82562e8697b4e9ec766e" exitCode=0
May 21 03:30:00.582148 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:00.582055    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh" event={"ID":"1dbe8a73-ae24-463f-ad0d-ad943651c689","Type":"ContainerDied","Data":"63a30c134bc40575d52533d39f53d0dbfdca3223617a82562e8697b4e9ec766e"}
May 21 03:30:01.587323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:01.587283    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh" event={"ID":"1dbe8a73-ae24-463f-ad0d-ad943651c689","Type":"ContainerStarted","Data":"a7bcd2f419bd5076386903af424ac252724133a6aaabf36ff5ed2ece202581a7"}
May 21 03:30:01.587804 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:01.587523    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:30:01.608976 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:01.608929    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh" podStartSLOduration=7.224359988 podStartE2EDuration="7.608916144s" podCreationTimestamp="2026-05-21 03:29:54 +0000 UTC" firstStartedPulling="2026-05-21 03:30:00.582552345 +0000 UTC m=+589.804035364" lastFinishedPulling="2026-05-21 03:30:00.967108502 +0000 UTC m=+590.188591520" observedRunningTime="2026-05-21 03:30:01.606775335 +0000 UTC m=+590.828258374" watchObservedRunningTime="2026-05-21 03:30:01.608916144 +0000 UTC m=+590.830399184"
May 21 03:30:12.603764 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:12.603736    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh"
May 21 03:30:15.497861 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.497819    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"]
May 21 03:30:15.502158 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.502141    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.504951 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.504930    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 21 03:30:15.511473 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.511449    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"]
May 21 03:30:15.615546 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.615690 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.615690 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.615772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.615772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j8tp\" (UniqueName: \"kubernetes.io/projected/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kube-api-access-4j8tp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.615772 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.615762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716340 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716311    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716349    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716383    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716439    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j8tp\" (UniqueName: \"kubernetes.io/projected/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kube-api-access-4j8tp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716470    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716669 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716719 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716661    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716840 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716820    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.716954 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.716932    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.718739 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.718719    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.719017 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.719000    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.724024 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.723997    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j8tp\" (UniqueName: \"kubernetes.io/projected/3b4a934a-9f54-4ea1-817f-eb91fb65e5bb-kube-api-access-4j8tp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p\" (UID: \"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.815291 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.815231    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:15.943216 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:15.943186    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"]
May 21 03:30:15.945254 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:30:15.945219    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4a934a_9f54_4ea1_817f_eb91fb65e5bb.slice/crio-939e01a9384ee058ccda412ad267b01fb5fa27c4b5e845850bab2c33e72ecc46 WatchSource:0}: Error finding container 939e01a9384ee058ccda412ad267b01fb5fa27c4b5e845850bab2c33e72ecc46: Status 404 returned error can't find the container with id 939e01a9384ee058ccda412ad267b01fb5fa27c4b5e845850bab2c33e72ecc46
May 21 03:30:16.639733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:16.639690    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p" event={"ID":"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb","Type":"ContainerStarted","Data":"fcc43c5e178d8861de8d2609230c6cdeb3b4392c520b2d9a57749f693c8865bc"}
May 21 03:30:16.639733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:16.639736    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p" event={"ID":"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb","Type":"ContainerStarted","Data":"939e01a9384ee058ccda412ad267b01fb5fa27c4b5e845850bab2c33e72ecc46"}
May 21 03:30:21.662199 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:21.662163    2558 generic.go:358] "Generic (PLEG): container finished" podID="3b4a934a-9f54-4ea1-817f-eb91fb65e5bb" containerID="fcc43c5e178d8861de8d2609230c6cdeb3b4392c520b2d9a57749f693c8865bc" exitCode=0
May 21 03:30:21.662578 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:21.662243    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p" event={"ID":"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb","Type":"ContainerDied","Data":"fcc43c5e178d8861de8d2609230c6cdeb3b4392c520b2d9a57749f693c8865bc"}
May 21 03:30:22.667612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:22.667571    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p" event={"ID":"3b4a934a-9f54-4ea1-817f-eb91fb65e5bb","Type":"ContainerStarted","Data":"3e4a6d0ad1ceed0f176053ed694f6e7f5220738cbf7ea02f088a7254489e32f2"}
May 21 03:30:22.667983 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:22.667782    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:30:22.686659 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:22.686616    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p" podStartSLOduration=7.506789437 podStartE2EDuration="7.68660336s" podCreationTimestamp="2026-05-21 03:30:15 +0000 UTC" firstStartedPulling="2026-05-21 03:30:21.662939706 +0000 UTC m=+610.884422728" lastFinishedPulling="2026-05-21 03:30:21.842753627 +0000 UTC m=+611.064236651" observedRunningTime="2026-05-21 03:30:22.684144943 +0000 UTC m=+611.905627982" watchObservedRunningTime="2026-05-21 03:30:22.68660336 +0000 UTC m=+611.908086399"
May 21 03:30:33.684612 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:30:33.684528    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p"
May 21 03:32:02.218570 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.218494    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:32:02.221009 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.218748    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-54b789f958-2m4sg" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerName="manager" containerID="cri-o://e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560" gracePeriod=30
May 21 03:32:02.231195 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.231163    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-54b789f958-2m4sg" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.30:8081/readyz\": dial tcp 10.134.0.30:8081: connect: connection refused"
May 21 03:32:02.460817 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.460792    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:32:02.562411 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.562375    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls5fh\" (UniqueName: \"kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh\") pod \"494cc66d-4851-47e6-b816-5ac6b5080a66\" (UID: \"494cc66d-4851-47e6-b816-5ac6b5080a66\") "
May 21 03:32:02.564605 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.564570    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh" (OuterVolumeSpecName: "kube-api-access-ls5fh") pod "494cc66d-4851-47e6-b816-5ac6b5080a66" (UID: "494cc66d-4851-47e6-b816-5ac6b5080a66"). InnerVolumeSpecName "kube-api-access-ls5fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 03:32:02.663625 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:02.663594    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls5fh\" (UniqueName: \"kubernetes.io/projected/494cc66d-4851-47e6-b816-5ac6b5080a66-kube-api-access-ls5fh\") on node \"ip-10-0-131-76.ec2.internal\" DevicePath \"\""
May 21 03:32:03.023569 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.023537    2558 generic.go:358] "Generic (PLEG): container finished" podID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerID="e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560" exitCode=0
May 21 03:32:03.023695 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.023601    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-2m4sg"
May 21 03:32:03.023695 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.023625    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-2m4sg" event={"ID":"494cc66d-4851-47e6-b816-5ac6b5080a66","Type":"ContainerDied","Data":"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"}
May 21 03:32:03.023695 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.023666    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-2m4sg" event={"ID":"494cc66d-4851-47e6-b816-5ac6b5080a66","Type":"ContainerDied","Data":"cb8e0e0f34a72e6ca9c4928fab84489a1ef68eb66aa17e22991c6f1b412dbfc9"}
May 21 03:32:03.023695 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.023686    2558 scope.go:117] "RemoveContainer" containerID="e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"
May 21 03:32:03.032955 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.032933    2558 scope.go:117] "RemoveContainer" containerID="e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"
May 21 03:32:03.033211 ip-10-0-131-76 kubenswrapper[2558]: E0521 03:32:03.033194    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560\": container with ID starting with e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560 not found: ID does not exist" containerID="e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"
May 21 03:32:03.033262 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.033220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560"} err="failed to get container status \"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560\": rpc error: code = NotFound desc = could not find container \"e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560\": container with ID starting with e7a14595658f07dc0b88ab0337b012ab0fee76d94ed3fffe16186a1ed208d560 not found: ID does not exist"
May 21 03:32:03.045403 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.045379    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:32:03.050854 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.050821    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54b789f958-2m4sg"]
May 21 03:32:03.412658 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:32:03.412586    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" path="/var/lib/kubelet/pods/494cc66d-4851-47e6-b816-5ac6b5080a66/volumes"
May 21 03:53:16.369164 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:16.369126    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-wxkjs_1cb097ef-2985-458d-ba25-30e95a2f4b24/manager/0.log"
May 21 03:53:16.582619 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:16.582586    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mx5gg_046d9f07-5bc9-49a8-9803-4d6bea09d3e5/postgres/0.log"
May 21 03:53:19.293024 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:19.292991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5749999c66-hb92j_28247289-774f-44e7-9719-5d3c47356096/kube-auth-proxy/0.log"
May 21 03:53:19.989694 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:19.989664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw_674f2fcc-8f53-4fd2-94dc-433779d3f181/storage-initializer/0.log"
May 21 03:53:19.996693 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:19.996665    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-bscxw_674f2fcc-8f53-4fd2-94dc-433779d3f181/main/0.log"
May 21 03:53:20.106446 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.106420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh_1dbe8a73-ae24-463f-ad0d-ad943651c689/storage-initializer/0.log"
May 21 03:53:20.113587 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.113563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s5pbh_1dbe8a73-ae24-463f-ad0d-ad943651c689/main/0.log"
May 21 03:53:20.227457 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.227434    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-xngmr_e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f/storage-initializer/0.log"
May 21 03:53:20.235992 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.235958    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-xngmr_e57c4e11-f3f4-4fba-8bb9-6157d6ceec7f/main/0.log"
May 21 03:53:20.345553 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.345529    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p_3b4a934a-9f54-4ea1-817f-eb91fb65e5bb/storage-initializer/0.log"
May 21 03:53:20.352947 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.352927    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccvhz8p_3b4a934a-9f54-4ea1-817f-eb91fb65e5bb/main/0.log"
May 21 03:53:20.463284 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.463264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt_c7608918-8601-46e0-b974-997985d1212f/storage-initializer/0.log"
May 21 03:53:20.469960 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.469945    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-gvpqt_c7608918-8601-46e0-b974-997985d1212f/main/0.log"
May 21 03:53:20.579547 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.579521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8_7dd26c94-89a9-4868-bb42-fdf2d031d61e/storage-initializer/0.log"
May 21 03:53:20.587416 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:20.587401    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2fzw8_7dd26c94-89a9-4868-bb42-fdf2d031d61e/main/0.log"
May 21 03:53:27.534808 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:27.534777    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8qds_80643220-b6c2-46b4-9799-da8e36cee769/global-pull-secret-syncer/0.log"
May 21 03:53:27.722763 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:27.722734    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bt7dg_9c3a52c0-9c67-48ad-b3c7-dacbf46ac0bc/konnectivity-agent/0.log"
May 21 03:53:27.781255 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:27.781230    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-76.ec2.internal_19944451ad6e4844bce6c2c9d20bf29a/haproxy/0.log"
May 21 03:53:34.280428 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.280387    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/alertmanager/0.log"
May 21 03:53:34.300201 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.300179    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/config-reloader/0.log"
May 21 03:53:34.319062 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.319044    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/kube-rbac-proxy-web/0.log"
May 21 03:53:34.340188 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.340112    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/kube-rbac-proxy/0.log"
May 21 03:53:34.361595 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.361577    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/kube-rbac-proxy-metric/0.log"
May 21 03:53:34.383193 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.383174    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/prom-label-proxy/0.log"
May 21 03:53:34.403838 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.403819    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eef4b5df-e1b2-4562-ae5a-e73652ee3aee/init-config-reloader/0.log"
May 21 03:53:34.474754 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.474735    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mm4hx_a660b6e8-8990-4a75-90d9-71b12b603a60/kube-state-metrics/0.log"
May 21 03:53:34.499265 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.499245    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mm4hx_a660b6e8-8990-4a75-90d9-71b12b603a60/kube-rbac-proxy-main/0.log"
May 21 03:53:34.519687 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.519670    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-mm4hx_a660b6e8-8990-4a75-90d9-71b12b603a60/kube-rbac-proxy-self/0.log"
May 21 03:53:34.676269 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.676246    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nswjd_3a5ab151-e3b8-4091-a51c-c5965d944ef1/node-exporter/0.log"
May 21 03:53:34.705103 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.705082    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nswjd_3a5ab151-e3b8-4091-a51c-c5965d944ef1/kube-rbac-proxy/0.log"
May 21 03:53:34.723835 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.723818    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nswjd_3a5ab151-e3b8-4091-a51c-c5965d944ef1/init-textfile/0.log"
May 21 03:53:34.900386 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.900332    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/prometheus/0.log"
May 21 03:53:34.920879 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.920837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/config-reloader/0.log"
May 21 03:53:34.943787 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.943767    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/thanos-sidecar/0.log"
May 21 03:53:34.963559 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.963539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/kube-rbac-proxy-web/0.log"
May 21 03:53:34.984344 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:34.984324    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/kube-rbac-proxy/0.log"
May 21 03:53:35.005684 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.005661    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/kube-rbac-proxy-thanos/0.log"
May 21 03:53:35.024939 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.024920    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b77dbe72-76c9-4b71-88d7-9d59bb3babec/init-config-reloader/0.log"
May 21 03:53:35.063893 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.063871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-pzrz7_46ff8fad-6fa8-47ea-b620-62bcf19c2699/prometheus-operator/0.log"
May 21 03:53:35.082511 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.082488    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-pzrz7_46ff8fad-6fa8-47ea-b620-62bcf19c2699/kube-rbac-proxy/0.log"
May 21 03:53:35.104706 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.104688    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-st4d6_faff6f53-2edb-4e1a-9624-a2a79fea7b60/prometheus-operator-admission-webhook/0.log"
May 21 03:53:35.195791 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.195744    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/thanos-query/0.log"
May 21 03:53:35.214733 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.214714    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/kube-rbac-proxy-web/0.log"
May 21 03:53:35.237614 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.237597    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/kube-rbac-proxy/0.log"
May 21 03:53:35.264133 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.264117    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/prom-label-proxy/0.log"
May 21 03:53:35.282839 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.282822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/kube-rbac-proxy-rules/0.log"
May 21 03:53:35.303046 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:35.303015    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4f7648b8-g95kx_f89c6e93-24dc-4844-ac03-504c7f7af1e7/kube-rbac-proxy-metrics/0.log"
May 21 03:53:36.037108 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.037079    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"]
May 21 03:53:36.037575 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.037557    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerName="manager"
May 21 03:53:36.037575 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.037576    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerName="manager"
May 21 03:53:36.037695 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.037638    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="494cc66d-4851-47e6-b816-5ac6b5080a66" containerName="manager"
May 21 03:53:36.040720 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.040705    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.043144 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.043118    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p57vb\"/\"default-dockercfg-zvfx6\""
May 21 03:53:36.043144 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.043133    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"openshift-service-ca.crt\""
May 21 03:53:36.044477 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.044442    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"kube-root-ca.crt\""
May 21 03:53:36.046706 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.046682    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"]
May 21 03:53:36.173190 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.173161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-lib-modules\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.173190 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.173198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-sys\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.173414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.173279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-proc\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.173414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.173298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjwx\" (UniqueName: \"kubernetes.io/projected/51555808-33b9-499b-bf75-10b789bedfac-kube-api-access-7xjwx\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.173414 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.173331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-podres\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274616 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274583    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-sys\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274641    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-proc\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274662    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjwx\" (UniqueName: \"kubernetes.io/projected/51555808-33b9-499b-bf75-10b789bedfac-kube-api-access-7xjwx\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274694    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-podres\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274700    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-sys\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274761 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274727    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-lib-modules\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274781    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-proc\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274829    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-lib-modules\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.274965 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.274826    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51555808-33b9-499b-bf75-10b789bedfac-podres\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.282224 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.282199    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjwx\" (UniqueName: \"kubernetes.io/projected/51555808-33b9-499b-bf75-10b789bedfac-kube-api-access-7xjwx\") pod \"perf-node-gather-daemonset-bcd24\" (UID: \"51555808-33b9-499b-bf75-10b789bedfac\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.334294 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.334229    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-c2kpk_30d6da9c-fb77-43de-8920-75043c338d9a/networking-console-plugin/0.log"
May 21 03:53:36.351825 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.351801    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.478526 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.478501    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"]
May 21 03:53:36.481712 ip-10-0-131-76 kubenswrapper[2558]: W0521 03:53:36.481688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51555808_33b9_499b_bf75_10b789bedfac.slice/crio-da4b66e5fbc29a0399b7daace7f32747f1ffced71813408f5f3187a80ff86fd1 WatchSource:0}: Error finding container da4b66e5fbc29a0399b7daace7f32747f1ffced71813408f5f3187a80ff86fd1: Status 404 returned error can't find the container with id da4b66e5fbc29a0399b7daace7f32747f1ffced71813408f5f3187a80ff86fd1
May 21 03:53:36.483236 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.483215    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 03:53:36.579784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.579752    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24" event={"ID":"51555808-33b9-499b-bf75-10b789bedfac","Type":"ContainerStarted","Data":"168721feea969444c2eec2769be4b796d3cd2c885edbcd79460a8beb82d9569b"}
May 21 03:53:36.579784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.579782    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24" event={"ID":"51555808-33b9-499b-bf75-10b789bedfac","Type":"ContainerStarted","Data":"da4b66e5fbc29a0399b7daace7f32747f1ffced71813408f5f3187a80ff86fd1"}
May 21 03:53:36.579928 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.579888    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:36.593616 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:36.593542    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24" podStartSLOduration=0.593530651 podStartE2EDuration="593.530651ms" podCreationTimestamp="2026-05-21 03:53:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:53:36.593065363 +0000 UTC m=+2005.814548406" watchObservedRunningTime="2026-05-21 03:53:36.593530651 +0000 UTC m=+2005.815013733"
May 21 03:53:37.368878 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:37.368831    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-gpcjf_9194a384-c067-4863-b4ff-399edad0df50/download-server/0.log"
May 21 03:53:38.593354 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:38.593325    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dh2q_6e5e8f12-cdd6-4a51-97cf-4394fc18eeba/dns/0.log"
May 21 03:53:38.611500 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:38.611478    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dh2q_6e5e8f12-cdd6-4a51-97cf-4394fc18eeba/kube-rbac-proxy/0.log"
May 21 03:53:38.752632 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:38.752604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd8vg_611e0764-fecb-45e3-a837-4854accebfec/dns-node-resolver/0.log"
May 21 03:53:39.200798 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:39.200772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cbfc89b9c-f7n4b_3b11a1c5-93d3-43aa-b6ba-c11d997c6165/registry/0.log"
May 21 03:53:39.260614 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:39.260584    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbbcs_11e2a2eb-33a6-469e-86a2-51af9e78a823/node-ca/0.log"
May 21 03:53:40.255402 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:40.255374    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5749999c66-hb92j_28247289-774f-44e7-9719-5d3c47356096/kube-auth-proxy/0.log"
May 21 03:53:41.005035 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:41.004990    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2gbs_6840ae4a-ba67-4ce2-a81d-dc097a0ce8f1/serve-healthcheck-canary/0.log"
May 21 03:53:41.538430 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:41.538400    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vczrs_5e5a7368-535f-4f6c-bd46-3deab2a9cabf/kube-rbac-proxy/0.log"
May 21 03:53:41.556974 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:41.556943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vczrs_5e5a7368-535f-4f6c-bd46-3deab2a9cabf/exporter/0.log"
May 21 03:53:41.576124 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:41.576100    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vczrs_5e5a7368-535f-4f6c-bd46-3deab2a9cabf/extractor/0.log"
May 21 03:53:42.593665 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:42.593640    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-bcd24"
May 21 03:53:43.983910 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:43.983880    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-wxkjs_1cb097ef-2985-458d-ba25-30e95a2f4b24/manager/0.log"
May 21 03:53:44.029117 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:44.029092    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mx5gg_046d9f07-5bc9-49a8-9803-4d6bea09d3e5/postgres/0.log"
May 21 03:53:45.155606 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:45.155576    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79478bfc9c-68j4m_476dd059-1d94-4815-8384-9073a5dc9274/manager/0.log"
May 21 03:53:49.720113 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:49.720079    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-k8qfv_54a2778e-235a-4326-8900-5f588a137147/migrator/0.log"
May 21 03:53:49.738821 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:49.738799    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-k8qfv_54a2778e-235a-4326-8900-5f588a137147/graceful-termination/0.log"
May 21 03:53:51.078208 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.078175    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5zwbq_b5375448-e2f5-48e4-9e5a-bb75d3961bcc/kube-multus/0.log"
May 21 03:53:51.251875 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.251822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/kube-multus-additional-cni-plugins/0.log"
May 21 03:53:51.271007 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.270977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/egress-router-binary-copy/0.log"
May 21 03:53:51.289722 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.289691    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/cni-plugins/0.log"
May 21 03:53:51.309302 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.309275    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/bond-cni-plugin/0.log"
May 21 03:53:51.336395 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.336324    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/routeoverride-cni/0.log"
May 21 03:53:51.356323 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.356299    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/whereabouts-cni-bincopy/0.log"
May 21 03:53:51.376144 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.376115    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m78d8_e299d2ff-3ad7-4715-9f89-355947812e8a/whereabouts-cni/0.log"
May 21 03:53:51.683784 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.683702    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fv9tm_03aeb780-f839-4667-a99e-9d4e48f99dbf/network-metrics-daemon/0.log"
May 21 03:53:51.703762 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:51.703736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fv9tm_03aeb780-f839-4667-a99e-9d4e48f99dbf/kube-rbac-proxy/0.log"
May 21 03:53:52.497588 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.497552    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/ovn-controller/0.log"
May 21 03:53:52.523055 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.523023    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/ovn-acl-logging/0.log"
May 21 03:53:52.539239 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.539209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/kube-rbac-proxy-node/0.log"
May 21 03:53:52.557992 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.557971    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/kube-rbac-proxy-ovn-metrics/0.log"
May 21 03:53:52.576711 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.576691    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/northd/0.log"
May 21 03:53:52.596013 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.595989    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/nbdb/0.log"
May 21 03:53:52.615496 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.615477    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/sbdb/0.log"
May 21 03:53:52.711424 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:52.711395    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8c7x_afe6c3c0-5c85-4a3c-a27a-67d3e16c6b46/ovnkube-controller/0.log"
May 21 03:53:54.453896 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:54.453868    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-p455n_8825c2dd-8e1d-482c-b592-5495feeed41e/check-endpoints/0.log"
May 21 03:53:54.537576 ip-10-0-131-76 kubenswrapper[2558]: I0521 03:53:54.537545    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wxwjc_ea94780c-111e-4535-8d0e-7f2776bb3518/network-check-target-container/0.log"