May 21 13:00:11.137097 ip-10-0-140-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 13:00:11.137109 ip-10-0-140-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 13:00:11.137116 ip-10-0-140-104 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 13:00:11.137352 ip-10-0-140-104 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 13:00:22.560833 ip-10-0-140-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 13:00:22.560852 ip-10-0-140-104 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d0e39dc406df444ca3e97a4c6902a747 --
May 21 13:02:56.155131 ip-10-0-140-104 systemd[1]: Starting Kubernetes Kubelet...
May 21 13:02:56.615536 ip-10-0-140-104 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 13:02:56.615536 ip-10-0-140-104 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 13:02:56.615536 ip-10-0-140-104 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 13:02:56.615536 ip-10-0-140-104 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 13:02:56.615536 ip-10-0-140-104 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 13:02:56.617782 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.617686    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 13:02:56.623885 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623863    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 13:02:56.623885 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623881    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 13:02:56.623885 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623886    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 13:02:56.623885 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623891    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623896    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623900    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623904    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623908    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623911    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623915    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623919    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623923    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623927    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623931    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623935    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623939    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623951    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623956    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623960    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623964    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623968    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623972    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623976    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623980    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 13:02:56.624125 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623984    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623988    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623992    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.623996    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624001    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624005    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624010    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624014    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624019    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624023    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624030    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624034    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624039    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624046    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624051    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624056    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624061    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624065    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624070    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624074    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 13:02:56.624985 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624078    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624082    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624087    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624091    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624096    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624101    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624106    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624110    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624114    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624119    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624123    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624128    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624132    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624140    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624147    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624152    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624156    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624161    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624165    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 13:02:56.625753 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624169    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624173    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624177    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624181    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624188    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624194    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624199    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624204    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624208    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624213    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624217    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624221    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624225    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624229    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624234    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624238    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624242    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624246    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624250    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 13:02:56.626205 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624255    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624260    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624264    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624267    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624983    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.624995    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625000    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625005    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625010    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625014    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625019    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625024    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625030    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625035    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625039    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625046    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625052    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625056    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625060    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625066    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 13:02:56.627009 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625071    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625075    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625080    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625085    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625090    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625095    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625099    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625104    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625108    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625112    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625116    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625120    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625125    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625130    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625134    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625138    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625143    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625147    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625151    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625156    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 13:02:56.627804 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625160    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625165    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625169    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625173    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625177    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625181    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625186    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625190    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625195    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625200    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625204    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625209    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625215    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625219    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625223    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625227    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625232    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625236    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625241    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625245    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 13:02:56.628509 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625249    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625253    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625258    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625262    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625267    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625273    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625277    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625281    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625288    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625294    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625299    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625303    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625309    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625314    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625319    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625323    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625327    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625334    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625338    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 13:02:56.629029 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625342    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625346    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625351    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625355    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625359    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625364    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625368    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625372    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625376    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625380    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.625384    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626247    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626263    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626276    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626283    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626291    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626297    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626304    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626311    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626318    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626323    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 13:02:56.629493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626329    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626335    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626340    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626345    2557 flags.go:64] FLAG: --cgroup-root=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626350    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626355    2557 flags.go:64] FLAG: --client-ca-file=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626360    2557 flags.go:64] FLAG: --cloud-config=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626365    2557 flags.go:64] FLAG: --cloud-provider="external"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626369    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626376    2557 flags.go:64] FLAG: --cluster-domain=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626380    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626386    2557 flags.go:64] FLAG: --config-dir=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626390    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626396    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626402    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626407    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626412    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626418    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626422    2557 flags.go:64] FLAG: --contention-profiling="false"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626427    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626432    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626437    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626442    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626449    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626454    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 13:02:56.630028 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626459    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626468    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626474    2557 flags.go:64] FLAG: --enable-server="true"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626479    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626488    2557 flags.go:64] FLAG: --event-burst="100"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626492    2557 flags.go:64] FLAG: --event-qps="50"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626498    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626503    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626508    2557 flags.go:64] FLAG: --eviction-hard=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626516    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626520    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626526    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626531    2557 flags.go:64] FLAG: --eviction-soft=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626536    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626540    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626545    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626550    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626556    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626561    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626566    2557 flags.go:64] FLAG: --feature-gates=""
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626572    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626577    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626582    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626587    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626593    2557 flags.go:64] FLAG: --healthz-port="10248"
May 21 13:02:56.630638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626598    2557 flags.go:64] FLAG: --help="false"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626603    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-140-104.ec2.internal"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626608    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626614    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626619    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626624    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626630    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626635    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626661    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626667    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626671    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626676    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626681    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626686    2557 flags.go:64] FLAG: --kube-reserved=""
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626692    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626697    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626702    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626707    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626712    2557 flags.go:64] FLAG: --lock-file=""
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626716    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626721    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626726    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626735    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 13:02:56.631260 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626740    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626745    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626749    2557 flags.go:64] FLAG: --logging-format="text"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626754    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626759    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626764    2557 flags.go:64] FLAG: --manifest-url=""
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626768    2557 flags.go:64] FLAG: --manifest-url-header=""
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626776    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626781    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626788    2557 flags.go:64] FLAG: --max-pods="110"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626792    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626798    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626802    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626807    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626812    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626816    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626822    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626837    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626842    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626847    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626852    2557 flags.go:64] FLAG: --pod-cidr=""
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626857    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626866    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626871    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 13:02:56.631835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626877    2557 flags.go:64] FLAG: --pods-per-core="0"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626882    2557 flags.go:64] FLAG: --port="10250"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626888    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626893    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a42daa40582b488"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626898    2557 flags.go:64] FLAG: --qos-reserved=""
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626903    2557 flags.go:64] FLAG: --read-only-port="10255"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626908    2557 flags.go:64] FLAG: --register-node="true"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626913    2557 flags.go:64] FLAG: --register-schedulable="true"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626918    2557 flags.go:64] FLAG: --register-with-taints=""
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626924    2557 flags.go:64] FLAG: --registry-burst="10"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626929    2557 flags.go:64] FLAG: --registry-qps="5"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626934    2557 flags.go:64] FLAG: --reserved-cpus=""
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626939    2557 flags.go:64] FLAG: --reserved-memory=""
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626952    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626957    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626962    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626966    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626971    2557 flags.go:64] FLAG: --runonce="false"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626977    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626982    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626987    2557 flags.go:64] FLAG: --seccomp-default="false"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626992    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.626997    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627002    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627007    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627013    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 21 13:02:56.632446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627019    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627024    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627028    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627033    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627038    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627043    2557 flags.go:64] FLAG: --system-cgroups=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627048    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627058    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627063    2557 flags.go:64] FLAG: --tls-cert-file=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627068    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627075    2557 flags.go:64] FLAG: --tls-min-version=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627080    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627085    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627091    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627096    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627101    2557 flags.go:64] FLAG: --v="2"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627107    2557 flags.go:64] FLAG: --version="false"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627114    2557 flags.go:64] FLAG: --vmodule=""
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627121    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.627126    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628411    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628546    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628555    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628559    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 13:02:56.633081 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628562    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628565    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628568    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628571    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628574    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628578    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628581    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628583    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628586    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628589    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628592    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628595    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628597    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628600    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628603    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628605    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628608    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628612    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628614    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628617    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 13:02:56.633719 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628620    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628623    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628625    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628634    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628637    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628640    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628660    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628664    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628669    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628672    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628675    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628677    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628681    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628683    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628686    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628690    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628692    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628695    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628698    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 13:02:56.634222 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628700    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628703    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628706    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628709    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628711    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628714    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628717    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628720    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628723    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628726    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628729    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628731    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628734    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628737    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628739    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628742    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628744    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628747    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628750    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628752    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 13:02:56.634721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628756    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628759    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628762    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628765    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628767    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628770    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628772    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628775    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628778    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628780    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628783    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628786    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628788    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628791    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628794    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628798    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628802    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628807    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628810    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 13:02:56.635280 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628813    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 13:02:56.636124 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628816    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 13:02:56.636124 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628819    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 13:02:56.636124 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.628821    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 13:02:56.636124 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.629828    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 13:02:56.636959 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.636935    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 13:02:56.636959 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.636957    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637032    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637040    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637044    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637050    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637054    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637059    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637064    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637069    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637073    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637078    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637083    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637087    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637091    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637095    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 13:02:56.637094 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637100    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637104    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637108    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637113    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637117    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637121    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637126    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637130    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637134    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637139    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637145    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637153    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637157    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637162    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637166    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637170    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637175    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637181    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637186    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637190    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 13:02:56.637822 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637194    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637198    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637202    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637206    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637211    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637215    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637223    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637228    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637233    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637238    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637242    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637246    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637250    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637254    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637260    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637265    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637269    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637273    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637277    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 13:02:56.638462 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637281    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637285    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637289    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637294    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637298    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637302    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637306    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637310    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637314    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637318    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637323    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637327    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637332    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637336    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637340    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637345    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637350    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637354    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637358    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637363    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 13:02:56.639071 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637367    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637371    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637375    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637380    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637384    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637389    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637393    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637398    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637402    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637406    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637411    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637415    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637419    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.637428    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637591    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 13:02:56.639774 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637599    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637604    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637608    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637613    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637617    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637621    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637625    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637638    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637642    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637663    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637667    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637671    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637676    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637681    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637686    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637690    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637694    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637700    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637706    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 13:02:56.640383 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637711    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637716    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637720    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637725    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637729    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637733    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637738    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637742    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637746    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637750    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637755    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637759    2557 feature_gate.go:328] unrecognized feature gate: Example
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637763    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637767    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637771    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637775    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637779    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637784    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637788    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637792    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 13:02:56.641146 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637797    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637801    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637805    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637811    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637815    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637819    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637823    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637827    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637831    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637835    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637839    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637844    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637848    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637852    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637856    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637862    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637866    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637870    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637874    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637878    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 13:02:56.641932 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637883    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637887    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637891    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637895    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637899    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637904    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637908    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637912    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637916    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637921    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637926    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637929    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637934    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637938    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637942    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637946    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637956    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637960    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637965    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637969    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 13:02:56.642439 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637974    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637978    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637982    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637986    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637991    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:56.637995    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.638004    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.638809    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.641580    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.642509    2557 server.go:1019] "Starting client certificate rotation"
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.642609    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 13:02:56.642963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.642641    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 13:02:56.665206 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.665184    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 13:02:56.667040 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.667020    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 13:02:56.682192 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.682172    2557 log.go:25] "Validated CRI v1 runtime API"
May 21 13:02:56.687456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.687434    2557 log.go:25] "Validated CRI v1 image API"
May 21 13:02:56.688784 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.688740    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 13:02:56.693895 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.693874    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 13:02:56.696068 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.696030    2557 fs.go:135] Filesystem UUIDs: map[39cd8409-beb8-4cad-a3e2-cbec10b9fbfc:/dev/nvme0n1p4 57e484b1-afab-4f9a-8d7d-cc2e150436cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 21 13:02:56.696175 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.696062    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 13:02:56.701101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.700987    2557 manager.go:217] Machine: {Timestamp:2026-05-21 13:02:56.700446802 +0000 UTC m=+0.421753691 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100364 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e428db39d0500167177a1d5e3dd0a SystemUUID:ec2e428d-b39d-0500-1671-77a1d5e3dd0a BootID:d0e39dc4-06df-444c-a3e9-7a4c6902a747 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:7a:5a:8f:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:7a:5a:8f:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:f4:6c:f8:64:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 13:02:56.701101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.701090    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 13:02:56.701219 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.701205    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 13:02:56.703034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703005    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 13:02:56.703172 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703037    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 13:02:56.703215 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703182    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 21 13:02:56.703215 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703190    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 21 13:02:56.703215 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703198    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 13:02:56.703215 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.703214    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 13:02:56.704870 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.704859    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 13:02:56.705157 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.705147    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 13:02:56.707319 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.707310    2557 kubelet.go:491] "Attempting to sync node with API server"
May 21 13:02:56.707353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.707324    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 13:02:56.707953 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.707944    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 13:02:56.707985 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.707958    2557 kubelet.go:397] "Adding apiserver pod source"
May 21 13:02:56.707985 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.707968    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 13:02:56.709181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.709170    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 13:02:56.709230 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.709188    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 13:02:56.711981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.711964    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 13:02:56.713806 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.713793    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 13:02:56.714657 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714636    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714663    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714670    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714677    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714686    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714692    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714698    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714705    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 13:02:56.714708 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714712    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 13:02:56.714927 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714718    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 13:02:56.714927 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.714736    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 13:02:56.715022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.715013    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 13:02:56.715901 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.715891    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 13:02:56.715901 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.715901    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 13:02:56.720159 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.720144    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 13:02:56.720233 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.720182    2557 server.go:1295] "Started kubelet"
May 21 13:02:56.720302 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.720252    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 13:02:56.720889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.720819    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 13:02:56.720984 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.720914    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 13:02:56.720990 ip-10-0-140-104 systemd[1]: Started Kubernetes Kubelet.
May 21 13:02:56.721914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.721891    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 13:02:56.722848 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.722803    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 13:02:56.723031 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.723020    2557 server.go:317] "Adding debug handlers to kubelet server"
May 21 13:02:56.723242 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.723221    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 13:02:56.723242 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.723211    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 13:02:56.727486 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.727465    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 13:02:56.727617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.727600    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 13:02:56.727814 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.727799    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 13:02:56.727866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.727816    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 13:02:56.728105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.728050    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 13:02:56.728174 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.728148    2557 reconstruct.go:97] "Volume reconstruction finished"
May 21 13:02:56.728174 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.728156    2557 reconciler.go:26] "Reconciler: start to sync state"
May 21 13:02:56.729171 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729147    2557 factory.go:153] Registering CRI-O factory
May 21 13:02:56.729261 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729174    2557 factory.go:223] Registration of the crio container factory successfully
May 21 13:02:56.729261 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729254    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 13:02:56.729366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729264    2557 factory.go:55] Registering systemd factory
May 21 13:02:56.729366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729273    2557 factory.go:223] Registration of the systemd container factory successfully
May 21 13:02:56.729366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729293    2557 factory.go:103] Registering Raw factory
May 21 13:02:56.729366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.729315    2557 manager.go:1196] Started watching for new ooms in manager
May 21 13:02:56.729580 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.728056    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-104.ec2.internal.18b1964b03e5b971  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-104.ec2.internal,UID:ip-10-0-140-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-104.ec2.internal,},FirstTimestamp:2026-05-21 13:02:56.720157041 +0000 UTC m=+0.441463930,LastTimestamp:2026-05-21 13:02:56.720157041 +0000 UTC m=+0.441463930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-104.ec2.internal,}"
May 21 13:02:56.729974 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.729948    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:56.730061 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.730014    2557 manager.go:319] Starting recovery of all containers
May 21 13:02:56.731828 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.731783    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 13:02:56.731939 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.731912    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9x9cq"
May 21 13:02:56.736356 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.735331    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 13:02:56.736356 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.735484    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 13:02:56.742131 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.741955    2557 manager.go:324] Recovery completed
May 21 13:02:56.742812 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.742793    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9x9cq"
May 21 13:02:56.746803 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.746791    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.749667 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.749620    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.749667 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.749664    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.749807 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.749675    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.750321 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.750193    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 13:02:56.750321 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.750214    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 13:02:56.750321 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.750232    2557 state_mem.go:36] "Initialized new in-memory state store"
May 21 13:02:56.751878 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.751810    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-104.ec2.internal.18b1964b05a78fb8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-104.ec2.internal,UID:ip-10-0-140-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-104.ec2.internal,},FirstTimestamp:2026-05-21 13:02:56.74963756 +0000 UTC m=+0.470944462,LastTimestamp:2026-05-21 13:02:56.74963756 +0000 UTC m=+0.470944462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-104.ec2.internal,}"
May 21 13:02:56.752525 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.752511    2557 policy_none.go:49] "None policy: Start"
May 21 13:02:56.752605 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.752530    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 13:02:56.752605 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.752543    2557 state_mem.go:35] "Initializing new in-memory state store"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794267    2557 manager.go:341] "Starting Device Plugin manager"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.794299    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794310    2557 server.go:85] "Starting device plugin registration server"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794579    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794592    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794694    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794793    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.794802    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.795349    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 13:02:56.797430 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.795403    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:56.853226 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.853185    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 13:02:56.854624 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.854604    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 13:02:56.854741 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.854629    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 13:02:56.854741 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.854665    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 13:02:56.854741 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.854675    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 13:02:56.854741 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.854720    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 13:02:56.857974 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.857956    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:02:56.894937 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.894906    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.896125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.896107    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.896237 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.896136    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.896237 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.896145    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.896237 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.896184    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-104.ec2.internal"
May 21 13:02:56.904958 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.904942    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-104.ec2.internal"
May 21 13:02:56.905011 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.904966    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-104.ec2.internal\": node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:56.928472 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.928444    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:56.955454 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.955374    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"]
May 21 13:02:56.955454 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.955448    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.957116 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.957099    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.957180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.957129    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.957180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.957145    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.958535 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.958522    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.958742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.958728    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:56.958803 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.958758    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.959281 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959264    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.959353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959278    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.959353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959295    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.959353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959303    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.959353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959318    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.959538 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.959306    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.960530 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.960518    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:56.960589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.960539    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 13:02:56.961202 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.961186    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientMemory"
May 21 13:02:56.961265 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.961217    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasNoDiskPressure"
May 21 13:02:56.961265 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:56.961231    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeHasSufficientPID"
May 21 13:02:56.984342 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.984323    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-104.ec2.internal\" not found" node="ip-10-0-140-104.ec2.internal"
May 21 13:02:56.988747 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:56.988732    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-104.ec2.internal\" not found" node="ip-10-0-140-104.ec2.internal"
May 21 13:02:57.029384 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.029358    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.030506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.030488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.030570 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.030514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.030570 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.030541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf620bc707d30c338bdd0243f6ea5345-config\") pod \"kube-apiserver-proxy-ip-10-0-140-104.ec2.internal\" (UID: \"bf620bc707d30c338bdd0243f6ea5345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.130306 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.130259    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.131395 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131374    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf620bc707d30c338bdd0243f6ea5345-config\") pod \"kube-apiserver-proxy-ip-10-0-140-104.ec2.internal\" (UID: \"bf620bc707d30c338bdd0243f6ea5345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.131449 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131403    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.131449 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131422    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.131514 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.131514 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131487    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf620bc707d30c338bdd0243f6ea5345-config\") pod \"kube-apiserver-proxy-ip-10-0-140-104.ec2.internal\" (UID: \"bf620bc707d30c338bdd0243f6ea5345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.131573 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.131490    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ffef27b8b441641ee91bc6a4ea4eecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal\" (UID: \"2ffef27b8b441641ee91bc6a4ea4eecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.231145 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.231079    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.287426 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.287391    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.291206 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.291185    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.331401 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.331371    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.431804 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.431770    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.532306 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.532226    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.601834 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.601802    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:02:57.632720 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.632686    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-104.ec2.internal\" not found"
May 21 13:02:57.642914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.642888    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 13:02:57.643043 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.643026    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 13:02:57.643103 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.643076    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 13:02:57.669360 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.669336    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:02:57.708392 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.708365    2557 apiserver.go:52] "Watching apiserver"
May 21 13:02:57.717515 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.717492    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 13:02:57.717869 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.717847    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-26nsr","openshift-ovn-kubernetes/ovnkube-node-xg827","kube-system/konnectivity-agent-x8k74","openshift-cluster-node-tuning-operator/tuned-6z24m","openshift-dns/node-resolver-6jwv9","openshift-multus/multus-2pxl5","openshift-multus/multus-additional-cni-plugins-7vr2k","openshift-multus/network-metrics-daemon-zlwz4","openshift-network-diagnostics/network-check-target-rlfhl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj","openshift-image-registry/node-ca-6fq9q"]
May 21 13:02:57.720271 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.720244    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.721520 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.721499    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.722637 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.722620    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 13:02:57.722766 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.722745    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 13:02:57.722836 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.722824    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 13:02:57.722899 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.722869    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.722978 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.722907    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.723121 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.723072    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jx7zt\""
May 21 13:02:57.725599 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.725072    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.726282 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.726267    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 13:02:57.726592 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.726575    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.726831 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.726639    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s75zv\""
May 21 13:02:57.726966 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.726952    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rhzqh\""
May 21 13:02:57.727017 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.727001    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 13:02:57.727266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.727252    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xhf6v\""
May 21 13:02:57.727762 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.727747    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 13:02:57.728027 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.728011    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 13:02:57.728101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.728028    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 13:02:57.728168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.728151    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.728497 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.728478    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 13:02:57.729016 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.728998    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 13:02:57.729162 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729148    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729225    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729254    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zzdv5\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729311    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729388    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729387    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729388    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6x8b5\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729392    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 13:02:57.729551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729462    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 13:02:57.729909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.729678    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 13:02:57.730351 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.730334    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 13:02:57.730484 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.730469    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qp4n7\""
May 21 13:02:57.730622 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.730603    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 13:02:57.730711 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.730674    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 13:02:57.731052 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.731036    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.731168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.731149    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 13:02:57.731227 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.731197    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:57.731281 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.731265    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:02:57.732255 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.732218    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.732468 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.732453    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 13:02:57.732539 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.732505    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:57.732593 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.732549    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:02:57.733736 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.733718    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.733892 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.733863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-conf\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.733892 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.733899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-cnibin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.733923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-netns\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.733973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstb8\" (UniqueName: \"kubernetes.io/projected/25c99216-1958-4203-9c43-1695d6e155e0-kube-api-access-bstb8\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-tuned\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-kubelet\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-etc-kubernetes\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734102    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmjc\" (UniqueName: \"kubernetes.io/projected/9c1194b8-b036-4f05-b271-409185f431fe-kube-api-access-7rmjc\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-modprobe-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-kubernetes\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-sys\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734178    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-host\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734219    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-os-release\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-bin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734306    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-config\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ff09d7-f6a7-4055-8e76-9a87620b2694-konnectivity-ca\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-socket-dir-parent\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-conf-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734454    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-multus-certs\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734478    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-env-overrides\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-ovn\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-log-socket\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-netd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cnibin\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-k8s-cni-cncf-io\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-multus-daemon-config\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-bin\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-tmp-dir\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm88z\" (UniqueName: \"kubernetes.io/projected/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-kube-api-access-hm88z\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wdp\" (UniqueName: \"kubernetes.io/projected/bbc40082-adb3-48f2-bcde-adb42f008c63-kube-api-access-z5wdp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.734909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-system-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-multus\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysconfig\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.734975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-tmp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c1194b8-b036-4f05-b271-409185f431fe-host\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-etc-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-system-cni-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-os-release\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8wg\" (UniqueName: \"kubernetes.io/projected/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-kube-api-access-hz8wg\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e219f45-6ef6-4869-bc74-883f150836bd-iptables-alerter-script\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-run\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-slash\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-systemd\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.735532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ff09d7-f6a7-4055-8e76-9a87620b2694-agent-certs\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-cni-binary-copy\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-hostroot\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-var-lib-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-node-log\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhrk\" (UniqueName: \"kubernetes.io/projected/9e219f45-6ef6-4869-bc74-883f150836bd-kube-api-access-gvhrk\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735557    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-var-lib-kubelet\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6cebc9e-129a-4497-b4f2-02938471badf-ovn-node-metrics-cert\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-script-lib\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-lib-modules\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735733    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-systemd-units\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735777    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-netns\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-hosts-file\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-kubelet\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqgl\" (UniqueName: \"kubernetes.io/projected/d6cebc9e-129a-4497-b4f2-02938471badf-kube-api-access-jdqgl\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e219f45-6ef6-4869-bc74-883f150836bd-host-slash\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c1194b8-b036-4f05-b271-409185f431fe-serviceca\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-systemd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.735977    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.736095    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.736381    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nktl2\""
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.736436    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.736591    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 13:02:57.736781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.736598    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtn72\""
May 21 13:02:57.746141 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.746116    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 12:57:56 +0000 UTC" deadline="2027-12-01 06:25:47.265715633 +0000 UTC"
May 21 13:02:57.746141 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.746139    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13409h22m49.519578987s"
May 21 13:02:57.755067 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.755049    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 13:02:57.761992 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.761975    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal"]
May 21 13:02:57.762356 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.762342    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 13:02:57.762436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.762424    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"
May 21 13:02:57.771068 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:57.771018    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffef27b8b441641ee91bc6a4ea4eecd.slice/crio-468cd848f5f9f21fe6b49d206a8de09af59e029f08b58b1aad6ab6e29db9bf10 WatchSource:0}: Error finding container 468cd848f5f9f21fe6b49d206a8de09af59e029f08b58b1aad6ab6e29db9bf10: Status 404 returned error can't find the container with id 468cd848f5f9f21fe6b49d206a8de09af59e029f08b58b1aad6ab6e29db9bf10
May 21 13:02:57.771501 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:57.771479    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf620bc707d30c338bdd0243f6ea5345.slice/crio-6559da73d7b622f3ee013ad0c9aa9e243b643d3fa9f681a54957b3b81498f545 WatchSource:0}: Error finding container 6559da73d7b622f3ee013ad0c9aa9e243b643d3fa9f681a54957b3b81498f545: Status 404 returned error can't find the container with id 6559da73d7b622f3ee013ad0c9aa9e243b643d3fa9f681a54957b3b81498f545
May 21 13:02:57.776728 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.776714    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 13:02:57.779156 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.779138    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 13:02:57.779628 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.779610    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal"]
May 21 13:02:57.786029 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.785979    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2hlb6"
May 21 13:02:57.798970 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.798951    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2hlb6"
May 21 13:02:57.829314 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.829292    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 13:02:57.836478 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836460    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c1194b8-b036-4f05-b271-409185f431fe-serviceca\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.836561 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836487    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-systemd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.836561 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836504    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.836561 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836528    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-conf\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.836561 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836552    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-cnibin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836574    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-netns\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836573    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-systemd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836664    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-cnibin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836697    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-conf\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836697    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-netns\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.836763 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836751    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bstb8\" (UniqueName: \"kubernetes.io/projected/25c99216-1958-4203-9c43-1695d6e155e0-kube-api-access-bstb8\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836771    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-tuned\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836806    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-kubelet\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836823    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-etc-kubernetes\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836838    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmjc\" (UniqueName: \"kubernetes.io/projected/9c1194b8-b036-4f05-b271-409185f431fe-kube-api-access-7rmjc\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836857    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-modprobe-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836899    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-kubernetes\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836902    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-etc-kubernetes\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836923    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-sys\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836944    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-host\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836939    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-kubelet\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836995    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-sys\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836994    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c1194b8-b036-4f05-b271-409185f431fe-serviceca\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.836995    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-kubernetes\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837020    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-modprobe-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837026    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837061    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-os-release\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837066    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-host\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.837084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837083    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-bin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837121    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837127    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-bin\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837126    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837154    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-os-release\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837152    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837180    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837217    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-config\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837245    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ff09d7-f6a7-4055-8e76-9a87620b2694-konnectivity-ca\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837272    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-socket-dir-parent\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837275    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837334    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-socket-dir-parent\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837368    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-conf-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837403    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-multus-certs\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzxb\" (UniqueName: \"kubernetes.io/projected/b45c0043-d0bb-45b6-8398-0448e025646e-kube-api-access-fnzxb\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837461    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-multus-conf-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837472    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-env-overrides\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-multus-certs\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.837981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837499    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-ovn\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837542    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-ovn\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-log-socket\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837583    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-netd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837603    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cnibin\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837609    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-log-socket\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837623    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-k8s-cni-cncf-io\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837643    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-multus-daemon-config\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837672    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-netd\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-sys-fs\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837714    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-run-k8s-cni-cncf-io\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cnibin\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837725    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-bin\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837767    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ff09d7-f6a7-4055-8e76-9a87620b2694-konnectivity-ca\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837774    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-tmp-dir\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837784    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-cni-bin\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.838840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837801    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm88z\" (UniqueName: \"kubernetes.io/projected/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-kube-api-access-hm88z\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837828    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837852    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wdp\" (UniqueName: \"kubernetes.io/projected/bbc40082-adb3-48f2-bcde-adb42f008c63-kube-api-access-z5wdp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-config\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837874    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-system-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837906    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-env-overrides\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.837973    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-system-cni-dir\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838004    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838040    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-tmp-dir\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838053    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-multus\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838089    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysconfig\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838117    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-tmp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838129    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-host-var-lib-cni-multus\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838147    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysconfig\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838173    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c1194b8-b036-4f05-b271-409185f431fe-host\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838206    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-etc-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838237    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-multus-daemon-config\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.839613 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838244    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-etc-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838259    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c1194b8-b036-4f05-b271-409185f431fe-host\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838273    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838302    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-system-cni-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838364    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-os-release\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838373    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-ovn-kubernetes\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838391    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8wg\" (UniqueName: \"kubernetes.io/projected/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-kube-api-access-hz8wg\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838454    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e219f45-6ef6-4869-bc74-883f150836bd-iptables-alerter-script\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838492    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-run\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838546    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-slash\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838591    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-systemd\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-device-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838423    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-system-cni-dir\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838712    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838751    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838764    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-slash\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838462    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-os-release\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838802    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ff09d7-f6a7-4055-8e76-9a87620b2694-agent-certs\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838834    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-run\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838834    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-cni-binary-copy\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838920    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e219f45-6ef6-4869-bc74-883f150836bd-iptables-alerter-script\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838952    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-hostroot\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.838982    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-systemd\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kczr\" (UniqueName: \"kubernetes.io/projected/62404bf4-3ebf-4c53-b55b-0a4197334123-kube-api-access-6kczr\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839127    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-var-lib-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839153    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-node-log\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839175    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhrk\" (UniqueName: \"kubernetes.io/projected/9e219f45-6ef6-4869-bc74-883f150836bd-kube-api-access-gvhrk\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839205    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839249    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-var-lib-kubelet\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839270    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6cebc9e-129a-4497-b4f2-02938471badf-ovn-node-metrics-cert\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839290    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-script-lib\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839305    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-run-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.840893 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839327    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25c99216-1958-4203-9c43-1695d6e155e0-cni-binary-copy\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839336    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-lib-modules\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839351    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-socket-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839421    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25c99216-1958-4203-9c43-1695d6e155e0-hostroot\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839431    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-sysctl-d\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839486    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-var-lib-openvswitch\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839505    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-systemd-units\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839529    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-var-lib-kubelet\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839534    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-netns\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839557    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbc40082-adb3-48f2-bcde-adb42f008c63-lib-modules\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839577    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-hosts-file\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839700    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-hosts-file\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839745    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-kubelet\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839773    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqgl\" (UniqueName: \"kubernetes.io/projected/d6cebc9e-129a-4497-b4f2-02938471badf-kube-api-access-jdqgl\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839797    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e219f45-6ef6-4869-bc74-883f150836bd-host-slash\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839839    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-registration-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.841367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839851    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-node-log\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839893    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-run-netns\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839910    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6cebc9e-129a-4497-b4f2-02938471badf-ovnkube-script-lib\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e219f45-6ef6-4869-bc74-883f150836bd-host-slash\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.839966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-host-kubelet\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.840170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6cebc9e-129a-4497-b4f2-02938471badf-systemd-units\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.840523    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.840589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-etc-tuned\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.840600    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc40082-adb3-48f2-bcde-adb42f008c63-tmp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.841609    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ff09d7-f6a7-4055-8e76-9a87620b2694-agent-certs\") pod \"konnectivity-agent-x8k74\" (UID: \"52ff09d7-f6a7-4055-8e76-9a87620b2694\") " pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:57.841853 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.841633    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6cebc9e-129a-4497-b4f2-02938471badf-ovn-node-metrics-cert\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.849755 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.849729    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstb8\" (UniqueName: \"kubernetes.io/projected/25c99216-1958-4203-9c43-1695d6e155e0-kube-api-access-bstb8\") pod \"multus-2pxl5\" (UID: \"25c99216-1958-4203-9c43-1695d6e155e0\") " pod="openshift-multus/multus-2pxl5"
May 21 13:02:57.858356 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.858302    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal" event={"ID":"2ffef27b8b441641ee91bc6a4ea4eecd","Type":"ContainerStarted","Data":"468cd848f5f9f21fe6b49d206a8de09af59e029f08b58b1aad6ab6e29db9bf10"}
May 21 13:02:57.859286 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.859267    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal" event={"ID":"bf620bc707d30c338bdd0243f6ea5345","Type":"ContainerStarted","Data":"6559da73d7b622f3ee013ad0c9aa9e243b643d3fa9f681a54957b3b81498f545"}
May 21 13:02:57.859779 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.859764    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmjc\" (UniqueName: \"kubernetes.io/projected/9c1194b8-b036-4f05-b271-409185f431fe-kube-api-access-7rmjc\") pod \"node-ca-6fq9q\" (UID: \"9c1194b8-b036-4f05-b271-409185f431fe\") " pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:57.872393 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.871728    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhrk\" (UniqueName: \"kubernetes.io/projected/9e219f45-6ef6-4869-bc74-883f150836bd-kube-api-access-gvhrk\") pod \"iptables-alerter-26nsr\" (UID: \"9e219f45-6ef6-4869-bc74-883f150836bd\") " pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:57.872393 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.871866    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wdp\" (UniqueName: \"kubernetes.io/projected/bbc40082-adb3-48f2-bcde-adb42f008c63-kube-api-access-z5wdp\") pod \"tuned-6z24m\" (UID: \"bbc40082-adb3-48f2-bcde-adb42f008c63\") " pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:57.872965 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.872944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm88z\" (UniqueName: \"kubernetes.io/projected/97be1c5d-9b40-4d11-a705-8689f2bc1d1d-kube-api-access-hm88z\") pod \"node-resolver-6jwv9\" (UID: \"97be1c5d-9b40-4d11-a705-8689f2bc1d1d\") " pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:57.873520 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.873498    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8wg\" (UniqueName: \"kubernetes.io/projected/dbe2c461-b14a-4ded-b5d0-f4811ec8b083-kube-api-access-hz8wg\") pod \"multus-additional-cni-plugins-7vr2k\" (UID: \"dbe2c461-b14a-4ded-b5d0-f4811ec8b083\") " pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:57.873595 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.873580    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqgl\" (UniqueName: \"kubernetes.io/projected/d6cebc9e-129a-4497-b4f2-02938471badf-kube-api-access-jdqgl\") pod \"ovnkube-node-xg827\" (UID: \"d6cebc9e-129a-4497-b4f2-02938471badf\") " pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:57.940268 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940244    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-device-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940268 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940273    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940293    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kczr\" (UniqueName: \"kubernetes.io/projected/62404bf4-3ebf-4c53-b55b-0a4197334123-kube-api-access-6kczr\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:57.940447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940321    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-socket-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940360    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-device-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940414    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940431    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-registration-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940444    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-socket-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940476    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940516    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzxb\" (UniqueName: \"kubernetes.io/projected/b45c0043-d0bb-45b6-8398-0448e025646e-kube-api-access-fnzxb\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940479    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-registration-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940536    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940579    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940861 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940636    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-sys-fs\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940861 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940683    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b45c0043-d0bb-45b6-8398-0448e025646e-sys-fs\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.940861 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.940686    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:57.940861 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.940748    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:57.940861 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.940823    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.440798013 +0000 UTC m=+2.162104889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:57.949380 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.949361    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:02:57.949380 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.949383    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:02:57.949505 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.949393    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:57.949505 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:57.949441    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.449429772 +0000 UTC m=+2.170736651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:57.952275 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.952253    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzxb\" (UniqueName: \"kubernetes.io/projected/b45c0043-d0bb-45b6-8398-0448e025646e-kube-api-access-fnzxb\") pod \"aws-ebs-csi-driver-node-pfbrj\" (UID: \"b45c0043-d0bb-45b6-8398-0448e025646e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:57.953346 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:57.953324    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kczr\" (UniqueName: \"kubernetes.io/projected/62404bf4-3ebf-4c53-b55b-0a4197334123-kube-api-access-6kczr\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:58.038039 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.037952    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fq9q"
May 21 13:02:58.044616 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.044593    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1194b8_b036_4f05_b271_409185f431fe.slice/crio-e6ac33349a534a6940c88dfbd157df7e0790f2937638abacbb6c0121778fa9d4 WatchSource:0}: Error finding container e6ac33349a534a6940c88dfbd157df7e0790f2937638abacbb6c0121778fa9d4: Status 404 returned error can't find the container with id e6ac33349a534a6940c88dfbd157df7e0790f2937638abacbb6c0121778fa9d4
May 21 13:02:58.058570 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.058549    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-26nsr"
May 21 13:02:58.064256 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.064231    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e219f45_6ef6_4869_bc74_883f150836bd.slice/crio-beca11605a28a381cf49eaf923e47e233655d738b63ec45e639d41aac43b6631 WatchSource:0}: Error finding container beca11605a28a381cf49eaf923e47e233655d738b63ec45e639d41aac43b6631: Status 404 returned error can't find the container with id beca11605a28a381cf49eaf923e47e233655d738b63ec45e639d41aac43b6631
May 21 13:02:58.078179 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.078159    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:02:58.083739 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.083719    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:02:58.084273 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.084251    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ff09d7_f6a7_4055_8e76_9a87620b2694.slice/crio-e65f54ad29280236162484300b6e11ea9d26058d8be5176bd6b3204bb74a9a42 WatchSource:0}: Error finding container e65f54ad29280236162484300b6e11ea9d26058d8be5176bd6b3204bb74a9a42: Status 404 returned error can't find the container with id e65f54ad29280236162484300b6e11ea9d26058d8be5176bd6b3204bb74a9a42
May 21 13:02:58.089030 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.089009    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6z24m"
May 21 13:02:58.090606 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.090582    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cebc9e_129a_4497_b4f2_02938471badf.slice/crio-f5b9d34fb30aceee22905a75fbb19ccc93dd21c856b7c282458992136d862ffe WatchSource:0}: Error finding container f5b9d34fb30aceee22905a75fbb19ccc93dd21c856b7c282458992136d862ffe: Status 404 returned error can't find the container with id f5b9d34fb30aceee22905a75fbb19ccc93dd21c856b7c282458992136d862ffe
May 21 13:02:58.094898 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.094880    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6jwv9"
May 21 13:02:58.095358 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.095292    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc40082_adb3_48f2_bcde_adb42f008c63.slice/crio-80b1ec9e2d4799da04df4cf6b309423c31821401ca13d1cf2d04d4d274220675 WatchSource:0}: Error finding container 80b1ec9e2d4799da04df4cf6b309423c31821401ca13d1cf2d04d4d274220675: Status 404 returned error can't find the container with id 80b1ec9e2d4799da04df4cf6b309423c31821401ca13d1cf2d04d4d274220675
May 21 13:02:58.100504 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.100484    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2pxl5"
May 21 13:02:58.100639 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.100620    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97be1c5d_9b40_4d11_a705_8689f2bc1d1d.slice/crio-c875bd917cea36b1dee55cbfa35dcdd85d0094c388f2b43047d061346127ca07 WatchSource:0}: Error finding container c875bd917cea36b1dee55cbfa35dcdd85d0094c388f2b43047d061346127ca07: Status 404 returned error can't find the container with id c875bd917cea36b1dee55cbfa35dcdd85d0094c388f2b43047d061346127ca07
May 21 13:02:58.105584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.105564    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vr2k"
May 21 13:02:58.106367 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.106347    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c99216_1958_4203_9c43_1695d6e155e0.slice/crio-1af99159a459a927fbbba60fd95a51fdb96f198a37ddbe2b561f1412f18027d1 WatchSource:0}: Error finding container 1af99159a459a927fbbba60fd95a51fdb96f198a37ddbe2b561f1412f18027d1: Status 404 returned error can't find the container with id 1af99159a459a927fbbba60fd95a51fdb96f198a37ddbe2b561f1412f18027d1
May 21 13:02:58.110380 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.110361    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj"
May 21 13:02:58.112454 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.112434    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe2c461_b14a_4ded_b5d0_f4811ec8b083.slice/crio-925bf0221637919ebf58c71a2b08a82d60a15c52140361a5336d61c2c17e098a WatchSource:0}: Error finding container 925bf0221637919ebf58c71a2b08a82d60a15c52140361a5336d61c2c17e098a: Status 404 returned error can't find the container with id 925bf0221637919ebf58c71a2b08a82d60a15c52140361a5336d61c2c17e098a
May 21 13:02:58.116694 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:02:58.116672    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45c0043_d0bb_45b6_8398_0448e025646e.slice/crio-da7ade4ac3c3fa8879db4e0950ba14f495cb7ca2a9db3ec7c1f0e84c1f71b18d WatchSource:0}: Error finding container da7ade4ac3c3fa8879db4e0950ba14f495cb7ca2a9db3ec7c1f0e84c1f71b18d: Status 404 returned error can't find the container with id da7ade4ac3c3fa8879db4e0950ba14f495cb7ca2a9db3ec7c1f0e84c1f71b18d
May 21 13:02:58.333668 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.333565    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:02:58.444299 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.444258    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:58.444477 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.444412    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:58.444521 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.444478    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:59.444458389 +0000 UTC m=+3.165765267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:58.545403 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.545363    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:58.545680 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.545636    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:02:58.545680 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.545674    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:02:58.545828 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.545688    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:58.545828 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:58.545756    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:59.545735461 +0000 UTC m=+3.267042354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:58.800596 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.800495    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:57 +0000 UTC" deadline="2027-10-22 09:10:56.017949342 +0000 UTC"
May 21 13:02:58.800596 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.800547    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12452h7m57.217406395s"
May 21 13:02:58.872907 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.872868    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj" event={"ID":"b45c0043-d0bb-45b6-8398-0448e025646e","Type":"ContainerStarted","Data":"da7ade4ac3c3fa8879db4e0950ba14f495cb7ca2a9db3ec7c1f0e84c1f71b18d"}
May 21 13:02:58.882760 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.882713    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerStarted","Data":"925bf0221637919ebf58c71a2b08a82d60a15c52140361a5336d61c2c17e098a"}
May 21 13:02:58.903209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.903115    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2pxl5" event={"ID":"25c99216-1958-4203-9c43-1695d6e155e0","Type":"ContainerStarted","Data":"1af99159a459a927fbbba60fd95a51fdb96f198a37ddbe2b561f1412f18027d1"}
May 21 13:02:58.933488 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.933447    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8k74" event={"ID":"52ff09d7-f6a7-4055-8e76-9a87620b2694","Type":"ContainerStarted","Data":"e65f54ad29280236162484300b6e11ea9d26058d8be5176bd6b3204bb74a9a42"}
May 21 13:02:58.943419 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.943378    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fq9q" event={"ID":"9c1194b8-b036-4f05-b271-409185f431fe","Type":"ContainerStarted","Data":"e6ac33349a534a6940c88dfbd157df7e0790f2937638abacbb6c0121778fa9d4"}
May 21 13:02:58.955189 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.955154    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6jwv9" event={"ID":"97be1c5d-9b40-4d11-a705-8689f2bc1d1d","Type":"ContainerStarted","Data":"c875bd917cea36b1dee55cbfa35dcdd85d0094c388f2b43047d061346127ca07"}
May 21 13:02:58.966943 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.966908    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6z24m" event={"ID":"bbc40082-adb3-48f2-bcde-adb42f008c63","Type":"ContainerStarted","Data":"80b1ec9e2d4799da04df4cf6b309423c31821401ca13d1cf2d04d4d274220675"}
May 21 13:02:58.987405 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:58.987365    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"f5b9d34fb30aceee22905a75fbb19ccc93dd21c856b7c282458992136d862ffe"}
May 21 13:02:59.019871 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.019799    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-26nsr" event={"ID":"9e219f45-6ef6-4869-bc74-883f150836bd","Type":"ContainerStarted","Data":"beca11605a28a381cf49eaf923e47e233655d738b63ec45e639d41aac43b6631"}
May 21 13:02:59.094714 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.094628    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:02:59.455146 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.455053    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:59.455306 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.455233    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:59.455306 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.455300    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:01.455281346 +0000 UTC m=+5.176588224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:02:59.556424 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.555775    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:59.556424 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.555971    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:02:59.556424 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.555992    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:02:59.556424 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.556004    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:59.556424 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.556060    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:01.556042065 +0000 UTC m=+5.277348943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:02:59.801042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.800935    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:57 +0000 UTC" deadline="2027-11-15 15:14:08.783048356 +0000 UTC"
May 21 13:02:59.801042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.800972    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13034h11m8.982080474s"
May 21 13:02:59.855000 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.854958    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:02:59.855176 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.855075    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:02:59.855581 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.855496    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:02:59.855740 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:02:59.855601    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:02:59.869409 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:02:59.868449    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 13:03:01.474896 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:01.474793    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:01.475340 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.474954    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:01.475340 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.475041    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:05.475018125 +0000 UTC m=+9.196325020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:01.576062 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:01.576017    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:01.576228 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.576206    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:03:01.576274 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.576232    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:03:01.576274 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.576248    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:01.576366 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.576320    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:05.576299983 +0000 UTC m=+9.297606864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:01.855776 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:01.855689    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:01.855928 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.855827    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:01.856253 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:01.856233    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:01.856375 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:01.856352    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:03.855394 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:03.855348    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:03.855881 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:03.855350    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:03.855881 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:03.855511    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:03.855881 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:03.855603    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:05.509461 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:05.509383    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:05.510054 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.509514    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:05.510054 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.509599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:13.509577208 +0000 UTC m=+17.230884095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:05.610685 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:05.610624    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:05.613403 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.613375    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:03:05.613566 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.613414    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:03:05.613566 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.613429    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:05.613566 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.613565    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:13.613537128 +0000 UTC m=+17.334844015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:05.855413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:05.855329    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:05.855572 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.855455    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:05.855891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:05.855863    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:05.856030 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:05.856003    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:07.854895 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:07.854856    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:07.855365 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:07.854865    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:07.855365 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:07.854979    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:07.855365 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:07.855112    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:09.855902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:09.855662    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:09.856362 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:09.855663    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:09.856362 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:09.856019    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:09.856362 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:09.856074    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:11.855306 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:11.855274    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:11.855862 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:11.855327    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:11.855862 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:11.855462    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:11.855862 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:11.855598    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:13.570904 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:13.570855    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:13.571360 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.570995    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:13.571360 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.571077    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:29.571054706 +0000 UTC m=+33.292361606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:13.671805 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:13.671766    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:13.671973 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.671919    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:03:13.671973 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.671941    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:03:13.671973 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.671954    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:13.672153 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.672008    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:29.671991156 +0000 UTC m=+33.393298040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:13.856090 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:13.855921    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:13.856090 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.856051    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:13.856090 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:13.856084    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:13.856362 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:13.856142    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:15.855153 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:15.855118    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:15.855584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:15.855126    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:15.855584 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:15.855249    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:15.855584 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:15.855354    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:17.063256 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.062904    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6z24m" event={"ID":"bbc40082-adb3-48f2-bcde-adb42f008c63","Type":"ContainerStarted","Data":"3ad36725735e221750aff90414e77769549df383fcb48fce15e765d389471edf"}
May 21 13:03:17.066266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.066034    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"c3706a069dc9a68000e09a85e0eee7a3048678c0da19e5eb93a1f0064bc16d8f"}
May 21 13:03:17.073950 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.073846    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal" event={"ID":"bf620bc707d30c338bdd0243f6ea5345","Type":"ContainerStarted","Data":"dba08034c7cd3561fa4435cc7fe1f44d97ae47797cafc7111e96b3dd06339e56"}
May 21 13:03:17.084639 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.084575    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6z24m" podStartSLOduration=1.408661067 podStartE2EDuration="20.084556903s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.09765766 +0000 UTC m=+1.818964550" lastFinishedPulling="2026-05-21 13:03:16.773553503 +0000 UTC m=+20.494860386" observedRunningTime="2026-05-21 13:03:17.084254296 +0000 UTC m=+20.805561192" watchObservedRunningTime="2026-05-21 13:03:17.084556903 +0000 UTC m=+20.805863800"
May 21 13:03:17.107142 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.107086    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-104.ec2.internal" podStartSLOduration=20.107047248 podStartE2EDuration="20.107047248s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:17.107036695 +0000 UTC m=+20.828343593" watchObservedRunningTime="2026-05-21 13:03:17.107047248 +0000 UTC m=+20.828354148"
May 21 13:03:17.855883 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.855672    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:17.856018 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:17.855679    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:17.856018 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:17.855981    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:17.856117 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:17.856051    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:18.082084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.082046    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2pxl5" event={"ID":"25c99216-1958-4203-9c43-1695d6e155e0","Type":"ContainerStarted","Data":"4d359286bb0e1a2b6be72a0d542b888e8b122b3077533523112a00373bcb3736"}
May 21 13:03:18.083554 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.083526    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8k74" event={"ID":"52ff09d7-f6a7-4055-8e76-9a87620b2694","Type":"ContainerStarted","Data":"424cb8cdd82720b00ebc23ca01c1bb92812bb7d5c1a343aeb91018b8696cb438"}
May 21 13:03:18.088044 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.088014    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fq9q" event={"ID":"9c1194b8-b036-4f05-b271-409185f431fe","Type":"ContainerStarted","Data":"00b61aabd08fb4be8a089ee38ac5be5e5f545b6d5e18efaaae983c4e3152038a"}
May 21 13:03:18.096877 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.096801    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6jwv9" event={"ID":"97be1c5d-9b40-4d11-a705-8689f2bc1d1d","Type":"ContainerStarted","Data":"5c37265e8b87bb595108f82b3096d726ecbe5dd83e9c453f0ac3eb901ebf609b"}
May 21 13:03:18.099759 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.099728    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"f406b73859bc37198cd7e6896b83f0537ba73b174a69b80f01259559ca300809"}
May 21 13:03:18.099759 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.099759    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"7177fc1a4428381b7e747fbec1d077b9ad1d3d869e6d2e18a03ac7fa62a73c07"}
May 21 13:03:18.099909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.099769    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"52f59ac283deab78630f4806a09a2cba0c403d05cec5c922cc3940fe490e2dac"}
May 21 13:03:18.099909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.099782    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"e39ea64013455ff54be76f74403e798fff4ba7ec18e753f9ca6c59842b46fcde"}
May 21 13:03:18.099909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.099794    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"1f7ce00cca02fcb122f9a0ba00160e6babe331b24e54031064b763b0040bc55d"}
May 21 13:03:18.101119 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.101092    2557 generic.go:358] "Generic (PLEG): container finished" podID="2ffef27b8b441641ee91bc6a4ea4eecd" containerID="db49cbdc4f188ab75a6912d3b588c61d7249ae6dd5c65126438514c735eda678" exitCode=0
May 21 13:03:18.101220 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.101171    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal" event={"ID":"2ffef27b8b441641ee91bc6a4ea4eecd","Type":"ContainerDied","Data":"db49cbdc4f188ab75a6912d3b588c61d7249ae6dd5c65126438514c735eda678"}
May 21 13:03:18.101500 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.101455    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2pxl5" podStartSLOduration=2.225410972 podStartE2EDuration="21.101439978s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.109017929 +0000 UTC m=+1.830324809" lastFinishedPulling="2026-05-21 13:03:16.985046924 +0000 UTC m=+20.706353815" observedRunningTime="2026-05-21 13:03:18.10105921 +0000 UTC m=+21.822366109" watchObservedRunningTime="2026-05-21 13:03:18.101439978 +0000 UTC m=+21.822746878"
May 21 13:03:18.102589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.102541    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj" event={"ID":"b45c0043-d0bb-45b6-8398-0448e025646e","Type":"ContainerStarted","Data":"5db84cae060a22e649c741871aa58df6b928909b9810ba4b73ddb89d29978429"}
May 21 13:03:18.104001 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.103979    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="40e3a32ee3360a03ba0c2eb95e3694da1a3f02012de4a4977b8dc3a31c12ef76" exitCode=0
May 21 13:03:18.104100 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.104033    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"40e3a32ee3360a03ba0c2eb95e3694da1a3f02012de4a4977b8dc3a31c12ef76"}
May 21 13:03:18.115422 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.115384    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6fq9q" podStartSLOduration=3.4236848970000002 podStartE2EDuration="22.115371017s" podCreationTimestamp="2026-05-21 13:02:56 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.046261121 +0000 UTC m=+1.767568010" lastFinishedPulling="2026-05-21 13:03:16.737947248 +0000 UTC m=+20.459254130" observedRunningTime="2026-05-21 13:03:18.114713875 +0000 UTC m=+21.836020772" watchObservedRunningTime="2026-05-21 13:03:18.115371017 +0000 UTC m=+21.836677916"
May 21 13:03:18.132750 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.132707    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x8k74" podStartSLOduration=2.481319517 podStartE2EDuration="21.132693383s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.086542921 +0000 UTC m=+1.807849801" lastFinishedPulling="2026-05-21 13:03:16.737916787 +0000 UTC m=+20.459223667" observedRunningTime="2026-05-21 13:03:18.132360426 +0000 UTC m=+21.853667323" watchObservedRunningTime="2026-05-21 13:03:18.132693383 +0000 UTC m=+21.854000282"
May 21 13:03:18.146759 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.146713    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6jwv9" podStartSLOduration=2.696987825 podStartE2EDuration="21.146702919s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.103463 +0000 UTC m=+1.824769876" lastFinishedPulling="2026-05-21 13:03:16.553178079 +0000 UTC m=+20.274484970" observedRunningTime="2026-05-21 13:03:18.146555895 +0000 UTC m=+21.867862793" watchObservedRunningTime="2026-05-21 13:03:18.146702919 +0000 UTC m=+21.868009816"
May 21 13:03:18.683612 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.683585    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 13:03:18.808448 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.808300    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T13:03:18.683604955Z","UUID":"aa666a58-ed89-4dd5-91ea-2026af0fc8bd","Handler":null,"Name":"","Endpoint":""}
May 21 13:03:18.810251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.810229    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 13:03:18.810366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:18.810261    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 13:03:19.108336 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.108299    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-26nsr" event={"ID":"9e219f45-6ef6-4869-bc74-883f150836bd","Type":"ContainerStarted","Data":"3779741f4eeb327f57556d5071caad46b0fe819da2159c6423af63a2a7ed5d40"}
May 21 13:03:19.110527 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.110495    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal" event={"ID":"2ffef27b8b441641ee91bc6a4ea4eecd","Type":"ContainerStarted","Data":"f2d7280d5658ddf9948639b49961f0aa99942e3844121d01e798278ce758b531"}
May 21 13:03:19.115622 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.115591    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj" event={"ID":"b45c0043-d0bb-45b6-8398-0448e025646e","Type":"ContainerStarted","Data":"0ead8e7b8281cf9ca8c044ca47746dd385ccc3580ad6710f1ef68500ec03f8be"}
May 21 13:03:19.124541 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.124487    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-26nsr" podStartSLOduration=3.452220165 podStartE2EDuration="22.124472918s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.065671766 +0000 UTC m=+1.786978641" lastFinishedPulling="2026-05-21 13:03:16.737924502 +0000 UTC m=+20.459231394" observedRunningTime="2026-05-21 13:03:19.124300015 +0000 UTC m=+22.845606914" watchObservedRunningTime="2026-05-21 13:03:19.124472918 +0000 UTC m=+22.845779821"
May 21 13:03:19.139989 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.139931    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-104.ec2.internal" podStartSLOduration=22.139913167 podStartE2EDuration="22.139913167s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:19.139512091 +0000 UTC m=+22.860818990" watchObservedRunningTime="2026-05-21 13:03:19.139913167 +0000 UTC m=+22.861220066"
May 21 13:03:19.581473 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.581439    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:03:19.582295 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.582273    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:03:19.855924 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.855842    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:19.855924 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:19.855864    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:19.856104 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:19.855951    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:19.856143 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:19.856099    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:20.119675 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:20.119578    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj" event={"ID":"b45c0043-d0bb-45b6-8398-0448e025646e","Type":"ContainerStarted","Data":"9dfbf292d0e6bc2ec7fc231ea20d337614c8df6ba08ab2cd1cfd991aa85eb1e1"}
May 21 13:03:20.122722 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:20.122697    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"6485ae0854f78aeb1335bff0adcb3f15411805a5f72fe823dfac3e0b83d48577"}
May 21 13:03:20.122878 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:20.122860    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:03:20.123353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:20.123337    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x8k74"
May 21 13:03:20.154225 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:20.154183    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfbrj" podStartSLOduration=1.631997444 podStartE2EDuration="23.154170189s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.118314068 +0000 UTC m=+1.839620944" lastFinishedPulling="2026-05-21 13:03:19.640486809 +0000 UTC m=+23.361793689" observedRunningTime="2026-05-21 13:03:20.139290314 +0000 UTC m=+23.860597211" watchObservedRunningTime="2026-05-21 13:03:20.154170189 +0000 UTC m=+23.875477110"
May 21 13:03:21.856035 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:21.855845    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:21.856391 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:21.855908    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:21.856391 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:21.856149    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:21.856391 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:21.856230    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:22.130139 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:22.130052    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" event={"ID":"d6cebc9e-129a-4497-b4f2-02938471badf","Type":"ContainerStarted","Data":"0cb0b97c7e7198abb1b6ed234af41c910d3702b66f9698105eca1cf171a2e9a4"}
May 21 13:03:22.156232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:22.156172    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xg827" podStartSLOduration=6.475660594 podStartE2EDuration="25.156152436s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.092447084 +0000 UTC m=+1.813753961" lastFinishedPulling="2026-05-21 13:03:16.772938704 +0000 UTC m=+20.494245803" observedRunningTime="2026-05-21 13:03:22.154784194 +0000 UTC m=+25.876091098" watchObservedRunningTime="2026-05-21 13:03:22.156152436 +0000 UTC m=+25.877459335"
May 21 13:03:22.450055 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:22.449959    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:23.132361 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.132329    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:23.133187 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.132375    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:23.148514 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.148488    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:23.148909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.148890    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:23.855541 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.855515    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:23.855638 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:23.855620    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:23.855698 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:23.855680    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:23.855792 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:23.855776    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:24.135105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:24.135023    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="d8ef658e27ce94478ebc8733f6b3993fb4819b0fb85257dc65622c9a71d2fbfa" exitCode=0
May 21 13:03:24.135552 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:24.135116    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"d8ef658e27ce94478ebc8733f6b3993fb4819b0fb85257dc65622c9a71d2fbfa"}
May 21 13:03:25.854970 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:25.854773    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:25.855364 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:25.854781    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:25.855364 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:25.855037    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:25.855364 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:25.855122    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:26.140396 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:26.140314    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="47b925c7a86eb2a89ef12fab99e800f80e051d8b913134b214bc1e76e2ec03d1" exitCode=0
May 21 13:03:26.140396 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:26.140369    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"47b925c7a86eb2a89ef12fab99e800f80e051d8b913134b214bc1e76e2ec03d1"}
May 21 13:03:27.855739 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:27.855696    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:27.856147 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:27.855696    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:27.856147 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:27.855846    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:27.856147 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:27.855875    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:28.146442 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:28.146338    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="ed5529c73ca9598bd496a5cb1ffbe42b6d627bf247d62ee617e9b1ba9c472435" exitCode=0
May 21 13:03:28.146442 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:28.146390    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"ed5529c73ca9598bd496a5cb1ffbe42b6d627bf247d62ee617e9b1ba9c472435"}
May 21 13:03:29.587829 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:29.587793    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:29.588239 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.587914    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:29.588239 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.587976    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs podName:62404bf4-3ebf-4c53-b55b-0a4197334123 nodeName:}" failed. No retries permitted until 2026-05-21 13:04:01.587959284 +0000 UTC m=+65.309266162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs") pod "network-metrics-daemon-zlwz4" (UID: "62404bf4-3ebf-4c53-b55b-0a4197334123") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 13:03:29.688809 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:29.688768    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:29.688960 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.688899    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 13:03:29.688960 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.688914    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 13:03:29.688960 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.688924    2557 projected.go:194] Error preparing data for projected volume kube-api-access-hfjh7 for pod openshift-network-diagnostics/network-check-target-rlfhl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:29.689070 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.688972    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7 podName:75d5b100-b520-4802-b016-c680a9c39700 nodeName:}" failed. No retries permitted until 2026-05-21 13:04:01.68896043 +0000 UTC m=+65.410267305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hfjh7" (UniqueName: "kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7") pod "network-check-target-rlfhl" (UID: "75d5b100-b520-4802-b016-c680a9c39700") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 13:03:29.855325 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:29.855241    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:29.855481 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.855354    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:29.855481 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:29.855431    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:29.855562 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:29.855527    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:31.836045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:31.836014    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zlwz4"]
May 21 13:03:31.836499 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:31.836139    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:31.836499 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:31.836233    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:31.839790 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:31.839760    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rlfhl"]
May 21 13:03:31.839908 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:31.839889    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:31.840014 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:31.839991    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:33.855129 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:33.855090    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:33.855550 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:33.855090    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:33.855550 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:33.855232    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zlwz4" podUID="62404bf4-3ebf-4c53-b55b-0a4197334123"
May 21 13:03:33.855550 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:33.855294    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlfhl" podUID="75d5b100-b520-4802-b016-c680a9c39700"
May 21 13:03:35.603825 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.603785    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-104.ec2.internal" event="NodeReady"
May 21 13:03:35.604278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.603947    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 13:03:35.655050 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.655010    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s2756"]
May 21 13:03:35.693155 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.693072    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b7jfc"]
May 21 13:03:35.693317 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.693258    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.695945 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.695920    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4szfj\""
May 21 13:03:35.695945 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.695931    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 13:03:35.696131 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.695976    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 13:03:35.717830 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.717807    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2756"]
May 21 13:03:35.717830 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.717834    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7jfc"]
May 21 13:03:35.718019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.717952    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.721817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.721793    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 13:03:35.722179 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.722155    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 13:03:35.722367 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.722346    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7b4pc\""
May 21 13:03:35.722627 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.722590    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 13:03:35.836521 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/457e2d6b-863e-4517-b456-0d16556a2358-tmp-dir\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.836755 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsxh7\" (UniqueName: \"kubernetes.io/projected/457e2d6b-863e-4517-b456-0d16556a2358-kube-api-access-dsxh7\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.836755 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/457e2d6b-863e-4517-b456-0d16556a2358-config-volume\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.836755 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6l6q\" (UniqueName: \"kubernetes.io/projected/44f3c210-aba1-4e92-8e2c-98fa9554d268-kube-api-access-f6l6q\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.836755 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f3c210-aba1-4e92-8e2c-98fa9554d268-cert\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.836919 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.836777    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/457e2d6b-863e-4517-b456-0d16556a2358-metrics-tls\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.855345 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.855312    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:03:35.855502 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.855312    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:03:35.858584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.858561    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4mfv\""
May 21 13:03:35.858725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.858607    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 13:03:35.858890 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.858867    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 13:03:35.859007 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.858898    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 13:03:35.860819 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.860801    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\""
May 21 13:03:35.937796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937765    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsxh7\" (UniqueName: \"kubernetes.io/projected/457e2d6b-863e-4517-b456-0d16556a2358-kube-api-access-dsxh7\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.938022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937812    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/457e2d6b-863e-4517-b456-0d16556a2358-config-volume\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.938022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937850    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6l6q\" (UniqueName: \"kubernetes.io/projected/44f3c210-aba1-4e92-8e2c-98fa9554d268-kube-api-access-f6l6q\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.938022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937876    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f3c210-aba1-4e92-8e2c-98fa9554d268-cert\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.938022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937908    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/457e2d6b-863e-4517-b456-0d16556a2358-metrics-tls\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.938022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.937956    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/457e2d6b-863e-4517-b456-0d16556a2358-tmp-dir\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.938552 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.938528    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/457e2d6b-863e-4517-b456-0d16556a2358-tmp-dir\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.938716 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.938693    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/457e2d6b-863e-4517-b456-0d16556a2358-config-volume\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.942587 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.942491    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/457e2d6b-863e-4517-b456-0d16556a2358-metrics-tls\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.942738 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.942715    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f3c210-aba1-4e92-8e2c-98fa9554d268-cert\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:35.945874 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.945830    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsxh7\" (UniqueName: \"kubernetes.io/projected/457e2d6b-863e-4517-b456-0d16556a2358-kube-api-access-dsxh7\") pod \"dns-default-s2756\" (UID: \"457e2d6b-863e-4517-b456-0d16556a2358\") " pod="openshift-dns/dns-default-s2756"
May 21 13:03:35.946166 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:35.946144    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6l6q\" (UniqueName: \"kubernetes.io/projected/44f3c210-aba1-4e92-8e2c-98fa9554d268-kube-api-access-f6l6q\") pod \"ingress-canary-b7jfc\" (UID: \"44f3c210-aba1-4e92-8e2c-98fa9554d268\") " pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:36.005036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:36.004998    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2756"
May 21 13:03:36.028059 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:36.028021    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7jfc"
May 21 13:03:36.570963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:36.570926    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7jfc"]
May 21 13:03:36.573545 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:36.573521    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2756"]
May 21 13:03:36.637175 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:36.637139    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f3c210_aba1_4e92_8e2c_98fa9554d268.slice/crio-ea837884940a7bc96d2d38e9826308293242c1fcec49dc47dfeb13519c9f8061 WatchSource:0}: Error finding container ea837884940a7bc96d2d38e9826308293242c1fcec49dc47dfeb13519c9f8061: Status 404 returned error can't find the container with id ea837884940a7bc96d2d38e9826308293242c1fcec49dc47dfeb13519c9f8061
May 21 13:03:36.638095 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:36.637767    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457e2d6b_863e_4517_b456_0d16556a2358.slice/crio-02b4e0c4c2eed826194dbc9453de1413b9032001f1bfb8693b1b8bea1332377d WatchSource:0}: Error finding container 02b4e0c4c2eed826194dbc9453de1413b9032001f1bfb8693b1b8bea1332377d: Status 404 returned error can't find the container with id 02b4e0c4c2eed826194dbc9453de1413b9032001f1bfb8693b1b8bea1332377d
May 21 13:03:37.165981 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:37.165772    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2756" event={"ID":"457e2d6b-863e-4517-b456-0d16556a2358","Type":"ContainerStarted","Data":"02b4e0c4c2eed826194dbc9453de1413b9032001f1bfb8693b1b8bea1332377d"}
May 21 13:03:37.168109 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:37.168037    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="f325dfb023c611949ecc09771fb5410d9febfd79147249c210e417298c57aa5b" exitCode=0
May 21 13:03:37.168109 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:37.168101    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"f325dfb023c611949ecc09771fb5410d9febfd79147249c210e417298c57aa5b"}
May 21 13:03:37.169235 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:37.169200    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7jfc" event={"ID":"44f3c210-aba1-4e92-8e2c-98fa9554d268","Type":"ContainerStarted","Data":"ea837884940a7bc96d2d38e9826308293242c1fcec49dc47dfeb13519c9f8061"}
May 21 13:03:37.599125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:37.599089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6jwv9_97be1c5d-9b40-4d11-a705-8689f2bc1d1d/dns-node-resolver/0.log"
May 21 13:03:38.173684 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.173634    2557 generic.go:358] "Generic (PLEG): container finished" podID="dbe2c461-b14a-4ded-b5d0-f4811ec8b083" containerID="543226f7fd797061958961b29b0da418a5a744f9a6a6183edb02f6ecca4e8c63" exitCode=0
May 21 13:03:38.173684 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.173679    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerDied","Data":"543226f7fd797061958961b29b0da418a5a744f9a6a6183edb02f6ecca4e8c63"}
May 21 13:03:38.744310 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.744273    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m8hw4"]
May 21 13:03:38.754967 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.754939    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.757528 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.757497    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-722bt\""
May 21 13:03:38.757689 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.757534    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 13:03:38.757689 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.757677    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 13:03:38.757912 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.757894    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 13:03:38.759082 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.759066    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 13:03:38.764876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.764853    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m8hw4"]
May 21 13:03:38.814520 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.814501    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fq9q_9c1194b8-b036-4f05-b271-409185f431fe/node-ca/0.log"
May 21 13:03:38.862682 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.862641    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjst2\" (UniqueName: \"kubernetes.io/projected/c655fb24-c9b6-4369-9162-2499aeb47448-kube-api-access-hjst2\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.862813 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.862726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c655fb24-c9b6-4369-9162-2499aeb47448-crio-socket\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.862813 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.862753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c655fb24-c9b6-4369-9162-2499aeb47448-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.862813 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.862798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c655fb24-c9b6-4369-9162-2499aeb47448-data-volume\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.862959 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.862829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c655fb24-c9b6-4369-9162-2499aeb47448-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964176 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964141    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c655fb24-c9b6-4369-9162-2499aeb47448-data-volume\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964298 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964186    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c655fb24-c9b6-4369-9162-2499aeb47448-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964298 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964267    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjst2\" (UniqueName: \"kubernetes.io/projected/c655fb24-c9b6-4369-9162-2499aeb47448-kube-api-access-hjst2\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964391 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964300    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c655fb24-c9b6-4369-9162-2499aeb47448-crio-socket\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964391 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964329    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c655fb24-c9b6-4369-9162-2499aeb47448-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.964488 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.964463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c655fb24-c9b6-4369-9162-2499aeb47448-data-volume\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.965496 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.965298    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c655fb24-c9b6-4369-9162-2499aeb47448-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.965496 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.965461    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c655fb24-c9b6-4369-9162-2499aeb47448-crio-socket\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.969836 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.969763    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c655fb24-c9b6-4369-9162-2499aeb47448-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:38.991419 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:38.991398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjst2\" (UniqueName: \"kubernetes.io/projected/c655fb24-c9b6-4369-9162-2499aeb47448-kube-api-access-hjst2\") pod \"insights-runtime-extractor-m8hw4\" (UID: \"c655fb24-c9b6-4369-9162-2499aeb47448\") " pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:39.063848 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.063827    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m8hw4"
May 21 13:03:39.191276 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.191182    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" event={"ID":"dbe2c461-b14a-4ded-b5d0-f4811ec8b083","Type":"ContainerStarted","Data":"f561eadb8ed567c7850d33dc616cfdc8be89f2073dbb05e0ec3771944ba98c76"}
May 21 13:03:39.193742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.193713    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7jfc" event={"ID":"44f3c210-aba1-4e92-8e2c-98fa9554d268","Type":"ContainerStarted","Data":"28b5d63d2689a6c70f2c58fc26b43f4512a0f44c4e99eddc832563cb5f92fb2a"}
May 21 13:03:39.201051 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.201025    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2756" event={"ID":"457e2d6b-863e-4517-b456-0d16556a2358","Type":"ContainerStarted","Data":"9614ec4f67407bf7c9ebdedf13c1ac3a7b423ca88785b8a398d3f38c57d01415"}
May 21 13:03:39.217482 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.217206    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7vr2k" podStartSLOduration=3.664431133 podStartE2EDuration="42.217186756s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:02:58.114134246 +0000 UTC m=+1.835441122" lastFinishedPulling="2026-05-21 13:03:36.666889859 +0000 UTC m=+40.388196745" observedRunningTime="2026-05-21 13:03:39.215738524 +0000 UTC m=+42.937045423" watchObservedRunningTime="2026-05-21 13:03:39.217186756 +0000 UTC m=+42.938493657"
May 21 13:03:39.231232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.231173    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b7jfc" podStartSLOduration=1.938357441 podStartE2EDuration="4.231155924s" podCreationTimestamp="2026-05-21 13:03:35 +0000 UTC" firstStartedPulling="2026-05-21 13:03:36.644251836 +0000 UTC m=+40.365558712" lastFinishedPulling="2026-05-21 13:03:38.937050309 +0000 UTC m=+42.658357195" observedRunningTime="2026-05-21 13:03:39.230439102 +0000 UTC m=+42.951746000" watchObservedRunningTime="2026-05-21 13:03:39.231155924 +0000 UTC m=+42.952462823"
May 21 13:03:39.237480 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.237433    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m8hw4"]
May 21 13:03:39.242371 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:39.242337    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc655fb24_c9b6_4369_9162_2499aeb47448.slice/crio-6ce43a180fa3ed252f6fb3c8c6aa81f294914319babcb6954ef4327baca5d7dd WatchSource:0}: Error finding container 6ce43a180fa3ed252f6fb3c8c6aa81f294914319babcb6954ef4327baca5d7dd: Status 404 returned error can't find the container with id 6ce43a180fa3ed252f6fb3c8c6aa81f294914319babcb6954ef4327baca5d7dd
May 21 13:03:39.421450 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.421417    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"]
May 21 13:03:39.438783 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.438758    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"]
May 21 13:03:39.438926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.438874    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.442075 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442021    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 13:03:39.442843 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442805    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 13:03:39.442956 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442867    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 13:03:39.442956 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442880    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 13:03:39.442956 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442880    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 13:03:39.442956 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.442897    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mghtw\""
May 21 13:03:39.571339 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.571293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.571507 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.571369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.571507 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.571394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4741b0bd-67ca-4f96-bc9b-29983c8143ca-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.571507 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.571423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk9vs\" (UniqueName: \"kubernetes.io/projected/4741b0bd-67ca-4f96-bc9b-29983c8143ca-kube-api-access-gk9vs\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.672437 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.672403    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.672577 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.672459    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.672577 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.672483    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4741b0bd-67ca-4f96-bc9b-29983c8143ca-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.672577 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.672527    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk9vs\" (UniqueName: \"kubernetes.io/projected/4741b0bd-67ca-4f96-bc9b-29983c8143ca-kube-api-access-gk9vs\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.672577 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:39.672554    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 21 13:03:39.672764 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:39.672626    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls podName:4741b0bd-67ca-4f96-bc9b-29983c8143ca nodeName:}" failed. No retries permitted until 2026-05-21 13:03:40.172609822 +0000 UTC m=+43.893916721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-4vrv2" (UID: "4741b0bd-67ca-4f96-bc9b-29983c8143ca") : secret "prometheus-operator-tls" not found
May 21 13:03:39.673196 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.673177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4741b0bd-67ca-4f96-bc9b-29983c8143ca-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.675750 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.675731    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.682890 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.682868    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk9vs\" (UniqueName: \"kubernetes.io/projected/4741b0bd-67ca-4f96-bc9b-29983c8143ca-kube-api-access-gk9vs\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:39.798283 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:39.798257    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7jfc_44f3c210-aba1-4e92-8e2c-98fa9554d268/serve-healthcheck-canary/0.log"
May 21 13:03:40.175956 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.175869    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:40.176088 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:40.175985    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 21 13:03:40.176088 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:40.176042    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls podName:4741b0bd-67ca-4f96-bc9b-29983c8143ca nodeName:}" failed. No retries permitted until 2026-05-21 13:03:41.176029295 +0000 UTC m=+44.897336171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-4vrv2" (UID: "4741b0bd-67ca-4f96-bc9b-29983c8143ca") : secret "prometheus-operator-tls" not found
May 21 13:03:40.204683 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.204637    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8hw4" event={"ID":"c655fb24-c9b6-4369-9162-2499aeb47448","Type":"ContainerStarted","Data":"5d65a56fc45db68be9f9652a708322499039f5e1638fd6c3cdad2cdc09e7c9a0"}
May 21 13:03:40.204683 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.204684    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8hw4" event={"ID":"c655fb24-c9b6-4369-9162-2499aeb47448","Type":"ContainerStarted","Data":"6ce43a180fa3ed252f6fb3c8c6aa81f294914319babcb6954ef4327baca5d7dd"}
May 21 13:03:40.206022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.205995    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2756" event={"ID":"457e2d6b-863e-4517-b456-0d16556a2358","Type":"ContainerStarted","Data":"02f085a734bf4ac40a2bec63701b9f35e7025161c1bf8e0cec9df55c63c309f3"}
May 21 13:03:40.206632 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.206616    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s2756"
May 21 13:03:40.224539 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:40.224493    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-s2756" podStartSLOduration=2.934241687 podStartE2EDuration="5.224477863s" podCreationTimestamp="2026-05-21 13:03:35 +0000 UTC" firstStartedPulling="2026-05-21 13:03:36.644272573 +0000 UTC m=+40.365579449" lastFinishedPulling="2026-05-21 13:03:38.934508743 +0000 UTC m=+42.655815625" observedRunningTime="2026-05-21 13:03:40.224378342 +0000 UTC m=+43.945685240" watchObservedRunningTime="2026-05-21 13:03:40.224477863 +0000 UTC m=+43.945784762"
May 21 13:03:41.183280 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:41.183069    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:41.186518 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:41.186484    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4741b0bd-67ca-4f96-bc9b-29983c8143ca-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-4vrv2\" (UID: \"4741b0bd-67ca-4f96-bc9b-29983c8143ca\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:41.209738 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:41.209702    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8hw4" event={"ID":"c655fb24-c9b6-4369-9162-2499aeb47448","Type":"ContainerStarted","Data":"1a8b7f960248bc0fb90e54f70820302f5a732c04a7ab5bcdee7e32c18e4df179"}
May 21 13:03:41.248305 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:41.248265    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"
May 21 13:03:41.381928 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:41.381857    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2"]
May 21 13:03:41.385026 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:41.384995    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4741b0bd_67ca_4f96_bc9b_29983c8143ca.slice/crio-d31967b75060718d7424c07c27b1c72b7bd29f45b76b0feb20b594d530343c79 WatchSource:0}: Error finding container d31967b75060718d7424c07c27b1c72b7bd29f45b76b0feb20b594d530343c79: Status 404 returned error can't find the container with id d31967b75060718d7424c07c27b1c72b7bd29f45b76b0feb20b594d530343c79
May 21 13:03:42.213244 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:42.213201    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2" event={"ID":"4741b0bd-67ca-4f96-bc9b-29983c8143ca","Type":"ContainerStarted","Data":"d31967b75060718d7424c07c27b1c72b7bd29f45b76b0feb20b594d530343c79"}
May 21 13:03:43.217526 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:43.217482    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8hw4" event={"ID":"c655fb24-c9b6-4369-9162-2499aeb47448","Type":"ContainerStarted","Data":"aae64092d13b12c91d868287476c595da9e15acb68eb02268dac6e61269b37ba"}
May 21 13:03:43.240637 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:43.240460    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m8hw4" podStartSLOduration=1.683632903 podStartE2EDuration="5.240446526s" podCreationTimestamp="2026-05-21 13:03:38 +0000 UTC" firstStartedPulling="2026-05-21 13:03:39.353842292 +0000 UTC m=+43.075149179" lastFinishedPulling="2026-05-21 13:03:42.910655912 +0000 UTC m=+46.631962802" observedRunningTime="2026-05-21 13:03:43.239617797 +0000 UTC m=+46.960924695" watchObservedRunningTime="2026-05-21 13:03:43.240446526 +0000 UTC m=+46.961753424"
May 21 13:03:44.221839 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:44.221797    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2" event={"ID":"4741b0bd-67ca-4f96-bc9b-29983c8143ca","Type":"ContainerStarted","Data":"1cc16368b3c18e64559d7e760505aecffb7a72442e4b7c625fbc6393e9ecba86"}
May 21 13:03:44.221839 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:44.221843    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2" event={"ID":"4741b0bd-67ca-4f96-bc9b-29983c8143ca","Type":"ContainerStarted","Data":"6abe55f2de4d6085d3261c0e6433fedba3817971fd3bbb316bd7dcd9ea2d1921"}
May 21 13:03:44.239710 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:44.239638    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-4vrv2" podStartSLOduration=3.425622731 podStartE2EDuration="5.239623771s" podCreationTimestamp="2026-05-21 13:03:39 +0000 UTC" firstStartedPulling="2026-05-21 13:03:41.386839167 +0000 UTC m=+45.108146044" lastFinishedPulling="2026-05-21 13:03:43.200840208 +0000 UTC m=+46.922147084" observedRunningTime="2026-05-21 13:03:44.239219003 +0000 UTC m=+47.960525906" watchObservedRunningTime="2026-05-21 13:03:44.239623771 +0000 UTC m=+47.960930669"
May 21 13:03:45.264809 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.264773    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:03:45.266931 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.266911    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.270748 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.270729    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 13:03:45.271097 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271077    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 13:03:45.271173 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271082    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 13:03:45.271173 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271135    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 13:03:45.271709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271693    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s69mp\""
May 21 13:03:45.271709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271700    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 13:03:45.271844 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271724    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 13:03:45.271844 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.271793    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 13:03:45.282632 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.282613    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:03:45.313716 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.313689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.313851 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.313744    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.313951 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.313928    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.313995 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.313974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.314034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.314006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.314070 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.314055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k6pp\" (UniqueName: \"kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.414709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.414709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414709    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.414909 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414744    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.414946 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414919    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2k6pp\" (UniqueName: \"kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.414980 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414965    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.415009 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.414999    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.415467 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.415450    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.415539 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.415465    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.415589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.415574    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.418431 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.418413    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.418556 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.418538    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.423348 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.423320    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k6pp\" (UniqueName: \"kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp\") pod \"console-c9556d5c6-7c5x5\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") " pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.576886 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.576803    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:45.706463 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.706431    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:03:45.710103 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:45.710076    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092319bc_599a_4157_9978_b219756fef87.slice/crio-d72af42e302813158dbcfa20577f9d65ccf9443e65d04358fe97f071cf6a26c3 WatchSource:0}: Error finding container d72af42e302813158dbcfa20577f9d65ccf9443e65d04358fe97f071cf6a26c3: Status 404 returned error can't find the container with id d72af42e302813158dbcfa20577f9d65ccf9443e65d04358fe97f071cf6a26c3
May 21 13:03:45.890925 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.890847    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"]
May 21 13:03:45.893728 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.893712    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:45.897073 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.897050    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 13:03:45.897183 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.897081    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 13:03:45.897183 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.897050    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wzc2s\""
May 21 13:03:45.913982 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.913955    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"]
May 21 13:03:45.918203 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.918179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:45.918323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.918236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:45.918323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.918262    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpd5\" (UniqueName: \"kubernetes.io/projected/76151287-bb4c-4f62-98e8-6b985fbf2fe2-kube-api-access-4mpd5\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:45.918323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.918284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76151287-bb4c-4f62-98e8-6b985fbf2fe2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:45.933633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.933605    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"]
May 21 13:03:45.935773 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.935755    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:45.939057 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.939036    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 13:03:45.939794 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.939761    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qlbmz\""
May 21 13:03:45.939794 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.939763    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 13:03:45.940598 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.940576    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 13:03:45.957076 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.957052    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"]
May 21 13:03:45.957937 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.957912    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gq2l8"]
May 21 13:03:45.960234 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.960211    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:45.962784 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.962762    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vl85\""
May 21 13:03:45.962876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.962818    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 13:03:45.963018 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.963006    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 13:03:45.963060 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:45.963051    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 13:03:46.019566 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.019566 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-sys\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019722    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7nk\" (UniqueName: \"kubernetes.io/projected/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-api-access-rh7nk\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.019796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019847    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019893    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpd5\" (UniqueName: \"kubernetes.io/projected/76151287-bb4c-4f62-98e8-6b985fbf2fe2-kube-api-access-4mpd5\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-root\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.019987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-textfile\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfk2\" (UniqueName: \"kubernetes.io/projected/30cd7f53-3b07-40e0-9964-a66816fd8735-kube-api-access-jpfk2\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-wtmp\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020135 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-metrics-client-ca\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.020454 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020144    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76151287-bb4c-4f62-98e8-6b985fbf2fe2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.020454 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.020795 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.020779    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76151287-bb4c-4f62-98e8-6b985fbf2fe2-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.022538 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.022519    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.022595 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.022552    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76151287-bb4c-4f62-98e8-6b985fbf2fe2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.030214 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.030189    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpd5\" (UniqueName: \"kubernetes.io/projected/76151287-bb4c-4f62-98e8-6b985fbf2fe2-kube-api-access-4mpd5\") pod \"openshift-state-metrics-9c959559f-lgh45\" (UID: \"76151287-bb4c-4f62-98e8-6b985fbf2fe2\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.120920 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.120718    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121086 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.120940    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121086 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.120967    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121086 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.120999    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-sys\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121086 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121055    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-sys\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121306 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121127    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121472 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121448    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121706 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121681    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121723    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7nk\" (UniqueName: \"kubernetes.io/projected/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-api-access-rh7nk\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121756    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.121954 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121841    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-root\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121954 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121865    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121954 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121891    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-textfile\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.121954 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121921    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfk2\" (UniqueName: \"kubernetes.io/projected/30cd7f53-3b07-40e0-9964-a66816fd8735-kube-api-access-jpfk2\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122197 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121972    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-wtmp\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122197 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.121992    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-metrics-client-ca\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122197 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:46.122146    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 13:03:46.122368 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:46.122208    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls podName:30cd7f53-3b07-40e0-9964-a66816fd8735 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:46.622190783 +0000 UTC m=+50.343497674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls") pod "node-exporter-gq2l8" (UID: "30cd7f53-3b07-40e0-9964-a66816fd8735") : secret "node-exporter-tls" not found
May 21 13:03:46.122368 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122288    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.122488 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122537 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122517    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30cd7f53-3b07-40e0-9964-a66816fd8735-metrics-client-ca\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122529    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-root\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.122589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122576    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-wtmp\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.123406 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-textfile\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.123406 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.122810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.124336 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.124307    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.124418 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.124396    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.124581 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.124566    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.130795 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.130776    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfk2\" (UniqueName: \"kubernetes.io/projected/30cd7f53-3b07-40e0-9964-a66816fd8735-kube-api-access-jpfk2\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.131199 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.131181    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh7nk\" (UniqueName: \"kubernetes.io/projected/2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8-kube-api-access-rh7nk\") pod \"kube-state-metrics-54fd6bc5c4-kpw8s\" (UID: \"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.203277 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.203195    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"
May 21 13:03:46.228787 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.228753    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9556d5c6-7c5x5" event={"ID":"092319bc-599a-4157-9978-b219756fef87","Type":"ContainerStarted","Data":"d72af42e302813158dbcfa20577f9d65ccf9443e65d04358fe97f071cf6a26c3"}
May 21 13:03:46.244998 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.244968    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"
May 21 13:03:46.346743 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.346660    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lgh45"]
May 21 13:03:46.352121 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:46.352093    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76151287_bb4c_4f62_98e8_6b985fbf2fe2.slice/crio-1702330d2eae6678d74bb6887f714057f61ca85ca481b12412e5a93b6a4744ef WatchSource:0}: Error finding container 1702330d2eae6678d74bb6887f714057f61ca85ca481b12412e5a93b6a4744ef: Status 404 returned error can't find the container with id 1702330d2eae6678d74bb6887f714057f61ca85ca481b12412e5a93b6a4744ef
May 21 13:03:46.412065 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.412022    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s"]
May 21 13:03:46.414444 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:46.414420    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fef88d0_5bf7_4f88_a6e9_6f4c396af1d8.slice/crio-9cb62b30b0cd99e70387704d01e62a59a112d8a4f0ad446da7864713b0594800 WatchSource:0}: Error finding container 9cb62b30b0cd99e70387704d01e62a59a112d8a4f0ad446da7864713b0594800: Status 404 returned error can't find the container with id 9cb62b30b0cd99e70387704d01e62a59a112d8a4f0ad446da7864713b0594800
May 21 13:03:46.626130 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.626092    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.629370 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.629341    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30cd7f53-3b07-40e0-9964-a66816fd8735-node-exporter-tls\") pod \"node-exporter-gq2l8\" (UID: \"30cd7f53-3b07-40e0-9964-a66816fd8735\") " pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.868021 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.867991    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq2l8"
May 21 13:03:46.875782 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.875753    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:03:46.879101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.879077    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882141    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882163    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882449    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882476    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882532    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882788    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882805    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882838    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.882901    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8l2lh\""
May 21 13:03:46.883209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.883084    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 13:03:46.907282 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.907253    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:03:46.929636 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.929824 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.929824 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.929824 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929759    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.929824 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929825    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jptvb\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.929983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930282 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.930025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:46.930282 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:46.930054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.030777 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.030739    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.030958 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.030792    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.030958 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.030854    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.030958 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.030910    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031124 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:03:47.030979    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle podName:e404995f-f6b3-4708-b5e3-e10f21b8e0a7 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:47.530951908 +0000 UTC m=+51.252258798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7") : configmap references non-existent config key: ca-bundle.crt
May 21 13:03:47.031124 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031015    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031124 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031058    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031186    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jptvb\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031223    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031262    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031288    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031323    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031373    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031416    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.031923 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.031779    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.032485 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.032444    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.037985    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038147 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.038078    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038223 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.038188    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.038449    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.038558    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.038999 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.038951    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.039093 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.039004    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.039230 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.039200    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.040443 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.040419    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.052089 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.052062    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jptvb\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.237390 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.237071    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s" event={"ID":"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8","Type":"ContainerStarted","Data":"9cb62b30b0cd99e70387704d01e62a59a112d8a4f0ad446da7864713b0594800"}
May 21 13:03:47.240259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.240229    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq2l8" event={"ID":"30cd7f53-3b07-40e0-9964-a66816fd8735","Type":"ContainerStarted","Data":"66bf569aa77027d7af59358d3daf587bea8677c9c3b4fa77faea41f2a4a36f19"}
May 21 13:03:47.259289 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.259253    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45" event={"ID":"76151287-bb4c-4f62-98e8-6b985fbf2fe2","Type":"ContainerStarted","Data":"3042ba37aa67b87988e89cb116b176c04cfdfb5d128395cd509e490818f752b8"}
May 21 13:03:47.259289 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.259294    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45" event={"ID":"76151287-bb4c-4f62-98e8-6b985fbf2fe2","Type":"ContainerStarted","Data":"f66f0c63cd537dfa24534edd1294cef498254fdf117cb418628a1fe8297160d6"}
May 21 13:03:47.259628 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.259323    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45" event={"ID":"76151287-bb4c-4f62-98e8-6b985fbf2fe2","Type":"ContainerStarted","Data":"1702330d2eae6678d74bb6887f714057f61ca85ca481b12412e5a93b6a4744ef"}
May 21 13:03:47.542603 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.541685    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.542603 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.542534    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:47.809527 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:47.809439    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:03:48.861929 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.861890    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-848d49d7b9-djrcw"]
May 21 13:03:48.865385 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.865360    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.869195 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869170    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 13:03:48.869195 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869189    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 13:03:48.869395 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869177    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 13:03:48.869905 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869826    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-csg4r\""
May 21 13:03:48.869905 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869841    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 13:03:48.869905 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869884    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 13:03:48.870116 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.869928    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-r0uj1b0u6bf5\""
May 21 13:03:48.875749 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.875724    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-848d49d7b9-djrcw"]
May 21 13:03:48.953964 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.953923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954150 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.953977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6133ca4c-eb49-49f5-8526-5c6248698ebd-metrics-client-ca\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954150 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954150 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954150 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps2mc\" (UniqueName: \"kubernetes.io/projected/6133ca4c-eb49-49f5-8526-5c6248698ebd-kube-api-access-ps2mc\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954150 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-grpc-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954384 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954164    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:48.954384 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:48.954218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055000 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.054962    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055009    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6133ca4c-eb49-49f5-8526-5c6248698ebd-metrics-client-ca\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055038    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055062    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps2mc\" (UniqueName: \"kubernetes.io/projected/6133ca4c-eb49-49f5-8526-5c6248698ebd-kube-api-access-ps2mc\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055130    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-grpc-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055172    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055463 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055200    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.055945 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.055896    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6133ca4c-eb49-49f5-8526-5c6248698ebd-metrics-client-ca\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.058725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.058670    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.058725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.058715    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.058868 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.058760    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.058868 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.058853    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.059584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.059554    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-grpc-tls\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.059752 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.059731    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6133ca4c-eb49-49f5-8526-5c6248698ebd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.066894 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.066872    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps2mc\" (UniqueName: \"kubernetes.io/projected/6133ca4c-eb49-49f5-8526-5c6248698ebd-kube-api-access-ps2mc\") pod \"thanos-querier-848d49d7b9-djrcw\" (UID: \"6133ca4c-eb49-49f5-8526-5c6248698ebd\") " pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.177363 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.177275    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:49.847373 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.845241    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:03:49.858130 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:49.858083    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode404995f_f6b3_4708_b5e3_e10f21b8e0a7.slice/crio-b3ab5823c6454409f82981906bd0ebe1294f3b8ae96a7d8e990d2b4af84a4c77 WatchSource:0}: Error finding container b3ab5823c6454409f82981906bd0ebe1294f3b8ae96a7d8e990d2b4af84a4c77: Status 404 returned error can't find the container with id b3ab5823c6454409f82981906bd0ebe1294f3b8ae96a7d8e990d2b4af84a4c77
May 21 13:03:49.879936 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:49.879467    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-848d49d7b9-djrcw"]
May 21 13:03:49.883381 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:49.883351    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6133ca4c_eb49_49f5_8526_5c6248698ebd.slice/crio-8c2f974ae0cd38c7873a8b7c8e68ededdfe7b5f604b44c3b2dea00768fd6f273 WatchSource:0}: Error finding container 8c2f974ae0cd38c7873a8b7c8e68ededdfe7b5f604b44c3b2dea00768fd6f273: Status 404 returned error can't find the container with id 8c2f974ae0cd38c7873a8b7c8e68ededdfe7b5f604b44c3b2dea00768fd6f273
May 21 13:03:50.211802 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.211725    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s2756"
May 21 13:03:50.272043 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.272007    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45" event={"ID":"76151287-bb4c-4f62-98e8-6b985fbf2fe2","Type":"ContainerStarted","Data":"a408ea3690e2ec6d7c639cf039c924d8255c9964b0be76dd5ea77841bd402bb6"}
May 21 13:03:50.273958 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.273934    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"8c2f974ae0cd38c7873a8b7c8e68ededdfe7b5f604b44c3b2dea00768fd6f273"}
May 21 13:03:50.276375 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.276335    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s" event={"ID":"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8","Type":"ContainerStarted","Data":"1e603f68eb8f5031637b2baeb3ae39f5dedf700408a52ea84cec0309d51f2d32"}
May 21 13:03:50.276587 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.276564    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s" event={"ID":"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8","Type":"ContainerStarted","Data":"3225308208f63b0f8ce4a689a357c6d2c51e2db825cb52648586fa679fef3fda"}
May 21 13:03:50.276732 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.276589    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s" event={"ID":"2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8","Type":"ContainerStarted","Data":"6338f36f4b7c5f9586ff2e64029acc698a7b9f33a0946f5b40e2832f36a0d8af"}
May 21 13:03:50.277962 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.277936    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9556d5c6-7c5x5" event={"ID":"092319bc-599a-4157-9978-b219756fef87","Type":"ContainerStarted","Data":"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"}
May 21 13:03:50.280475 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.280452    2557 generic.go:358] "Generic (PLEG): container finished" podID="30cd7f53-3b07-40e0-9964-a66816fd8735" containerID="442d9cbaa8da4e19c2703015256a83314f38fcb040e9b5de667b7bd270f35991" exitCode=0
May 21 13:03:50.281551 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.280993    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq2l8" event={"ID":"30cd7f53-3b07-40e0-9964-a66816fd8735","Type":"ContainerDied","Data":"442d9cbaa8da4e19c2703015256a83314f38fcb040e9b5de667b7bd270f35991"}
May 21 13:03:50.282050 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.282025    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"b3ab5823c6454409f82981906bd0ebe1294f3b8ae96a7d8e990d2b4af84a4c77"}
May 21 13:03:50.296576 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.295815    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lgh45" podStartSLOduration=2.152273211 podStartE2EDuration="5.295794214s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:46.492770831 +0000 UTC m=+50.214077713" lastFinishedPulling="2026-05-21 13:03:49.636291827 +0000 UTC m=+53.357598716" observedRunningTime="2026-05-21 13:03:50.294365442 +0000 UTC m=+54.015672340" watchObservedRunningTime="2026-05-21 13:03:50.295794214 +0000 UTC m=+54.017101114"
May 21 13:03:50.410986 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.410640    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c9556d5c6-7c5x5" podStartSLOduration=1.453029105 podStartE2EDuration="5.41062049s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:45.711821646 +0000 UTC m=+49.433128521" lastFinishedPulling="2026-05-21 13:03:49.669413027 +0000 UTC m=+53.390719906" observedRunningTime="2026-05-21 13:03:50.408143403 +0000 UTC m=+54.129450300" watchObservedRunningTime="2026-05-21 13:03:50.41062049 +0000 UTC m=+54.131927389"
May 21 13:03:50.411125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.411087    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-kpw8s" podStartSLOduration=2.174778733 podStartE2EDuration="5.411073277s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:46.416453304 +0000 UTC m=+50.137760183" lastFinishedPulling="2026-05-21 13:03:49.652747839 +0000 UTC m=+53.374054727" observedRunningTime="2026-05-21 13:03:50.35597837 +0000 UTC m=+54.077285294" watchObservedRunningTime="2026-05-21 13:03:50.411073277 +0000 UTC m=+54.132380177"
May 21 13:03:50.470320 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.469421    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"]
May 21 13:03:50.472238 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.472219    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.476534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.475749    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 13:03:50.476534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.475794    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jclkr\""
May 21 13:03:50.476534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.476034    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 13:03:50.476534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.476187    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 13:03:50.476534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.476315    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 13:03:50.477105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.476583    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-79ua6iu2totn5\""
May 21 13:03:50.482600 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.481796    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"]
May 21 13:03:50.573160 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.572997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/264a33dc-beef-4120-b8e1-76897d6721f3-audit-log\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573160 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-metrics-server-audit-profiles\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573160 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-tls\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573160 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-client-certs\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573473 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ntsp\" (UniqueName: \"kubernetes.io/projected/264a33dc-beef-4120-b8e1-76897d6721f3-kube-api-access-7ntsp\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573654 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573627    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-client-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.573787 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.573733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.627418 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.627378    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"]
May 21 13:03:50.632316 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.632291    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:50.635166 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.634937    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 21 13:03:50.635166 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.635057    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-wdz5x\""
May 21 13:03:50.638828 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.638297    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"]
May 21 13:03:50.674411 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674372    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/264a33dc-beef-4120-b8e1-76897d6721f3-audit-log\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674562 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674436    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-metrics-server-audit-profiles\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674562 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3ff2e12-9764-4459-b6e2-232d53add419-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-fc6bf\" (UID: \"f3ff2e12-9764-4459-b6e2-232d53add419\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:50.674726 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674669    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-tls\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674786 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674720    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-client-certs\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674838 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674816    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/264a33dc-beef-4120-b8e1-76897d6721f3-audit-log\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674887 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674871    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ntsp\" (UniqueName: \"kubernetes.io/projected/264a33dc-beef-4120-b8e1-76897d6721f3-kube-api-access-7ntsp\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.674947 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674935    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-client-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.675001 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.674974    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.675603 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.675572    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-metrics-server-audit-profiles\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.675603 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.675600    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/264a33dc-beef-4120-b8e1-76897d6721f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.680062 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.680031    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-client-certs\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.680220 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.680200    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-secret-metrics-server-tls\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.680360 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.680303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/264a33dc-beef-4120-b8e1-76897d6721f3-client-ca-bundle\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.684720 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.684694    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ntsp\" (UniqueName: \"kubernetes.io/projected/264a33dc-beef-4120-b8e1-76897d6721f3-kube-api-access-7ntsp\") pod \"metrics-server-6b8bbb7865-dq7dc\" (UID: \"264a33dc-beef-4120-b8e1-76897d6721f3\") " pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.776690 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.776073    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3ff2e12-9764-4459-b6e2-232d53add419-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-fc6bf\" (UID: \"f3ff2e12-9764-4459-b6e2-232d53add419\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:50.779422 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.779393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3ff2e12-9764-4459-b6e2-232d53add419-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-fc6bf\" (UID: \"f3ff2e12-9764-4459-b6e2-232d53add419\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:50.788828 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.788794    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:03:50.947716 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:50.947627    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:51.121534 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.121132    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"]
May 21 13:03:51.132895 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.132867    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d56975b97-s5ttv"]
May 21 13:03:51.135635 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.135617    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.139394 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.139373    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 21 13:03:51.139516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.139400    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 21 13:03:51.139516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.139437    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 21 13:03:51.139516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.139510    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-swtct\""
May 21 13:03:51.139685 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.139622    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 21 13:03:51.140151 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.140135    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 21 13:03:51.143327 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.143277    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"]
May 21 13:03:51.151347 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.151301    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d56975b97-s5ttv"]
May 21 13:03:51.155118 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.155097    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 21 13:03:51.162038 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:51.161796    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ff2e12_9764_4459_b6e2_232d53add419.slice/crio-722e44cb984446a9ad8086ed7ffa6286de596edba03c8ac836a570cccb609182 WatchSource:0}: Error finding container 722e44cb984446a9ad8086ed7ffa6286de596edba03c8ac836a570cccb609182: Status 404 returned error can't find the container with id 722e44cb984446a9ad8086ed7ffa6286de596edba03c8ac836a570cccb609182
May 21 13:03:51.162470 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:51.162448    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264a33dc_beef_4120_b8e1_76897d6721f3.slice/crio-9e0e4b8500f82a85553ac1b5144ebf053d9796ed6216e2b9ee05118bcb92c123 WatchSource:0}: Error finding container 9e0e4b8500f82a85553ac1b5144ebf053d9796ed6216e2b9ee05118bcb92c123: Status 404 returned error can't find the container with id 9e0e4b8500f82a85553ac1b5144ebf053d9796ed6216e2b9ee05118bcb92c123
May 21 13:03:51.180921 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.180889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-metrics-client-ca\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181029 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.180952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-serving-certs-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181029 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.180987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-federate-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181155 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.181053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181155 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.181114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb24r\" (UniqueName: \"kubernetes.io/projected/f9c832ca-3144-45ce-b508-e46734728aae-kube-api-access-vb24r\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.181155    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.181182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.181258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.181218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282302    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vb24r\" (UniqueName: \"kubernetes.io/projected/f9c832ca-3144-45ce-b508-e46734728aae-kube-api-access-vb24r\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282357    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282382    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282446 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282417    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282798 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282501    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-metrics-client-ca\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282798 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282543    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-serving-certs-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282798 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282575    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-federate-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.282798 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.282608    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.283568 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.283393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.283568 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.283516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-metrics-client-ca\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.283801 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.283614    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9c832ca-3144-45ce-b508-e46734728aae-serving-certs-ca-bundle\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.286004 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.285620    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.286258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.286227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-secret-telemeter-client\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.286258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.286227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-federate-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.287589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.287552    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9c832ca-3144-45ce-b508-e46734728aae-telemeter-client-tls\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.288586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.288535    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq2l8" event={"ID":"30cd7f53-3b07-40e0-9964-a66816fd8735","Type":"ContainerStarted","Data":"f6d12dcfb6a740af637eea9c7a754d541911f7c7f42273d66b223bacca194749"}
May 21 13:03:51.288586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.288573    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq2l8" event={"ID":"30cd7f53-3b07-40e0-9964-a66816fd8735","Type":"ContainerStarted","Data":"8fdd2b02aba1ac176b95b81d9d543d8d6e198263e4e378e4263012118af8ccf6"}
May 21 13:03:51.290577 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.290554    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a" exitCode=0
May 21 13:03:51.290753 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.290623    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a"}
May 21 13:03:51.291540 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.291397    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb24r\" (UniqueName: \"kubernetes.io/projected/f9c832ca-3144-45ce-b508-e46734728aae-kube-api-access-vb24r\") pod \"telemeter-client-5d56975b97-s5ttv\" (UID: \"f9c832ca-3144-45ce-b508-e46734728aae\") " pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:51.292839 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.292805    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc" event={"ID":"264a33dc-beef-4120-b8e1-76897d6721f3","Type":"ContainerStarted","Data":"9e0e4b8500f82a85553ac1b5144ebf053d9796ed6216e2b9ee05118bcb92c123"}
May 21 13:03:51.294037 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.293978    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf" event={"ID":"f3ff2e12-9764-4459-b6e2-232d53add419","Type":"ContainerStarted","Data":"722e44cb984446a9ad8086ed7ffa6286de596edba03c8ac836a570cccb609182"}
May 21 13:03:51.306841 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.306792    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gq2l8" podStartSLOduration=3.5577131619999998 podStartE2EDuration="6.30677796s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:46.887241017 +0000 UTC m=+50.608547893" lastFinishedPulling="2026-05-21 13:03:49.636305801 +0000 UTC m=+53.357612691" observedRunningTime="2026-05-21 13:03:51.306414724 +0000 UTC m=+55.027721622" watchObservedRunningTime="2026-05-21 13:03:51.30677796 +0000 UTC m=+55.028084859"
May 21 13:03:51.471036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:51.471000    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv"
May 21 13:03:52.019927 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.019814    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d56975b97-s5ttv"]
May 21 13:03:52.023727 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:52.023702    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c832ca_3144_45ce_b508_e46734728aae.slice/crio-3241bb30b2327de16dcc43a212c247b5f34f2e973ffe4d9c3bab6e0de71d41d7 WatchSource:0}: Error finding container 3241bb30b2327de16dcc43a212c247b5f34f2e973ffe4d9c3bab6e0de71d41d7: Status 404 returned error can't find the container with id 3241bb30b2327de16dcc43a212c247b5f34f2e973ffe4d9c3bab6e0de71d41d7
May 21 13:03:52.121279 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.119131    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:03:52.123443 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.123424    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.129803 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.129728    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 13:03:52.130254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.129939    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 13:03:52.130254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.130121    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 13:03:52.130420 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.130289    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.132578    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.133594    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.134111    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48nnbfb225e5r\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.134391    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.134610    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z74jn\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.134846    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.135162    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 13:03:52.135699 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.135408    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 13:03:52.139031 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.139011    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 13:03:52.150564 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.145964    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:03:52.150564 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.150146    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 13:03:52.190894 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.190798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.190894 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.190850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191137 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.190980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191137 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191137 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191303 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191303 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191303 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191303 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191303 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191283    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcbgn\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191547 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.191984 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.191551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292697    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292751    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292820    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292856    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292882    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292912    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292939    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292966    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.292997    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293045    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293078    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293108    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293133    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293169    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293195    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293250    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcbgn\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.293633 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.294538 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293286    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.294538 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.293335    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.295851 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.295526    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.297045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.296933    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.297569 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.297533    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.298743 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.298205    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.299274 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.299244    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.305618    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.306034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.306107    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.306467    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.306629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.307035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.307101    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307852 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.307458    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.307852 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.307268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.308542 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.308304    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.308542 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.308486    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.311876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.311845    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"1361d696c465da987c929661697f2d3eb824637e6e0e05a873b29e543fef2272"}
May 21 13:03:52.311965 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.311888    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"8bc1b7f6b90d1eeb87e2c8b8509771443a84c820264c9077327bc59fcd30c34f"}
May 21 13:03:52.311965 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.311901    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"aa8235c355487a0cfe0c8daab16ad07655686a40646f46bc34d07d066ed48155"}
May 21 13:03:52.313914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.313884    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv" event={"ID":"f9c832ca-3144-45ce-b508-e46734728aae","Type":"ContainerStarted","Data":"3241bb30b2327de16dcc43a212c247b5f34f2e973ffe4d9c3bab6e0de71d41d7"}
May 21 13:03:52.323468 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.323438    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcbgn\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn\") pod \"prometheus-k8s-0\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.475164 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.475032    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:03:52.658331 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:52.658214    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:03:52.662925 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:03:52.662876    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd1a01c_d750_4ae4_8294_e3341895d783.slice/crio-db34f648f4eca912338055f2ca868571f5a163564ae7e8a706dd113ef8277886 WatchSource:0}: Error finding container db34f648f4eca912338055f2ca868571f5a163564ae7e8a706dd113ef8277886: Status 404 returned error can't find the container with id db34f648f4eca912338055f2ca868571f5a163564ae7e8a706dd113ef8277886
May 21 13:03:53.317971 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:53.317939    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="8baa54d036aeb589803b87047626de5c34bf05fcbe111377b8cf868cf2fdf316" exitCode=0
May 21 13:03:53.318332 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:53.318031    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"8baa54d036aeb589803b87047626de5c34bf05fcbe111377b8cf868cf2fdf316"}
May 21 13:03:53.318332 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:53.318076    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"db34f648f4eca912338055f2ca868571f5a163564ae7e8a706dd113ef8277886"}
May 21 13:03:54.326144 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.326030    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"}
May 21 13:03:54.326144 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.326075    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"}
May 21 13:03:54.327743 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.327719    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc" event={"ID":"264a33dc-beef-4120-b8e1-76897d6721f3","Type":"ContainerStarted","Data":"e5ef96d90b462bee48c312520af5eb4116be25bf8fc859db8c2e5765dc35e27a"}
May 21 13:03:54.332273 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.331810    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"1af4ea571e0c6785059ac21d58e5d4d27e59582fcd3f0db1c77919e37950e254"}
May 21 13:03:54.332273 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.331841    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"f74d1123f21d8730d11df6741897efea2199e281a0f6d8cd17ae30823136b880"}
May 21 13:03:54.334180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.334156    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf" event={"ID":"f3ff2e12-9764-4459-b6e2-232d53add419","Type":"ContainerStarted","Data":"5630f45d00fa4d2d1405a1267593a0c499bc5f836b42ad2e78d73e568b14e73e"}
May 21 13:03:54.334791 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.334772    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:54.341939 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.341917    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf"
May 21 13:03:54.354390 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.354339    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc" podStartSLOduration=1.4717870259999999 podStartE2EDuration="4.354322891s" podCreationTimestamp="2026-05-21 13:03:50 +0000 UTC" firstStartedPulling="2026-05-21 13:03:51.16482862 +0000 UTC m=+54.886135498" lastFinishedPulling="2026-05-21 13:03:54.047364472 +0000 UTC m=+57.768671363" observedRunningTime="2026-05-21 13:03:54.351956217 +0000 UTC m=+58.073263117" watchObservedRunningTime="2026-05-21 13:03:54.354322891 +0000 UTC m=+58.075629790"
May 21 13:03:54.404767 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:54.404637    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-fc6bf" podStartSLOduration=1.523295201 podStartE2EDuration="4.4046205s" podCreationTimestamp="2026-05-21 13:03:50 +0000 UTC" firstStartedPulling="2026-05-21 13:03:51.164404038 +0000 UTC m=+54.885710920" lastFinishedPulling="2026-05-21 13:03:54.045729323 +0000 UTC m=+57.767036219" observedRunningTime="2026-05-21 13:03:54.403222048 +0000 UTC m=+58.124528947" watchObservedRunningTime="2026-05-21 13:03:54.4046205 +0000 UTC m=+58.125927398"
May 21 13:03:55.152105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.152070    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xg827"
May 21 13:03:55.340695 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.340588    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" event={"ID":"6133ca4c-eb49-49f5-8526-5c6248698ebd","Type":"ContainerStarted","Data":"8efd0c69d5a290314df76c8a9138efb363c5f9b5021d749faaa9f12eeb70fb32"}
May 21 13:03:55.341085 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.340840    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:03:55.342637 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.342605    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv" event={"ID":"f9c832ca-3144-45ce-b508-e46734728aae","Type":"ContainerStarted","Data":"af449869b86a0acb19ba48e72435e1d34be92bb774835fb31b315df01bfee499"}
May 21 13:03:55.342777 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.342639    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv" event={"ID":"f9c832ca-3144-45ce-b508-e46734728aae","Type":"ContainerStarted","Data":"a8aa54291531195b7bd520910b087ad38c6bc63417403e9469ac3a7de457a672"}
May 21 13:03:55.342777 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.342680    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv" event={"ID":"f9c832ca-3144-45ce-b508-e46734728aae","Type":"ContainerStarted","Data":"1e74c704343cb8135b289b8bef8052a7dd575c63c1b9c2b8ec16a587e997cb3a"}
May 21 13:03:55.345400 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.345381    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"}
May 21 13:03:55.345506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.345404    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"}
May 21 13:03:55.345506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.345418    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"}
May 21 13:03:55.345506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.345427    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerStarted","Data":"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"}
May 21 13:03:55.364931 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.364881    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw" podStartSLOduration=3.204303594 podStartE2EDuration="7.364867795s" podCreationTimestamp="2026-05-21 13:03:48 +0000 UTC" firstStartedPulling="2026-05-21 13:03:49.886135408 +0000 UTC m=+53.607442287" lastFinishedPulling="2026-05-21 13:03:54.046699606 +0000 UTC m=+57.768006488" observedRunningTime="2026-05-21 13:03:55.363951289 +0000 UTC m=+59.085258187" watchObservedRunningTime="2026-05-21 13:03:55.364867795 +0000 UTC m=+59.086174693"
May 21 13:03:55.395990 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.395935    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.205863784 podStartE2EDuration="9.395919634s" podCreationTimestamp="2026-05-21 13:03:46 +0000 UTC" firstStartedPulling="2026-05-21 13:03:49.861268266 +0000 UTC m=+53.582575142" lastFinishedPulling="2026-05-21 13:03:54.051324116 +0000 UTC m=+57.772630992" observedRunningTime="2026-05-21 13:03:55.394290523 +0000 UTC m=+59.115597446" watchObservedRunningTime="2026-05-21 13:03:55.395919634 +0000 UTC m=+59.117226531"
May 21 13:03:55.417241 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.417175    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d56975b97-s5ttv" podStartSLOduration=1.582182671 podStartE2EDuration="4.417153534s" podCreationTimestamp="2026-05-21 13:03:51 +0000 UTC" firstStartedPulling="2026-05-21 13:03:52.025838929 +0000 UTC m=+55.747145809" lastFinishedPulling="2026-05-21 13:03:54.860809785 +0000 UTC m=+58.582116672" observedRunningTime="2026-05-21 13:03:55.414873272 +0000 UTC m=+59.136180212" watchObservedRunningTime="2026-05-21 13:03:55.417153534 +0000 UTC m=+59.138460433"
May 21 13:03:55.577667 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.577607    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:55.577816 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.577750    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:55.582914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:55.582893    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:56.355126 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:56.354766    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358318    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"6010e8b04957b4c4525ef1873f97ff1cf754e05da0aae55833e7a4e89b1d2f74"}
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358361    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"6bcba07d70431a627f8f54533905f772eeb7eb30f1635e68b3a0e84ddcca982e"}
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358371    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"f2bb171e20043adbf34554ecafc2c3817dba34de96ea2109929f2fe7f6d5bb4f"}
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"5909910c93a80ea50e84321f775fa83b6770a954bea599ae4c3c5510c27b9ae8"}
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358391    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"9b1671b5c72cd9892f836182e50d6afe82233da576629d9600ecf4c01ef5e925"}
May 21 13:03:57.358423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.358400    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerStarted","Data":"210df708d70a9d63f66d6d9f5aa2f3ef775f41c0255cfcde7c528912338a6b17"}
May 21 13:03:57.392854 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.392804    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.910668057 podStartE2EDuration="5.39278868s" podCreationTimestamp="2026-05-21 13:03:52 +0000 UTC" firstStartedPulling="2026-05-21 13:03:53.319351541 +0000 UTC m=+57.040658417" lastFinishedPulling="2026-05-21 13:03:56.80147215 +0000 UTC m=+60.522779040" observedRunningTime="2026-05-21 13:03:57.390026552 +0000 UTC m=+61.111333450" watchObservedRunningTime="2026-05-21 13:03:57.39278868 +0000 UTC m=+61.114095578"
May 21 13:03:57.475864 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:03:57.475831    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:04:01.355847 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.355818    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-848d49d7b9-djrcw"
May 21 13:04:01.594172 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.594139    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:04:01.596621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.596606    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 13:04:01.606936 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.606873    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62404bf4-3ebf-4c53-b55b-0a4197334123-metrics-certs\") pod \"network-metrics-daemon-zlwz4\" (UID: \"62404bf4-3ebf-4c53-b55b-0a4197334123\") " pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:04:01.676948 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.676920    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\""
May 21 13:04:01.685368 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.685343    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zlwz4"
May 21 13:04:01.695497 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.695464    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:04:01.698438 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.698409    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 13:04:01.708459 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.708440    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 13:04:01.719132 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.719107    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjh7\" (UniqueName: \"kubernetes.io/projected/75d5b100-b520-4802-b016-c680a9c39700-kube-api-access-hfjh7\") pod \"network-check-target-rlfhl\" (UID: \"75d5b100-b520-4802-b016-c680a9c39700\") " pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:04:01.812743 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.812667    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zlwz4"]
May 21 13:04:01.815433 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:04:01.815403    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62404bf4_3ebf_4c53_b55b_0a4197334123.slice/crio-c978ef6b8da734bfdfe16a0eb0c5b113d9ce03a6be5e7b2d88978681917482f8 WatchSource:0}: Error finding container c978ef6b8da734bfdfe16a0eb0c5b113d9ce03a6be5e7b2d88978681917482f8: Status 404 returned error can't find the container with id c978ef6b8da734bfdfe16a0eb0c5b113d9ce03a6be5e7b2d88978681917482f8
May 21 13:04:01.970594 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.970508    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4mfv\""
May 21 13:04:01.978641 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:01.978615    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:04:02.143456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.143426    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rlfhl"]
May 21 13:04:02.146264 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:04:02.146239    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d5b100_b520_4802_b016_c680a9c39700.slice/crio-65cce0116cce81144e225ec14234f4f6445652dccad5505798a75654970d0b87 WatchSource:0}: Error finding container 65cce0116cce81144e225ec14234f4f6445652dccad5505798a75654970d0b87: Status 404 returned error can't find the container with id 65cce0116cce81144e225ec14234f4f6445652dccad5505798a75654970d0b87
May 21 13:04:02.377084 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.377040    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zlwz4" event={"ID":"62404bf4-3ebf-4c53-b55b-0a4197334123","Type":"ContainerStarted","Data":"c978ef6b8da734bfdfe16a0eb0c5b113d9ce03a6be5e7b2d88978681917482f8"}
May 21 13:04:02.378365 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.378335    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rlfhl" event={"ID":"75d5b100-b520-4802-b016-c680a9c39700","Type":"ContainerStarted","Data":"65cce0116cce81144e225ec14234f4f6445652dccad5505798a75654970d0b87"}
May 21 13:04:02.483891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.483856    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:04:02.487996 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.487963    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.510137 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.510107    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:04:02.522599 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.522572    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 13:04:02.606756 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.606723    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wsrh\" (UniqueName: \"kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.606926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.606854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.606926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.606911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.607036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.606948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.607036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.606973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.607036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.607024    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.607180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.607150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708194 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708103    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708194 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708164    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wsrh\" (UniqueName: \"kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708389 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708220    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708389 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708346    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708470 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708406    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708470 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708437    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708535 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708476    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.708990 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.708958    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.709208 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.709183    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.709310 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.709235    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.709449 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.709426    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.710952 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.710932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.711125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.711106    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.721685 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.721663    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wsrh\" (UniqueName: \"kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh\") pod \"console-5f65dc6f9c-6fskl\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") " pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.800632 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.800601    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:02.935641 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:02.935609    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:04:02.937606 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:04:02.937581    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94635d9_b33a_48c5_a693_0390c24cbeb0.slice/crio-9f185acda104e35594a86e39f9231dad060a75ee057318e1cd8fe00098ad291e WatchSource:0}: Error finding container 9f185acda104e35594a86e39f9231dad060a75ee057318e1cd8fe00098ad291e: Status 404 returned error can't find the container with id 9f185acda104e35594a86e39f9231dad060a75ee057318e1cd8fe00098ad291e
May 21 13:04:03.384802 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.384740    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zlwz4" event={"ID":"62404bf4-3ebf-4c53-b55b-0a4197334123","Type":"ContainerStarted","Data":"40ed028409dd952ac1c25379f850ce0dc32989ec7a00e8978da01dde9d8882b8"}
May 21 13:04:03.384802 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.384787    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zlwz4" event={"ID":"62404bf4-3ebf-4c53-b55b-0a4197334123","Type":"ContainerStarted","Data":"6ce28e211d9a37005e6a36ea5da6d4a13b5a941291e444ac00990db940c51043"}
May 21 13:04:03.386287 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.386256    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65dc6f9c-6fskl" event={"ID":"d94635d9-b33a-48c5-a693-0390c24cbeb0","Type":"ContainerStarted","Data":"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"}
May 21 13:04:03.386287 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.386285    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65dc6f9c-6fskl" event={"ID":"d94635d9-b33a-48c5-a693-0390c24cbeb0","Type":"ContainerStarted","Data":"9f185acda104e35594a86e39f9231dad060a75ee057318e1cd8fe00098ad291e"}
May 21 13:04:03.429799 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.429748    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zlwz4" podStartSLOduration=65.405686258 podStartE2EDuration="1m6.429729892s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:04:01.817467229 +0000 UTC m=+65.538774105" lastFinishedPulling="2026-05-21 13:04:02.841510863 +0000 UTC m=+66.562817739" observedRunningTime="2026-05-21 13:04:03.421593035 +0000 UTC m=+67.142899935" watchObservedRunningTime="2026-05-21 13:04:03.429729892 +0000 UTC m=+67.151036791"
May 21 13:04:03.469136 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:03.469080    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f65dc6f9c-6fskl" podStartSLOduration=1.469058901 podStartE2EDuration="1.469058901s" podCreationTimestamp="2026-05-21 13:04:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:04:03.467544132 +0000 UTC m=+67.188851030" watchObservedRunningTime="2026-05-21 13:04:03.469058901 +0000 UTC m=+67.190365800"
May 21 13:04:05.394709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:05.394679    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rlfhl" event={"ID":"75d5b100-b520-4802-b016-c680a9c39700","Type":"ContainerStarted","Data":"eb4fa72e8078d5a408f619d766eb363e11d61986547c5cd5754c8f7a2570db6c"}
May 21 13:04:05.395172 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:05.394747    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:04:05.409894 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:05.409844    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rlfhl" podStartSLOduration=65.241274671 podStartE2EDuration="1m8.409829321s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:04:02.148232905 +0000 UTC m=+65.869539785" lastFinishedPulling="2026-05-21 13:04:05.316787541 +0000 UTC m=+69.038094435" observedRunningTime="2026-05-21 13:04:05.408800817 +0000 UTC m=+69.130107747" watchObservedRunningTime="2026-05-21 13:04:05.409829321 +0000 UTC m=+69.131136218"
May 21 13:04:10.789085 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:10.788933    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:04:10.789557 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:10.789383    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:04:12.800980 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:12.800940    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:12.800980 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:12.800991    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:12.806067 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:12.806043    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:13.423314 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:13.423285    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:04:13.482526 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:13.482494    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:04:30.794878 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:30.794847    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:04:30.799006 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:30.798981    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b8bbb7865-dq7dc"
May 21 13:04:36.400891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:36.400859    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rlfhl"
May 21 13:04:38.506104 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.506063    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c9556d5c6-7c5x5" podUID="092319bc-599a-4157-9978-b219756fef87" containerName="console" containerID="cri-o://34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69" gracePeriod=15
May 21 13:04:38.754502 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.754480    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c9556d5c6-7c5x5_092319bc-599a-4157-9978-b219756fef87/console/0.log"
May 21 13:04:38.754635 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.754552    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:04:38.846919 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.846831    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.846919 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.846877    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.846919 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.846918    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.847189 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.846943    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k6pp\" (UniqueName: \"kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.847189 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.846961    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.847189 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.847074    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config\") pod \"092319bc-599a-4157-9978-b219756fef87\" (UID: \"092319bc-599a-4157-9978-b219756fef87\") "
May 21 13:04:38.847341 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.847227    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:04:38.847436 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.847415    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-oauth-serving-cert\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:38.847489 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.847449    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca" (OuterVolumeSpecName: "service-ca") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:04:38.847545 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.847529    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config" (OuterVolumeSpecName: "console-config") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:04:38.849204 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.849179    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:38.849444 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.849413    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:38.849539 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.849442    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp" (OuterVolumeSpecName: "kube-api-access-2k6pp") pod "092319bc-599a-4157-9978-b219756fef87" (UID: "092319bc-599a-4157-9978-b219756fef87"). InnerVolumeSpecName "kube-api-access-2k6pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:04:38.947866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.947835    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-serving-cert\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:38.947866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.947859    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092319bc-599a-4157-9978-b219756fef87-console-oauth-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:38.947866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.947869    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k6pp\" (UniqueName: \"kubernetes.io/projected/092319bc-599a-4157-9978-b219756fef87-kube-api-access-2k6pp\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:38.948107 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.947879    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-service-ca\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:38.948107 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:38.947888    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092319bc-599a-4157-9978-b219756fef87-console-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:39.501067 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501041    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c9556d5c6-7c5x5_092319bc-599a-4157-9978-b219756fef87/console/0.log"
May 21 13:04:39.501278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501077    2557 generic.go:358] "Generic (PLEG): container finished" podID="092319bc-599a-4157-9978-b219756fef87" containerID="34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69" exitCode=2
May 21 13:04:39.501278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501109    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9556d5c6-7c5x5" event={"ID":"092319bc-599a-4157-9978-b219756fef87","Type":"ContainerDied","Data":"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"}
May 21 13:04:39.501278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501153    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9556d5c6-7c5x5" event={"ID":"092319bc-599a-4157-9978-b219756fef87","Type":"ContainerDied","Data":"d72af42e302813158dbcfa20577f9d65ccf9443e65d04358fe97f071cf6a26c3"}
May 21 13:04:39.501278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501157    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9556d5c6-7c5x5"
May 21 13:04:39.501278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.501168    2557 scope.go:117] "RemoveContainer" containerID="34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"
May 21 13:04:39.510770 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.510702    2557 scope.go:117] "RemoveContainer" containerID="34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"
May 21 13:04:39.511014 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:39.510957    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69\": container with ID starting with 34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69 not found: ID does not exist" containerID="34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"
May 21 13:04:39.511014 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.510988    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69"} err="failed to get container status \"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69\": rpc error: code = NotFound desc = could not find container \"34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69\": container with ID starting with 34d8ade6e25d0c4800994de385e96fab9de801ad57d45b0c27127b3ca598bf69 not found: ID does not exist"
May 21 13:04:39.517417 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.517393    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:04:39.522904 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:39.522876    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9556d5c6-7c5x5"]
May 21 13:04:40.859884 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:40.859842    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092319bc-599a-4157-9978-b219756fef87" path="/var/lib/kubelet/pods/092319bc-599a-4157-9978-b219756fef87/volumes"
May 21 13:04:41.558130 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:41.558096    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:04:41.578098 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:41.578071    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:04:42.491837 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:42.491808    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:04:56.204036 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.203996    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:56.204513 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204457    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="alertmanager" containerID="cri-o://ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b" gracePeriod=120
May 21 13:04:56.204682 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204524    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-web" containerID="cri-o://ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180" gracePeriod=120
May 21 13:04:56.204682 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204548    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy" containerID="cri-o://bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495" gracePeriod=120
May 21 13:04:56.204814 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204524    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-metric" containerID="cri-o://a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb" gracePeriod=120
May 21 13:04:56.204814 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204693    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="prom-label-proxy" containerID="cri-o://cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b" gracePeriod=120
May 21 13:04:56.204814 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.204619    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="config-reloader" containerID="cri-o://5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad" gracePeriod=120
May 21 13:04:56.557005 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.556972    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b" exitCode=0
May 21 13:04:56.557005 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.556997    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb" exitCode=0
May 21 13:04:56.557005 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557005    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495" exitCode=0
May 21 13:04:56.557005 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557011    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad" exitCode=0
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557017    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b" exitCode=0
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557037    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"}
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557072    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"}
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557083    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"}
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557092    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"}
May 21 13:04:56.557259 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:56.557101    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"}
May 21 13:04:57.473013 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.472989    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:57.562588 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.562551    2557 generic.go:358] "Generic (PLEG): container finished" podID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerID="ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180" exitCode=0
May 21 13:04:57.562779 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.562610    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"}
May 21 13:04:57.562779 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.562701    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:57.562779 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.562705    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e404995f-f6b3-4708-b5e3-e10f21b8e0a7","Type":"ContainerDied","Data":"b3ab5823c6454409f82981906bd0ebe1294f3b8ae96a7d8e990d2b4af84a4c77"}
May 21 13:04:57.562779 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.562728    2557 scope.go:117] "RemoveContainer" containerID="cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"
May 21 13:04:57.570079 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.570060    2557 scope.go:117] "RemoveContainer" containerID="a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"
May 21 13:04:57.576698 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.576678    2557 scope.go:117] "RemoveContainer" containerID="bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"
May 21 13:04:57.583458 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.583441    2557 scope.go:117] "RemoveContainer" containerID="ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"
May 21 13:04:57.590031 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.590014    2557 scope.go:117] "RemoveContainer" containerID="5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"
May 21 13:04:57.596738 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.596719    2557 scope.go:117] "RemoveContainer" containerID="ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"
May 21 13:04:57.603160 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.603142    2557 scope.go:117] "RemoveContainer" containerID="96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a"
May 21 13:04:57.607217 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607199    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jptvb\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607251    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607290    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607319    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607477 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607354    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607477 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607396    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607477 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607450    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607489    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607527    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607558    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607603    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.607841 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.607795    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608280    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608346    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608389    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets\") pod \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\" (UID: \"e404995f-f6b3-4708-b5e3-e10f21b8e0a7\") "
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608770    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608836    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-main-db\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.608889 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.608858    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-metrics-client-ca\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.610204 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.610176    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.610639 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.610614    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume" (OuterVolumeSpecName: "config-volume") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.611181 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611156    2557 scope.go:117] "RemoveContainer" containerID="cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"
May 21 13:04:57.611582 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.611482    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b\": container with ID starting with cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b not found: ID does not exist" containerID="cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"
May 21 13:04:57.611582 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611515    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b"} err="failed to get container status \"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b\": rpc error: code = NotFound desc = could not find container \"cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b\": container with ID starting with cd5c5eb939ef1050f240bff8c56f19881e772e2053c038f3d03894e51ab4e37b not found: ID does not exist"
May 21 13:04:57.611582 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611543    2557 scope.go:117] "RemoveContainer" containerID="a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"
May 21 13:04:57.611783 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611589    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out" (OuterVolumeSpecName: "config-out") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 13:04:57.611783 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611699    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.611968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611934    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.612045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.611976    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb" (OuterVolumeSpecName: "kube-api-access-jptvb") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "kube-api-access-jptvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:04:57.612045 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.611976    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb\": container with ID starting with a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb not found: ID does not exist" containerID="a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"
May 21 13:04:57.612045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612010    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb"} err="failed to get container status \"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb\": rpc error: code = NotFound desc = could not find container \"a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb\": container with ID starting with a233808da4f8317eb8efb18dfc764bc3a09c7c9863723db0b5e23c59830477fb not found: ID does not exist"
May 21 13:04:57.612045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612036    2557 scope.go:117] "RemoveContainer" containerID="bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"
May 21 13:04:57.612230 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612179    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.612230 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612185    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:04:57.612334 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.612322    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495\": container with ID starting with bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495 not found: ID does not exist" containerID="bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"
May 21 13:04:57.612388 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612344    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495"} err="failed to get container status \"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495\": rpc error: code = NotFound desc = could not find container \"bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495\": container with ID starting with bd0fd74aa2a9d6e537a52f92b93bfc997699fc0033a54c2154313ab6d8952495 not found: ID does not exist"
May 21 13:04:57.612388 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612360    2557 scope.go:117] "RemoveContainer" containerID="ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"
May 21 13:04:57.612590 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.612573    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180\": container with ID starting with ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180 not found: ID does not exist" containerID="ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"
May 21 13:04:57.612704 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612593    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180"} err="failed to get container status \"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180\": rpc error: code = NotFound desc = could not find container \"ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180\": container with ID starting with ed99e228f093039126b30b35d6ce7c2f7e6d170c23d52a18e5210b60acfab180 not found: ID does not exist"
May 21 13:04:57.612704 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612605    2557 scope.go:117] "RemoveContainer" containerID="5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"
May 21 13:04:57.612836 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.612819    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad\": container with ID starting with 5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad not found: ID does not exist" containerID="5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"
May 21 13:04:57.612891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612840    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad"} err="failed to get container status \"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad\": rpc error: code = NotFound desc = could not find container \"5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad\": container with ID starting with 5fc98543a40b0fcc40f7319f11c25dacfaf9bd528d93b39de6d640f8c6290dad not found: ID does not exist"
May 21 13:04:57.612891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.612854    2557 scope.go:117] "RemoveContainer" containerID="ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"
May 21 13:04:57.613108 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.613089    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b\": container with ID starting with ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b not found: ID does not exist" containerID="ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"
May 21 13:04:57.613169 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.613114    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b"} err="failed to get container status \"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b\": rpc error: code = NotFound desc = could not find container \"ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b\": container with ID starting with ac566cb6d69bf89f61606d494d4ec39dc08b1f1d9ce1a14e5bf37970da28027b not found: ID does not exist"
May 21 13:04:57.613169 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.613134    2557 scope.go:117] "RemoveContainer" containerID="96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a"
May 21 13:04:57.613384 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:04:57.613367    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a\": container with ID starting with 96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a not found: ID does not exist" containerID="96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a"
May 21 13:04:57.613439 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.613388    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a"} err="failed to get container status \"96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a\": rpc error: code = NotFound desc = could not find container \"96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a\": container with ID starting with 96b47a82e7ffb07071c624bba5e02b5a537fd8992bb61d999ea766b193257b6a not found: ID does not exist"
May 21 13:04:57.616429 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.616347    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.623396 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.623371    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config" (OuterVolumeSpecName: "web-config") pod "e404995f-f6b3-4708-b5e3-e10f21b8e0a7" (UID: "e404995f-f6b3-4708-b5e3-e10f21b8e0a7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:04:57.709905 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709876    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.709905 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709904    2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-cluster-tls-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709917    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709931    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-main-tls\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709940    2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-volume\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709950    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709959    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709984    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-tls-assets\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.709993    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jptvb\" (UniqueName: \"kubernetes.io/projected/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-kube-api-access-jptvb\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.710005    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-config-out\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.710101 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.710015    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e404995f-f6b3-4708-b5e3-e10f21b8e0a7-web-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:04:57.891177 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.891146    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:57.899664 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.899616    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:57.938942 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.938912    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:57.939387 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939367    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="config-reloader"
May 21 13:04:57.939387 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939384    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="config-reloader"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939396    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939402    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939414    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="alertmanager"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939419    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="alertmanager"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939427    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092319bc-599a-4157-9978-b219756fef87" containerName="console"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939432    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="092319bc-599a-4157-9978-b219756fef87" containerName="console"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939447    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-web"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939452    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-web"
May 21 13:04:57.939460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939461    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="init-config-reloader"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939467    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="init-config-reloader"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939474    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-metric"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939479    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-metric"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939487    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="prom-label-proxy"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939492    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="prom-label-proxy"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939537    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-metric"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939545    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939552    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="alertmanager"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939561    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="prom-label-proxy"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939571    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="config-reloader"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939576    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" containerName="kube-rbac-proxy-web"
May 21 13:04:57.939725 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.939583    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="092319bc-599a-4157-9978-b219756fef87" containerName="console"
May 21 13:04:57.944989 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.944962    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:57.947405 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947382    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 13:04:57.947517 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947474    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 13:04:57.947630 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947610    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 13:04:57.948042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947802    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 13:04:57.948042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947884    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 13:04:57.948042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947892    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 13:04:57.948042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947893    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 13:04:57.948042 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.947886    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 13:04:57.948353 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.948277    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8l2lh\""
May 21 13:04:57.953192 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.953174    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 13:04:57.963712 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:57.963691    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:58.112793 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-out\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.112968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.112968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwc6m\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-kube-api-access-cwc6m\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.112968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-web-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.112968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.112968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.112941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113168 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113348 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.113348 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.113265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.213891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213798    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-out\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.213891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213853    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.213891 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213880    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwc6m\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-kube-api-access-cwc6m\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213913    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-web-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213941    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.213987    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214037    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214059    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214152 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214107    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214165    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214198    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214227    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214506 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.214781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.214755    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.215037 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.215013    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.216910 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.216835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-out\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.216910 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.216844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217070 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.216944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217070 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.216971    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217185 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.217168    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-web-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217244 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.217231    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217340 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.217320    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217528 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.217512    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.217668 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.217632    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.218783 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.218767    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.222561 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.222539    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwc6m\" (UniqueName: \"kubernetes.io/projected/7373b84d-e0fa-43d1-a941-11dd0f87fd1d-kube-api-access-cwc6m\") pod \"alertmanager-main-0\" (UID: \"7373b84d-e0fa-43d1-a941-11dd0f87fd1d\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.254576 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.254546    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 13:04:58.396621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.396596    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 13:04:58.399335 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:04:58.399309    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7373b84d_e0fa_43d1_a941_11dd0f87fd1d.slice/crio-6a76c53d1ca09fe3aa57191227e39e4b60fd1bce8d1f2bf78028afaccc60a639 WatchSource:0}: Error finding container 6a76c53d1ca09fe3aa57191227e39e4b60fd1bce8d1f2bf78028afaccc60a639: Status 404 returned error can't find the container with id 6a76c53d1ca09fe3aa57191227e39e4b60fd1bce8d1f2bf78028afaccc60a639
May 21 13:04:58.567490 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.567453    2557 generic.go:358] "Generic (PLEG): container finished" podID="7373b84d-e0fa-43d1-a941-11dd0f87fd1d" containerID="078366b4d1e04d2c98f1fc14229e82dcb8f672ced9ef7126d07969ac273d641f" exitCode=0
May 21 13:04:58.567916 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.567527    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerDied","Data":"078366b4d1e04d2c98f1fc14229e82dcb8f672ced9ef7126d07969ac273d641f"}
May 21 13:04:58.567916 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.567565    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"6a76c53d1ca09fe3aa57191227e39e4b60fd1bce8d1f2bf78028afaccc60a639"}
May 21 13:04:58.862203 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:58.862169    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e404995f-f6b3-4708-b5e3-e10f21b8e0a7" path="/var/lib/kubelet/pods/e404995f-f6b3-4708-b5e3-e10f21b8e0a7/volumes"
May 21 13:04:59.575182 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575144    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"41e3b94ccd3aa5c2827b2770992b6a6d3323bb83b0a785aa5e240c1466342d08"}
May 21 13:04:59.575182 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575184    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"96e53ca3795f087fa2adc5ad1bffb44fb98be13deee6c616ec197147c5491de0"}
May 21 13:04:59.575594 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575193    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"4684457a7872e005538bb123d822dc242f2dbad62690273604c147d6d502e2f4"}
May 21 13:04:59.575594 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"0834ca56382729b1e37441d2b4ffbb2fde500c0b62423cab0f1b58eddea2dc99"}
May 21 13:04:59.575594 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575211    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"2f879502a54b8b538dc1e21d7ff927da442e1e065750bda8f1362e7e66ee6b35"}
May 21 13:04:59.575594 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.575220    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7373b84d-e0fa-43d1-a941-11dd0f87fd1d","Type":"ContainerStarted","Data":"a618daad599fdb746e7a8629689aceec93840708ae78f305a984cb5a9d8177e6"}
May 21 13:04:59.604493 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:04:59.604434    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.604409578 podStartE2EDuration="2.604409578s" podCreationTimestamp="2026-05-21 13:04:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:04:59.602198847 +0000 UTC m=+123.323505745" watchObservedRunningTime="2026-05-21 13:04:59.604409578 +0000 UTC m=+123.325716479"
May 21 13:05:00.436068 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436031    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436630    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy" containerID="cri-o://6bcba07d70431a627f8f54533905f772eeb7eb30f1635e68b3a0e84ddcca982e" gracePeriod=600
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436685    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="config-reloader" containerID="cri-o://9b1671b5c72cd9892f836182e50d6afe82233da576629d9600ecf4c01ef5e925" gracePeriod=600
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436687    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-web" containerID="cri-o://f2bb171e20043adbf34554ecafc2c3817dba34de96ea2109929f2fe7f6d5bb4f" gracePeriod=600
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436681    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="thanos-sidecar" containerID="cri-o://5909910c93a80ea50e84321f775fa83b6770a954bea599ae4c3c5510c27b9ae8" gracePeriod=600
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436619    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="prometheus" containerID="cri-o://210df708d70a9d63f66d6d9f5aa2f3ef775f41c0255cfcde7c528912338a6b17" gracePeriod=600
May 21 13:05:00.436817 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.436792    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6010e8b04957b4c4525ef1873f97ff1cf754e05da0aae55833e7a4e89b1d2f74" gracePeriod=600
May 21 13:05:00.584307 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584276    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="6010e8b04957b4c4525ef1873f97ff1cf754e05da0aae55833e7a4e89b1d2f74" exitCode=0
May 21 13:05:00.584307 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584302    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="6bcba07d70431a627f8f54533905f772eeb7eb30f1635e68b3a0e84ddcca982e" exitCode=0
May 21 13:05:00.584307 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584309    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="f2bb171e20043adbf34554ecafc2c3817dba34de96ea2109929f2fe7f6d5bb4f" exitCode=0
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584317    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="5909910c93a80ea50e84321f775fa83b6770a954bea599ae4c3c5510c27b9ae8" exitCode=0
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584326    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="9b1671b5c72cd9892f836182e50d6afe82233da576629d9600ecf4c01ef5e925" exitCode=0
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584336    2557 generic.go:358] "Generic (PLEG): container finished" podID="afd1a01c-d750-4ae4-8294-e3341895d783" containerID="210df708d70a9d63f66d6d9f5aa2f3ef775f41c0255cfcde7c528912338a6b17" exitCode=0
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584349    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"6010e8b04957b4c4525ef1873f97ff1cf754e05da0aae55833e7a4e89b1d2f74"}
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584390    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"6bcba07d70431a627f8f54533905f772eeb7eb30f1635e68b3a0e84ddcca982e"}
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584401    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"f2bb171e20043adbf34554ecafc2c3817dba34de96ea2109929f2fe7f6d5bb4f"}
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584410    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"5909910c93a80ea50e84321f775fa83b6770a954bea599ae4c3c5510c27b9ae8"}
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584420    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"9b1671b5c72cd9892f836182e50d6afe82233da576629d9600ecf4c01ef5e925"}
May 21 13:05:00.584742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.584428    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"210df708d70a9d63f66d6d9f5aa2f3ef775f41c0255cfcde7c528912338a6b17"}
May 21 13:05:00.695487 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.695462    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:00.837447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837408    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcbgn\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837457    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837487    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837526    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837560    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837587    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837638    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837694    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837734    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837762    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837850    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.837926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837900    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837914    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.837936    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838002    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838029    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838067    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838111    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838210 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838143    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config\") pod \"afd1a01c-d750-4ae4-8294-e3341895d783\" (UID: \"afd1a01c-d750-4ae4-8294-e3341895d783\") "
May 21 13:05:00.838811 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838213    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:05:00.838811 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838449    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.838811 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.838468    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.839267 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.839240    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 13:05:00.839457 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.839431    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:05:00.839601 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.839572    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:05:00.841020 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.840980    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn" (OuterVolumeSpecName: "kube-api-access-tcbgn") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "kube-api-access-tcbgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:05:00.841125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841038    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:05:00.841125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841051    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config" (OuterVolumeSpecName: "config") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.841125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841094    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.841482 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841458    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.841721 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841694    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out" (OuterVolumeSpecName: "config-out") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 13:05:00.841938 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841913    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.842021 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.841991    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:05:00.842076 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.842040    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.842231 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.842211    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.842720 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.842695    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.842773 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.842712    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.853352 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.853327    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config" (OuterVolumeSpecName: "web-config") pod "afd1a01c-d750-4ae4-8294-e3341895d783" (UID: "afd1a01c-d750-4ae4-8294-e3341895d783"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939818    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-tls-assets\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939847    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-config-out\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939857    2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-metrics-client-certs\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939868    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-db\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939878    2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-kube-rbac-proxy\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939887    2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939895    2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.939902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939905    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939914    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-configmap-metrics-client-ca\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939923    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939933    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939944    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afd1a01c-d750-4ae4-8294-e3341895d783-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939952    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939961    2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-secret-grpc-tls\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939969    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afd1a01c-d750-4ae4-8294-e3341895d783-web-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:00.940232 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:00.939977    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcbgn\" (UniqueName: \"kubernetes.io/projected/afd1a01c-d750-4ae4-8294-e3341895d783-kube-api-access-tcbgn\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:05:01.590809 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.590772    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afd1a01c-d750-4ae4-8294-e3341895d783","Type":"ContainerDied","Data":"db34f648f4eca912338055f2ca868571f5a163564ae7e8a706dd113ef8277886"}
May 21 13:05:01.591188 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.590823    2557 scope.go:117] "RemoveContainer" containerID="6010e8b04957b4c4525ef1873f97ff1cf754e05da0aae55833e7a4e89b1d2f74"
May 21 13:05:01.591188 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.590873    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.598482 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.598458    2557 scope.go:117] "RemoveContainer" containerID="6bcba07d70431a627f8f54533905f772eeb7eb30f1635e68b3a0e84ddcca982e"
May 21 13:05:01.605018 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.605000    2557 scope.go:117] "RemoveContainer" containerID="f2bb171e20043adbf34554ecafc2c3817dba34de96ea2109929f2fe7f6d5bb4f"
May 21 13:05:01.611847 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.611829    2557 scope.go:117] "RemoveContainer" containerID="5909910c93a80ea50e84321f775fa83b6770a954bea599ae4c3c5510c27b9ae8"
May 21 13:05:01.612858 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.612834    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:01.618244 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.618222    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:01.619282 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.619261    2557 scope.go:117] "RemoveContainer" containerID="9b1671b5c72cd9892f836182e50d6afe82233da576629d9600ecf4c01ef5e925"
May 21 13:05:01.625710 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.625690    2557 scope.go:117] "RemoveContainer" containerID="210df708d70a9d63f66d6d9f5aa2f3ef775f41c0255cfcde7c528912338a6b17"
May 21 13:05:01.632470 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.632452    2557 scope.go:117] "RemoveContainer" containerID="8baa54d036aeb589803b87047626de5c34bf05fcbe111377b8cf868cf2fdf316"
May 21 13:05:01.646423 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646395    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:01.646896 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646880    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy"
May 21 13:05:01.646935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646900    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy"
May 21 13:05:01.646935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646918    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-thanos"
May 21 13:05:01.646935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646927    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-thanos"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646946    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="prometheus"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646954    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="prometheus"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646967    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="thanos-sidecar"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646974    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="thanos-sidecar"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646989    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="init-config-reloader"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.646998    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="init-config-reloader"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647007    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="config-reloader"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647016    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="config-reloader"
May 21 13:05:01.647032 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647028    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-web"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647036    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-web"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647099    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="thanos-sidecar"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647115    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="config-reloader"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647125    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-web"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647134    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy-thanos"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647145    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="prometheus"
May 21 13:05:01.647266 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.647157    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" containerName="kube-rbac-proxy"
May 21 13:05:01.652837 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.652820    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.655178 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.655161    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659066    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659177    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659066    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659244    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659405    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659533    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 13:05:01.659810 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659712    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z74jn\""
May 21 13:05:01.660103 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.659891    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 13:05:01.660103 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.660062    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 13:05:01.660261 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.660119    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 13:05:01.660261 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.660168    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48nnbfb225e5r\""
May 21 13:05:01.661798 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.661782    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 13:05:01.664781 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.664294    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 13:05:01.666258 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.666239    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:01.747926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.747926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.747926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9whrf\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-kube-api-access-9whrf\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.747926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.747985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748043    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748180 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.748421 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.748369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.849757 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849721    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.849935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849766    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.849935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.849935 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849808    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850131 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849933    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850131 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.849974    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9whrf\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-kube-api-access-9whrf\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850231 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850170    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850231 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850217    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850337 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850256    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850337 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850316    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850419 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850354    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850419 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850404    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850518 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850429    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850518 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850469    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850518 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850680 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850524    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850680 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850550    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850680 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850574    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850867 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.850921 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.850869    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.851037 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.851016    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.851087 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.851043    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.851750 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.851725    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.853225 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.853002    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.853543 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.853509    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.853543 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.853534    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.853749 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.853729    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.854309 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.854236    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2988d592-de2e-4e32-8fea-645cf5b84b1f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.854407 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.854303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.854407 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.854353    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2988d592-de2e-4e32-8fea-645cf5b84b1f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.855263 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.855225    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.855878 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.855854    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.855957 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.855932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-config\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.856233 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.856210    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.856410 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.856390    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2988d592-de2e-4e32-8fea-645cf5b84b1f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.858039 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.858024    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9whrf\" (UniqueName: \"kubernetes.io/projected/2988d592-de2e-4e32-8fea-645cf5b84b1f-kube-api-access-9whrf\") pod \"prometheus-k8s-0\" (UID: \"2988d592-de2e-4e32-8fea-645cf5b84b1f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:01.962470 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:01.962439    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:02.092635 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:02.092575    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 13:05:02.094812 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:05:02.094783    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2988d592_de2e_4e32_8fea_645cf5b84b1f.slice/crio-ff726c02cf1417fb9787e78ffcb69a89c0c665b8afe5128a36d096e48f16967e WatchSource:0}: Error finding container ff726c02cf1417fb9787e78ffcb69a89c0c665b8afe5128a36d096e48f16967e: Status 404 returned error can't find the container with id ff726c02cf1417fb9787e78ffcb69a89c0c665b8afe5128a36d096e48f16967e
May 21 13:05:02.595251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:02.595222    2557 generic.go:358] "Generic (PLEG): container finished" podID="2988d592-de2e-4e32-8fea-645cf5b84b1f" containerID="c2384fff630fe7506bc1074332f7124c1782dec7c155f9978ca3a0b5adbf52ce" exitCode=0
May 21 13:05:02.595625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:02.595290    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerDied","Data":"c2384fff630fe7506bc1074332f7124c1782dec7c155f9978ca3a0b5adbf52ce"}
May 21 13:05:02.595625 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:02.595312    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"ff726c02cf1417fb9787e78ffcb69a89c0c665b8afe5128a36d096e48f16967e"}
May 21 13:05:02.860914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:02.860886    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd1a01c-d750-4ae4-8294-e3341895d783" path="/var/lib/kubelet/pods/afd1a01c-d750-4ae4-8294-e3341895d783/volumes"
May 21 13:05:03.600859 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600821    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"af7afb8c8309352f619262bff9bd5c37f8651218d3229d34344843ce16aac789"}
May 21 13:05:03.600859 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600859    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"2fc982d734f1b1e6e954c888e6fbc82053827c2c4ea8706816d4c01197a16697"}
May 21 13:05:03.601292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600869    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"d201c12d6e41e66f23205edee4259edb3f084de3103bbbeeecf5447439bd999a"}
May 21 13:05:03.601292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600879    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"552f8d00a5edfe201ba2861ca6f8bb1dbc310da9f2a154955202c6e8f7cb0edb"}
May 21 13:05:03.601292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600887    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"b84a82b607e9d182dde1cdded18b7b2e694f05e317c523d023c019d82e7e78fc"}
May 21 13:05:03.601292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.600895    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2988d592-de2e-4e32-8fea-645cf5b84b1f","Type":"ContainerStarted","Data":"877073e05e6b5d3ab5948a799cb2c3e994c0c537ac2cf0612380eb33085169f9"}
May 21 13:05:03.631237 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:03.631189    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.631174825 podStartE2EDuration="2.631174825s" podCreationTimestamp="2026-05-21 13:05:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:05:03.628686157 +0000 UTC m=+127.349993055" watchObservedRunningTime="2026-05-21 13:05:03.631174825 +0000 UTC m=+127.352481723"
May 21 13:05:06.962963 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:06.962907    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:05:39.759837 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:39.759802    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:05:41.949599 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:41.949567    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dkbtc"]
May 21 13:05:41.952812 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:41.952795    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:41.955113 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:41.955092    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 13:05:41.964279 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:41.964253    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dkbtc"]
May 21 13:05:42.113621 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.113578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-dbus\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.113823 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.113721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-kubelet-config\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.113823 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.113780    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5460e936-deef-4763-8183-6506536e71ff-original-pull-secret\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.215290 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.215189    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-kubelet-config\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.215290 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.215247    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5460e936-deef-4763-8183-6506536e71ff-original-pull-secret\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.215290 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.215288    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-dbus\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.215516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.215328    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-kubelet-config\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.215516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.215425    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5460e936-deef-4763-8183-6506536e71ff-dbus\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.217703 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.217677    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5460e936-deef-4763-8183-6506536e71ff-original-pull-secret\") pod \"global-pull-secret-syncer-dkbtc\" (UID: \"5460e936-deef-4763-8183-6506536e71ff\") " pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.261835 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.261796    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkbtc"
May 21 13:05:42.383468 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.383317    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dkbtc"]
May 21 13:05:42.386162 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:05:42.386127    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5460e936_deef_4763_8183_6506536e71ff.slice/crio-726abee3bf906d7cec98fe909ec28bec44e364548612e399ff37563a00147d4a WatchSource:0}: Error finding container 726abee3bf906d7cec98fe909ec28bec44e364548612e399ff37563a00147d4a: Status 404 returned error can't find the container with id 726abee3bf906d7cec98fe909ec28bec44e364548612e399ff37563a00147d4a
May 21 13:05:42.719887 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:42.719843    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dkbtc" event={"ID":"5460e936-deef-4763-8183-6506536e71ff","Type":"ContainerStarted","Data":"726abee3bf906d7cec98fe909ec28bec44e364548612e399ff37563a00147d4a"}
May 21 13:05:47.736365 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:47.736327    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dkbtc" event={"ID":"5460e936-deef-4763-8183-6506536e71ff","Type":"ContainerStarted","Data":"e48d06ad1e8286dec3f977e3ad80a37b02915ba4db6105a03eb6b1fbc26c2fae"}
May 21 13:05:47.751722 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:05:47.751672    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dkbtc" podStartSLOduration=2.444448076 podStartE2EDuration="6.751632078s" podCreationTimestamp="2026-05-21 13:05:41 +0000 UTC" firstStartedPulling="2026-05-21 13:05:42.387807157 +0000 UTC m=+166.109114033" lastFinishedPulling="2026-05-21 13:05:46.694991159 +0000 UTC m=+170.416298035" observedRunningTime="2026-05-21 13:05:47.75063445 +0000 UTC m=+171.471941351" watchObservedRunningTime="2026-05-21 13:05:47.751632078 +0000 UTC m=+171.472938975"
May 21 13:06:01.962955 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:01.962895    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:06:01.979009 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:01.978982    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:06:02.796513 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:02.796483    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 13:06:04.779058 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:04.779017    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f65dc6f9c-6fskl" podUID="d94635d9-b33a-48c5-a693-0390c24cbeb0" containerName="console" containerID="cri-o://3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107" gracePeriod=15
May 21 13:06:05.023999 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.023973    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f65dc6f9c-6fskl_d94635d9-b33a-48c5-a693-0390c24cbeb0/console/0.log"
May 21 13:06:05.024124 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.024038    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:06:05.133715 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133606    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133715 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133684    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wsrh\" (UniqueName: \"kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133715 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133707    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133955 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133746    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133955 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133776    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133955 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133868    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.133955 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.133926    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle\") pod \"d94635d9-b33a-48c5-a693-0390c24cbeb0\" (UID: \"d94635d9-b33a-48c5-a693-0390c24cbeb0\") "
May 21 13:06:05.134148 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134051    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:06:05.134148 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134122    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config" (OuterVolumeSpecName: "console-config") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:06:05.134330 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134302    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:06:05.134330 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134320    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 13:06:05.134474 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134339    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-service-ca\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.134474 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.134360    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.136133 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.136100    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:06:05.136229 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.136128    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh" (OuterVolumeSpecName: "kube-api-access-2wsrh") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "kube-api-access-2wsrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:06:05.136229 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.136156    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d94635d9-b33a-48c5-a693-0390c24cbeb0" (UID: "d94635d9-b33a-48c5-a693-0390c24cbeb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 13:06:05.235440 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.235399    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-oauth-config\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.235440 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.235431    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-trusted-ca-bundle\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.235440 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.235445    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wsrh\" (UniqueName: \"kubernetes.io/projected/d94635d9-b33a-48c5-a693-0390c24cbeb0-kube-api-access-2wsrh\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.235707 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.235459    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d94635d9-b33a-48c5-a693-0390c24cbeb0-console-serving-cert\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.235707 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.235474    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d94635d9-b33a-48c5-a693-0390c24cbeb0-oauth-serving-cert\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:06:05.791204 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791172    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f65dc6f9c-6fskl_d94635d9-b33a-48c5-a693-0390c24cbeb0/console/0.log"
May 21 13:06:05.791761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791217    2557 generic.go:358] "Generic (PLEG): container finished" podID="d94635d9-b33a-48c5-a693-0390c24cbeb0" containerID="3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107" exitCode=2
May 21 13:06:05.791761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791283    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65dc6f9c-6fskl"
May 21 13:06:05.791761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791306    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65dc6f9c-6fskl" event={"ID":"d94635d9-b33a-48c5-a693-0390c24cbeb0","Type":"ContainerDied","Data":"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"}
May 21 13:06:05.791761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791340    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65dc6f9c-6fskl" event={"ID":"d94635d9-b33a-48c5-a693-0390c24cbeb0","Type":"ContainerDied","Data":"9f185acda104e35594a86e39f9231dad060a75ee057318e1cd8fe00098ad291e"}
May 21 13:06:05.791761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.791355    2557 scope.go:117] "RemoveContainer" containerID="3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"
May 21 13:06:05.799451 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.799433    2557 scope.go:117] "RemoveContainer" containerID="3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"
May 21 13:06:05.799726 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:06:05.799708    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107\": container with ID starting with 3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107 not found: ID does not exist" containerID="3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"
May 21 13:06:05.799807 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.799732    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107"} err="failed to get container status \"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107\": rpc error: code = NotFound desc = could not find container \"3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107\": container with ID starting with 3616417c34c56e2c09ced8ba984ef73f5513c6fe2be4493ca0e1e3b84668e107 not found: ID does not exist"
May 21 13:06:05.812709 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.812668    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:06:05.816823 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:05.816804    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f65dc6f9c-6fskl"]
May 21 13:06:06.858502 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:06.858468    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94635d9-b33a-48c5-a693-0390c24cbeb0" path="/var/lib/kubelet/pods/d94635d9-b33a-48c5-a693-0390c24cbeb0/volumes"
May 21 13:06:45.280983 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.280941    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6pwmx"]
May 21 13:06:45.281519 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.281489    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94635d9-b33a-48c5-a693-0390c24cbeb0" containerName="console"
May 21 13:06:45.281519 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.281509    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94635d9-b33a-48c5-a693-0390c24cbeb0" containerName="console"
May 21 13:06:45.281636 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.281577    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d94635d9-b33a-48c5-a693-0390c24cbeb0" containerName="console"
May 21 13:06:45.284464 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.284444    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.286792 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.286772    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qp7b6\""
May 21 13:06:45.287102 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.287085    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 13:06:45.287630 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.287613    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 13:06:45.297177 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.297149    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6pwmx"]
May 21 13:06:45.398012 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.397975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mskw\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-kube-api-access-7mskw\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.398190 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.398043    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.499350 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.499312    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.499527 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.499383    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mskw\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-kube-api-access-7mskw\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.510062 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.510034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.510187 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.510096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mskw\" (UniqueName: \"kubernetes.io/projected/5bfdc59c-bc81-416c-878d-1a83fb3addbf-kube-api-access-7mskw\") pod \"cert-manager-webhook-587ccfb98-6pwmx\" (UID: \"5bfdc59c-bc81-416c-878d-1a83fb3addbf\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.606978 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.606883    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:45.742426 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.742393    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6pwmx"]
May 21 13:06:45.747472 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:06:45.747443    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bfdc59c_bc81_416c_878d_1a83fb3addbf.slice/crio-a3bc2017c48c7364a17662b101b58c8b7167caebfc70e0aae995ab907d40a568 WatchSource:0}: Error finding container a3bc2017c48c7364a17662b101b58c8b7167caebfc70e0aae995ab907d40a568: Status 404 returned error can't find the container with id a3bc2017c48c7364a17662b101b58c8b7167caebfc70e0aae995ab907d40a568
May 21 13:06:45.910783 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:45.910693    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx" event={"ID":"5bfdc59c-bc81-416c-878d-1a83fb3addbf","Type":"ContainerStarted","Data":"a3bc2017c48c7364a17662b101b58c8b7167caebfc70e0aae995ab907d40a568"}
May 21 13:06:49.927086 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:49.927043    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx" event={"ID":"5bfdc59c-bc81-416c-878d-1a83fb3addbf","Type":"ContainerStarted","Data":"4fd07268b285d5897373de45797cc29a00ee31c50d8a3c27181164d67c41da33"}
May 21 13:06:49.927560 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:49.927195    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:49.944660 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:49.944598    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx" podStartSLOduration=1.783744178 podStartE2EDuration="4.944584321s" podCreationTimestamp="2026-05-21 13:06:45 +0000 UTC" firstStartedPulling="2026-05-21 13:06:45.749443001 +0000 UTC m=+229.470749881" lastFinishedPulling="2026-05-21 13:06:48.910283148 +0000 UTC m=+232.631590024" observedRunningTime="2026-05-21 13:06:49.943447278 +0000 UTC m=+233.664754177" watchObservedRunningTime="2026-05-21 13:06:49.944584321 +0000 UTC m=+233.665891219"
May 21 13:06:52.908452 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.908419    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"]
May 21 13:06:52.912053 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.912023    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:52.916200 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.916178    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 13:06:52.919328 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.918554    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kwlv6\""
May 21 13:06:52.919328 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.918801    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 13:06:52.924610 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.924583    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"]
May 21 13:06:52.965837 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.965792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j2xv\" (UniqueName: \"kubernetes.io/projected/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-kube-api-access-7j2xv\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:52.966058 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:52.965955    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-tmp\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.066726 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.066678    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-tmp\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.066914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.066770    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7j2xv\" (UniqueName: \"kubernetes.io/projected/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-kube-api-access-7j2xv\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.067144 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.067121    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-tmp\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.080973 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.080946    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j2xv\" (UniqueName: \"kubernetes.io/projected/6fd2a905-9052-4464-87d8-d0aeb10d9dc8-kube-api-access-7j2xv\") pod \"openshift-lws-operator-bfc7f696d-2fkbc\" (UID: \"6fd2a905-9052-4464-87d8-d0aeb10d9dc8\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.226589 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.226502    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"
May 21 13:06:53.353987 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.353962    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc"]
May 21 13:06:53.355967 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:06:53.355935    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fd2a905_9052_4464_87d8_d0aeb10d9dc8.slice/crio-6e87efe63650584ab601eeabe8c26bfce19b9c21b288882917ef6f2e2d6cd6b9 WatchSource:0}: Error finding container 6e87efe63650584ab601eeabe8c26bfce19b9c21b288882917ef6f2e2d6cd6b9: Status 404 returned error can't find the container with id 6e87efe63650584ab601eeabe8c26bfce19b9c21b288882917ef6f2e2d6cd6b9
May 21 13:06:53.941832 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:53.941795    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc" event={"ID":"6fd2a905-9052-4464-87d8-d0aeb10d9dc8","Type":"ContainerStarted","Data":"6e87efe63650584ab601eeabe8c26bfce19b9c21b288882917ef6f2e2d6cd6b9"}
May 21 13:06:55.933516 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:55.933488    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-6pwmx"
May 21 13:06:56.952460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:56.952424    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc" event={"ID":"6fd2a905-9052-4464-87d8-d0aeb10d9dc8","Type":"ContainerStarted","Data":"ece76961ab5dd48f4b4f3dcce64344b9f1a8172b8041313bd0d192bfc9f92abd"}
May 21 13:06:56.972163 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:56.972113    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-2fkbc" podStartSLOduration=1.517944736 podStartE2EDuration="4.972099599s" podCreationTimestamp="2026-05-21 13:06:52 +0000 UTC" firstStartedPulling="2026-05-21 13:06:53.357295999 +0000 UTC m=+237.078602874" lastFinishedPulling="2026-05-21 13:06:56.811450861 +0000 UTC m=+240.532757737" observedRunningTime="2026-05-21 13:06:56.970067622 +0000 UTC m=+240.691374518" watchObservedRunningTime="2026-05-21 13:06:56.972099599 +0000 UTC m=+240.693406496"
May 21 13:06:58.903211 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:58.903174    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mq4nq"]
May 21 13:06:58.906569 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:58.906552    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:58.912213 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:58.912193    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7fnv5\""
May 21 13:06:58.933737 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:58.933707    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mq4nq"]
May 21 13:06:59.023250 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.023223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-kube-api-access-6xcf7\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.023424 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.023279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-bound-sa-token\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.124324 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.124288    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-bound-sa-token\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.124488 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.124385    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-kube-api-access-6xcf7\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.132193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.132162    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-kube-api-access-6xcf7\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.132314 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.132191    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98d00ff-be03-44bf-bcf6-b420e3db0546-bound-sa-token\") pod \"cert-manager-79c8d999ff-mq4nq\" (UID: \"f98d00ff-be03-44bf-bcf6-b420e3db0546\") " pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.215022 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.214947    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-mq4nq"
May 21 13:06:59.344694 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.344539    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mq4nq"]
May 21 13:06:59.347456 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:06:59.347428    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf98d00ff_be03_44bf_bcf6_b420e3db0546.slice/crio-37b05bdd593afabbbfd59ff854be6e580355c30cefad7382df262bfa19a6f690 WatchSource:0}: Error finding container 37b05bdd593afabbbfd59ff854be6e580355c30cefad7382df262bfa19a6f690: Status 404 returned error can't find the container with id 37b05bdd593afabbbfd59ff854be6e580355c30cefad7382df262bfa19a6f690
May 21 13:06:59.963228 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.963193    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-mq4nq" event={"ID":"f98d00ff-be03-44bf-bcf6-b420e3db0546","Type":"ContainerStarted","Data":"eb95c099f0df1df051872775e7d41afc7d409c0ab65d830a6951164da8543736"}
May 21 13:06:59.963228 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.963230    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-mq4nq" event={"ID":"f98d00ff-be03-44bf-bcf6-b420e3db0546","Type":"ContainerStarted","Data":"37b05bdd593afabbbfd59ff854be6e580355c30cefad7382df262bfa19a6f690"}
May 21 13:06:59.980758 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:06:59.980710    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-mq4nq" podStartSLOduration=1.980695402 podStartE2EDuration="1.980695402s" podCreationTimestamp="2026-05-21 13:06:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:06:59.979660981 +0000 UTC m=+243.700967876" watchObservedRunningTime="2026-05-21 13:06:59.980695402 +0000 UTC m=+243.702002299"
May 21 13:07:13.951469 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.951429    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"]
May 21 13:07:13.954786 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.954768    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:13.958328 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.958300    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 13:07:13.958455 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.958300    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 13:07:13.958731 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.958708    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2g5gn\""
May 21 13:07:13.959125 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.959108    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 13:07:13.959567 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.959550    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 13:07:13.981264 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:13.981233    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"]
May 21 13:07:14.054714 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.054675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.054925 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.054735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8fq\" (UniqueName: \"kubernetes.io/projected/c0d39e54-7460-4aeb-8836-afb5a7afc843-kube-api-access-zv8fq\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.054925 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.054771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.155758 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.155715    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.155929 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.155802    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.155929 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.155841    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8fq\" (UniqueName: \"kubernetes.io/projected/c0d39e54-7460-4aeb-8836-afb5a7afc843-kube-api-access-zv8fq\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.158251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.158216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.158251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.158247    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0d39e54-7460-4aeb-8836-afb5a7afc843-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.165424 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.165395    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8fq\" (UniqueName: \"kubernetes.io/projected/c0d39e54-7460-4aeb-8836-afb5a7afc843-kube-api-access-zv8fq\") pod \"opendatahub-operator-controller-manager-8545859b7d-n9wr8\" (UID: \"c0d39e54-7460-4aeb-8836-afb5a7afc843\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.266768 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.266734    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:14.399943 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:14.399918    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"]
May 21 13:07:14.402252 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:07:14.402223    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d39e54_7460_4aeb_8836_afb5a7afc843.slice/crio-ebeaedb61abb6926b319acfbdd453e3223b23344b210d67b7711d90cc857c085 WatchSource:0}: Error finding container ebeaedb61abb6926b319acfbdd453e3223b23344b210d67b7711d90cc857c085: Status 404 returned error can't find the container with id ebeaedb61abb6926b319acfbdd453e3223b23344b210d67b7711d90cc857c085
May 21 13:07:15.009512 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:15.009472    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8" event={"ID":"c0d39e54-7460-4aeb-8836-afb5a7afc843","Type":"ContainerStarted","Data":"ebeaedb61abb6926b319acfbdd453e3223b23344b210d67b7711d90cc857c085"}
May 21 13:07:17.018840 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:17.018806    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8" event={"ID":"c0d39e54-7460-4aeb-8836-afb5a7afc843","Type":"ContainerStarted","Data":"431332a57acc2ffe612a45088933f5711aeb06cd3b2d3c1ae6a6893dc16bfe83"}
May 21 13:07:17.019336 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:17.018863    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:17.050796 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:17.050744    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8" podStartSLOduration=1.602515473 podStartE2EDuration="4.050731847s" podCreationTimestamp="2026-05-21 13:07:13 +0000 UTC" firstStartedPulling="2026-05-21 13:07:14.404241133 +0000 UTC m=+258.125548014" lastFinishedPulling="2026-05-21 13:07:16.852457512 +0000 UTC m=+260.573764388" observedRunningTime="2026-05-21 13:07:17.049791695 +0000 UTC m=+260.771098593" watchObservedRunningTime="2026-05-21 13:07:17.050731847 +0000 UTC m=+260.772038744"
May 21 13:07:23.111864 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.111824    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"]
May 21 13:07:23.117712 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.117689    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.120290 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.120268    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8qkpg\""
May 21 13:07:23.125664 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.121549    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 13:07:23.125664 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.121999    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 13:07:23.125664 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.122285    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 13:07:23.129964 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.129930    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"]
May 21 13:07:23.140568 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.140541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.140706 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.140582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-manager-config\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.140761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.140739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-metrics-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.140851 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.140834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s996p\" (UniqueName: \"kubernetes.io/projected/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-kube-api-access-s996p\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.242273 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.242234    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s996p\" (UniqueName: \"kubernetes.io/projected/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-kube-api-access-s996p\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.242460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.242332    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.242460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.242359    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-manager-config\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.242460 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.242412    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-metrics-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.243109 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.243086    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-manager-config\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.244888 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.244868    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.245057 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.245034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-metrics-cert\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.250056 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.250026    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s996p\" (UniqueName: \"kubernetes.io/projected/9add6fd1-491d-4c25-bc4e-8d6d0e5adef5-kube-api-access-s996p\") pod \"lws-controller-manager-54666c59c-fjp68\" (UID: \"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.433319 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.433221    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:23.578735 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:23.578696    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"]
May 21 13:07:23.579939 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:07:23.579915    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9add6fd1_491d_4c25_bc4e_8d6d0e5adef5.slice/crio-77bdf84653d78438f573ba8f659e03ebc18f5740fc8bc238d3388db09222931f WatchSource:0}: Error finding container 77bdf84653d78438f573ba8f659e03ebc18f5740fc8bc238d3388db09222931f: Status 404 returned error can't find the container with id 77bdf84653d78438f573ba8f659e03ebc18f5740fc8bc238d3388db09222931f
May 21 13:07:24.043811 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:24.043774    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68" event={"ID":"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5","Type":"ContainerStarted","Data":"77bdf84653d78438f573ba8f659e03ebc18f5740fc8bc238d3388db09222931f"}
May 21 13:07:26.052105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:26.052064    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68" event={"ID":"9add6fd1-491d-4c25-bc4e-8d6d0e5adef5","Type":"ContainerStarted","Data":"a95398b27c5ec208646936bf4502f2e9e6a4af2ada11b8b2f7c5c796d416d685"}
May 21 13:07:26.052510 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:26.052169    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:26.070274 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:26.070108    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68" podStartSLOduration=1.498243541 podStartE2EDuration="3.070091066s" podCreationTimestamp="2026-05-21 13:07:23 +0000 UTC" firstStartedPulling="2026-05-21 13:07:23.581812386 +0000 UTC m=+267.303119262" lastFinishedPulling="2026-05-21 13:07:25.153659902 +0000 UTC m=+268.874966787" observedRunningTime="2026-05-21 13:07:26.069615878 +0000 UTC m=+269.790922777" watchObservedRunningTime="2026-05-21 13:07:26.070091066 +0000 UTC m=+269.791397965"
May 21 13:07:28.025331 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:28.025301    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-n9wr8"
May 21 13:07:37.057068 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:37.057035    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54666c59c-fjp68"
May 21 13:07:43.305130 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.305088    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-h6l4s"]
May 21 13:07:43.308698 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.308676    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.311866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.311826    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 13:07:43.312363 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.312345    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5l9h\""
May 21 13:07:43.312454 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.312363    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 13:07:43.312784 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.312763    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 13:07:43.313005 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.312991    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 13:07:43.336302 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.336273    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-h6l4s"]
May 21 13:07:43.422986 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.422955    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7a1af7-06c7-430d-9686-e01f16427a1b-tmp\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.423182 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.423079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7a1af7-06c7-430d-9686-e01f16427a1b-tls-certs\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.423182 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.423124    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qchtm\" (UniqueName: \"kubernetes.io/projected/7e7a1af7-06c7-430d-9686-e01f16427a1b-kube-api-access-qchtm\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.523910 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.523872    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7a1af7-06c7-430d-9686-e01f16427a1b-tls-certs\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.523910 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.523915    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qchtm\" (UniqueName: \"kubernetes.io/projected/7e7a1af7-06c7-430d-9686-e01f16427a1b-kube-api-access-qchtm\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.524163 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.524047    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7a1af7-06c7-430d-9686-e01f16427a1b-tmp\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.526256 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.526233    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e7a1af7-06c7-430d-9686-e01f16427a1b-tmp\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.526507 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.526487    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7a1af7-06c7-430d-9686-e01f16427a1b-tls-certs\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.532443 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.532420    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qchtm\" (UniqueName: \"kubernetes.io/projected/7e7a1af7-06c7-430d-9686-e01f16427a1b-kube-api-access-qchtm\") pod \"kube-auth-proxy-577646db99-h6l4s\" (UID: \"7e7a1af7-06c7-430d-9686-e01f16427a1b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.618545 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.618448    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s"
May 21 13:07:43.756623 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:43.756592    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-h6l4s"]
May 21 13:07:43.758239 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:07:43.758206    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7a1af7_06c7_430d_9686_e01f16427a1b.slice/crio-a8571c4642bd6df7fc1658cac143ff381bd6cc057fddc68adc5e5e70651410f9 WatchSource:0}: Error finding container a8571c4642bd6df7fc1658cac143ff381bd6cc057fddc68adc5e5e70651410f9: Status 404 returned error can't find the container with id a8571c4642bd6df7fc1658cac143ff381bd6cc057fddc68adc5e5e70651410f9
May 21 13:07:44.115584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:44.115546    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s" event={"ID":"7e7a1af7-06c7-430d-9686-e01f16427a1b","Type":"ContainerStarted","Data":"a8571c4642bd6df7fc1658cac143ff381bd6cc057fddc68adc5e5e70651410f9"}
May 21 13:07:47.127315 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:47.127284    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s" event={"ID":"7e7a1af7-06c7-430d-9686-e01f16427a1b","Type":"ContainerStarted","Data":"aa1f871307d9f603ee427e18600053cef2134f9f132a2fdb86387c3057fc3b93"}
May 21 13:07:56.759800 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:07:56.759763    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 21 13:09:35.255114 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.255053    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-577646db99-h6l4s" podStartSLOduration=108.966850998 podStartE2EDuration="1m52.255036641s" podCreationTimestamp="2026-05-21 13:07:43 +0000 UTC" firstStartedPulling="2026-05-21 13:07:43.760205812 +0000 UTC m=+287.481512687" lastFinishedPulling="2026-05-21 13:07:47.048391445 +0000 UTC m=+290.769698330" observedRunningTime="2026-05-21 13:07:47.154992011 +0000 UTC m=+290.876298913" watchObservedRunningTime="2026-05-21 13:09:35.255036641 +0000 UTC m=+398.976343541"
May 21 13:09:35.256209 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.256191    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"]
May 21 13:09:35.259596 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.259579    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.262328 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.262309    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 13:09:35.262442 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.262418    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 13:09:35.262504 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.262442    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s5swn\""
May 21 13:09:35.271158 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.271134    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"]
May 21 13:09:35.400296 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.400257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvx69\" (UniqueName: \"kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.400478 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.400364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.501694 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.501640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.501864 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.501778    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvx69\" (UniqueName: \"kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.502053 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.502035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.511251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.511227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvx69\" (UniqueName: \"kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69\") pod \"kuadrant-operator-controller-manager-84b657d985-s9z87\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.570218 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.570178    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:35.701472 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.701382    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"]
May 21 13:09:35.704152 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:09:35.704124    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c9a89d_984d_4f28_bd51_db4a8811d54e.slice/crio-4319006f3f147755110a81fe3f60261b2f45c2b0912ee2de3a74945b318b3af0 WatchSource:0}: Error finding container 4319006f3f147755110a81fe3f60261b2f45c2b0912ee2de3a74945b318b3af0: Status 404 returned error can't find the container with id 4319006f3f147755110a81fe3f60261b2f45c2b0912ee2de3a74945b318b3af0
May 21 13:09:35.706487 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.706473    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 13:09:35.781083 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.780866    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"]
May 21 13:09:35.786409 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:35.783964    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"]
May 21 13:09:40.521278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.521182    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" containerName="manager" containerID="cri-o://cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1" gracePeriod=2
May 21 13:09:40.758615 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.758586    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:40.761179 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.761151    2557 status_manager.go:895] "Failed to get status for pod" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87" err="pods \"kuadrant-operator-controller-manager-84b657d985-s9z87\" is forbidden: User \"system:node:ip-10-0-140-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-104.ec2.internal' and this object"
May 21 13:09:40.856617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.856525    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvx69\" (UniqueName: \"kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69\") pod \"55c9a89d-984d-4f28-bd51-db4a8811d54e\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") "
May 21 13:09:40.856617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.856576    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume\") pod \"55c9a89d-984d-4f28-bd51-db4a8811d54e\" (UID: \"55c9a89d-984d-4f28-bd51-db4a8811d54e\") "
May 21 13:09:40.856982 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.856958    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "55c9a89d-984d-4f28-bd51-db4a8811d54e" (UID: "55c9a89d-984d-4f28-bd51-db4a8811d54e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 13:09:40.858923 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.858889    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69" (OuterVolumeSpecName: "kube-api-access-rvx69") pod "55c9a89d-984d-4f28-bd51-db4a8811d54e" (UID: "55c9a89d-984d-4f28-bd51-db4a8811d54e"). InnerVolumeSpecName "kube-api-access-rvx69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:09:40.859777 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.859753    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" path="/var/lib/kubelet/pods/55c9a89d-984d-4f28-bd51-db4a8811d54e/volumes"
May 21 13:09:40.957724 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.957677    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55c9a89d-984d-4f28-bd51-db4a8811d54e-extensions-socket-volume\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:09:40.957724 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:40.957719    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvx69\" (UniqueName: \"kubernetes.io/projected/55c9a89d-984d-4f28-bd51-db4a8811d54e-kube-api-access-rvx69\") on node \"ip-10-0-140-104.ec2.internal\" DevicePath \"\""
May 21 13:09:41.525461 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.525428    2557 generic.go:358] "Generic (PLEG): container finished" podID="55c9a89d-984d-4f28-bd51-db4a8811d54e" containerID="cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1" exitCode=2
May 21 13:09:41.525895 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.525473    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87"
May 21 13:09:41.525895 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.525501    2557 scope.go:117] "RemoveContainer" containerID="cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1"
May 21 13:09:41.537611 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.537587    2557 scope.go:117] "RemoveContainer" containerID="cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1"
May 21 13:09:41.538068 ip-10-0-140-104 kubenswrapper[2557]: E0521 13:09:41.538026    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1\": container with ID starting with cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1 not found: ID does not exist" containerID="cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1"
May 21 13:09:41.538175 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.538110    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1"} err="failed to get container status \"cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1\": rpc error: code = NotFound desc = could not find container \"cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1\": container with ID starting with cfb51745bc13357d1660c9457882a686ad21160be48dcb828e6c66c86a93d1c1 not found: ID does not exist"
May 21 13:09:41.541045 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:09:41.541020    2557 status_manager.go:895] "Failed to get status for pod" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-s9z87" err="pods \"kuadrant-operator-controller-manager-84b657d985-s9z87\" is forbidden: User \"system:node:ip-10-0-140-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-104.ec2.internal' and this object"
May 21 13:10:27.826083 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.826046    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:10:27.826509 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.826389    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" containerName="manager"
May 21 13:10:27.826509 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.826401    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" containerName="manager"
May 21 13:10:27.826509 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.826473    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="55c9a89d-984d-4f28-bd51-db4a8811d54e" containerName="manager"
May 21 13:10:27.830535 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.830515    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:27.833376 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.833355    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 13:10:27.834418 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.834400    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 13:10:27.834418 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.834411    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zst48\""
May 21 13:10:27.834559 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.834413    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 13:10:27.841286 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.841264    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:10:27.870527 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.870490    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:10:27.987742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.987701    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbvg\" (UniqueName: \"kubernetes.io/projected/0c0e82f8-8226-4914-983f-30988de758e0-kube-api-access-5tbvg\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:27.987947 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:27.987899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c0e82f8-8226-4914-983f-30988de758e0-config-file\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.088723 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.088625    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbvg\" (UniqueName: \"kubernetes.io/projected/0c0e82f8-8226-4914-983f-30988de758e0-kube-api-access-5tbvg\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.088723 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.088704    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c0e82f8-8226-4914-983f-30988de758e0-config-file\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.089331 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.089310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c0e82f8-8226-4914-983f-30988de758e0-config-file\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.097278 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.097251    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbvg\" (UniqueName: \"kubernetes.io/projected/0c0e82f8-8226-4914-983f-30988de758e0-kube-api-access-5tbvg\") pod \"limitador-limitador-78c99df468-qf6zc\" (UID: \"0c0e82f8-8226-4914-983f-30988de758e0\") " pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.140812 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.140764    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:28.271960 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.271936    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:10:28.274463 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:10:28.274431    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0e82f8_8226_4914_983f_30988de758e0.slice/crio-dd67b90a3a61fc8b4ab4ec161943c94148b2dba0b4cf7ea703fdee66735ec2a4 WatchSource:0}: Error finding container dd67b90a3a61fc8b4ab4ec161943c94148b2dba0b4cf7ea703fdee66735ec2a4: Status 404 returned error can't find the container with id dd67b90a3a61fc8b4ab4ec161943c94148b2dba0b4cf7ea703fdee66735ec2a4
May 21 13:10:28.684761 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:28.684704    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc" event={"ID":"0c0e82f8-8226-4914-983f-30988de758e0","Type":"ContainerStarted","Data":"dd67b90a3a61fc8b4ab4ec161943c94148b2dba0b4cf7ea703fdee66735ec2a4"}
May 21 13:10:31.696954 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:31.696917    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc" event={"ID":"0c0e82f8-8226-4914-983f-30988de758e0","Type":"ContainerStarted","Data":"9b349c7ec095fdaad5558805c89c682f20a60fcda413764cf87d6581a857fbc7"}
May 21 13:10:31.697440 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:31.697023    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:10:31.715372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:31.715322    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc" podStartSLOduration=2.269924753 podStartE2EDuration="4.715308411s" podCreationTimestamp="2026-05-21 13:10:27 +0000 UTC" firstStartedPulling="2026-05-21 13:10:28.276166801 +0000 UTC m=+451.997473677" lastFinishedPulling="2026-05-21 13:10:30.721550459 +0000 UTC m=+454.442857335" observedRunningTime="2026-05-21 13:10:31.713984853 +0000 UTC m=+455.435291750" watchObservedRunningTime="2026-05-21 13:10:31.715308411 +0000 UTC m=+455.436615309"
May 21 13:10:42.701155 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:10:42.701124    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-qf6zc"
May 21 13:11:54.817304 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:11:54.817266    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:10.564073 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:10.564036    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:17.822537 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:17.822502    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:20.020132 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:20.020090    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:22.211608 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.211572    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"]
May 21 13:12:22.216874 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.216849    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.220996 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.220973    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g2h66\""
May 21 13:12:22.221176 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.220972    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 13:12:22.221176 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.220981    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 13:12:22.221347 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.221322    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 13:12:22.224486 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.224460    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"]
May 21 13:12:22.318097 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.318264 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.318264 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.318264 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318237    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xcd\" (UniqueName: \"kubernetes.io/projected/cf339c16-e860-4782-b73a-642e790f22e6-kube-api-access-x2xcd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.318372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.318372 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.318293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf339c16-e860-4782-b73a-642e790f22e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419241 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419205    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419241 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419243    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419498 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419282    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419498 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419299    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xcd\" (UniqueName: \"kubernetes.io/projected/cf339c16-e860-4782-b73a-642e790f22e6-kube-api-access-x2xcd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419498 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419336    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419498 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419357    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf339c16-e860-4782-b73a-642e790f22e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419753 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419611    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419753 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419691    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.419832 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.419772    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.421734 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.421712    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf339c16-e860-4782-b73a-642e790f22e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.421899 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.421884    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf339c16-e860-4782-b73a-642e790f22e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.427213 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.427192    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xcd\" (UniqueName: \"kubernetes.io/projected/cf339c16-e860-4782-b73a-642e790f22e6-kube-api-access-x2xcd\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf\" (UID: \"cf339c16-e860-4782-b73a-642e790f22e6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.528331 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.528295    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:22.657412 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:22.657295    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"]
May 21 13:12:22.660378 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:12:22.660348    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf339c16_e860_4782_b73a_642e790f22e6.slice/crio-2e1339d231b4f29fb44adc78180d2d99fc528b3be65bc842ad69fcf8363673a2 WatchSource:0}: Error finding container 2e1339d231b4f29fb44adc78180d2d99fc528b3be65bc842ad69fcf8363673a2: Status 404 returned error can't find the container with id 2e1339d231b4f29fb44adc78180d2d99fc528b3be65bc842ad69fcf8363673a2
May 21 13:12:23.062881 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:23.062842    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf" event={"ID":"cf339c16-e860-4782-b73a-642e790f22e6","Type":"ContainerStarted","Data":"2e1339d231b4f29fb44adc78180d2d99fc528b3be65bc842ad69fcf8363673a2"}
May 21 13:12:23.387802 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:23.387702    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:27.132011 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:27.131971    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:12:28.083030 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:28.082993    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf" event={"ID":"cf339c16-e860-4782-b73a-642e790f22e6","Type":"ContainerStarted","Data":"eef2dddf6d5d6a7eb242e3b375b33ac65144a3154c9e3c6e9c8ed3990a570bd9"}
May 21 13:12:37.119447 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:37.119413    2557 generic.go:358] "Generic (PLEG): container finished" podID="cf339c16-e860-4782-b73a-642e790f22e6" containerID="eef2dddf6d5d6a7eb242e3b375b33ac65144a3154c9e3c6e9c8ed3990a570bd9" exitCode=0
May 21 13:12:37.119855 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:37.119492    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf" event={"ID":"cf339c16-e860-4782-b73a-642e790f22e6","Type":"ContainerDied","Data":"eef2dddf6d5d6a7eb242e3b375b33ac65144a3154c9e3c6e9c8ed3990a570bd9"}
May 21 13:12:39.128311 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:39.128273    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf" event={"ID":"cf339c16-e860-4782-b73a-642e790f22e6","Type":"ContainerStarted","Data":"1a29eaded0166ed3e358936c55a63ee28600378d8535768445ea642a1c77b32b"}
May 21 13:12:39.128800 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:39.128484    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:12:39.149962 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:39.149889    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf" podStartSLOduration=1.380709123 podStartE2EDuration="17.149875206s" podCreationTimestamp="2026-05-21 13:12:22 +0000 UTC" firstStartedPulling="2026-05-21 13:12:22.662211919 +0000 UTC m=+566.383518799" lastFinishedPulling="2026-05-21 13:12:38.431377992 +0000 UTC m=+582.152684882" observedRunningTime="2026-05-21 13:12:39.147668651 +0000 UTC m=+582.868975547" watchObservedRunningTime="2026-05-21 13:12:39.149875206 +0000 UTC m=+582.871182103"
May 21 13:12:50.146129 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:12:50.146091    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf"
May 21 13:13:15.634072 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.634032    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"]
May 21 13:13:15.636412 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.636397    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.638681 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.638665    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 13:13:15.644795 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.644773    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"]
May 21 13:13:15.718445 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e922bd4-22de-4b92-a446-e0fbed1d12cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.718617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.718617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.718617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88t4j\" (UniqueName: \"kubernetes.io/projected/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kube-api-access-88t4j\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.718617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.718617 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.718601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.819678 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819601    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.819876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819702    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.819876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819766    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88t4j\" (UniqueName: \"kubernetes.io/projected/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kube-api-access-88t4j\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.819876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819845    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.819876 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819868    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.820034 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.819909    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e922bd4-22de-4b92-a446-e0fbed1d12cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.820105 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.820081    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.820141 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.820118    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.820328 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.820296    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.822124 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.822105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e922bd4-22de-4b92-a446-e0fbed1d12cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.822398 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.822378    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e922bd4-22de-4b92-a446-e0fbed1d12cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.827501 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.827480    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88t4j\" (UniqueName: \"kubernetes.io/projected/5e922bd4-22de-4b92-a446-e0fbed1d12cf-kube-api-access-88t4j\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb\" (UID: \"5e922bd4-22de-4b92-a446-e0fbed1d12cf\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:15.948146 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:15.948061    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:16.075799 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:16.075769    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"]
May 21 13:13:16.078901 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:13:16.078864    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e922bd4_22de_4b92_a446_e0fbed1d12cf.slice/crio-850ad5fb2b53fb0b679961c0abd618eb50e003270843a600f69cae49e7b87b50 WatchSource:0}: Error finding container 850ad5fb2b53fb0b679961c0abd618eb50e003270843a600f69cae49e7b87b50: Status 404 returned error can't find the container with id 850ad5fb2b53fb0b679961c0abd618eb50e003270843a600f69cae49e7b87b50
May 21 13:13:16.267138 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:16.267103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb" event={"ID":"5e922bd4-22de-4b92-a446-e0fbed1d12cf","Type":"ContainerStarted","Data":"c9e086f558a89112e0ce1c5f6fcb30aed7479e5e5f99c7e52d65f6681b44f396"}
May 21 13:13:16.267138 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:16.267144    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb" event={"ID":"5e922bd4-22de-4b92-a446-e0fbed1d12cf","Type":"ContainerStarted","Data":"850ad5fb2b53fb0b679961c0abd618eb50e003270843a600f69cae49e7b87b50"}
May 21 13:13:16.921169 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:16.921129    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:13:22.288487 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:22.288449    2557 generic.go:358] "Generic (PLEG): container finished" podID="5e922bd4-22de-4b92-a446-e0fbed1d12cf" containerID="c9e086f558a89112e0ce1c5f6fcb30aed7479e5e5f99c7e52d65f6681b44f396" exitCode=0
May 21 13:13:22.288902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:22.288524    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb" event={"ID":"5e922bd4-22de-4b92-a446-e0fbed1d12cf","Type":"ContainerDied","Data":"c9e086f558a89112e0ce1c5f6fcb30aed7479e5e5f99c7e52d65f6681b44f396"}
May 21 13:13:23.293023 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:23.292985    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb" event={"ID":"5e922bd4-22de-4b92-a446-e0fbed1d12cf","Type":"ContainerStarted","Data":"e2d4822d4bd4a34c23e1b1337a9133ecef7aafc2eb1ab3181d063df1b21edf96"}
May 21 13:13:23.293507 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:23.293226    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:23.314816 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:23.314768    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb" podStartSLOduration=8.040068874 podStartE2EDuration="8.314754323s" podCreationTimestamp="2026-05-21 13:13:15 +0000 UTC" firstStartedPulling="2026-05-21 13:13:22.289154397 +0000 UTC m=+626.010461277" lastFinishedPulling="2026-05-21 13:13:22.563839841 +0000 UTC m=+626.285146726" observedRunningTime="2026-05-21 13:13:23.312347641 +0000 UTC m=+627.033654541" watchObservedRunningTime="2026-05-21 13:13:23.314754323 +0000 UTC m=+627.036061218"
May 21 13:13:34.309142 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:34.309109    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb"
May 21 13:13:53.923845 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:53.923810    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:13:59.324983 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:13:59.324947    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:05.319481 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:05.319449    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:15.323226 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:15.323182    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:24.422775 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:24.422733    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:34.419605 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:34.419567    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:43.133719 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:43.133627    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:14:54.327961 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:14:54.327921    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:15:35.141928 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:15:35.141884    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:15:40.144092 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:15:40.144054    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:16:09.740080 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:16:09.740045    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:16:24.832274 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:16:24.832236    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:17:04.737666 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:17:04.737621    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:17:21.073554 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:17:21.073515    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:17:36.436014 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:17:36.435963    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:17:52.030389 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:17:52.030309    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:17:56.183892 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:17:56.183855    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:18:19.242267 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:18:19.242230    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:18:24.630618 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:18:24.630584    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:18:47.737474 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:18:47.737430    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:18:56.865979 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:18:56.865951    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:19:13.622087 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:19:13.622044    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:19:22.531540 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:19:22.531503    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:19:39.026732 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:19:39.026697    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:19:46.520660 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:19:46.520610    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:20.522185 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:20.522146    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:27.524395 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:27.524358    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:31.124199 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:31.124165    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:37.433937 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:37.433898    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:45.426413 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:45.426331    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:20:53.037515 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:20:53.037484    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:21:10.832569 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:21:10.832530    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:21:21.520584 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:21:21.520546    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:08.917223 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:08.917174    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:13.613568 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:13.613533    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:22.522570 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:22.522537    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:30.515249 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:30.515218    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:40.822377 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:40.822339    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:48.625283 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:48.625246    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:22:57.329092 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:22:57.329058    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:05.932726 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:05.932691    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:14.730287 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:14.730243    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:23.313710 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:23.313676    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:32.521622 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:32.521573    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:40.415929 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:40.415845    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:50.221268 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:50.221226    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:23:58.120091 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:23:58.120048    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:24:06.719148 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:24:06.719109    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:24:15.524716 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:24:15.524678    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:24:24.325237 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:24:24.325187    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:24:32.317791 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:24:32.317755    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:26:50.162879 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:26:50.162786    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:26:55.423019 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:26:55.422982    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:27:21.529269 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:27:21.529236    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:27:28.324730 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:27:28.324687    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:27:37.626146 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:27:37.626102    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:27:47.925076 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:27:47.925039    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:27:56.623392 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:27:56.623350    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:07.127245 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:07.127211    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:15.620962 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:15.620916    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:26.027558 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:26.027520    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:35.918945 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:35.918908    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:45.319727 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:45.319691    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:28:54.615301 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:28:54.615269    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:29:00.421700 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:29:00.421663    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:29:28.019490 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:29:28.019450    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:10.221629 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:10.221593    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:19.136748 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:19.136708    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:28.793057 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:28.793020    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:36.333590 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:36.333552    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:45.319989 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:45.319953    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:30:57.530048 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:30:57.530012    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:06.364190 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:06.364153    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:14.828983 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:14.828948    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:23.344987 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:23.344947    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:30.938983 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:30.938948    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:40.224292 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:40.224254    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:31:50.322474 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:31:50.322436    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:08.935742 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:08.935709    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:16.624569 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:16.624530    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:25.123485 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:25.123442    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:34.126804 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:34.126769    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:51.621263 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:51.621227    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:32:59.027883 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:32:59.027844    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:08.221018 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:08.220980    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:15.923162 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:15.923122    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:26.621095 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:26.621062    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:34.327585 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:34.327553    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:43.730364 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:43.730320    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:33:54.717444 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:33:54.717409    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:05.423176 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:05.423138    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:15.444424 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:15.444385    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:24.128815 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:24.128776    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:32.922035 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:32.922005    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:41.836327 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:41.836294    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:34:49.934861 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:34:49.934820    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:35:05.928079 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:35:05.928043    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:35:15.172477 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:35:15.172438    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:35:23.287121 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:35:23.287080    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:35:32.102044 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:35:32.102010    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:35:56.467102 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:35:56.467018    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:36:08.798688 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:08.798639    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qf6zc"]
May 21 13:36:16.538599 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:16.538569    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-n9wr8_c0d39e54-7460-4aeb-8836-afb5a7afc843/manager/0.log"
May 21 13:36:19.391566 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:19.391534    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qf6zc_0c0e82f8-8226-4914-983f-30988de758e0/limitador/0.log"
May 21 13:36:20.146886 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:20.146854    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577646db99-h6l4s_7e7a1af7-06c7-430d-9686-e01f16427a1b/kube-auth-proxy/0.log"
May 21 13:36:21.646866 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:21.646834    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb_5e922bd4-22de-4b92-a446-e0fbed1d12cf/storage-initializer/0.log"
May 21 13:36:21.657339 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:21.657309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-8zjpb_5e922bd4-22de-4b92-a446-e0fbed1d12cf/main/0.log"
May 21 13:36:21.779677 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:21.779637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf_cf339c16-e860-4782-b73a-642e790f22e6/storage-initializer/0.log"
May 21 13:36:21.793195 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:21.793166    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5qmwf_cf339c16-e860-4782-b73a-642e790f22e6/main/0.log"
May 21 13:36:25.818323 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.818287    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pn2g5/must-gather-5f42c"]
May 21 13:36:25.821923 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.821903    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:25.826251 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.826229    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pn2g5\"/\"default-dockercfg-dz7nz\""
May 21 13:36:25.827363 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.827343    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"openshift-service-ca.crt\""
May 21 13:36:25.827854 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.827834    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"kube-root-ca.crt\""
May 21 13:36:25.935898 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.935858    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/must-gather-5f42c"]
May 21 13:36:25.940902 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.940870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6rb\" (UniqueName: \"kubernetes.io/projected/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-kube-api-access-hx6rb\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:25.941127 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:25.941104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-must-gather-output\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.041938 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.041893    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-must-gather-output\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.042123 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.041956    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6rb\" (UniqueName: \"kubernetes.io/projected/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-kube-api-access-hx6rb\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.042310 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.042286    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-must-gather-output\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.052968 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.052936    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6rb\" (UniqueName: \"kubernetes.io/projected/72d0a07f-a1c5-4e1f-83df-064b3b3093d8-kube-api-access-hx6rb\") pod \"must-gather-5f42c\" (UID: \"72d0a07f-a1c5-4e1f-83df-064b3b3093d8\") " pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.131058 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.130974    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/must-gather-5f42c"
May 21 13:36:26.276037 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.276010    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/must-gather-5f42c"]
May 21 13:36:26.277782 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:36:26.277738    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72d0a07f_a1c5_4e1f_83df_064b3b3093d8.slice/crio-9dca2bf39a0e24be1b506c9bb444088df2f7a0191837e94974aeffc7fbe0cf04 WatchSource:0}: Error finding container 9dca2bf39a0e24be1b506c9bb444088df2f7a0191837e94974aeffc7fbe0cf04: Status 404 returned error can't find the container with id 9dca2bf39a0e24be1b506c9bb444088df2f7a0191837e94974aeffc7fbe0cf04
May 21 13:36:26.279675 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:26.279636    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 13:36:27.121723 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:27.121683    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/must-gather-5f42c" event={"ID":"72d0a07f-a1c5-4e1f-83df-064b3b3093d8","Type":"ContainerStarted","Data":"9dca2bf39a0e24be1b506c9bb444088df2f7a0191837e94974aeffc7fbe0cf04"}
May 21 13:36:28.128288 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:28.128256    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/must-gather-5f42c" event={"ID":"72d0a07f-a1c5-4e1f-83df-064b3b3093d8","Type":"ContainerStarted","Data":"61ffd53c86e862e8940f55cd8ccc31b83ca68c345268134b2b69310b0394b5af"}
May 21 13:36:28.128288 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:28.128296    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/must-gather-5f42c" event={"ID":"72d0a07f-a1c5-4e1f-83df-064b3b3093d8","Type":"ContainerStarted","Data":"7abcf7ca3136718d6691d88aad8f74373b696916d72ec3f858253509ea9e40d9"}
May 21 13:36:28.171414 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:28.171363    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-pn2g5/must-gather-5f42c" podStartSLOduration=2.320096435 podStartE2EDuration="3.171348753s" podCreationTimestamp="2026-05-21 13:36:25 +0000 UTC" firstStartedPulling="2026-05-21 13:36:26.279787716 +0000 UTC m=+2010.001094596" lastFinishedPulling="2026-05-21 13:36:27.131040021 +0000 UTC m=+2010.852346914" observedRunningTime="2026-05-21 13:36:28.170566609 +0000 UTC m=+2011.891873508" watchObservedRunningTime="2026-05-21 13:36:28.171348753 +0000 UTC m=+2011.892655651"
May 21 13:36:29.213049 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:29.213008    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dkbtc_5460e936-deef-4763-8183-6506536e71ff/global-pull-secret-syncer/0.log"
May 21 13:36:29.454914 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:29.454872    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x8k74_52ff09d7-f6a7-4055-8e76-9a87620b2694/konnectivity-agent/0.log"
May 21 13:36:29.576886 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:29.576847    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-104.ec2.internal_bf620bc707d30c338bdd0243f6ea5345/haproxy/0.log"
May 21 13:36:35.017582 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:35.017551    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qf6zc_0c0e82f8-8226-4914-983f-30988de758e0/limitador/0.log"
May 21 13:36:36.317913 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.317883    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/alertmanager/0.log"
May 21 13:36:36.343322 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.343289    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/config-reloader/0.log"
May 21 13:36:36.369424 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.369392    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/kube-rbac-proxy-web/0.log"
May 21 13:36:36.399920 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.399823    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/kube-rbac-proxy/0.log"
May 21 13:36:36.427767 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.427724    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/kube-rbac-proxy-metric/0.log"
May 21 13:36:36.460501 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.460468    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/prom-label-proxy/0.log"
May 21 13:36:36.483245 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.483205    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7373b84d-e0fa-43d1-a941-11dd0f87fd1d/init-config-reloader/0.log"
May 21 13:36:36.570560 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.570530    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-kpw8s_2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8/kube-state-metrics/0.log"
May 21 13:36:36.606171 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.606139    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-kpw8s_2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8/kube-rbac-proxy-main/0.log"
May 21 13:36:36.637677 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.637625    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-kpw8s_2fef88d0-5bf7-4f88-a6e9-6f4c396af1d8/kube-rbac-proxy-self/0.log"
May 21 13:36:36.675108 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.675012    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b8bbb7865-dq7dc_264a33dc-beef-4120-b8e1-76897d6721f3/metrics-server/0.log"
May 21 13:36:36.707560 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.707527    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-fc6bf_f3ff2e12-9764-4459-b6e2-232d53add419/monitoring-plugin/0.log"
May 21 13:36:36.747638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.747606    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq2l8_30cd7f53-3b07-40e0-9964-a66816fd8735/node-exporter/0.log"
May 21 13:36:36.791730 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.791701    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq2l8_30cd7f53-3b07-40e0-9964-a66816fd8735/kube-rbac-proxy/0.log"
May 21 13:36:36.820809 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:36.820783    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq2l8_30cd7f53-3b07-40e0-9964-a66816fd8735/init-textfile/0.log"
May 21 13:36:37.154602 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.154571    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lgh45_76151287-bb4c-4f62-98e8-6b985fbf2fe2/kube-rbac-proxy-main/0.log"
May 21 13:36:37.191456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.191427    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lgh45_76151287-bb4c-4f62-98e8-6b985fbf2fe2/kube-rbac-proxy-self/0.log"
May 21 13:36:37.226671 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.226184    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lgh45_76151287-bb4c-4f62-98e8-6b985fbf2fe2/openshift-state-metrics/0.log"
May 21 13:36:37.290456 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.290428    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/prometheus/0.log"
May 21 13:36:37.350638 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.350605    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/config-reloader/0.log"
May 21 13:36:37.410079 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.410003    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/thanos-sidecar/0.log"
May 21 13:36:37.454619 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.454586    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/kube-rbac-proxy-web/0.log"
May 21 13:36:37.493378 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.493345    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/kube-rbac-proxy/0.log"
May 21 13:36:37.557334 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.557297    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"]
May 21 13:36:37.558555 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.558526    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/kube-rbac-proxy-thanos/0.log"
May 21 13:36:37.562756 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.562732    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.581834 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.581792    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"]
May 21 13:36:37.609640 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.609613    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2988d592-de2e-4e32-8fea-645cf5b84b1f/init-config-reloader/0.log"
May 21 13:36:37.644928 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.644898    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4vrv2_4741b0bd-67ca-4f96-bc9b-29983c8143ca/prometheus-operator/0.log"
May 21 13:36:37.666565 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.666476    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-podres\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.666565 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.666522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-lib-modules\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.666565 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.666567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-sys\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.666870 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.666609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-proc\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.666870 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.666625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfdw\" (UniqueName: \"kubernetes.io/projected/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-kube-api-access-vxfdw\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.667103 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.667071    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-4vrv2_4741b0bd-67ca-4f96-bc9b-29983c8143ca/kube-rbac-proxy/0.log"
May 21 13:36:37.730698 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.730641    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56975b97-s5ttv_f9c832ca-3144-45ce-b508-e46734728aae/telemeter-client/0.log"
May 21 13:36:37.754470 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.754439    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56975b97-s5ttv_f9c832ca-3144-45ce-b508-e46734728aae/reload/0.log"
May 21 13:36:37.768067 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768030    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-sys\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768099    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-proc\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768127    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfdw\" (UniqueName: \"kubernetes.io/projected/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-kube-api-access-vxfdw\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768160    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-sys\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768254 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768221    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-proc\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768473 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768263    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-podres\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768473 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768308    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-lib-modules\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768473 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-podres\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.768586 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.768475    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-lib-modules\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.779317 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.779282    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfdw\" (UniqueName: \"kubernetes.io/projected/3854981c-cf2c-4cbb-a7ae-c396efdf7d24-kube-api-access-vxfdw\") pod \"perf-node-gather-daemonset-g8gkj\" (UID: \"3854981c-cf2c-4cbb-a7ae-c396efdf7d24\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.785630 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.785603    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56975b97-s5ttv_f9c832ca-3144-45ce-b508-e46734728aae/kube-rbac-proxy/0.log"
May 21 13:36:37.819581 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.819550    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/thanos-query/0.log"
May 21 13:36:37.844250 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.844222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/kube-rbac-proxy-web/0.log"
May 21 13:36:37.872904 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.872875    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:37.874098 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.874073    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/kube-rbac-proxy/0.log"
May 21 13:36:37.905998 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.905968    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/prom-label-proxy/0.log"
May 21 13:36:37.946090 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.946059    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/kube-rbac-proxy-rules/0.log"
May 21 13:36:37.975358 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:37.975315    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-848d49d7b9-djrcw_6133ca4c-eb49-49f5-8526-5c6248698ebd/kube-rbac-proxy-metrics/0.log"
May 21 13:36:38.031873 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:38.030754    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"]
May 21 13:36:38.039721 ip-10-0-140-104 kubenswrapper[2557]: W0521 13:36:38.039674    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3854981c_cf2c_4cbb_a7ae_c396efdf7d24.slice/crio-95e8e6f04a1ef49458d89e1f3198d58dbe67dda933419a3b186e6844f5a4cdae WatchSource:0}: Error finding container 95e8e6f04a1ef49458d89e1f3198d58dbe67dda933419a3b186e6844f5a4cdae: Status 404 returned error can't find the container with id 95e8e6f04a1ef49458d89e1f3198d58dbe67dda933419a3b186e6844f5a4cdae
May 21 13:36:38.183704 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:38.183607    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj" event={"ID":"3854981c-cf2c-4cbb-a7ae-c396efdf7d24","Type":"ContainerStarted","Data":"af5d6a78aa9abd096ea0cf06c803f71f33a6e6df568d056b54c82da247d4a2f4"}
May 21 13:36:38.183704 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:38.183665    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj" event={"ID":"3854981c-cf2c-4cbb-a7ae-c396efdf7d24","Type":"ContainerStarted","Data":"95e8e6f04a1ef49458d89e1f3198d58dbe67dda933419a3b186e6844f5a4cdae"}
May 21 13:36:38.183884 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:38.183709    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:38.204281 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:38.204231    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj" podStartSLOduration=1.204215856 podStartE2EDuration="1.204215856s" podCreationTimestamp="2026-05-21 13:36:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:36:38.20167475 +0000 UTC m=+2021.922981649" watchObservedRunningTime="2026-05-21 13:36:38.204215856 +0000 UTC m=+2021.925522804"
May 21 13:36:41.534442 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:41.534412    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2756_457e2d6b-863e-4517-b456-0d16556a2358/dns/0.log"
May 21 13:36:41.576374 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:41.576343    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2756_457e2d6b-863e-4517-b456-0d16556a2358/kube-rbac-proxy/0.log"
May 21 13:36:41.640050 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:41.640020    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6jwv9_97be1c5d-9b40-4d11-a705-8689f2bc1d1d/dns-node-resolver/0.log"
May 21 13:36:42.291529 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:42.291503    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fq9q_9c1194b8-b036-4f05-b271-409185f431fe/node-ca/0.log"
May 21 13:36:43.341926 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:43.341893    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577646db99-h6l4s_7e7a1af7-06c7-430d-9686-e01f16427a1b/kube-auth-proxy/0.log"
May 21 13:36:44.197965 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:44.197940    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-g8gkj"
May 21 13:36:44.207907 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:44.207880    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7jfc_44f3c210-aba1-4e92-8e2c-98fa9554d268/serve-healthcheck-canary/0.log"
May 21 13:36:44.958492 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:44.958461    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8hw4_c655fb24-c9b6-4369-9162-2499aeb47448/kube-rbac-proxy/0.log"
May 21 13:36:44.987366 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:44.987341    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8hw4_c655fb24-c9b6-4369-9162-2499aeb47448/exporter/0.log"
May 21 13:36:45.020193 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:45.020165    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8hw4_c655fb24-c9b6-4369-9162-2499aeb47448/extractor/0.log"
May 21 13:36:47.748760 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:47.748680    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-n9wr8_c0d39e54-7460-4aeb-8836-afb5a7afc843/manager/0.log"
May 21 13:36:49.152532 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:49.152493    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54666c59c-fjp68_9add6fd1-491d-4c25-bc4e-8d6d0e5adef5/manager/0.log"
May 21 13:36:49.181464 ip-10-0-140-104 kubenswrapper[2557]: I0521 13:36:49.181436    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-2fkbc_6fd2a905-9052-4464-87d8-d0aeb10d9dc8/openshift-lws-operator/0.log"