May 28 09:31:49.191353 ip-10-0-135-248 systemd[1]: Starting Kubernetes Kubelet...
May 28 09:31:49.699880 ip-10-0-135-248 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:49.699880 ip-10-0-135-248 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 09:31:49.699880 ip-10-0-135-248 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:49.699880 ip-10-0-135-248 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 09:31:49.699880 ip-10-0-135-248 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:49.701776 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.701687    2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 09:31:49.704723 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704708    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:49.704723 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704723    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704727    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704730    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704733    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704735    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704738    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704741    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704743    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704746    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704750    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704754    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704756    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704759    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704762    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704764    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704767    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704769    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704772    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704779    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:49.704790 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704782    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704784    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704787    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704790    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704793    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704796    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704798    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704802    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704804    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704807    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704809    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704812    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704814    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704818    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704820    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704823    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704825    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704827    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704830    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704832    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:49.705272 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704835    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704837    2559 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704839    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704842    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704844    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704847    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704849    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704851    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704854    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704856    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704859    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704861    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704864    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704867    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704870    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704873    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704875    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704878    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704880    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704883    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:49.705893 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704885    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704888    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704890    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704893    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704895    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704898    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704900    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704903    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704905    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704908    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704910    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704913    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704916    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704918    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704921    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704923    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704925    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704928    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704931    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704933    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:49.706614 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704935    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704938    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704941    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704946    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704949    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.704952    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705344    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705350    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705354    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705357    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705360    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705363    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705366    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705369    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705371    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705374    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705378    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705382    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:49.707131 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705385    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705387    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705390    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705392    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705395    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705398    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705402    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705405    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705408    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705411    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705414    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705417    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705419    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705422    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705424    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705427    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705429    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705432    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705434    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:49.707574 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705472    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705515    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705520    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705525    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705530    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705537    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.705541    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706526    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706534    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706537    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706540    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706545    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706550    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706560    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706570    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706573    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706578    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706594    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706601    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706621    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706771    2559 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:49.708069 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706778    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706783    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706787    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706791    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706793    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706796    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706798    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706801    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706804    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706806    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706809    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706812    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706816    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706818    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706821    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706824    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706827    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706830    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706833    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:49.708583 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706835    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706841    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706844    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706846    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706849    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706851    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706854    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706857    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706859    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706862    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706865    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706868    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706871    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706874    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.706877    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707602    2559 flags.go:64] FLAG: --address="0.0.0.0"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707611    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707618    2559 flags.go:64] FLAG: --anonymous-auth="true"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707624    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707629    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707632    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 09:31:49.709055 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707637    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707642    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707645    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707649    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707652    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707655    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707659    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707662    2559 flags.go:64] FLAG: --cgroup-root=""
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707664    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707668    2559 flags.go:64] FLAG: --client-ca-file=""
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707670    2559 flags.go:64] FLAG: --cloud-config=""
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707673    2559 flags.go:64] FLAG: --cloud-provider="external"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707676    2559 flags.go:64] FLAG: --cluster-dns="[]"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707681    2559 flags.go:64] FLAG: --cluster-domain=""
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707684    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707687    2559 flags.go:64] FLAG: --config-dir=""
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707690    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707693    2559 flags.go:64] FLAG: --container-log-max-files="5"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707697    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707700    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707704    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707707    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707710    2559 flags.go:64] FLAG: --contention-profiling="false"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707713    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 09:31:49.709574 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707716    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707719    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707722    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707726    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707729    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707732    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707735    2559 flags.go:64] FLAG: --enable-load-reader="false"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707738    2559 flags.go:64] FLAG: --enable-server="true"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707741    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707746    2559 flags.go:64] FLAG: --event-burst="100"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707749    2559 flags.go:64] FLAG: --event-qps="50"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707753    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707756    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707759    2559 flags.go:64] FLAG: --eviction-hard=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707763    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707765    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707768    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707771    2559 flags.go:64] FLAG: --eviction-soft=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707774    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707777    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707780    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707783    2559 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707786    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707789    2559 flags.go:64] FLAG: --fail-swap-on="true"
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707791    2559 flags.go:64] FLAG: --feature-gates=""
May 28 09:31:49.710201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707795    2559 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707800    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707803    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707806    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707809    2559 flags.go:64] FLAG: --healthz-port="10248"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707812    2559 flags.go:64] FLAG: --help="false"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707815    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-248.ec2.internal"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707818    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707821    2559 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707824    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707827    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707831    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707834    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707837    2559 flags.go:64] FLAG: --image-service-endpoint=""
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707843    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707846    2559 flags.go:64] FLAG: --kube-api-burst="100"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707849    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707853    2559 flags.go:64] FLAG: --kube-api-qps="50"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707855    2559 flags.go:64] FLAG: --kube-reserved=""
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707858    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707861    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707864    2559 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707867    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707870    2559 flags.go:64] FLAG: --lock-file=""
May 28 09:31:49.710813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707872    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707875    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707878    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707883    2559 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707886    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707889    2559 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707892    2559 flags.go:64] FLAG: --logging-format="text"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707894    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707898    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707901    2559 flags.go:64] FLAG: --manifest-url=""
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707904    2559 flags.go:64] FLAG: --manifest-url-header=""
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707908    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707911    2559 flags.go:64] FLAG: --max-open-files="1000000"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707916    2559 flags.go:64] FLAG: --max-pods="110"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707919    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707922    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707925    2559 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707927    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707930    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707933    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707936    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707944    2559 flags.go:64] FLAG: --node-status-max-images="50"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707949    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707952    2559 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 09:31:49.711440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707955    2559 flags.go:64] FLAG: --pod-cidr=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707958    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707964    2559 flags.go:64] FLAG: --pod-manifest-path=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707967    2559 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707970    2559 flags.go:64] FLAG: --pods-per-core="0"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707973    2559 flags.go:64] FLAG: --port="10250"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707984    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707988    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e1131ed5163ca7f"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707991    2559 flags.go:64] FLAG: --qos-reserved=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707994    2559 flags.go:64] FLAG: --read-only-port="10255"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.707997    2559 flags.go:64] FLAG: --register-node="true"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708000    2559 flags.go:64] FLAG: --register-schedulable="true"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708003    2559 flags.go:64] FLAG: --register-with-taints=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708007    2559 flags.go:64] FLAG: --registry-burst="10"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708009    2559 flags.go:64] FLAG: --registry-qps="5"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708013    2559 flags.go:64] FLAG: --reserved-cpus=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708016    2559 flags.go:64] FLAG: --reserved-memory=""
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708020    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708023    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708027    2559 flags.go:64] FLAG: --rotate-certificates="false"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708032    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708035    2559 flags.go:64] FLAG: --runonce="false"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708038    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708041    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708056    2559 flags.go:64] FLAG: --seccomp-default="false"
May 28 09:31:49.712037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708059    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708062    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708065    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708068    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708071    2559 flags.go:64] FLAG: --storage-driver-password="root"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708075    2559 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708079    2559 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708082    2559 flags.go:64] FLAG: --storage-driver-user="root"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708085    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708088    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708091    2559 flags.go:64] FLAG: --system-cgroups=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708094    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708100    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708103    2559 flags.go:64] FLAG: --tls-cert-file=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708106    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708110    2559 flags.go:64] FLAG: --tls-min-version=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708113    2559 flags.go:64] FLAG: --tls-private-key-file=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708116    2559 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708119    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708122    2559 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708125    2559 flags.go:64] FLAG: --v="2"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708129    2559 flags.go:64] FLAG: --version="false"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708133    2559 flags.go:64] FLAG: --vmodule=""
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708138    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.708141    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 09:31:49.712698 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708232    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708236    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708241    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708244    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708247    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708250    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708252    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708255    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708257    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708260    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708263    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708265    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708268    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708272    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708275    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708277    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708280    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708283    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708285    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708288    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:49.713341 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708291    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708293    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708296    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708298    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708301    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708303    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708306    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708308    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708311    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708314    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708316    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708319    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708321    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708324    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708328    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708331    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708333    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708336    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708339    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:49.713843 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708342    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708346    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708349    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708352    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708354    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708357    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708361    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708363    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708366    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708368    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708371    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708374    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708376    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708379    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708381    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708384    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708387    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708389    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708392    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708395    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:49.714389 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708397    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708400    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708402    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708405    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708407    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708410    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708415    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708422    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708425    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708429    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708432    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708435    2559 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708438    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708441    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708443    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708446    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708449    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708451    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708455    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708457    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:49.714928 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708460    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708463    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708465    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708468    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708470    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708473    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.708475    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:49.715428 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.709342    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:49.716012 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.715993    2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 09:31:49.716043 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.716013    2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716071    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716077    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716080    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716083    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716086    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:49.716092 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716091    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716095    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716099    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716102    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716105    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716108    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716111    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716114    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716117    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716120    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716123    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716125    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716128    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716130    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716133    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716135    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716138    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716140    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716143    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:49.716248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716146    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716148    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716151    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716153    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716156    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716158    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716161    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716165    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716167    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716170    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716173    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716177    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716181    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716184    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716187    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716192    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716195    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716198    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716200    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:49.716755 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716203    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716206    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716208    2559 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716212    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716214    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716217    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716220    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716222    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716225    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716227    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716230    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716233    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716235    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716237    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716240    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716243    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716245    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716248    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716251    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716254    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716256    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:49.717231 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716260    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716262    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716265    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716268    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716271    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716274    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716276    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716280    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716282    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716285    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716288    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716290    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716293    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716295    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716298    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716301    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716303    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716306    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716309    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716311    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:49.717743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716314    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716316    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.716322    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716420    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716425    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716428    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716431    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716434    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716437    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716440    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716442    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716445    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716448    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716451    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716454    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:49.718248 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716457    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716459    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716462    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716465    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716468    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716471    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716473    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716476    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716478    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716481    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716483    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716486    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716489    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716491    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716494    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716496    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716499    2559 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716501    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716504    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716506    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:49.718653 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716509    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716511    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716514    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716516    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716519    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716521    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716524    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716527    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716529    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716532    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716535    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716542    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716545    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716547    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716550    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716552    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716555    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716558    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716560    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716563    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:49.719220 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716565    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716568    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716570    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716573    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716576    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716580    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716583    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716585    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716588    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716590    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716593    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716595    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716598    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716600    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716603    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716605    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716607    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716610    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716612    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716615    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:49.719707 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716618    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716620    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716623    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716625    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716630    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716633    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716636    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716639    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716642    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716645    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716648    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716650    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716653    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:49.716656    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.716661    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:49.720204 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.717563    2559 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 09:31:49.720773 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.720760    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 09:31:49.721883 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.721871    2559 server.go:1019] "Starting client certificate rotation"
May 28 09:31:49.721990 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.721976    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:49.722027 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.722012    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:49.749917 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.749900    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:49.755529 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.755514    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:49.770087 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.770067    2559 log.go:25] "Validated CRI v1 runtime API"
May 28 09:31:49.778726 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.778703    2559 log.go:25] "Validated CRI v1 image API"
May 28 09:31:49.780027 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.780004    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:49.780160 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.780134    2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 09:31:49.782746 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.782729    2559 fs.go:135] Filesystem UUIDs: map[448e3984-00af-4a34-bcf9-5d204de0454f:/dev/nvme0n1p4 49f81baa-6ae1-47fa-8008-a71e1ba9991e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 28 09:31:49.782830 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.782746    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 09:31:49.787117 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.786991    2559 manager.go:217] Machine: {Timestamp:2026-05-28 09:31:49.786452653 +0000 UTC m=+0.460069062 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099978 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a9609751c797bd2722d508ccb744 SystemUUID:ec23a960-9751-c797-bd27-22d508ccb744 BootID:608c9ce6-79ed-4d1c-88e8-f7dadb1a4989 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:e1:43:44:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:e1:43:44:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:81:49:15:40:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 09:31:49.787949 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.787938    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 09:31:49.788059 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.788035    2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 09:31:49.791858 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.791834    2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 09:31:49.792002 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.791861    2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 09:31:49.792064 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.792012    2559 topology_manager.go:138] "Creating topology manager with none policy"
May 28 09:31:49.792064 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.792021    2559 container_manager_linux.go:306] "Creating device plugin manager"
May 28 09:31:49.792064 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.792030    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:49.792680 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.792669    2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:49.794595 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.794585    2559 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:49.794711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.794703    2559 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 09:31:49.797462 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.797452    2559 kubelet.go:491] "Attempting to sync node with API server"
May 28 09:31:49.797503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.797466    2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 09:31:49.797503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.797477    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 09:31:49.797503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.797487    2559 kubelet.go:397] "Adding apiserver pod source"
May 28 09:31:49.797503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.797495    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 09:31:49.798741 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.798728    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:49.798782 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.798746    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:49.802030 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.802013    2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 09:31:49.804392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.804378    2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 09:31:49.805969 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.805955    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.805972    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.805980    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.805990    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806004    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806012    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806018    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 09:31:49.806022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806024    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 09:31:49.806328 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806031    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 09:31:49.806328 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806037    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 09:31:49.806328 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806063    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 09:31:49.806328 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.806070    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 09:31:49.807098 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.807086    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 09:31:49.807098 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.807096    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 09:31:49.808615 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.808594    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-752kv"
May 28 09:31:49.810409 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.810395    2559 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 09:31:49.810461 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.810433    2559 server.go:1295] "Started kubelet"
May 28 09:31:49.810576 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.810510    2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 09:31:49.810625 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.810609    2559 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 09:31:49.810779 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.810609    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 09:31:49.811238 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.811217    2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 09:31:49.811296 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.811235    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 09:31:49.811397 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.811359    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 09:31:49.811410 ip-10-0-135-248 systemd[1]: Started Kubernetes Kubelet.
May 28 09:31:49.812286 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.812239    2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 09:31:49.813138 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.813123    2559 server.go:317] "Adding debug handlers to kubelet server"
May 28 09:31:49.816968 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.816948    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-752kv"
May 28 09:31:49.819297 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.817949    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-248.ec2.internal.18b3b0d5be66ce5a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-248.ec2.internal,UID:ip-10-0-135-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-248.ec2.internal,},FirstTimestamp:2026-05-28 09:31:49.81040905 +0000 UTC m=+0.484025459,LastTimestamp:2026-05-28 09:31:49.81040905 +0000 UTC m=+0.484025459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-248.ec2.internal,}"
May 28 09:31:49.820176 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.820158    2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 09:31:49.821655 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.821638    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 09:31:49.822319 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.822304    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.824469    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.824562    2559 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.824579    2559 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.824885    2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.824895    2559 reconstruct.go:97] "Volume reconstruction finished"
May 28 09:31:49.825376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.824924    2559 reconciler.go:26] "Reconciler: start to sync state"
May 28 09:31:49.827651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827631    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 09:31:49.827651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827651    2559 factory.go:55] Registering systemd factory
May 28 09:31:49.827651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827660    2559 factory.go:223] Registration of the systemd container factory successfully
May 28 09:31:49.827914 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827898    2559 factory.go:153] Registering CRI-O factory
May 28 09:31:49.827965 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827919    2559 factory.go:223] Registration of the crio container factory successfully
May 28 09:31:49.827965 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827938    2559 factory.go:103] Registering Raw factory
May 28 09:31:49.827965 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.827953    2559 manager.go:1196] Started watching for new ooms in manager
May 28 09:31:49.828440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.828425    2559 manager.go:319] Starting recovery of all containers
May 28 09:31:49.829451 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.829432    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:49.836017 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.835882    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-248.ec2.internal\" not found" node="ip-10-0-135-248.ec2.internal"
May 28 09:31:49.839017 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.839001    2559 manager.go:324] Recovery completed
May 28 09:31:49.843147 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.843134    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:49.844835 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.844821    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:49.844892 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.844848    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:49.844892 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.844859    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:49.845358 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.845344    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 09:31:49.845358 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.845356    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 09:31:49.845444 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.845373    2559 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:49.849243 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.849226    2559 policy_none.go:49] "None policy: Start"
May 28 09:31:49.849243 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.849244    2559 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 09:31:49.849353 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.849254    2559 state_mem.go:35] "Initializing new in-memory state store"
May 28 09:31:49.890735 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.890717    2559 manager.go:341] "Starting Device Plugin manager"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.890756    2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.890771    2559 server.go:85] "Starting device plugin registration server"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.890998    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.891007    2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.891122    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.891201    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.891210    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.892168    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 09:31:49.908660 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.892208    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:49.928759 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.928730    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 09:31:49.929893 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.929873    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 09:31:49.929951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.929914    2559 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 09:31:49.929951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.929939    2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 09:31:49.929951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.929949    2559 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 09:31:49.930070 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:49.929993    2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 09:31:49.936792 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.936770    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:49.991869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.991793    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:49.992833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.992808    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:49.992958 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.992847    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:49.992958 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.992862    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:49.992958 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:49.992892    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-248.ec2.internal"
May 28 09:31:50.002183 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.002164    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-248.ec2.internal"
May 28 09:31:50.002247 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.002189    2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-248.ec2.internal\": node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.030203 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.030172    2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"]
May 28 09:31:50.030317 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.030254    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:50.031170 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.031153    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:50.031232 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.031184    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:50.031232 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.031194    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:50.032421 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.032406    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:50.032601 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.032584    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.032716 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.032623    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:50.033129 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033111    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:50.033203 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033137    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:50.033203 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033147    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:50.033203 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033111    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:50.033300 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033229    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:50.033300 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.033241    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:50.034314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.034302    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.034363 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.034325    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:50.034960 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.034943    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:50.035023 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.034977    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:50.035023 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.034995    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:50.049560 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.049543    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.060817 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.060793    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-248.ec2.internal\" not found" node="ip-10-0-135-248.ec2.internal"
May 28 09:31:50.065291 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.065275    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-248.ec2.internal\" not found" node="ip-10-0-135-248.ec2.internal"
May 28 09:31:50.126653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.126629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c523654d72a132fa6c94341510b4d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-248.ec2.internal\" (UID: \"086c523654d72a132fa6c94341510b4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.126787 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.126659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.126787 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.126680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.149814 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.149788    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.226868 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.226961 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226877    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.226961 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c523654d72a132fa6c94341510b4d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-248.ec2.internal\" (UID: \"086c523654d72a132fa6c94341510b4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.226961 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226949    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c523654d72a132fa6c94341510b4d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-248.ec2.internal\" (UID: \"086c523654d72a132fa6c94341510b4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.227082 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226955    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.227082 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.226961    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8455d85783eddec7a1fefb29cbe58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal\" (UID: \"87c8455d85783eddec7a1fefb29cbe58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.249983 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.249914    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.350494 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.350462    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.363642 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.363620    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.367351 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.367333    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.451375 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.451323    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.551870 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.551790    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.652286 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.652247    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-248.ec2.internal\" not found"
May 28 09:31:50.721566 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.721531    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 09:31:50.722204 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.721691    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 09:31:50.722204 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.721691    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 09:31:50.731334 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.731315    2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:50.798012 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.797979    2559 apiserver.go:52] "Watching apiserver"
May 28 09:31:50.810431 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.810382    2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 09:31:50.811444 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.811423    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qfpnf","openshift-dns/node-resolver-9gts4","openshift-multus/multus-additional-cni-plugins-9wdbb","openshift-multus/multus-vdhs5","openshift-multus/network-metrics-daemon-6bd26","openshift-network-diagnostics/network-check-target-f4hdh","kube-system/konnectivity-agent-zj55m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g","openshift-image-registry/node-ca-mmtfl","openshift-network-operator/iptables-alerter-7rsh8","openshift-ovn-kubernetes/ovnkube-node-hlrhk"]
May 28 09:31:50.815314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.815298    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.815411 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.815393    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.817749 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817727    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:50.817839 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817774    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 09:31:50.817839 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817793    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 09:31:50.817839 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817729    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 09:31:50.817839 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817832    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4l2pt\""
May 28 09:31:50.818005 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.817841    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcs4p\""
May 28 09:31:50.818137 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.818124    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.819421 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.819379    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 09:26:49 +0000 UTC" deadline="2028-01-29 22:40:25.581892165 +0000 UTC"
May 28 09:31:50.819479 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.819421    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14677h8m34.762474508s"
May 28 09:31:50.819938 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.819924    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 09:31:50.820132 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.820116    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.820191 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.820177    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 09:31:50.820525 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.820503    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 09:31:50.820626 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.820599    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 09:31:50.820744 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.820730    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twwjm\""
May 28 09:31:50.821180 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.821163    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 09:31:50.822231 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.822216    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 09:31:50.822305 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.822264    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:50.822359 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.822331    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:31:50.823276 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.823256    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 09:31:50.823506 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.823495    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mx7gz\""
May 28 09:31:50.824392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.824379    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.824515 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.824499    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:50.824580 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.824562    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:31:50.826703 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.826688    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.828877 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.828857    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q4qd9\""
May 28 09:31:50.828961 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.828906    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.829021 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.828974    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 09:31:50.829113 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.829019    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 09:31:50.830170 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-os-release\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.830256 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:50.830256 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-sys\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-netns\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-kubelet\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830392 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-run\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-daemon-config\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-tmp-dir\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830501    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-var-lib-kubelet\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-host\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89l79\" (UniqueName: \"kubernetes.io/projected/3b37a980-d2da-4e78-b685-a03abcc21f52-kube-api-access-89l79\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-system-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-multus-certs\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.830701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-cnibin\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.830940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wzh6\" (UniqueName: \"kubernetes.io/projected/24e3aee5-12fc-402d-a7df-1392399d6c05-kube-api-access-8wzh6\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-konnectivity-ca\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831172    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-conf\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cnibin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.831285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-hostroot\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dghr\" (UniqueName: \"kubernetes.io/projected/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-kube-api-access-5dghr\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831298    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831327    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-agent-certs\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-tmp\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.831584 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-socket-dir-parent\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.831903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-modprobe-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.831903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysconfig\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.831903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-lib-modules\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.831903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-os-release\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.831903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.831818    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-k8s-cni-cncf-io\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832290    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-multus\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vzqb\" (UniqueName: \"kubernetes.io/projected/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-kube-api-access-2vzqb\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-systemd\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832562    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wh4zd\""
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cni-binary-copy\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-bin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-etc-kubernetes\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:50.833227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.832782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/7369f3ea-d49b-49e7-8d44-7088f4de9c42-kube-api-access-6skwd\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:50.833869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.833283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-hosts-file\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.833869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.833308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-kubernetes\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.833869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.833336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-tuned\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.833869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.833363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-conf-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.833869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.833413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.834918 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.834900    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:50.834994 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.834973    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"
May 28 09:31:50.835544 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.835522    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 09:31:50.835647 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.835547    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 09:31:50.835647 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.835587    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg94z\""
May 28 09:31:50.835762 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.835649    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 09:31:50.835762 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.835738    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:50.838198 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.838181    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal"]
May 28 09:31:50.838300 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.838289    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.839829 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.839813    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 09:31:50.839911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.839851    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcc6h\""
May 28 09:31:50.839957 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.839937    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 09:31:50.840182 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840165    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:50.840364 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840350    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 09:31:50.840403 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840362    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-222xt\""
May 28 09:31:50.840686 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840673    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 09:31:50.840748 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840736    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 09:31:50.840793 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.840756    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 09:31:50.841018 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.841003    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 09:31:50.841096 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.841004    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 09:31:50.841147 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.841110    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:50.849791 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.849775    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:50.849884 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.849873    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal"]
May 28 09:31:50.853978 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.853962    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:50.867120 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.867103    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-285mq"
May 28 09:31:50.875656 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.875638    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-285mq"
May 28 09:31:50.885184 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:50.885153    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086c523654d72a132fa6c94341510b4d.slice/crio-23234273dfe51e09aea47907457d3e16fcaea5c49cea2d6c3f4d3992aecb6d8d WatchSource:0}: Error finding container 23234273dfe51e09aea47907457d3e16fcaea5c49cea2d6c3f4d3992aecb6d8d: Status 404 returned error can't find the container with id 23234273dfe51e09aea47907457d3e16fcaea5c49cea2d6c3f4d3992aecb6d8d
May 28 09:31:50.885388 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:50.885356    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c8455d85783eddec7a1fefb29cbe58.slice/crio-9c4ff7f6c861f7adc58b17f74b449e8bcc895a3af6bd21728200c50210645a10 WatchSource:0}: Error finding container 9c4ff7f6c861f7adc58b17f74b449e8bcc895a3af6bd21728200c50210645a10: Status 404 returned error can't find the container with id 9c4ff7f6c861f7adc58b17f74b449e8bcc895a3af6bd21728200c50210645a10
May 28 09:31:50.888530 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.888510    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:31:50.926406 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.926386    2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 09:31:50.933560 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933541    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-tmp\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.933651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.933651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-ovn\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.933651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933627    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-modprobe-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.933651 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933649    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysconfig\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933694    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-k8s-cni-cncf-io\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933752    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysconfig\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933770    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-multus\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933791    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-k8s-cni-cncf-io\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-netd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.933850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-config\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933856    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-multus\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933871    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cni-binary-copy\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933896    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-modprobe-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-log-socket\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933911    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933933    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-kubernetes\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933971    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-kubernetes\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.933999    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-tuned\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934068    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-os-release\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934130    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934159    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-netns\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934185    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-daemon-config\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934187 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934192    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-os-release\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30dc46e4-a552-4aa6-81fc-9fdae20ea956-iptables-alerter-script\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934286    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934310    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-run\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934339    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal" event={"ID":"87c8455d85783eddec7a1fefb29cbe58","Type":"ContainerStarted","Data":"9c4ff7f6c861f7adc58b17f74b449e8bcc895a3af6bd21728200c50210645a10"}
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-bin\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934410    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-tmp-dir\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934437    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934412    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-netns\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934447    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cni-binary-copy\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934472    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-var-lib-kubelet\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934489    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-run\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934500    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-host\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934525    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89l79\" (UniqueName: \"kubernetes.io/projected/3b37a980-d2da-4e78-b685-a03abcc21f52-kube-api-access-89l79\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934550    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-multus-certs\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.934727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934560    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-host\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-systemd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmr86\" (UniqueName: \"kubernetes.io/projected/b9df3dd9-6179-44cc-bed7-7012e7ed0390-kube-api-access-mmr86\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934629    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-konnectivity-ca\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934652    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cnibin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934679    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-hostroot\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-tmp-dir\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dghr\" (UniqueName: \"kubernetes.io/projected/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-kube-api-access-5dghr\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-slash\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-var-lib-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-script-lib\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-d\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934801    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934813    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934835    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-var-lib-kubelet\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934827    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-socket-dir-parent\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg7sm\" (UniqueName: \"kubernetes.io/projected/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kube-api-access-qg7sm\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.935537 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934902    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-lib-modules\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934927    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-os-release\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934947    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-cnibin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec1906-9449-4bb3-ac02-717d625bde6f-serviceca\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.934899    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-daemon-config\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-etc-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935079    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-socket-dir-parent\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935088    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vzqb\" (UniqueName: \"kubernetes.io/projected/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-kube-api-access-2vzqb\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935131    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-systemd\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935154    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-os-release\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935161    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-bin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935131    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-hostroot\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935202    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-etc-kubernetes\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-lib-modules\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935242    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-etc-kubernetes\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-systemd\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935210    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-cni-bin\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.936327 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-run-multus-certs\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935323    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/7369f3ea-d49b-49e7-8d44-7088f4de9c42-kube-api-access-6skwd\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935388    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-konnectivity-ca\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.935433    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935462    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6xgd\" (UniqueName: \"kubernetes.io/projected/30dc46e4-a552-4aa6-81fc-9fdae20ea956-kube-api-access-z6xgd\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.935510    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:51.435489232 +0000 UTC m=+2.109105656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935534    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-hosts-file\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935564    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-conf-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935596    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-hosts-file\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935608    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-conf-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec1906-9449-4bb3-ac02-717d625bde6f-host\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-kubelet\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovn-node-metrics-cert\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935707    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.937139 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935732    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-sys\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935757    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-sys\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935780    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-kubelet\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-device-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935822    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-multus-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-systemd-units\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-netns\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30dc46e4-a552-4aa6-81fc-9fdae20ea956-host-slash\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935888    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-host-var-lib-kubelet\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-node-log\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935931    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935945    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal" event={"ID":"086c523654d72a132fa6c94341510b4d","Type":"ContainerStarted","Data":"23234273dfe51e09aea47907457d3e16fcaea5c49cea2d6c3f4d3992aecb6d8d"}
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935956    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-system-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.935980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-env-overrides\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936036    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936075    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-cnibin\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.937646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-system-cni-dir\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936101    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wzh6\" (UniqueName: \"kubernetes.io/projected/24e3aee5-12fc-402d-a7df-1392399d6c05-kube-api-access-8wzh6\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936126    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-conf\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936148    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-system-cni-dir\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936172    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24e3aee5-12fc-402d-a7df-1392399d6c05-cnibin\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/5dec1906-9449-4bb3-ac02-717d625bde6f-kube-api-access-5lzdg\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936211    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936224    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-agent-certs\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936279    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-sysctl-conf\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.936347    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24e3aee5-12fc-402d-a7df-1392399d6c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.937162    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-etc-tuned\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.938118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.937204    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b37a980-d2da-4e78-b685-a03abcc21f52-tmp\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.938436 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.938188    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47d46b4e-aa26-4bb1-a2a8-4b44026f242a-agent-certs\") pod \"konnectivity-agent-zj55m\" (UID: \"47d46b4e-aa26-4bb1-a2a8-4b44026f242a\") " pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:50.942159 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.942143    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:50.942211 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.942162    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:50.942211 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.942173    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:50.942278 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:50.942224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:51.442212256 +0000 UTC m=+2.115828675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:50.944059 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.944010    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wzh6\" (UniqueName: \"kubernetes.io/projected/24e3aee5-12fc-402d-a7df-1392399d6c05-kube-api-access-8wzh6\") pod \"multus-additional-cni-plugins-9wdbb\" (UID: \"24e3aee5-12fc-402d-a7df-1392399d6c05\") " pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:50.944206 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.944190    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89l79\" (UniqueName: \"kubernetes.io/projected/3b37a980-d2da-4e78-b685-a03abcc21f52-kube-api-access-89l79\") pod \"tuned-qfpnf\" (UID: \"3b37a980-d2da-4e78-b685-a03abcc21f52\") " pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:50.948266 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.948243    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vzqb\" (UniqueName: \"kubernetes.io/projected/957525a4-ea1c-44d7-b306-d3fcc0ae8dbd-kube-api-access-2vzqb\") pod \"node-resolver-9gts4\" (UID: \"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd\") " pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:50.948464 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.948444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dghr\" (UniqueName: \"kubernetes.io/projected/f1e9a5df-dc69-4768-a272-119dbdc3cfa6-kube-api-access-5dghr\") pod \"multus-vdhs5\" (UID: \"f1e9a5df-dc69-4768-a272-119dbdc3cfa6\") " pod="openshift-multus/multus-vdhs5"
May 28 09:31:50.949323 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:50.949307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/7369f3ea-d49b-49e7-8d44-7088f4de9c42-kube-api-access-6skwd\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:51.036736 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036713    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-systemd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.036847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036742    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmr86\" (UniqueName: \"kubernetes.io/projected/b9df3dd9-6179-44cc-bed7-7012e7ed0390-kube-api-access-mmr86\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.036847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036763    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-slash\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.036847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036778    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-var-lib-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.036847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036814    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-systemd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.036847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036832    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-script-lib\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036854    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-slash\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036861    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qg7sm\" (UniqueName: \"kubernetes.io/projected/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kube-api-access-qg7sm\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-var-lib-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036894    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec1906-9449-4bb3-ac02-717d625bde6f-serviceca\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036926    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-etc-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036955    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036970    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6xgd\" (UniqueName: \"kubernetes.io/projected/30dc46e4-a552-4aa6-81fc-9fdae20ea956-kube-api-access-z6xgd\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.036994    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-etc-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037110    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec1906-9449-4bb3-ac02-717d625bde6f-host\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.037136 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037141    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-kubelet\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037171    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovn-node-metrics-cert\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037180    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec1906-9449-4bb3-ac02-717d625bde6f-host\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037186    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-kubelet\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037200    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-device-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037223    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-systemd-units\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037241    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-device-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037250    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-netns\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037275    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30dc46e4-a552-4aa6-81fc-9fdae20ea956-host-slash\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-systemd-units\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-netns\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037325    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30dc46e4-a552-4aa6-81fc-9fdae20ea956-host-slash\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037300    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-node-log\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037355    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-node-log\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037362    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-env-overrides\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037379    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec1906-9449-4bb3-ac02-717d625bde6f-serviceca\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037393    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.037673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037466    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/5dec1906-9449-4bb3-ac02-717d625bde6f-kube-api-access-5lzdg\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037493    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037508    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-ovn\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037541    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037548    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-ovn\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037567    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-netd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037570    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037577    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-script-lib\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037596    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-config\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037610    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037621    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-netd\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037642    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-log-socket\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037660    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-log-socket\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037670    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037724    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30dc46e4-a552-4aa6-81fc-9fdae20ea956-iptables-alerter-script\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.038234 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037730    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-env-overrides\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037751    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037777    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037805    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-bin\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037808    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-run-openvswitch\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037830    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037858    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9df3dd9-6179-44cc-bed7-7012e7ed0390-host-cni-bin\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.037928    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovnkube-config\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.038711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.038105    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30dc46e4-a552-4aa6-81fc-9fdae20ea956-iptables-alerter-script\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.039524 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.039506    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9df3dd9-6179-44cc-bed7-7012e7ed0390-ovn-node-metrics-cert\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.045633 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.045611    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/5dec1906-9449-4bb3-ac02-717d625bde6f-kube-api-access-5lzdg\") pod \"node-ca-mmtfl\" (UID: \"5dec1906-9449-4bb3-ac02-717d625bde6f\") " pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.045935 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.045919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg7sm\" (UniqueName: \"kubernetes.io/projected/8614746a-40d7-4fad-af8e-75e7dcb8a6c9-kube-api-access-qg7sm\") pod \"aws-ebs-csi-driver-node-h892g\" (UID: \"8614746a-40d7-4fad-af8e-75e7dcb8a6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.045974 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.045928    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6xgd\" (UniqueName: \"kubernetes.io/projected/30dc46e4-a552-4aa6-81fc-9fdae20ea956-kube-api-access-z6xgd\") pod \"iptables-alerter-7rsh8\" (UID: \"30dc46e4-a552-4aa6-81fc-9fdae20ea956\") " pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.046008 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.046001    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmr86\" (UniqueName: \"kubernetes.io/projected/b9df3dd9-6179-44cc-bed7-7012e7ed0390-kube-api-access-mmr86\") pod \"ovnkube-node-hlrhk\" (UID: \"b9df3dd9-6179-44cc-bed7-7012e7ed0390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.149766 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.149686    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qfpnf"
May 28 09:31:51.156275 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.156246    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b37a980_d2da_4e78_b685_a03abcc21f52.slice/crio-e40b50de6511898bf95d184d24b4b715cf310c237380292e00992b6ef1acc347 WatchSource:0}: Error finding container e40b50de6511898bf95d184d24b4b715cf310c237380292e00992b6ef1acc347: Status 404 returned error can't find the container with id e40b50de6511898bf95d184d24b4b715cf310c237380292e00992b6ef1acc347
May 28 09:31:51.162870 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.162852    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9gts4"
May 28 09:31:51.168258 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.168238    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957525a4_ea1c_44d7_b306_d3fcc0ae8dbd.slice/crio-ffe40a38a89c73edd78eae0b0809c8f8e966e05d0675b8e8188fef43a0a7c27e WatchSource:0}: Error finding container ffe40a38a89c73edd78eae0b0809c8f8e966e05d0675b8e8188fef43a0a7c27e: Status 404 returned error can't find the container with id ffe40a38a89c73edd78eae0b0809c8f8e966e05d0675b8e8188fef43a0a7c27e
May 28 09:31:51.171124 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.171102    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9wdbb"
May 28 09:31:51.176776 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.176756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e3aee5_12fc_402d_a7df_1392399d6c05.slice/crio-2e5661235631054fdd7de2323893754f4461096be8adbc9b9720bc497324d2e3 WatchSource:0}: Error finding container 2e5661235631054fdd7de2323893754f4461096be8adbc9b9720bc497324d2e3: Status 404 returned error can't find the container with id 2e5661235631054fdd7de2323893754f4461096be8adbc9b9720bc497324d2e3
May 28 09:31:51.191218 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.191200    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdhs5"
May 28 09:31:51.196599 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.196573    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e9a5df_dc69_4768_a272_119dbdc3cfa6.slice/crio-150d6a10c14689e73cdb51735e1de204058f7bdc4898a6142967529f4c5128fe WatchSource:0}: Error finding container 150d6a10c14689e73cdb51735e1de204058f7bdc4898a6142967529f4c5128fe: Status 404 returned error can't find the container with id 150d6a10c14689e73cdb51735e1de204058f7bdc4898a6142967529f4c5128fe
May 28 09:31:51.197134 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.197116    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:31:51.202638 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.202618    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g"
May 28 09:31:51.207981 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.207960    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mmtfl"
May 28 09:31:51.208615 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.208581    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8614746a_40d7_4fad_af8e_75e7dcb8a6c9.slice/crio-614c0c587d6fecc441426b0752f1c0a96dd8dc31b3b91df98ae82282038b4e21 WatchSource:0}: Error finding container 614c0c587d6fecc441426b0752f1c0a96dd8dc31b3b91df98ae82282038b4e21: Status 404 returned error can't find the container with id 614c0c587d6fecc441426b0752f1c0a96dd8dc31b3b91df98ae82282038b4e21
May 28 09:31:51.214132 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.214115    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rsh8"
May 28 09:31:51.214431 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.214409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dec1906_9449_4bb3_ac02_717d625bde6f.slice/crio-57434ba4c6564e182a9189096de744ca54299594b34552a71daf8db16a0996ae WatchSource:0}: Error finding container 57434ba4c6564e182a9189096de744ca54299594b34552a71daf8db16a0996ae: Status 404 returned error can't find the container with id 57434ba4c6564e182a9189096de744ca54299594b34552a71daf8db16a0996ae
May 28 09:31:51.218424 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.218351    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:31:51.223278 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:31:51.223258    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30dc46e4_a552_4aa6_81fc_9fdae20ea956.slice/crio-4932464a19be5cb6f5902ae2ae2bc741da9039000f63021695a2023698cf6bdc WatchSource:0}: Error finding container 4932464a19be5cb6f5902ae2ae2bc741da9039000f63021695a2023698cf6bdc: Status 404 returned error can't find the container with id 4932464a19be5cb6f5902ae2ae2bc741da9039000f63021695a2023698cf6bdc
May 28 09:31:51.439765 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.439671    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:51.439937 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.439844    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:51.440058 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.440020    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:52.43999685 +0000 UTC m=+3.113613270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:51.541097 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.540431    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:51.541097 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.540646    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:51.541097 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.540664    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:51.541097 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.540677    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:51.541097 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:51.540736    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:52.540716644 +0000 UTC m=+3.214333060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:51.598200 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.597910    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:51.876791 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.876745    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:50 +0000 UTC" deadline="2028-01-21 11:55:54.845162018 +0000 UTC"
May 28 09:31:51.876791 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.876788    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14474h24m2.968377517s"
May 28 09:31:51.889966 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.889931    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:51.949771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.949647    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g" event={"ID":"8614746a-40d7-4fad-af8e-75e7dcb8a6c9","Type":"ContainerStarted","Data":"614c0c587d6fecc441426b0752f1c0a96dd8dc31b3b91df98ae82282038b4e21"}
May 28 09:31:51.957417 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.957385    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerStarted","Data":"2e5661235631054fdd7de2323893754f4461096be8adbc9b9720bc497324d2e3"}
May 28 09:31:51.960823 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.960638    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9gts4" event={"ID":"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd","Type":"ContainerStarted","Data":"ffe40a38a89c73edd78eae0b0809c8f8e966e05d0675b8e8188fef43a0a7c27e"}
May 28 09:31:51.969114 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.968952    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zj55m" event={"ID":"47d46b4e-aa26-4bb1-a2a8-4b44026f242a","Type":"ContainerStarted","Data":"df5af0228e74446a26f60ba51ab7de01baee7221fffb7b0055b05c7207136149"}
May 28 09:31:51.984935 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.984900    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdhs5" event={"ID":"f1e9a5df-dc69-4768-a272-119dbdc3cfa6","Type":"ContainerStarted","Data":"150d6a10c14689e73cdb51735e1de204058f7bdc4898a6142967529f4c5128fe"}
May 28 09:31:51.995036 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:51.995000    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qfpnf" event={"ID":"3b37a980-d2da-4e78-b685-a03abcc21f52","Type":"ContainerStarted","Data":"e40b50de6511898bf95d184d24b4b715cf310c237380292e00992b6ef1acc347"}
May 28 09:31:52.011614 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.011557    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"b29b5ba1b03bd8f745b933fce5d5e7c6fa014ecfa577ac225f27c3b1ec3e9158"}
May 28 09:31:52.018532 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.018476    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rsh8" event={"ID":"30dc46e4-a552-4aa6-81fc-9fdae20ea956","Type":"ContainerStarted","Data":"4932464a19be5cb6f5902ae2ae2bc741da9039000f63021695a2023698cf6bdc"}
May 28 09:31:52.043143 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.043103    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mmtfl" event={"ID":"5dec1906-9449-4bb3-ac02-717d625bde6f","Type":"ContainerStarted","Data":"57434ba4c6564e182a9189096de744ca54299594b34552a71daf8db16a0996ae"}
May 28 09:31:52.447737 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.447655    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:52.447901 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.447804    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:52.447901 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.447865    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:54.447844073 +0000 UTC m=+5.121460475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:52.548693 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.548649    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:52.548903 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.548880    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:52.548975 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.548908    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:52.548975 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.548921    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:52.549096 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.548992    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:54.548962701 +0000 UTC m=+5.222579113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:52.877352 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.877249    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:50 +0000 UTC" deadline="2028-03-08 14:00:36.01186625 +0000 UTC"
May 28 09:31:52.877352 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.877302    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15604h28m43.134568506s"
May 28 09:31:52.931157 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.931122    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:52.931323 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.931249    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:31:52.931404 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:52.931370    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:52.931633 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:52.931458    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:31:54.465851 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:54.465288    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:54.465851 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.465465    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:54.465851 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.465520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:58.46550231 +0000 UTC m=+9.139118725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:54.566507 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:54.566476    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:54.566701 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.566603    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:54.566701 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.566620    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:54.566701 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.566628    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:54.566701 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.566695    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:58.566678924 +0000 UTC m=+9.240295340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:54.931666 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:54.930929    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:54.931666 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.931080    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:31:54.931666 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:54.931475    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:54.931666 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:54.931563    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:31:56.931394 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:56.930982    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:56.931394 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:56.930982    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:56.931394 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:56.931142    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:31:56.931394 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:56.931234    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:31:58.500568 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:58.500529    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:58.500973 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.500700    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:58.500973 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.500775    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.500757088 +0000 UTC m=+17.174373495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:58.601364 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:58.601322    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:58.601556 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.601545    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:58.601607 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.601564    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:58.601607 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.601577    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:58.601704 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.601637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.60161935 +0000 UTC m=+17.275235769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:58.931095 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:58.930886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:31:58.931095 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.931012    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:31:58.931286 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:31:58.931093    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:31:58.931286 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:31:58.931189    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:00.931239 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:00.931204    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:00.931677 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:00.931336    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:00.931677 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:00.931208    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:00.931793 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:00.931704    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:02.931236 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:02.930969    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:02.931666 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:02.930969    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:02.931666 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:02.931346    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:02.931666 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:02.931441    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:04.930824 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:04.930774    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:04.931302 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:04.930786    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:04.931302 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:04.930928    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:04.931302 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:04.930991    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:06.563460 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:06.563420    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:06.563892 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.563561    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:06.563892 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.563637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:22.56361613 +0000 UTC m=+33.237232542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:06.664227 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:06.664183    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:06.664411 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.664366    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:32:06.664411 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.664387    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:32:06.664411 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.664401    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:06.664565 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.664466    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:22.664448798 +0000 UTC m=+33.338065208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:06.930703 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:06.930610    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:06.930863 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.930727    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:06.930863 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:06.930781    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:06.930967 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:06.930886    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:08.930209 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:08.930170    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:08.930632 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:08.930170    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:08.930632 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:08.930283    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:08.930632 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:08.930408    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:10.089529 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.089242    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"c5ee465b7881aa93146515b9d44d02c8fdb31ef8653f57081ff65278b8945713"}
May 28 09:32:10.089529 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.089502    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"ce02514f40be309bda7ca9877ca12d472f25cd2c4e26ced73538f80ef714a378"}
May 28 09:32:10.089529 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.089521    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"592e690b6f23f835560f253c7484dfca14c08e0c7475f989f9d4e380327d074e"}
May 28 09:32:10.091665 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.091581    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal" event={"ID":"086c523654d72a132fa6c94341510b4d","Type":"ContainerStarted","Data":"3d6d3b44456a554e7a4147ed056e8d63978d800f1906c760d49cc10c0596bccb"}
May 28 09:32:10.098664 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.098641    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdhs5" event={"ID":"f1e9a5df-dc69-4768-a272-119dbdc3cfa6","Type":"ContainerStarted","Data":"27ce93d4729de513424c8add816908e641ac1aae50403aa8d3f7869fc4ce68cf"}
May 28 09:32:10.100497 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.100476    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qfpnf" event={"ID":"3b37a980-d2da-4e78-b685-a03abcc21f52","Type":"ContainerStarted","Data":"376d4a446b076c1b10705d3cccf1a782e467e22261e4a95fd66be43031bda2b5"}
May 28 09:32:10.134317 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.133825    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-248.ec2.internal" podStartSLOduration=20.133804335 podStartE2EDuration="20.133804335s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:32:10.109607296 +0000 UTC m=+20.783223715" watchObservedRunningTime="2026-05-28 09:32:10.133804335 +0000 UTC m=+20.807420752"
May 28 09:32:10.134317 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.133925    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qfpnf" podStartSLOduration=1.5456179429999999 podStartE2EDuration="20.13391754s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.157765595 +0000 UTC m=+1.831381992" lastFinishedPulling="2026-05-28 09:32:09.746065189 +0000 UTC m=+20.419681589" observedRunningTime="2026-05-28 09:32:10.132727504 +0000 UTC m=+20.806343922" watchObservedRunningTime="2026-05-28 09:32:10.13391754 +0000 UTC m=+20.807533959"
May 28 09:32:10.139290 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.139263    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hw9nz"]
May 28 09:32:10.144745 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.144723    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.144842 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.144798    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:10.156564 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.156505    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vdhs5" podStartSLOduration=1.506388955 podStartE2EDuration="20.156486659s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.198200579 +0000 UTC m=+1.871816979" lastFinishedPulling="2026-05-28 09:32:09.848298282 +0000 UTC m=+20.521914683" observedRunningTime="2026-05-28 09:32:10.155933891 +0000 UTC m=+20.829550311" watchObservedRunningTime="2026-05-28 09:32:10.156486659 +0000 UTC m=+20.830103077"
May 28 09:32:10.192887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.191503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-dbus\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.192887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.191591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.192887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.191626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-kubelet-config\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.292847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.292810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-kubelet-config\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.292987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.292869    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-dbus\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.292987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.292906    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.292987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.292939    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-kubelet-config\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.293142 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.292988    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:32:10.293142 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.293019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ececc8-e8e0-42b9-9042-adebde152eee-dbus\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.293142 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.293037    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret podName:27ececc8-e8e0-42b9-9042-adebde152eee nodeName:}" failed. No retries permitted until 2026-05-28 09:32:10.793024895 +0000 UTC m=+21.466641291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret") pod "global-pull-secret-syncer-hw9nz" (UID: "27ececc8-e8e0-42b9-9042-adebde152eee") : object "kube-system"/"original-pull-secret" not registered
May 28 09:32:10.798531 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.798339    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:10.798683 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.798495    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:32:10.798683 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.798654    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret podName:27ececc8-e8e0-42b9-9042-adebde152eee nodeName:}" failed. No retries permitted until 2026-05-28 09:32:11.79863782 +0000 UTC m=+22.472254220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret") pod "global-pull-secret-syncer-hw9nz" (UID: "27ececc8-e8e0-42b9-9042-adebde152eee") : object "kube-system"/"original-pull-secret" not registered
May 28 09:32:10.930431 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.930396    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:10.930606 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:10.930402    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:10.930606 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.930510    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:10.930606 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:10.930595    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:11.104631 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.104599    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"a1c5c1cd95c2d49dae2957e98babb5dafd55862c54ae6330e4b091b4d37cf1a8"}
May 28 09:32:11.105219 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.104639    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"43c8d1e2bc701dc80f1b41bdb83f6edca0dfc45c96163b184894a0db29480097"}
May 28 09:32:11.105219 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.104653    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"b6bbd394a3a01c2813e58a6de58813074ad83d73eb2e3e19604eb400923c81f4"}
May 28 09:32:11.106305 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.106275    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mmtfl" event={"ID":"5dec1906-9449-4bb3-ac02-717d625bde6f","Type":"ContainerStarted","Data":"e222fda5d7351336b625d1cc3a9fbfbe699215a113ad8282508720c768889a07"}
May 28 09:32:11.107613 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.107590    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g" event={"ID":"8614746a-40d7-4fad-af8e-75e7dcb8a6c9","Type":"ContainerStarted","Data":"976440d06370c656b00e62946a5c5746ee672e1af582c58dd5ed98ceb0c6977a"}
May 28 09:32:11.108706 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.108684    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="5093f31b8d9502ebc55172484f4c21913bec91fd34d8180092baf205d784c086" exitCode=0
May 28 09:32:11.108785 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.108751    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"5093f31b8d9502ebc55172484f4c21913bec91fd34d8180092baf205d784c086"}
May 28 09:32:11.109957 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.109926    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9gts4" event={"ID":"957525a4-ea1c-44d7-b306-d3fcc0ae8dbd","Type":"ContainerStarted","Data":"155633bbc6cf8a41b471f6effa35473011fba24d01eedbb3ac92840741af3540"}
May 28 09:32:11.111736 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.111711    2559 generic.go:358] "Generic (PLEG): container finished" podID="87c8455d85783eddec7a1fefb29cbe58" containerID="6fb9291400f70a1c26c324339cc66aa5defa50733a1a23810f1ca136d3d5c342" exitCode=0
May 28 09:32:11.111824 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.111794    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal" event={"ID":"87c8455d85783eddec7a1fefb29cbe58","Type":"ContainerDied","Data":"6fb9291400f70a1c26c324339cc66aa5defa50733a1a23810f1ca136d3d5c342"}
May 28 09:32:11.113089 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.113063    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zj55m" event={"ID":"47d46b4e-aa26-4bb1-a2a8-4b44026f242a","Type":"ContainerStarted","Data":"3f3d0d1218c46f53e62e729d7be7ff1c59a54773c2f84bd51917322f4e9b3f07"}
May 28 09:32:11.125316 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.125279    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mmtfl" podStartSLOduration=2.599167747 podStartE2EDuration="21.125267503s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.217817026 +0000 UTC m=+1.891433424" lastFinishedPulling="2026-05-28 09:32:09.743916772 +0000 UTC m=+20.417533180" observedRunningTime="2026-05-28 09:32:11.124866227 +0000 UTC m=+21.798482638" watchObservedRunningTime="2026-05-28 09:32:11.125267503 +0000 UTC m=+21.798883912"
May 28 09:32:11.143264 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.143220    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zj55m" podStartSLOduration=2.637264382 podStartE2EDuration="21.143207929s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.205574935 +0000 UTC m=+1.879191346" lastFinishedPulling="2026-05-28 09:32:09.711518481 +0000 UTC m=+20.385134893" observedRunningTime="2026-05-28 09:32:11.142812813 +0000 UTC m=+21.816429221" watchObservedRunningTime="2026-05-28 09:32:11.143207929 +0000 UTC m=+21.816824341"
May 28 09:32:11.165202 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.165174    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 09:32:11.179017 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.178961    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9gts4" podStartSLOduration=3.020454384 podStartE2EDuration="21.17894407s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.169699196 +0000 UTC m=+1.843315593" lastFinishedPulling="2026-05-28 09:32:09.328188871 +0000 UTC m=+20.001805279" observedRunningTime="2026-05-28 09:32:11.178664728 +0000 UTC m=+21.852281147" watchObservedRunningTime="2026-05-28 09:32:11.17894407 +0000 UTC m=+21.852560489"
May 28 09:32:11.807500 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.807455    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:11.807737 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:11.807670    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:32:11.807807 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:11.807743    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret podName:27ececc8-e8e0-42b9-9042-adebde152eee nodeName:}" failed. No retries permitted until 2026-05-28 09:32:13.807724229 +0000 UTC m=+24.481340631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret") pod "global-pull-secret-syncer-hw9nz" (UID: "27ececc8-e8e0-42b9-9042-adebde152eee") : object "kube-system"/"original-pull-secret" not registered
May 28 09:32:11.902888 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.902752    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T09:32:11.165196161Z","UUID":"c1da5e6a-928c-42c6-909a-6040314f0af9","Handler":null,"Name":"","Endpoint":""}
May 28 09:32:11.905525 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.905500    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 09:32:11.905668 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.905539    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 09:32:11.930586 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:11.930552    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:11.930780 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:11.930682    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:12.116426 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.116333    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rsh8" event={"ID":"30dc46e4-a552-4aa6-81fc-9fdae20ea956","Type":"ContainerStarted","Data":"5601839a24be45968cd2340972f0b6e09241f0380d25e8068ba6a3dbf2c5d375"}
May 28 09:32:12.118084 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.118040    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g" event={"ID":"8614746a-40d7-4fad-af8e-75e7dcb8a6c9","Type":"ContainerStarted","Data":"29528dee6ea3f15d6e9c8a2d171c712bac3be6768b28edf58b2dc22eb8495af3"}
May 28 09:32:12.119787 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.119719    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal" event={"ID":"87c8455d85783eddec7a1fefb29cbe58","Type":"ContainerStarted","Data":"359a81a14af68ddf9f0aea5d768a40b1e5554291bb4f38960df9e10f425f0cdb"}
May 28 09:32:12.133386 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.133337    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rsh8" podStartSLOduration=3.844744227 podStartE2EDuration="22.133321888s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.224816173 +0000 UTC m=+1.898432574" lastFinishedPulling="2026-05-28 09:32:09.513393828 +0000 UTC m=+20.187010235" observedRunningTime="2026-05-28 09:32:12.132393677 +0000 UTC m=+22.806010107" watchObservedRunningTime="2026-05-28 09:32:12.133321888 +0000 UTC m=+22.806938305"
May 28 09:32:12.150412 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.150366    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-248.ec2.internal" podStartSLOduration=22.15034995 podStartE2EDuration="22.15034995s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:32:12.150134451 +0000 UTC m=+22.823750870" watchObservedRunningTime="2026-05-28 09:32:12.15034995 +0000 UTC m=+22.823966368"
May 28 09:32:12.931249 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.931166    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:12.931415 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:12.931166    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:12.931415 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:12.931300    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:12.931415 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:12.931387    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:13.124736 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:13.124694    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"72fd4cc7a22b3a644de5acb532dedcbfc55645daac8280f71beb81e31686acb3"}
May 28 09:32:13.126765 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:13.126734    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g" event={"ID":"8614746a-40d7-4fad-af8e-75e7dcb8a6c9","Type":"ContainerStarted","Data":"faf9c0bff995e0c3ee86cf2e99128008a003f2cfcf2c09042589414f4bd3b62a"}
May 28 09:32:13.149752 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:13.149700    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h892g" podStartSLOduration=2.140408191 podStartE2EDuration="23.149685367s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.211234971 +0000 UTC m=+1.884851372" lastFinishedPulling="2026-05-28 09:32:12.220512148 +0000 UTC m=+22.894128548" observedRunningTime="2026-05-28 09:32:13.149457185 +0000 UTC m=+23.823073635" watchObservedRunningTime="2026-05-28 09:32:13.149685367 +0000 UTC m=+23.823301784"
May 28 09:32:13.825856 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:13.825811    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:13.826034 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:13.825967    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:32:13.826034 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:13.826032    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret podName:27ececc8-e8e0-42b9-9042-adebde152eee nodeName:}" failed. No retries permitted until 2026-05-28 09:32:17.826017092 +0000 UTC m=+28.499633503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret") pod "global-pull-secret-syncer-hw9nz" (UID: "27ececc8-e8e0-42b9-9042-adebde152eee") : object "kube-system"/"original-pull-secret" not registered
May 28 09:32:13.930240 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:13.930200    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:13.930421 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:13.930332    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:14.930775 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:14.930740    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:14.931173 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:14.930740    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:14.931173 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:14.930861    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:14.931173 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:14.930920    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:15.134016 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.133849    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" event={"ID":"b9df3dd9-6179-44cc-bed7-7012e7ed0390","Type":"ContainerStarted","Data":"5c51d367bb2d6fd792c08cef1e314ded5f148e460f9a907a1a7220d8d86955a1"}
May 28 09:32:15.134266 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.134243    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:15.134266 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.134277    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:15.148865 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.148842    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:15.162697 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.162037    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk" podStartSLOduration=6.642892717 podStartE2EDuration="25.16201945s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.227147447 +0000 UTC m=+1.900763844" lastFinishedPulling="2026-05-28 09:32:09.746274173 +0000 UTC m=+20.419890577" observedRunningTime="2026-05-28 09:32:15.161668132 +0000 UTC m=+25.835284552" watchObservedRunningTime="2026-05-28 09:32:15.16201945 +0000 UTC m=+25.835635868"
May 28 09:32:15.771538 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.771506    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:32:15.772113 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.772089    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:32:15.930769 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:15.930739    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:15.930956 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:15.930833    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:16.136943 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.136860    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="e4d42f36c2f8c12883814c38af141639431d63afa346132c860833d8e5e5b7a0" exitCode=0
May 28 09:32:16.137095 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.136949    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"e4d42f36c2f8c12883814c38af141639431d63afa346132c860833d8e5e5b7a0"}
May 28 09:32:16.137303 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.137276    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:32:16.137447 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.137317    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:16.138098 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.137741    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zj55m"
May 28 09:32:16.153424 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.153259    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:16.931063 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.931017    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:16.931063 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:16.931063    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:16.931555 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:16.931137    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:16.931555 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:16.931274    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:17.207074 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.207032    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4hdh"]
May 28 09:32:17.207168 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.207156    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:17.207287 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:17.207251    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:17.210083 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.210040    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw9nz"]
May 28 09:32:17.210175 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.210150    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:17.210266 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:17.210250    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:17.211025 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.210998    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6bd26"]
May 28 09:32:17.211127 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.211117    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:17.211273 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:17.211231    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:17.860296 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:17.860246    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:17.860485 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:17.860398    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:32:17.860485 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:17.860473    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret podName:27ececc8-e8e0-42b9-9042-adebde152eee nodeName:}" failed. No retries permitted until 2026-05-28 09:32:25.860454529 +0000 UTC m=+36.534070925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret") pod "global-pull-secret-syncer-hw9nz" (UID: "27ececc8-e8e0-42b9-9042-adebde152eee") : object "kube-system"/"original-pull-secret" not registered
May 28 09:32:18.142506 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:18.142405    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="b0ccc21c5709576a4b4e1f9bd2d57d57067c2d46d049734fdf913742445c4a73" exitCode=0
May 28 09:32:18.142506 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:18.142439    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"b0ccc21c5709576a4b4e1f9bd2d57d57067c2d46d049734fdf913742445c4a73"}
May 28 09:32:18.930465 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:18.930381    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:18.930596 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:18.930484    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:18.930596 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:18.930506    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:18.930674 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:18.930484    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:18.930674 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:18.930591    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:18.930744 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:18.930693    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:19.147208 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:19.147178    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="17a203c8303119035219e6898685ec3c25af88e830bac3c6a110418bf7ddb324" exitCode=0
May 28 09:32:19.147558 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:19.147228    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"17a203c8303119035219e6898685ec3c25af88e830bac3c6a110418bf7ddb324"}
May 28 09:32:20.930794 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:20.930760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:20.931266 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:20.930760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:20.931266 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:20.930899    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:32:20.931266 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:20.930980    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4hdh" podUID="98ef3228-ce41-4908-b1c6-8916c3658e95"
May 28 09:32:20.931266 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:20.930760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:20.931266 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:20.931099    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hw9nz" podUID="27ececc8-e8e0-42b9-9042-adebde152eee"
May 28 09:32:22.592713 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.592434    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:22.592713 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.592579    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:22.593259 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.592746    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:54.592725004 +0000 UTC m=+65.266341428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:22.617513 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.617489    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-248.ec2.internal" event="NodeReady"
May 28 09:32:22.617685 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.617642    2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 09:32:22.652022 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.651983    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:32:22.673998 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.673959    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l578n"]
May 28 09:32:22.674195 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.674166    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.676408 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.676268    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 09:32:22.676408 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.676283    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rk8br\""
May 28 09:32:22.676408 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.676375    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 09:32:22.676639 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.676418    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 09:32:22.681040 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.681006    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 09:32:22.692280 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.692252    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j7nk2"]
May 28 09:32:22.692450 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.692428    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.693004 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.692983    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:22.693152 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.693141    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:32:22.693204 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.693160    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:32:22.693204 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.693174    2559 projected.go:194] Error preparing data for projected volume kube-api-access-b6ch9 for pod openshift-network-diagnostics/network-check-target-f4hdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:22.693307 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.693226    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9 podName:98ef3228-ce41-4908-b1c6-8916c3658e95 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:54.693208676 +0000 UTC m=+65.366825092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6ch9" (UniqueName: "kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9") pod "network-check-target-f4hdh" (UID: "98ef3228-ce41-4908-b1c6-8916c3658e95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:22.694695 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.694674    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 09:32:22.694695 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.694690    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 09:32:22.694847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.694729    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59hlf\""
May 28 09:32:22.713995 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.713963    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:32:22.713995 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.713996    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l578n"]
May 28 09:32:22.714167 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.714009    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j7nk2"]
May 28 09:32:22.714167 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.714115    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:22.716760 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.716384    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 09:32:22.716760 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.716454    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 09:32:22.717288 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.716513    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 09:32:22.717288 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.716611    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5x7r9\""
May 28 09:32:22.793568 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.793568 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.793786 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.793786 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c29454-1a98-4368-b38c-96901375e0eb-config-volume\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.793786 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.793786 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.793981 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.793981 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnjc\" (UniqueName: \"kubernetes.io/projected/83c29454-1a98-4368-b38c-96901375e0eb-kube-api-access-fmnjc\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.793981 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.793956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brn2p\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.794152 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.794021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.794152 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.794061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.794152 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.794089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c29454-1a98-4368-b38c-96901375e0eb-tmp-dir\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895208 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895106    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895208 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895157    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895208 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895184    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c29454-1a98-4368-b38c-96901375e0eb-tmp-dir\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895244    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895267    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895290    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895315    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c29454-1a98-4368-b38c-96901375e0eb-config-volume\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99m46\" (UniqueName: \"kubernetes.io/projected/bf749018-d6fd-4fa9-8599-3f47a1dc7620-kube-api-access-99m46\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895391    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.895396    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895413    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.895420    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895453    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895476 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.895486    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:23.395464787 +0000 UTC m=+34.069081224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:22.895987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895545    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnjc\" (UniqueName: \"kubernetes.io/projected/83c29454-1a98-4368-b38c-96901375e0eb-kube-api-access-fmnjc\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895551    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c29454-1a98-4368-b38c-96901375e0eb-tmp-dir\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.895987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.895581    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brn2p\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.895987 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.895685    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:22.895987 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.895735    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:23.395718912 +0000 UTC m=+34.069335311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:22.896246 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.896192    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.896346 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.896328    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.896410 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.896369    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.896410 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.896389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83c29454-1a98-4368-b38c-96901375e0eb-config-volume\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.900256 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.900090    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.900256 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.900089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.905493 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.905465    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.905923 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.905900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnjc\" (UniqueName: \"kubernetes.io/projected/83c29454-1a98-4368-b38c-96901375e0eb-kube-api-access-fmnjc\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:22.905923 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.905914    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brn2p\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:22.930713 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.930684    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:22.930881 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.930685    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:22.930881 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.930685    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:22.933873 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.933685    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxqxx\""
May 28 09:32:22.933873 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.933700    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:32:22.933873 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.933709    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:32:22.933873 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.933763    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 09:32:22.933873 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.933711    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:32:22.934215 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.934073    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59hvh\""
May 28 09:32:22.996564 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.996535    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:22.996564 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:22.996576    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99m46\" (UniqueName: \"kubernetes.io/projected/bf749018-d6fd-4fa9-8599-3f47a1dc7620-kube-api-access-99m46\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:22.996780 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.996692    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:22.996833 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:22.996781    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:23.496757071 +0000 UTC m=+34.170373473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:23.008104 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:23.008077    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99m46\" (UniqueName: \"kubernetes.io/projected/bf749018-d6fd-4fa9-8599-3f47a1dc7620-kube-api-access-99m46\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:23.399633 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:23.399592    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:23.399843 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:23.399738    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:23.399843 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.399766    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:23.399948 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.399845    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:24.399824298 +0000 UTC m=+35.073440695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:23.399948 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.399855    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:23.399948 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.399871    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:23.399948 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.399919    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:24.399904776 +0000 UTC m=+35.073521172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:23.500325 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:23.500292    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:23.500517 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.500439    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:23.500517 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:23.500508    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:24.500491027 +0000 UTC m=+35.174107430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:24.406973 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:24.406938    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:24.406996    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.407133    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.407225    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:26.407202625 +0000 UTC m=+37.080819048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.407132    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.407259    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:24.407654 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.407319    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:26.407301578 +0000 UTC m=+37.080918016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:24.507991 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:24.507959    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:24.508176 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.508130    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:24.508221 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:24.508195    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:26.508177555 +0000 UTC m=+37.181793951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:25.161712 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:25.161682    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerStarted","Data":"de3f18b25ac98a4470cdbf3b6fffe51bd1df1115d92cccffea0e91c94c217e0f"}
May 28 09:32:25.917494 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:25.917454    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:25.919969 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:25.919933    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ececc8-e8e0-42b9-9042-adebde152eee-original-pull-secret\") pod \"global-pull-secret-syncer-hw9nz\" (UID: \"27ececc8-e8e0-42b9-9042-adebde152eee\") " pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:25.956593 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:25.956557    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hw9nz"
May 28 09:32:26.088128 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.087913    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hw9nz"]
May 28 09:32:26.092172 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:32:26.092129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ececc8_e8e0_42b9_9042_adebde152eee.slice/crio-754487ad8a57e8770d158732fdb0783dd7faeba7547532a1a67ebb47d1e3d8e1 WatchSource:0}: Error finding container 754487ad8a57e8770d158732fdb0783dd7faeba7547532a1a67ebb47d1e3d8e1: Status 404 returned error can't find the container with id 754487ad8a57e8770d158732fdb0783dd7faeba7547532a1a67ebb47d1e3d8e1
May 28 09:32:26.164915 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.164876    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw9nz" event={"ID":"27ececc8-e8e0-42b9-9042-adebde152eee","Type":"ContainerStarted","Data":"754487ad8a57e8770d158732fdb0783dd7faeba7547532a1a67ebb47d1e3d8e1"}
May 28 09:32:26.167182 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.167155    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="de3f18b25ac98a4470cdbf3b6fffe51bd1df1115d92cccffea0e91c94c217e0f" exitCode=0
May 28 09:32:26.167308 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.167196    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"de3f18b25ac98a4470cdbf3b6fffe51bd1df1115d92cccffea0e91c94c217e0f"}
May 28 09:32:26.421920 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.421830    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:26.421920 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.421875    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:26.422125 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.421973    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:26.422125 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.421979    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:26.422125 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.421999    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:26.422125 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.422025    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:30.422012227 +0000 UTC m=+41.095628623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:26.422125 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.422061    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:30.422031966 +0000 UTC m=+41.095648363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:26.522346 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:26.522309    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:26.522512 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.522431    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:26.522512 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:26.522481    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:30.522467517 +0000 UTC m=+41.196083914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:27.171980 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:27.171948    2559 generic.go:358] "Generic (PLEG): container finished" podID="24e3aee5-12fc-402d-a7df-1392399d6c05" containerID="0ea464799d0eedb8017ae8529deea8f657663935de241289eaedcd9bff0d9eae" exitCode=0
May 28 09:32:27.172414 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:27.172030    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerDied","Data":"0ea464799d0eedb8017ae8529deea8f657663935de241289eaedcd9bff0d9eae"}
May 28 09:32:28.177883 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:28.177835    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" event={"ID":"24e3aee5-12fc-402d-a7df-1392399d6c05","Type":"ContainerStarted","Data":"0910e23218412fdbada13c6825e5b470de8836880beb393f5cc1b58733d4cb6a"}
May 28 09:32:28.201989 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:28.201945    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9wdbb" podStartSLOduration=4.46064363 podStartE2EDuration="38.201931221s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:31:51.178137885 +0000 UTC m=+1.851754285" lastFinishedPulling="2026-05-28 09:32:24.919425476 +0000 UTC m=+35.593041876" observedRunningTime="2026-05-28 09:32:28.200458381 +0000 UTC m=+38.874074799" watchObservedRunningTime="2026-05-28 09:32:28.201931221 +0000 UTC m=+38.875547635"
May 28 09:32:29.997701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:29.997663    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"]
May 28 09:32:30.018219 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.018185    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"]
May 28 09:32:30.018397 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.018349    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.020674 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.020625    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 09:32:30.020811 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.020625    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 09:32:30.020811 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.020727    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 09:32:30.020979 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.020960    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 09:32:30.150632 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.150586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2t9x\" (UniqueName: \"kubernetes.io/projected/b4d2fa52-8955-4d77-8b93-716092cf78e0-kube-api-access-g2t9x\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.150811 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.150764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d2fa52-8955-4d77-8b93-716092cf78e0-tmp\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.150858 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.150809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b4d2fa52-8955-4d77-8b93-716092cf78e0-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.251934 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.251848    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d2fa52-8955-4d77-8b93-716092cf78e0-tmp\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.251934 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.251900    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b4d2fa52-8955-4d77-8b93-716092cf78e0-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.251934 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.251932    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2t9x\" (UniqueName: \"kubernetes.io/projected/b4d2fa52-8955-4d77-8b93-716092cf78e0-kube-api-access-g2t9x\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.252256 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.252236    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d2fa52-8955-4d77-8b93-716092cf78e0-tmp\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.261351 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.261319    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2t9x\" (UniqueName: \"kubernetes.io/projected/b4d2fa52-8955-4d77-8b93-716092cf78e0-kube-api-access-g2t9x\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.266665 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.266639    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b4d2fa52-8955-4d77-8b93-716092cf78e0-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d7d95b9c-757n8\" (UID: \"b4d2fa52-8955-4d77-8b93-716092cf78e0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.329577 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.329543    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:30.453312 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.453271    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:30.453489 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.453406    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:30.453489 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.453436    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:30.453622 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.453512    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:30.453622 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.453524    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:30.453622 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.453514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:38.45349137 +0000 UTC m=+49.127107792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:30.453622 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.453589    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:38.453572362 +0000 UTC m=+49.127188766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:30.454573 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.454549    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"]
May 28 09:32:30.553743 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:32:30.553671    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d2fa52_8955_4d77_8b93_716092cf78e0.slice/crio-8bea3ffa11e602712103e012c9aa0134914438aff395362dd22e48014566e001 WatchSource:0}: Error finding container 8bea3ffa11e602712103e012c9aa0134914438aff395362dd22e48014566e001: Status 404 returned error can't find the container with id 8bea3ffa11e602712103e012c9aa0134914438aff395362dd22e48014566e001
May 28 09:32:30.553743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:30.553703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:30.553933 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.553826    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:30.553933 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:30.553898    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:38.553878922 +0000 UTC m=+49.227495336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:31.184075 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:31.184025    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hw9nz" event={"ID":"27ececc8-e8e0-42b9-9042-adebde152eee","Type":"ContainerStarted","Data":"d3ab367dd784b5ff11bb748877f274f883f4e04f8b0defbd417cc765f1d40d01"}
May 28 09:32:31.185085 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:31.185062    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" event={"ID":"b4d2fa52-8955-4d77-8b93-716092cf78e0","Type":"ContainerStarted","Data":"8bea3ffa11e602712103e012c9aa0134914438aff395362dd22e48014566e001"}
May 28 09:32:31.201414 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:31.201363    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hw9nz" podStartSLOduration=16.716472037 podStartE2EDuration="21.201349005s" podCreationTimestamp="2026-05-28 09:32:10 +0000 UTC" firstStartedPulling="2026-05-28 09:32:26.093901866 +0000 UTC m=+36.767518263" lastFinishedPulling="2026-05-28 09:32:30.578778835 +0000 UTC m=+41.252395231" observedRunningTime="2026-05-28 09:32:31.200219843 +0000 UTC m=+41.873836262" watchObservedRunningTime="2026-05-28 09:32:31.201349005 +0000 UTC m=+41.874965417"
May 28 09:32:35.193888 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:35.193851    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" event={"ID":"b4d2fa52-8955-4d77-8b93-716092cf78e0","Type":"ContainerStarted","Data":"1fe6b09e438ea21e8a46ef3a05103ebe4e7813c1b3be54b11db26ae8c0779bbf"}
May 28 09:32:35.194368 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:35.194094    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:35.195837 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:35.195816    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:32:35.210178 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:35.210088    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" podStartSLOduration=1.990840177 podStartE2EDuration="6.210072642s" podCreationTimestamp="2026-05-28 09:32:29 +0000 UTC" firstStartedPulling="2026-05-28 09:32:30.566694925 +0000 UTC m=+41.240311322" lastFinishedPulling="2026-05-28 09:32:34.785927387 +0000 UTC m=+45.459543787" observedRunningTime="2026-05-28 09:32:35.209716302 +0000 UTC m=+45.883332719" watchObservedRunningTime="2026-05-28 09:32:35.210072642 +0000 UTC m=+45.883689061"
May 28 09:32:38.517744 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:38.517703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:38.517744 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:38.517752    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:38.518222 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.517843    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:38.518222 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.517850    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:38.518222 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.517869    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:38.518222 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.517895    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:32:54.517881817 +0000 UTC m=+65.191498214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:38.518222 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.517910    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:54.51790463 +0000 UTC m=+65.191521026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:38.618314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:38.618277    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:38.618500 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.618444    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:38.618565 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:38.618521    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:54.618501201 +0000 UTC m=+65.292117597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:48.153140 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:48.153107    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hlrhk"
May 28 09:32:54.537889 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.537845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:32:54.537889 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.537897    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:32:54.538390 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.538005    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:54.538390 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.538080    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:33:26.538062972 +0000 UTC m=+97.211679381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:32:54.538390 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.538007    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:54.538390 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.538104    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:32:54.538390 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.538147    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:26.538134834 +0000 UTC m=+97.211751238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:32:54.639143 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.639111    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:32:54.639290 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.639178    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:32:54.639290 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.639267    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:54.639374 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.639330    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:26.639315115 +0000 UTC m=+97.312931516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:32:54.641596 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.641572    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:32:54.650146 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.650132    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 09:32:54.650233 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:32:54.650177    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:58.650162932 +0000 UTC m=+129.323779328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : secret "metrics-daemon-secret" not found
May 28 09:32:54.740433 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.740386    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:54.743152 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.743129    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:32:54.752684 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.752663    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:32:54.763557 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:54.763535    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6ch9\" (UniqueName: \"kubernetes.io/projected/98ef3228-ce41-4908-b1c6-8916c3658e95-kube-api-access-b6ch9\") pod \"network-check-target-f4hdh\" (UID: \"98ef3228-ce41-4908-b1c6-8916c3658e95\") " pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:55.053534 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:55.053500    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59hvh\""
May 28 09:32:55.060869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:55.060846    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:55.182235 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:55.182204    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4hdh"]
May 28 09:32:55.185188 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:32:55.185160    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ef3228_ce41_4908_b1c6_8916c3658e95.slice/crio-a8cc0af4aa675c1d685bf4e0b5d7db7a1ceb18faa533b5cc03389ceea87d50bb WatchSource:0}: Error finding container a8cc0af4aa675c1d685bf4e0b5d7db7a1ceb18faa533b5cc03389ceea87d50bb: Status 404 returned error can't find the container with id a8cc0af4aa675c1d685bf4e0b5d7db7a1ceb18faa533b5cc03389ceea87d50bb
May 28 09:32:55.230109 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:55.230075    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4hdh" event={"ID":"98ef3228-ce41-4908-b1c6-8916c3658e95","Type":"ContainerStarted","Data":"a8cc0af4aa675c1d685bf4e0b5d7db7a1ceb18faa533b5cc03389ceea87d50bb"}
May 28 09:32:59.238567 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:59.238522    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4hdh" event={"ID":"98ef3228-ce41-4908-b1c6-8916c3658e95","Type":"ContainerStarted","Data":"834bd896081ecc749e5c4218799333212deebc0d33e0e2618a4888bf08d7b628"}
May 28 09:32:59.238979 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:59.238653    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:32:59.257179 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:32:59.257122    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f4hdh" podStartSLOduration=66.249369536 podStartE2EDuration="1m9.257106505s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:32:55.186977531 +0000 UTC m=+65.860593927" lastFinishedPulling="2026-05-28 09:32:58.194714497 +0000 UTC m=+68.868330896" observedRunningTime="2026-05-28 09:32:59.256009976 +0000 UTC m=+69.929626395" watchObservedRunningTime="2026-05-28 09:32:59.257106505 +0000 UTC m=+69.930722923"
May 28 09:33:26.580859 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:33:26.580825    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:33:26.580919    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.581010    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.581012    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.581139    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls podName:83c29454-1a98-4368-b38c-96901375e0eb nodeName:}" failed. No retries permitted until 2026-05-28 09:34:30.581121525 +0000 UTC m=+161.254737922 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls") pod "dns-default-l578n" (UID: "83c29454-1a98-4368-b38c-96901375e0eb") : secret "dns-default-metrics-tls" not found
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.581145    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7f9d9c5-h68lh: secret "image-registry-tls" not found
May 28 09:33:26.581283 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.581226    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls podName:85e3f27e-ae40-4bff-a3f3-ed3858bafd68 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:30.581205808 +0000 UTC m=+161.254822225 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls") pod "image-registry-6d7f9d9c5-h68lh" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68") : secret "image-registry-tls" not found
May 28 09:33:26.681860 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:33:26.681823    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:33:26.682017 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.681952    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:33:26.682080 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:26.682020    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert podName:bf749018-d6fd-4fa9-8599-3f47a1dc7620 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:30.682005655 +0000 UTC m=+161.355622051 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert") pod "ingress-canary-j7nk2" (UID: "bf749018-d6fd-4fa9-8599-3f47a1dc7620") : secret "canary-serving-cert" not found
May 28 09:33:30.242987 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:33:30.242956    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f4hdh"
May 28 09:33:58.702091 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:33:58.702015    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:33:58.702575 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:58.702174    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 09:33:58.702575 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:33:58.702253    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs podName:7369f3ea-d49b-49e7-8d44-7088f4de9c42 nodeName:}" failed. No retries permitted until 2026-05-28 09:36:00.702237066 +0000 UTC m=+251.375853463 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs") pod "network-metrics-daemon-6bd26" (UID: "7369f3ea-d49b-49e7-8d44-7088f4de9c42") : secret "metrics-daemon-secret" not found
May 28 09:34:07.572510 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.572473    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6ffccfcd84-vl8s7"]
May 28 09:34:07.575336 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.575321    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.577445 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.577416    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 09:34:07.577576 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.577448    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 09:34:07.577912 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.577888    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 09:34:07.578037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.577914    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 09:34:07.578037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.577958    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 09:34:07.578561 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.578535    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wjz5n\""
May 28 09:34:07.579317 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.578684    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 09:34:07.588195 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.588176    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ffccfcd84-vl8s7"]
May 28 09:34:07.669242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.669201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.669242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.669247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-stats-auth\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.669440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.669308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-default-certificate\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.669440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.669342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.669440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.669364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9tgb\" (UniqueName: \"kubernetes.io/projected/52aac343-0f12-420a-b4a4-6ecd4a33f884-kube-api-access-r9tgb\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.769967 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.769921    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.770133 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.769977    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-stats-auth\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.770133 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.770094    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-default-certificate\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.770133 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:07.770117    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:08.270099147 +0000 UTC m=+138.943715549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:07.770307 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.770166    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.770307 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.770194    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9tgb\" (UniqueName: \"kubernetes.io/projected/52aac343-0f12-420a-b4a4-6ecd4a33f884-kube-api-access-r9tgb\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.770403 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:07.770302    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:07.770403 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:07.770372    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:08.270356629 +0000 UTC m=+138.943973031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:07.772561 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.772531    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-default-certificate\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.772653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.772531    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-stats-auth\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:07.780593 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:07.780570    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9tgb\" (UniqueName: \"kubernetes.io/projected/52aac343-0f12-420a-b4a4-6ecd4a33f884-kube-api-access-r9tgb\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:08.273283 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:08.273235    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:08.273515 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:08.273400    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:08.273515 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:08.273471    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:09.273441263 +0000 UTC m=+139.947057661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:08.273640 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:08.273520    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:08.273640 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:08.273574    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:09.273561939 +0000 UTC m=+139.947178336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:09.282355 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:09.282308    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:09.282355 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:09.282385    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:09.282820 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:09.282476    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:09.282820 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:09.282482    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:11.282466485 +0000 UTC m=+141.956082886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:09.282820 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:09.282523    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:11.282511028 +0000 UTC m=+141.956127429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:11.299261 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:11.299210    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:11.299712 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:11.299296    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:11.299712 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:11.299382    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:11.299712 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:11.299413    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:15.299398301 +0000 UTC m=+145.973014698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:11.299712 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:11.299455    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:15.299433659 +0000 UTC m=+145.973050072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:15.331689 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.331645    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:15.332171 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:15.331810    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:23.331790653 +0000 UTC m=+154.005407050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:15.332171 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.331749    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:15.332171 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:15.331847    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:15.332171 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:15.331899    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:23.331883928 +0000 UTC m=+154.005500343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:15.501760 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.501720    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-54nsz"]
May 28 09:34:15.504701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.504682    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.507239 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.507214    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xvr78\""
May 28 09:34:15.507374 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.507216    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 09:34:15.507374 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.507216    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 09:34:15.507940 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.507924    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 09:34:15.508031 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.507925    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 09:34:15.512382 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.512358    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-54nsz"]
May 28 09:34:15.634286 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.634189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-cabundle\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.634447 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.634292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-kube-api-access-pwhmk\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.634447 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.634389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-key\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.649630 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.649606    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9gts4_957525a4-ea1c-44d7-b306-d3fcc0ae8dbd/dns-node-resolver/0.log"
May 28 09:34:15.735312 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.735259    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-key\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.735312 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.735323    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-cabundle\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.735517 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.735383    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-kube-api-access-pwhmk\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.736003 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.735977    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-cabundle\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.737727 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.737709    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-signing-key\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.744974 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.744950    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1-kube-api-access-pwhmk\") pod \"service-ca-67d667c7d-54nsz\" (UID: \"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1\") " pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.813984 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.813939    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-54nsz"
May 28 09:34:15.938869 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:15.938834    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-54nsz"]
May 28 09:34:15.943038 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:15.943009    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdccb1e_03cf_4f0f_b8f0_665beb42b8f1.slice/crio-580928ff9912ba8dcd3b715aa293337955e5727fa3e7c009c97ef01a6e4fade2 WatchSource:0}: Error finding container 580928ff9912ba8dcd3b715aa293337955e5727fa3e7c009c97ef01a6e4fade2: Status 404 returned error can't find the container with id 580928ff9912ba8dcd3b715aa293337955e5727fa3e7c009c97ef01a6e4fade2
May 28 09:34:16.384657 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:16.384604    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-54nsz" event={"ID":"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1","Type":"ContainerStarted","Data":"580928ff9912ba8dcd3b715aa293337955e5727fa3e7c009c97ef01a6e4fade2"}
May 28 09:34:16.857483 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:16.857455    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mmtfl_5dec1906-9449-4bb3-ac02-717d625bde6f/node-ca/0.log"
May 28 09:34:18.389311 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:18.389275    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-54nsz" event={"ID":"dbdccb1e-03cf-4f0f-b8f0-665beb42b8f1","Type":"ContainerStarted","Data":"84b36c5e9b0a9ff642b98e9052ce6e84290726ef9ca949602d038024d45405da"}
May 28 09:34:18.410137 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:18.408860    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-54nsz" podStartSLOduration=1.8146041290000001 podStartE2EDuration="3.408838787s" podCreationTimestamp="2026-05-28 09:34:15 +0000 UTC" firstStartedPulling="2026-05-28 09:34:15.945350307 +0000 UTC m=+146.618966704" lastFinishedPulling="2026-05-28 09:34:17.539584965 +0000 UTC m=+148.213201362" observedRunningTime="2026-05-28 09:34:18.407597577 +0000 UTC m=+149.081213997" watchObservedRunningTime="2026-05-28 09:34:18.408838787 +0000 UTC m=+149.082455208"
May 28 09:34:23.399938 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:23.399902    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:23.400567 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:23.399976    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:23.400567 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:23.400086    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 09:34:23.400567 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:23.400106    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:39.400091888 +0000 UTC m=+170.073708285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : configmap references non-existent config key: service-ca.crt
May 28 09:34:23.400567 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:23.400167    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs podName:52aac343-0f12-420a-b4a4-6ecd4a33f884 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:39.400149 +0000 UTC m=+170.073765408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs") pod "router-default-6ffccfcd84-vl8s7" (UID: "52aac343-0f12-420a-b4a4-6ecd4a33f884") : secret "router-metrics-certs-default" not found
May 28 09:34:25.687465 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:25.687405    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68"
May 28 09:34:25.703585 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:25.703542    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l578n" podUID="83c29454-1a98-4368-b38c-96901375e0eb"
May 28 09:34:25.724878 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:25.724844    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j7nk2" podUID="bf749018-d6fd-4fa9-8599-3f47a1dc7620"
May 28 09:34:25.943156 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:34:25.943066    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6bd26" podUID="7369f3ea-d49b-49e7-8d44-7088f4de9c42"
May 28 09:34:26.405428 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:26.405349    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:26.405586 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:26.405356    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l578n"
May 28 09:34:30.658811 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.658771    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:30.659308 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.658822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:34:30.661098 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.661074    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83c29454-1a98-4368-b38c-96901375e0eb-metrics-tls\") pod \"dns-default-l578n\" (UID: \"83c29454-1a98-4368-b38c-96901375e0eb\") " pod="openshift-dns/dns-default-l578n"
May 28 09:34:30.661250 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.661230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"image-registry-6d7f9d9c5-h68lh\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") " pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:30.759754 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.759698    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:34:30.762250 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.762215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf749018-d6fd-4fa9-8599-3f47a1dc7620-cert\") pod \"ingress-canary-j7nk2\" (UID: \"bf749018-d6fd-4fa9-8599-3f47a1dc7620\") " pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:34:30.909533 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.909440    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rk8br\""
May 28 09:34:30.909533 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.909484    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59hlf\""
May 28 09:34:30.917391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.917362    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l578n"
May 28 09:34:30.917511 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:30.917454    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:31.061783 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.061590    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l578n"]
May 28 09:34:31.064305 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:31.064278    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c29454_1a98_4368_b38c_96901375e0eb.slice/crio-805984f35580297b8af861d771e4e77fb75b4560b82eb20c4a7cce6180c9652b WatchSource:0}: Error finding container 805984f35580297b8af861d771e4e77fb75b4560b82eb20c4a7cce6180c9652b: Status 404 returned error can't find the container with id 805984f35580297b8af861d771e4e77fb75b4560b82eb20c4a7cce6180c9652b
May 28 09:34:31.076692 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.076662    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:34:31.079639 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:31.079611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e3f27e_ae40_4bff_a3f3_ed3858bafd68.slice/crio-ce63b76ecfa477241c2faceb9a0ab2fcb5eab5087c51af3ebb74df5f5b19aa1b WatchSource:0}: Error finding container ce63b76ecfa477241c2faceb9a0ab2fcb5eab5087c51af3ebb74df5f5b19aa1b: Status 404 returned error can't find the container with id ce63b76ecfa477241c2faceb9a0ab2fcb5eab5087c51af3ebb74df5f5b19aa1b
May 28 09:34:31.415199 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.415160    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l578n" event={"ID":"83c29454-1a98-4368-b38c-96901375e0eb","Type":"ContainerStarted","Data":"805984f35580297b8af861d771e4e77fb75b4560b82eb20c4a7cce6180c9652b"}
May 28 09:34:31.416523 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.416488    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" event={"ID":"85e3f27e-ae40-4bff-a3f3-ed3858bafd68","Type":"ContainerStarted","Data":"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"}
May 28 09:34:31.416633 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.416524    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" event={"ID":"85e3f27e-ae40-4bff-a3f3-ed3858bafd68","Type":"ContainerStarted","Data":"ce63b76ecfa477241c2faceb9a0ab2fcb5eab5087c51af3ebb74df5f5b19aa1b"}
May 28 09:34:31.416676 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.416634    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:31.438515 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:31.438462    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" podStartSLOduration=181.438445924 podStartE2EDuration="3m1.438445924s" podCreationTimestamp="2026-05-28 09:31:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:34:31.437467494 +0000 UTC m=+162.111083913" watchObservedRunningTime="2026-05-28 09:34:31.438445924 +0000 UTC m=+162.112062342"
May 28 09:34:32.420902 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:32.420869    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l578n" event={"ID":"83c29454-1a98-4368-b38c-96901375e0eb","Type":"ContainerStarted","Data":"49df1a3d4fa6e4c229488f07c25c51c9e11e3156c8a0c388d9c132063ee17b0f"}
May 28 09:34:33.425039 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:33.424999    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l578n" event={"ID":"83c29454-1a98-4368-b38c-96901375e0eb","Type":"ContainerStarted","Data":"466ed4d7a16c7b91819f3fe52c5b4571aff0c3bbac8db66f988b788889943142"}
May 28 09:34:33.425549 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:33.425167    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l578n"
May 28 09:34:33.444938 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:33.444881    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l578n" podStartSLOduration=130.233629954 podStartE2EDuration="2m11.444862747s" podCreationTimestamp="2026-05-28 09:32:22 +0000 UTC" firstStartedPulling="2026-05-28 09:34:31.06612682 +0000 UTC m=+161.739743217" lastFinishedPulling="2026-05-28 09:34:32.277359613 +0000 UTC m=+162.950976010" observedRunningTime="2026-05-28 09:34:33.443334524 +0000 UTC m=+164.116950936" watchObservedRunningTime="2026-05-28 09:34:33.444862747 +0000 UTC m=+164.118479165"
May 28 09:34:35.194449 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:35.194393    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" podUID="b4d2fa52-8955-4d77-8b93-716092cf78e0" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
May 28 09:34:35.432521 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:35.432434    2559 generic.go:358] "Generic (PLEG): container finished" podID="b4d2fa52-8955-4d77-8b93-716092cf78e0" containerID="1fe6b09e438ea21e8a46ef3a05103ebe4e7813c1b3be54b11db26ae8c0779bbf" exitCode=1
May 28 09:34:35.432521 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:35.432480    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" event={"ID":"b4d2fa52-8955-4d77-8b93-716092cf78e0","Type":"ContainerDied","Data":"1fe6b09e438ea21e8a46ef3a05103ebe4e7813c1b3be54b11db26ae8c0779bbf"}
May 28 09:34:35.432843 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:35.432825    2559 scope.go:117] "RemoveContainer" containerID="1fe6b09e438ea21e8a46ef3a05103ebe4e7813c1b3be54b11db26ae8c0779bbf"
May 28 09:34:35.979572 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:35.979540    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:34:36.048983 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.048945    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4rl6g"]
May 28 09:34:36.051753 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.051736    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.053902 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.053879    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 09:34:36.054037 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.053879    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 09:34:36.054191 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.054176    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 09:34:36.054486 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.054467    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gxpk9\""
May 28 09:34:36.054581 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.054503    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 09:34:36.063773 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.063752    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4rl6g"]
May 28 09:34:36.206765 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.206720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e19347c-00df-485d-b860-5080b11007d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.206765 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.206764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e19347c-00df-485d-b860-5080b11007d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.207245 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.206795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e19347c-00df-485d-b860-5080b11007d6-crio-socket\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.207245 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.206891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzj8f\" (UniqueName: \"kubernetes.io/projected/5e19347c-00df-485d-b860-5080b11007d6-kube-api-access-vzj8f\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.207245 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.206964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e19347c-00df-485d-b860-5080b11007d6-data-volume\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308274 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308183    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e19347c-00df-485d-b860-5080b11007d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308274 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308225    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e19347c-00df-485d-b860-5080b11007d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308366    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e19347c-00df-485d-b860-5080b11007d6-crio-socket\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308406    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzj8f\" (UniqueName: \"kubernetes.io/projected/5e19347c-00df-485d-b860-5080b11007d6-kube-api-access-vzj8f\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308443    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e19347c-00df-485d-b860-5080b11007d6-data-volume\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308563 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308484    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e19347c-00df-485d-b860-5080b11007d6-crio-socket\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308770 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308743    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e19347c-00df-485d-b860-5080b11007d6-data-volume\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.308877 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.308830    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e19347c-00df-485d-b860-5080b11007d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.310531 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.310511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e19347c-00df-485d-b860-5080b11007d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.317803 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.317782    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzj8f\" (UniqueName: \"kubernetes.io/projected/5e19347c-00df-485d-b860-5080b11007d6-kube-api-access-vzj8f\") pod \"insights-runtime-extractor-4rl6g\" (UID: \"5e19347c-00df-485d-b860-5080b11007d6\") " pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.360378 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.360345    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4rl6g"
May 28 09:34:36.440586 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.440550    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8" event={"ID":"b4d2fa52-8955-4d77-8b93-716092cf78e0","Type":"ContainerStarted","Data":"f4adda5b228e9b1067823007aed991dec251736b0f2284292a475481d2690b67"}
May 28 09:34:36.440958 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.440919    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:34:36.441648 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.441622    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d7d95b9c-757n8"
May 28 09:34:36.488354 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:36.488325    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4rl6g"]
May 28 09:34:36.492099 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:36.492069    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e19347c_00df_485d_b860_5080b11007d6.slice/crio-810d1f7b7a455979dd5273a52275abb19802b6d5051f21c415bd8d4cea90df7e WatchSource:0}: Error finding container 810d1f7b7a455979dd5273a52275abb19802b6d5051f21c415bd8d4cea90df7e: Status 404 returned error can't find the container with id 810d1f7b7a455979dd5273a52275abb19802b6d5051f21c415bd8d4cea90df7e
May 28 09:34:37.445989 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.445950    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rl6g" event={"ID":"5e19347c-00df-485d-b860-5080b11007d6","Type":"ContainerStarted","Data":"4309731a7455a98ae473d4a01e4f8f907fd8eff3525c9efee60e9fcfa6354beb"}
May 28 09:34:37.445989 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.445995    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rl6g" event={"ID":"5e19347c-00df-485d-b860-5080b11007d6","Type":"ContainerStarted","Data":"06ba446085f77855f57707cb014607fca127187c5260a7a6a91c5756e3600989"}
May 28 09:34:37.446415 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.446010    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rl6g" event={"ID":"5e19347c-00df-485d-b860-5080b11007d6","Type":"ContainerStarted","Data":"810d1f7b7a455979dd5273a52275abb19802b6d5051f21c415bd8d4cea90df7e"}
May 28 09:34:37.930421 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.930340    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:34:37.933277 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.933251    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5x7r9\""
May 28 09:34:37.940901 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:37.940867    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j7nk2"
May 28 09:34:38.089441 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:38.089409    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j7nk2"]
May 28 09:34:38.093460 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:38.093426    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf749018_d6fd_4fa9_8599_3f47a1dc7620.slice/crio-e9057cb8a7d354ba3c7acc28db79b3bef42c71a38b4df215d185d5608a8f14a5 WatchSource:0}: Error finding container e9057cb8a7d354ba3c7acc28db79b3bef42c71a38b4df215d185d5608a8f14a5: Status 404 returned error can't find the container with id e9057cb8a7d354ba3c7acc28db79b3bef42c71a38b4df215d185d5608a8f14a5
May 28 09:34:38.450025 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:38.449979    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j7nk2" event={"ID":"bf749018-d6fd-4fa9-8599-3f47a1dc7620","Type":"ContainerStarted","Data":"e9057cb8a7d354ba3c7acc28db79b3bef42c71a38b4df215d185d5608a8f14a5"}
May 28 09:34:39.434738 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.434645    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:39.434738 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.434703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:39.435425 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.435403    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52aac343-0f12-420a-b4a4-6ecd4a33f884-service-ca-bundle\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:39.437354 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.437325    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52aac343-0f12-420a-b4a4-6ecd4a33f884-metrics-certs\") pod \"router-default-6ffccfcd84-vl8s7\" (UID: \"52aac343-0f12-420a-b4a4-6ecd4a33f884\") " pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:39.454453 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.454418    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4rl6g" event={"ID":"5e19347c-00df-485d-b860-5080b11007d6","Type":"ContainerStarted","Data":"8640f8966d673ff349a0468a5ca5338bcf29191a347352ebeb4a061166ed1a87"}
May 28 09:34:39.474730 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.474679    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4rl6g" podStartSLOduration=1.485956776 podStartE2EDuration="3.474665935s" podCreationTimestamp="2026-05-28 09:34:36 +0000 UTC" firstStartedPulling="2026-05-28 09:34:36.555575771 +0000 UTC m=+167.229192168" lastFinishedPulling="2026-05-28 09:34:38.544284917 +0000 UTC m=+169.217901327" observedRunningTime="2026-05-28 09:34:39.473457025 +0000 UTC m=+170.147073445" watchObservedRunningTime="2026-05-28 09:34:39.474665935 +0000 UTC m=+170.148282356"
May 28 09:34:39.686954 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.686859    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:39.890781 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:39.890754    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ffccfcd84-vl8s7"]
May 28 09:34:39.893840 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:39.893812    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aac343_0f12_420a_b4a4_6ecd4a33f884.slice/crio-a7b7b8a8d2d212ab38d63ccb2edd33672990e301e8c56838a357ac7bd06fed4c WatchSource:0}: Error finding container a7b7b8a8d2d212ab38d63ccb2edd33672990e301e8c56838a357ac7bd06fed4c: Status 404 returned error can't find the container with id a7b7b8a8d2d212ab38d63ccb2edd33672990e301e8c56838a357ac7bd06fed4c
May 28 09:34:40.458921 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.458886    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j7nk2" event={"ID":"bf749018-d6fd-4fa9-8599-3f47a1dc7620","Type":"ContainerStarted","Data":"5e13cd86b0bbec1a88238bb9d960d4a320f9e4f0c12ff5edb32fbd0853db177f"}
May 28 09:34:40.460242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.460220    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7" event={"ID":"52aac343-0f12-420a-b4a4-6ecd4a33f884","Type":"ContainerStarted","Data":"03f32cb6a227e5544733965a19b6b4bfe11d02fc0a4c51d89bd0809fb6a78b5e"}
May 28 09:34:40.460340 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.460250    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7" event={"ID":"52aac343-0f12-420a-b4a4-6ecd4a33f884","Type":"ContainerStarted","Data":"a7b7b8a8d2d212ab38d63ccb2edd33672990e301e8c56838a357ac7bd06fed4c"}
May 28 09:34:40.476604 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.476558    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j7nk2" podStartSLOduration=136.757818893 podStartE2EDuration="2m18.476544767s" podCreationTimestamp="2026-05-28 09:32:22 +0000 UTC" firstStartedPulling="2026-05-28 09:34:38.095834696 +0000 UTC m=+168.769451093" lastFinishedPulling="2026-05-28 09:34:39.814560569 +0000 UTC m=+170.488176967" observedRunningTime="2026-05-28 09:34:40.476231363 +0000 UTC m=+171.149847781" watchObservedRunningTime="2026-05-28 09:34:40.476544767 +0000 UTC m=+171.150161187"
May 28 09:34:40.497430 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.497377    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7" podStartSLOduration=33.497361542 podStartE2EDuration="33.497361542s" podCreationTimestamp="2026-05-28 09:34:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:34:40.495457023 +0000 UTC m=+171.169073487" watchObservedRunningTime="2026-05-28 09:34:40.497361542 +0000 UTC m=+171.170977960"
May 28 09:34:40.687391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.687349    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:40.689779 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.689756    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:40.930839 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:40.930746    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:34:41.463282 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:41.463252    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:41.464492 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:41.464474    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6ffccfcd84-vl8s7"
May 28 09:34:43.431358 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:43.431327    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l578n"
May 28 09:34:45.960777 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.960743    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"]
May 28 09:34:45.964820 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.964801    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:45.967606 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967583    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 09:34:45.967743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967591    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 09:34:45.967743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967710    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 09:34:45.967743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967733    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rdjsz\""
May 28 09:34:45.967912 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967758    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 09:34:45.967912 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.967596    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 09:34:45.982503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:45.982400    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"]
May 28 09:34:46.090667 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.090633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xtcw\" (UniqueName: \"kubernetes.io/projected/819b23d4-4d5c-46a7-8388-b74b4da84ab6-kube-api-access-4xtcw\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.090667 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.090672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/819b23d4-4d5c-46a7-8388-b74b4da84ab6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.090889 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.090697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.090889 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.090871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.191965 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.191927    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.192165 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.191980    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xtcw\" (UniqueName: \"kubernetes.io/projected/819b23d4-4d5c-46a7-8388-b74b4da84ab6-kube-api-access-4xtcw\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.192165 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.192010    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/819b23d4-4d5c-46a7-8388-b74b4da84ab6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.192165 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.192073    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.192768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.192738    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/819b23d4-4d5c-46a7-8388-b74b4da84ab6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.194608 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.194573    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.194701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.194588    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/819b23d4-4d5c-46a7-8388-b74b4da84ab6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.203786 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.203756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xtcw\" (UniqueName: \"kubernetes.io/projected/819b23d4-4d5c-46a7-8388-b74b4da84ab6-kube-api-access-4xtcw\") pod \"prometheus-operator-7779bbdd78-dq4k9\" (UID: \"819b23d4-4d5c-46a7-8388-b74b4da84ab6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.278826 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.278744    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"
May 28 09:34:46.414868 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.414835    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9"]
May 28 09:34:46.417672 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:46.417640    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819b23d4_4d5c_46a7_8388_b74b4da84ab6.slice/crio-63bfa2f6863ab815ff1b891598827090cb09387bbdfddebf2ed95e490d7064de WatchSource:0}: Error finding container 63bfa2f6863ab815ff1b891598827090cb09387bbdfddebf2ed95e490d7064de: Status 404 returned error can't find the container with id 63bfa2f6863ab815ff1b891598827090cb09387bbdfddebf2ed95e490d7064de
May 28 09:34:46.476940 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:46.476903    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9" event={"ID":"819b23d4-4d5c-46a7-8388-b74b4da84ab6","Type":"ContainerStarted","Data":"63bfa2f6863ab815ff1b891598827090cb09387bbdfddebf2ed95e490d7064de"}
May 28 09:34:47.945331 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.945307    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:34:47.948158 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.948131    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:47.950295 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.950275    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 09:34:47.950982 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.950965    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 09:34:47.951100 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951013    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 09:34:47.951169 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951150    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 09:34:47.951261 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951244    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 09:34:47.951321 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951265    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jptm6\""
May 28 09:34:47.951379 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951344    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 09:34:47.951437 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.951379    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 09:34:47.960291 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:47.960083    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:34:48.108951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.108856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.108951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.108896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.108951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.108917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bfx\" (UniqueName: \"kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.109242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.108979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.109242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.109080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.109242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.109108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209780 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209747    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209786    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209826    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209844    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209859    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bfx\" (UniqueName: \"kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.209950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.209893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.210592 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.210561    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.210592 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.210582    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.210763 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.210564    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.212270 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.212252    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.212355 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.212285    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.219522 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.219496    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bfx\" (UniqueName: \"kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx\") pod \"console-675d7cf9c9-zk8tn\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") " pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.258561 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.258523    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:48.382132 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.382058    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:34:48.385175 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:48.385141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584d27e8_4b36_4da6_b7d5_8cfcec7896ee.slice/crio-e967e9d123aec6ac4489b8329f5d3c7d214ab05c6ad02c9c6ad4c6e551ac500b WatchSource:0}: Error finding container e967e9d123aec6ac4489b8329f5d3c7d214ab05c6ad02c9c6ad4c6e551ac500b: Status 404 returned error can't find the container with id e967e9d123aec6ac4489b8329f5d3c7d214ab05c6ad02c9c6ad4c6e551ac500b
May 28 09:34:48.483494 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.483453    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9" event={"ID":"819b23d4-4d5c-46a7-8388-b74b4da84ab6","Type":"ContainerStarted","Data":"c352f0566099ff55c8ed731f269893696fac4e3b75d4c3717086e6e455584604"}
May 28 09:34:48.483494 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.483498    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9" event={"ID":"819b23d4-4d5c-46a7-8388-b74b4da84ab6","Type":"ContainerStarted","Data":"c6d988a6bd7dc2b85e81b8fa35536bc81dcd9031061f23f28f916bf4665b7daa"}
May 28 09:34:48.484495 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.484469    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675d7cf9c9-zk8tn" event={"ID":"584d27e8-4b36-4da6-b7d5-8cfcec7896ee","Type":"ContainerStarted","Data":"e967e9d123aec6ac4489b8329f5d3c7d214ab05c6ad02c9c6ad4c6e551ac500b"}
May 28 09:34:48.507544 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:48.507492    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-dq4k9" podStartSLOduration=2.093580721 podStartE2EDuration="3.5074772s" podCreationTimestamp="2026-05-28 09:34:45 +0000 UTC" firstStartedPulling="2026-05-28 09:34:46.41953167 +0000 UTC m=+177.093148069" lastFinishedPulling="2026-05-28 09:34:47.833428148 +0000 UTC m=+178.507044548" observedRunningTime="2026-05-28 09:34:48.506210889 +0000 UTC m=+179.179827314" watchObservedRunningTime="2026-05-28 09:34:48.5074772 +0000 UTC m=+179.181093619"
May 28 09:34:50.317350 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.316036    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"]
May 28 09:34:50.319915 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.319889    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.325197 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.322365    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 09:34:50.325197 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.322448    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 09:34:50.325197 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.322683    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-s8bjk\""
May 28 09:34:50.330791 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.330701    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"]
May 28 09:34:50.334756 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.334714    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gpxpk"]
May 28 09:34:50.338160 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.338135    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.340692 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.340667    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 09:34:50.341063 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.341020    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nt95n\""
May 28 09:34:50.341448 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.341242    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 09:34:50.341448 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.341269    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 09:34:50.425670 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.425628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.425844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.425698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.425844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.425743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dfa420-c93a-4f5b-a6c9-d592761dc157-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.425844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.425799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9l6\" (UniqueName: \"kubernetes.io/projected/e2dfa420-c93a-4f5b-a6c9-d592761dc157-kube-api-access-zl9l6\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4gxk\" (UniqueName: \"kubernetes.io/projected/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-kube-api-access-v4gxk\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527240    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-sys\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527306    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-metrics-client-ca\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-tls\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-wtmp\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527430    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dfa420-c93a-4f5b-a6c9-d592761dc157-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.527503 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.528123 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527536    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9l6\" (UniqueName: \"kubernetes.io/projected/e2dfa420-c93a-4f5b-a6c9-d592761dc157-kube-api-access-zl9l6\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.528123 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.528123 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-textfile\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.528123 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.527694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-root\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.528343 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.528157    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dfa420-c93a-4f5b-a6c9-d592761dc157-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.530285 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.530260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.530805 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.530782    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2dfa420-c93a-4f5b-a6c9-d592761dc157-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.540610 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.540578    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9l6\" (UniqueName: \"kubernetes.io/projected/e2dfa420-c93a-4f5b-a6c9-d592761dc157-kube-api-access-zl9l6\") pod \"openshift-state-metrics-9c959559f-7ghnr\" (UID: \"e2dfa420-c93a-4f5b-a6c9-d592761dc157\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.628377 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628285    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-root\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628377 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628339    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4gxk\" (UniqueName: \"kubernetes.io/projected/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-kube-api-access-v4gxk\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628377 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628375    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-sys\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628406    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-metrics-client-ca\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628413    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-root\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628434    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-tls\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628498    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-sys\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628545    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-wtmp\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628667    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-wtmp\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628728    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.628887 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628790    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.629072 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.628834    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-textfile\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.629673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.629208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-textfile\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.629673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.629291    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-metrics-client-ca\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.629673 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.629638    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.631561 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.631501    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.631671 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.631615    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-node-exporter-tls\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.632338 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.632316    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"
May 28 09:34:50.639779 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.639754    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4gxk\" (UniqueName: \"kubernetes.io/projected/22c2d849-e37c-4df4-82ae-6f0f8c751c6b-kube-api-access-v4gxk\") pod \"node-exporter-gpxpk\" (UID: \"22c2d849-e37c-4df4-82ae-6f0f8c751c6b\") " pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:50.649653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:50.649618    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpxpk"
May 28 09:34:51.551966 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:51.551928    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c2d849_e37c_4df4_82ae_6f0f8c751c6b.slice/crio-276c7f7b2ecc98a6bae6642d42f3f46e54776ff438a726e18a94f7aa5039c148 WatchSource:0}: Error finding container 276c7f7b2ecc98a6bae6642d42f3f46e54776ff438a726e18a94f7aa5039c148: Status 404 returned error can't find the container with id 276c7f7b2ecc98a6bae6642d42f3f46e54776ff438a726e18a94f7aa5039c148
May 28 09:34:51.688359 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:51.688328    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr"]
May 28 09:34:51.692549 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:51.692506    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2dfa420_c93a_4f5b_a6c9_d592761dc157.slice/crio-5036bf9f7dbe564a7e0716ced347dcedb71290d95ee4c88dbf02dec30e1313f2 WatchSource:0}: Error finding container 5036bf9f7dbe564a7e0716ced347dcedb71290d95ee4c88dbf02dec30e1313f2: Status 404 returned error can't find the container with id 5036bf9f7dbe564a7e0716ced347dcedb71290d95ee4c88dbf02dec30e1313f2
May 28 09:34:52.497637 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.497599    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675d7cf9c9-zk8tn" event={"ID":"584d27e8-4b36-4da6-b7d5-8cfcec7896ee","Type":"ContainerStarted","Data":"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"}
May 28 09:34:52.499118 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.499087    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpxpk" event={"ID":"22c2d849-e37c-4df4-82ae-6f0f8c751c6b","Type":"ContainerStarted","Data":"276c7f7b2ecc98a6bae6642d42f3f46e54776ff438a726e18a94f7aa5039c148"}
May 28 09:34:52.500881 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.500857    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr" event={"ID":"e2dfa420-c93a-4f5b-a6c9-d592761dc157","Type":"ContainerStarted","Data":"2dbcf90809f401115c20eda040837d8691ef66d626d10b910e63a10b31b469d8"}
May 28 09:34:52.500998 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.500886    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr" event={"ID":"e2dfa420-c93a-4f5b-a6c9-d592761dc157","Type":"ContainerStarted","Data":"999f01fbc849e69960b00a487e50799bd19c7d2c72d5716f1a5958b97e07223c"}
May 28 09:34:52.500998 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.500896    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr" event={"ID":"e2dfa420-c93a-4f5b-a6c9-d592761dc157","Type":"ContainerStarted","Data":"5036bf9f7dbe564a7e0716ced347dcedb71290d95ee4c88dbf02dec30e1313f2"}
May 28 09:34:52.518075 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:52.518011    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-675d7cf9c9-zk8tn" podStartSLOduration=2.299191812 podStartE2EDuration="5.517995694s" podCreationTimestamp="2026-05-28 09:34:47 +0000 UTC" firstStartedPulling="2026-05-28 09:34:48.386936601 +0000 UTC m=+179.060552997" lastFinishedPulling="2026-05-28 09:34:51.605740482 +0000 UTC m=+182.279356879" observedRunningTime="2026-05-28 09:34:52.517549607 +0000 UTC m=+183.191166027" watchObservedRunningTime="2026-05-28 09:34:52.517995694 +0000 UTC m=+183.191612114"
May 28 09:34:53.489951 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.489909    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"]
May 28 09:34:53.493750 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.493723    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.496342 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496317    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 09:34:53.496569 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496551    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 09:34:53.496708 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496591    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7shws\""
May 28 09:34:53.496774 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496610    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 09:34:53.496826 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496617    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 09:34:53.496826 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496647    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e66ts8ok22g5n\""
May 28 09:34:53.496926 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.496777    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 09:34:53.505680 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.505652    2559 generic.go:358] "Generic (PLEG): container finished" podID="22c2d849-e37c-4df4-82ae-6f0f8c751c6b" containerID="cd59535db6d3bc6c44a1b7917ec82e94f8be606db302e04fdecfee8b10dae75e" exitCode=0
May 28 09:34:53.505802 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.505736    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpxpk" event={"ID":"22c2d849-e37c-4df4-82ae-6f0f8c751c6b","Type":"ContainerDied","Data":"cd59535db6d3bc6c44a1b7917ec82e94f8be606db302e04fdecfee8b10dae75e"}
May 28 09:34:53.507902 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.507869    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr" event={"ID":"e2dfa420-c93a-4f5b-a6c9-d592761dc157","Type":"ContainerStarted","Data":"63d8ec4651f600530fe99aafd366b768bc4319d313ef7313d12b842b0356e2ba"}
May 28 09:34:53.509964 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.509942    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"]
May 28 09:34:53.553261 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.553229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.553896 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.553867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c77d21-f828-42d4-b3fe-4e0974848570-metrics-client-ca\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554010 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.553914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-grpc-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554109 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.554092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554165 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.554138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554219 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.554165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nblcw\" (UniqueName: \"kubernetes.io/projected/87c77d21-f828-42d4-b3fe-4e0974848570-kube-api-access-nblcw\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554580 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.554555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.554693 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.554587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.560201 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.560157    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-7ghnr" podStartSLOduration=2.648192935 podStartE2EDuration="3.560138317s" podCreationTimestamp="2026-05-28 09:34:50 +0000 UTC" firstStartedPulling="2026-05-28 09:34:51.825195387 +0000 UTC m=+182.498811789" lastFinishedPulling="2026-05-28 09:34:52.737140771 +0000 UTC m=+183.410757171" observedRunningTime="2026-05-28 09:34:53.559281998 +0000 UTC m=+184.232898418" watchObservedRunningTime="2026-05-28 09:34:53.560138317 +0000 UTC m=+184.233754735"
May 28 09:34:53.656729 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.656699    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.656894 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.656789    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c77d21-f828-42d4-b3fe-4e0974848570-metrics-client-ca\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.656959 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.656821    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-grpc-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657159 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657136    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657312 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657289    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657430 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657325    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nblcw\" (UniqueName: \"kubernetes.io/projected/87c77d21-f828-42d4-b3fe-4e0974848570-kube-api-access-nblcw\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657577 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657550    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657759 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657722    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.657847 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.657650    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87c77d21-f828-42d4-b3fe-4e0974848570-metrics-client-ca\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660195 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660404 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660505 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660557 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660539    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660628 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660545    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.660680 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.660659    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87c77d21-f828-42d4-b3fe-4e0974848570-secret-grpc-tls\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.669879 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.669841    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nblcw\" (UniqueName: \"kubernetes.io/projected/87c77d21-f828-42d4-b3fe-4e0974848570-kube-api-access-nblcw\") pod \"thanos-querier-57f7c79b6c-xhqgz\" (UID: \"87c77d21-f828-42d4-b3fe-4e0974848570\") " pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.805110 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.804992    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:53.950405 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:53.950354    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"]
May 28 09:34:53.952819 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:53.952795    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c77d21_f828_42d4_b3fe_4e0974848570.slice/crio-8d6a41cd176e8122ede12e811efe3113c47efefc3cacf04567e610711f9b3566 WatchSource:0}: Error finding container 8d6a41cd176e8122ede12e811efe3113c47efefc3cacf04567e610711f9b3566: Status 404 returned error can't find the container with id 8d6a41cd176e8122ede12e811efe3113c47efefc3cacf04567e610711f9b3566
May 28 09:34:54.511739 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:54.511684    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"8d6a41cd176e8122ede12e811efe3113c47efefc3cacf04567e610711f9b3566"}
May 28 09:34:54.513744 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:54.513712    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpxpk" event={"ID":"22c2d849-e37c-4df4-82ae-6f0f8c751c6b","Type":"ContainerStarted","Data":"48cb3fc3a35822e531c008e2200cdb10b8dfadc296ad8f6b6d7723566c646fcb"}
May 28 09:34:54.513850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:54.513753    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpxpk" event={"ID":"22c2d849-e37c-4df4-82ae-6f0f8c751c6b","Type":"ContainerStarted","Data":"8fcf8ffcf31cd49e6ea90979221b3e7686222d725eb46c6eff188c21d4af359e"}
May 28 09:34:54.540623 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:54.540570    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gpxpk" podStartSLOduration=3.633987588 podStartE2EDuration="4.540552922s" podCreationTimestamp="2026-05-28 09:34:50 +0000 UTC" firstStartedPulling="2026-05-28 09:34:51.553858594 +0000 UTC m=+182.227475007" lastFinishedPulling="2026-05-28 09:34:52.460423943 +0000 UTC m=+183.134040341" observedRunningTime="2026-05-28 09:34:54.538512458 +0000 UTC m=+185.212128890" watchObservedRunningTime="2026-05-28 09:34:54.540552922 +0000 UTC m=+185.214169340"
May 28 09:34:55.986213 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:55.986173    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:34:56.524750 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.524658    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"be0832818e8692f3423556a6a67807ff998bfe3939491445a4f6aa65902b6434"}
May 28 09:34:56.524750 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.524708    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"92d8144150e7ddcd362b865bc855c23f7d52c0c4918033c5ce5ae515c6a235f4"}
May 28 09:34:56.524750 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.524724    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"ad3a71e9cc3744c2501c85a2e5a2e6967848105b6faf9b4bc8cf0d8af3185159"}
May 28 09:34:56.688286 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.688206    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:56.692566 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.692536    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.695735 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.695708    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 09:34:56.696743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.696723    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 09:34:56.696861 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.696772    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 09:34:56.696948 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.696929    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hwxxt\""
May 28 09:34:56.697809 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.697781    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 09:34:56.697935 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.697919    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 09:34:56.698008 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.697999    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 09:34:56.698165 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698143    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-egbfelrc6svbv\""
May 28 09:34:56.698286 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698266    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 09:34:56.698344 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698284    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 09:34:56.698810 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698505    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 09:34:56.698810 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698523    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 09:34:56.698810 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698671    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 09:34:56.698810 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698752    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 09:34:56.699104 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.698854    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 09:34:56.711553 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.711438    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:56.786742 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786742 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.786977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.786962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787259 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787259 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787259 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmsz7\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787259 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787259 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.787468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.787362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.887915 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.887876    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.887915 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.887915    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.887947    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.887973    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888000    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888040    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888107    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888434 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888416    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888491 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888455    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888543 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888486    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888543 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888517    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888554    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888593    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888623    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888653 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888649    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888848 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888699    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888848 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888729    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888848 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888755    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmsz7\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.888848 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.888801    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.889758 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.889445    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.889758 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.889488    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.889758 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.889588    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.892180 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.891908    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.892180 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.892167    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.893899 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.893872    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.895291 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.895227    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.895291 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.895256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896251 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.895905    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896251 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.895919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896251 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.895955    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896514 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.896302    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896514 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.896414    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896685 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.896665    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.896901 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.896882    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.897672 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.897637    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:56.898736 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:56.898715    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmsz7\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7\") pod \"prometheus-k8s-0\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:57.006158 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.006123    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:34:57.162928 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.162332    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:34:57.164455 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:34:57.164426    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc7c9d3_f678_4974_b682_873131fb8765.slice/crio-383ba6288588dc37c0a25d500ab7f55cc6720420e6fe98efe3106f0f9d485866 WatchSource:0}: Error finding container 383ba6288588dc37c0a25d500ab7f55cc6720420e6fe98efe3106f0f9d485866: Status 404 returned error can't find the container with id 383ba6288588dc37c0a25d500ab7f55cc6720420e6fe98efe3106f0f9d485866
May 28 09:34:57.536176 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.536131    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"f9a00c3503c607b3796182f4a684b5e88012672dc380a1680d31ccae8be08130"}
May 28 09:34:57.536363 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.536290    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"4322295c0e55d91d407d17fb900d94aa9da86f9e83c985bbbe3ee08d92dd10e5"}
May 28 09:34:57.536363 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.536321    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:34:57.536363 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.536333    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" event={"ID":"87c77d21-f828-42d4-b3fe-4e0974848570","Type":"ContainerStarted","Data":"265853bc7a2830f5f44e5f564c5796414bd77dbfde17675ec09ccad769059da3"}
May 28 09:34:57.537579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.537548    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"383ba6288588dc37c0a25d500ab7f55cc6720420e6fe98efe3106f0f9d485866"}
May 28 09:34:57.568489 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:57.568424    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz" podStartSLOduration=1.482148769 podStartE2EDuration="4.568405732s" podCreationTimestamp="2026-05-28 09:34:53 +0000 UTC" firstStartedPulling="2026-05-28 09:34:53.954627538 +0000 UTC m=+184.628243938" lastFinishedPulling="2026-05-28 09:34:57.040884489 +0000 UTC m=+187.714500901" observedRunningTime="2026-05-28 09:34:57.566892641 +0000 UTC m=+188.240509053" watchObservedRunningTime="2026-05-28 09:34:57.568405732 +0000 UTC m=+188.242022152"
May 28 09:34:58.259295 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.259263    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:58.259684 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.259415    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:58.264161 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.264133    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:34:58.542230 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.542189    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef" exitCode=0
May 28 09:34:58.542405 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.542279    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"}
May 28 09:34:58.546643 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:34:58.546621    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:35:01.000902 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.000826    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" containerName="registry" containerID="cri-o://cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a" gracePeriod=30
May 28 09:35:01.526633 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.526608    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:35:01.555685 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.555645    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"}
May 28 09:35:01.557097 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.557062    2559 generic.go:358] "Generic (PLEG): container finished" podID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" containerID="cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a" exitCode=0
May 28 09:35:01.557391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.557179    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" event={"ID":"85e3f27e-ae40-4bff-a3f3-ed3858bafd68","Type":"ContainerDied","Data":"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"}
May 28 09:35:01.557391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.557207    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh" event={"ID":"85e3f27e-ae40-4bff-a3f3-ed3858bafd68","Type":"ContainerDied","Data":"ce63b76ecfa477241c2faceb9a0ab2fcb5eab5087c51af3ebb74df5f5b19aa1b"}
May 28 09:35:01.557391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.557227    2559 scope.go:117] "RemoveContainer" containerID="cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"
May 28 09:35:01.557391 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.557351    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7f9d9c5-h68lh"
May 28 09:35:01.579226 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.579201    2559 scope.go:117] "RemoveContainer" containerID="cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"
May 28 09:35:01.579700 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:35:01.579678    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a\": container with ID starting with cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a not found: ID does not exist" containerID="cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"
May 28 09:35:01.579770 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.579712    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a"} err="failed to get container status \"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a\": rpc error: code = NotFound desc = could not find container \"cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a\": container with ID starting with cdb48767e371104615f6110fb336b9434ee0163cb94051b8f32f86a48603e33a not found: ID does not exist"
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636378    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636441    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brn2p\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636471    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636514    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636560    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636588    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636663    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.637817 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.636706    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") pod \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\" (UID: \"85e3f27e-ae40-4bff-a3f3-ed3858bafd68\") "
May 28 09:35:01.639314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.639277    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:35:01.639642 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.639614    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:35:01.641168 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.641114    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:35:01.643903 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.643861    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:35:01.644557 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.644521    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:35:01.645192 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.645167    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:35:01.645325 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.645298    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p" (OuterVolumeSpecName: "kube-api-access-brn2p") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "kube-api-access-brn2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:35:01.653200 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.653170    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85e3f27e-ae40-4bff-a3f3-ed3858bafd68" (UID: "85e3f27e-ae40-4bff-a3f3-ed3858bafd68"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737797    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-certificates\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737833    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brn2p\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-kube-api-access-brn2p\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737847    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-trusted-ca\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737861    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-bound-sa-token\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737875    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-image-registry-private-configuration\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737888    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-installation-pull-secrets\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737903    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-ca-trust-extracted\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.737950 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.737917    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e3f27e-ae40-4bff-a3f3-ed3858bafd68-registry-tls\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:01.894883 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.894800    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:35:01.898977 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.898944    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d7f9d9c5-h68lh"]
May 28 09:35:01.935272 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:01.935232    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" path="/var/lib/kubelet/pods/85e3f27e-ae40-4bff-a3f3-ed3858bafd68/volumes"
May 28 09:35:02.564159 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.564120    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"}
May 28 09:35:02.564159 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.564161    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"}
May 28 09:35:02.564587 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.564173    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"}
May 28 09:35:02.564587 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.564181    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"}
May 28 09:35:02.564587 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.564190    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerStarted","Data":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"}
May 28 09:35:02.599622 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:02.599569    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.336364791 podStartE2EDuration="6.599547392s" podCreationTimestamp="2026-05-28 09:34:56 +0000 UTC" firstStartedPulling="2026-05-28 09:34:57.166589435 +0000 UTC m=+187.840205836" lastFinishedPulling="2026-05-28 09:35:01.429772031 +0000 UTC m=+192.103388437" observedRunningTime="2026-05-28 09:35:02.598424283 +0000 UTC m=+193.272040703" watchObservedRunningTime="2026-05-28 09:35:02.599547392 +0000 UTC m=+193.273163816"
May 28 09:35:03.549131 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:03.549097    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57f7c79b6c-xhqgz"
May 28 09:35:07.006470 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:07.006416    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:35:13.761530 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:13.761482    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:35:24.283463 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:24.283429    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ffccfcd84-vl8s7_52aac343-0f12-420a-b4a4-6ecd4a33f884/router/0.log"
May 28 09:35:24.298036 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:24.298011    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j7nk2_bf749018-d6fd-4fa9-8599-3f47a1dc7620/serve-healthcheck-canary/0.log"
May 28 09:35:38.780893 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:38.780821    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-675d7cf9c9-zk8tn" podUID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" containerName="console" containerID="cri-o://f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab" gracePeriod=15
May 28 09:35:39.018438 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.018415    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-675d7cf9c9-zk8tn_584d27e8-4b36-4da6-b7d5-8cfcec7896ee/console/0.log"
May 28 09:35:39.018551 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.018476    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:35:39.061701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061619    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.061701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061660    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.061701 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061697    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.061920 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061749    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6bfx\" (UniqueName: \"kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.061920 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061794    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.061920 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.061821    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca\") pod \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\" (UID: \"584d27e8-4b36-4da6-b7d5-8cfcec7896ee\") "
May 28 09:35:39.062080 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.062029    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config" (OuterVolumeSpecName: "console-config") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:35:39.062200 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.062082    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:35:39.062288 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.062266    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:35:39.063959 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.063928    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx" (OuterVolumeSpecName: "kube-api-access-v6bfx") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "kube-api-access-v6bfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:35:39.064072 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.063961    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:35:39.064072 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.064003    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "584d27e8-4b36-4da6-b7d5-8cfcec7896ee" (UID: "584d27e8-4b36-4da6-b7d5-8cfcec7896ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:35:39.162788 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162747    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6bfx\" (UniqueName: \"kubernetes.io/projected/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-kube-api-access-v6bfx\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.162788 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162781    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-serving-cert\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.162788 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162792    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-service-ca\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.162788 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162801    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-oauth-config\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.163081 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162810    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-console-config\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.163081 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.162819    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/584d27e8-4b36-4da6-b7d5-8cfcec7896ee-oauth-serving-cert\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:35:39.679609 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679579    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-675d7cf9c9-zk8tn_584d27e8-4b36-4da6-b7d5-8cfcec7896ee/console/0.log"
May 28 09:35:39.679780 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679622    2559 generic.go:358] "Generic (PLEG): container finished" podID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" containerID="f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab" exitCode=2
May 28 09:35:39.679780 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679698    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675d7cf9c9-zk8tn"
May 28 09:35:39.679780 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679696    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675d7cf9c9-zk8tn" event={"ID":"584d27e8-4b36-4da6-b7d5-8cfcec7896ee","Type":"ContainerDied","Data":"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"}
May 28 09:35:39.679881 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679806    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675d7cf9c9-zk8tn" event={"ID":"584d27e8-4b36-4da6-b7d5-8cfcec7896ee","Type":"ContainerDied","Data":"e967e9d123aec6ac4489b8329f5d3c7d214ab05c6ad02c9c6ad4c6e551ac500b"}
May 28 09:35:39.679881 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.679825    2559 scope.go:117] "RemoveContainer" containerID="f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"
May 28 09:35:39.688596 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.688577    2559 scope.go:117] "RemoveContainer" containerID="f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"
May 28 09:35:39.688826 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:35:39.688804    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab\": container with ID starting with f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab not found: ID does not exist" containerID="f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"
May 28 09:35:39.688872 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.688835    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab"} err="failed to get container status \"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab\": rpc error: code = NotFound desc = could not find container \"f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab\": container with ID starting with f728f60adb0364e17042edc34eae51f83a2844c11cfc9133704188c9c0f7baab not found: ID does not exist"
May 28 09:35:39.701891 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.701859    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:35:39.706756 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.706729    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-675d7cf9c9-zk8tn"]
May 28 09:35:39.934711 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:39.934625    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" path="/var/lib/kubelet/pods/584d27e8-4b36-4da6-b7d5-8cfcec7896ee/volumes"
May 28 09:35:57.007199 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:57.007158    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:35:57.022919 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:57.022883    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:35:57.747323 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:35:57.747293    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:00.742764 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:00.742734    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:36:00.744892 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:00.744872    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7369f3ea-d49b-49e7-8d44-7088f4de9c42-metrics-certs\") pod \"network-metrics-daemon-6bd26\" (UID: \"7369f3ea-d49b-49e7-8d44-7088f4de9c42\") " pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:36:01.033737 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:01.033664    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxqxx\""
May 28 09:36:01.041587 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:01.041566    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6bd26"
May 28 09:36:01.165658 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:01.165630    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6bd26"]
May 28 09:36:01.168891 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:36:01.168861    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7369f3ea_d49b_49e7_8d44_7088f4de9c42.slice/crio-8de64439257ff86ab889bdbf141f7f13fab5398f87ab7790764e93437a7b98a8 WatchSource:0}: Error finding container 8de64439257ff86ab889bdbf141f7f13fab5398f87ab7790764e93437a7b98a8: Status 404 returned error can't find the container with id 8de64439257ff86ab889bdbf141f7f13fab5398f87ab7790764e93437a7b98a8
May 28 09:36:01.744770 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:01.744724    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bd26" event={"ID":"7369f3ea-d49b-49e7-8d44-7088f4de9c42","Type":"ContainerStarted","Data":"8de64439257ff86ab889bdbf141f7f13fab5398f87ab7790764e93437a7b98a8"}
May 28 09:36:02.749314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:02.749280    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bd26" event={"ID":"7369f3ea-d49b-49e7-8d44-7088f4de9c42","Type":"ContainerStarted","Data":"2dc0a09af763cbb0d23d62dcebc39e8df9cb0bbbe709620524e9b3a126ce76d3"}
May 28 09:36:02.749314 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:02.749317    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6bd26" event={"ID":"7369f3ea-d49b-49e7-8d44-7088f4de9c42","Type":"ContainerStarted","Data":"514f1cee6f2990d0006bab3478759a7861ad36cfc0d1ac1b54e4ab9ff7fe7d13"}
May 28 09:36:02.768528 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:02.768479    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6bd26" podStartSLOduration=251.888229131 podStartE2EDuration="4m12.768463054s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:36:01.170564021 +0000 UTC m=+251.844180418" lastFinishedPulling="2026-05-28 09:36:02.050797942 +0000 UTC m=+252.724414341" observedRunningTime="2026-05-28 09:36:02.767177879 +0000 UTC m=+253.440794296" watchObservedRunningTime="2026-05-28 09:36:02.768463054 +0000 UTC m=+253.442079472"
May 28 09:36:15.170911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.169691    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:15.170911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.170311    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="prometheus" containerID="cri-o://10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04" gracePeriod=600
May 28 09:36:15.170911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.170680    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-thanos" containerID="cri-o://21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa" gracePeriod=600
May 28 09:36:15.170911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.170767    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy" containerID="cri-o://3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47" gracePeriod=600
May 28 09:36:15.170911 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.170831    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-web" containerID="cri-o://01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675" gracePeriod=600
May 28 09:36:15.171726 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.170937    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="thanos-sidecar" containerID="cri-o://70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc" gracePeriod=600
May 28 09:36:15.171726 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.171154    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="config-reloader" containerID="cri-o://20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471" gracePeriod=600
May 28 09:36:15.415504 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.415479    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.565855 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565807    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.565855 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565855    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565887    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565914    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565936    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565959    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.565997    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmsz7\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566023    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566077    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566115    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566162 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566149    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566180    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566232    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566258    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566286    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566316    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566348    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566579 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566409    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs\") pod \"5dc7c9d3-f678-4974-b682-873131fb8765\" (UID: \"5dc7c9d3-f678-4974-b682-873131fb8765\") "
May 28 09:36:15.566898 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.566640    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:15.569029 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.568989    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.569182 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.569106    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.569182 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.569119    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:15.569432 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.569402    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:15.569509 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.569451    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:15.569886 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.569857    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.570113 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570087    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.570304 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570282    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:36:15.570409 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570357    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:15.570480 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570408    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:36:15.570480 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570445    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.570744 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.570712    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.571178 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.571156    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7" (OuterVolumeSpecName: "kube-api-access-xmsz7") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "kube-api-access-xmsz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:36:15.572776 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.572752    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out" (OuterVolumeSpecName: "config-out") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:36:15.572871 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.572810    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.573633 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.573601    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config" (OuterVolumeSpecName: "config") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.581303 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.581282    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config" (OuterVolumeSpecName: "web-config") pod "5dc7c9d3-f678-4974-b682-873131fb8765" (UID: "5dc7c9d3-f678-4974-b682-873131fb8765"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:15.667414 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667376    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-grpc-tls\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667414 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667410    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667414 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667420    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-kube-rbac-proxy\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667431    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-k8s-db\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667439    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-metrics-client-ca\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667449    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-metrics-client-certs\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667459    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667467    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667477    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667485    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667495    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667504    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-tls-assets\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667512    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmsz7\" (UniqueName: \"kubernetes.io/projected/5dc7c9d3-f678-4974-b682-873131fb8765-kube-api-access-xmsz7\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667521    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-web-config\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667529    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5dc7c9d3-f678-4974-b682-873131fb8765-config\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667537    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667545    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5dc7c9d3-f678-4974-b682-873131fb8765-config-out\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.667650 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.667553    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc7c9d3-f678-4974-b682-873131fb8765-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-248.ec2.internal\" DevicePath \"\""
May 28 09:36:15.787498 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787465    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa" exitCode=0
May 28 09:36:15.787498 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787493    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47" exitCode=0
May 28 09:36:15.787498 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787501    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675" exitCode=0
May 28 09:36:15.787498 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787506    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc" exitCode=0
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787513    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471" exitCode=0
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787518    2559 generic.go:358] "Generic (PLEG): container finished" podID="5dc7c9d3-f678-4974-b682-873131fb8765" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04" exitCode=0
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787565    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787559    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787678    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787690    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787699    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787707    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787717    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787725    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5dc7c9d3-f678-4974-b682-873131fb8765","Type":"ContainerDied","Data":"383ba6288588dc37c0a25d500ab7f55cc6720420e6fe98efe3106f0f9d485866"}
May 28 09:36:15.787768 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.787739    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.795353 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.795129    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.802189 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.802171    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.808137 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.808121    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.811479 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.811458    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:15.815298 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.815270    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.817104 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.816023    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:15.822192 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.822174    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.828555 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.828536    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.834816 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.834800    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.835096 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.835078    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.835164 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835104    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.835164 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835122    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.835369 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.835351    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.835413 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835376    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.835413 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835392    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.835598 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.835581    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.835634 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835602    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.835634 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835617    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.835795 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.835776    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.835833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835799    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.835833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.835813    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.836027 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.836011    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.836130 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836030    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.836130 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836056    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.836337 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.836323    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.836380 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836340    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.836380 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836352    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.836565 ip-10-0-135-248 kubenswrapper[2559]: E0528 09:36:15.836550    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.836601 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836569    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.836601 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836583    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.836782 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836765    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.836826 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836783    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.837001 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.836985    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.837071 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837001    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.837340 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837320    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.837425 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837342    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.837563 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837546    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.837609 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837563    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.837743 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837727    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.837784 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837745    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.837968 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837948    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.838018 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.837968    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.838183 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838165    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.838221 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838184    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.838382 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838361    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.838422 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838383    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.838587 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838570    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.838629 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838588    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.838778 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838762    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.838816 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838779    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.838986 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838965    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.839042 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.838987    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.839193 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839175    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.839242 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839193    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.839393 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839376    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.839440 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839393    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.839591 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839574    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.839630 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839591    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.839777 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839762    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.839777 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839776    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.839963 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839948    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.840015 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.839963    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.840215 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840198    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.840215 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840214    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.840438 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840418    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.840480 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840438    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.840617 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840603    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.840664 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840618    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.840813 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840795    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.840850 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840814    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.841013 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.840995    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.841013 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841012    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.841225 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841210    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.841269 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841225    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.841424 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841406    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.841462 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841427    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.841643 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841626    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.841685 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841643    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.841844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841825    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.841909 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.841846    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.842131 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842109    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.842200 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842132    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.842376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842341    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.842376 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842377    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.842656 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842629    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.842656 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842656    2559 scope.go:117] "RemoveContainer" containerID="21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"
May 28 09:36:15.842917 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842894    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa"} err="failed to get container status \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": rpc error: code = NotFound desc = could not find container \"21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa\": container with ID starting with 21a8f9e899a6d108d82b7e4023fbc62944537b38f1dbb39a8fee6af953bd32aa not found: ID does not exist"
May 28 09:36:15.842983 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.842919    2559 scope.go:117] "RemoveContainer" containerID="3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"
May 28 09:36:15.843196 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843173    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47"} err="failed to get container status \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": rpc error: code = NotFound desc = could not find container \"3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47\": container with ID starting with 3b597645d82cdea64a0904ce3c42111f006a710ef76250460d6361f9f504ec47 not found: ID does not exist"
May 28 09:36:15.843196 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843196    2559 scope.go:117] "RemoveContainer" containerID="01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"
May 28 09:36:15.843471 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843445    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675"} err="failed to get container status \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": rpc error: code = NotFound desc = could not find container \"01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675\": container with ID starting with 01e4f72ef788ddae2d0a8eab26e374364be4f2853d930ddafa78eacdc37c0675 not found: ID does not exist"
May 28 09:36:15.843542 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843473    2559 scope.go:117] "RemoveContainer" containerID="70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"
May 28 09:36:15.843705 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843681    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc"} err="failed to get container status \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": rpc error: code = NotFound desc = could not find container \"70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc\": container with ID starting with 70929f3009ceeb07915199d381756ae6d9b190a152b31d0668a7614103c689cc not found: ID does not exist"
May 28 09:36:15.843792 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843705    2559 scope.go:117] "RemoveContainer" containerID="20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"
May 28 09:36:15.843871 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843851    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:15.843939 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843913    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471"} err="failed to get container status \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": rpc error: code = NotFound desc = could not find container \"20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471\": container with ID starting with 20a4503a35da7ce47de5a2bfb2729e00c9431c4f1ffc9df1b95c30458f234471 not found: ID does not exist"
May 28 09:36:15.843939 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.843936    2559 scope.go:117] "RemoveContainer" containerID="10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"
May 28 09:36:15.844148 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844128    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04"} err="failed to get container status \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": rpc error: code = NotFound desc = could not find container \"10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04\": container with ID starting with 10cd4883c44c72a31a3e9358759f9b5de1149335f688dc70161c4752e30d2e04 not found: ID does not exist"
May 28 09:36:15.844202 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844150    2559 scope.go:117] "RemoveContainer" containerID="fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"
May 28 09:36:15.844241 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844200    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" containerName="registry"
May 28 09:36:15.844241 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844213    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" containerName="registry"
May 28 09:36:15.844241 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844222    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="thanos-sidecar"
May 28 09:36:15.844241 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844228    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="thanos-sidecar"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844246    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="init-config-reloader"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844253    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="init-config-reloader"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844264    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" containerName="console"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844272    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" containerName="console"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844283    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-web"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844290    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-web"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844301    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844309    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844317    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="config-reloader"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844322    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="config-reloader"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844328    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="prometheus"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844335    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="prometheus"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844349    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-thanos"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844357    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-thanos"
May 28 09:36:15.844388 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844355    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef"} err="failed to get container status \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": rpc error: code = NotFound desc = could not find container \"fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef\": container with ID starting with fc87bcad0febc01af2dffd5b3563dfa44011128cc9e4c73ab39bfeb5241be2ef not found: ID does not exist"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844405    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-web"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844413    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85e3f27e-ae40-4bff-a3f3-ed3858bafd68" containerName="registry"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844420    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="prometheus"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844427    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="config-reloader"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844433    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844439    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="kube-rbac-proxy-thanos"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844444    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="584d27e8-4b36-4da6-b7d5-8cfcec7896ee" containerName="console"
May 28 09:36:15.844833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.844449    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" containerName="thanos-sidecar"
May 28 09:36:15.847825 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.847808    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.849978 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.849951    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 09:36:15.850091 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850039    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hwxxt\""
May 28 09:36:15.850344 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850326    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 09:36:15.850433 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850364    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 09:36:15.850696 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850617    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 09:36:15.850696 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850680    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 09:36:15.851115 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850708    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 09:36:15.851115 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850733    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 09:36:15.851115 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850877    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 09:36:15.851115 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850903    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-egbfelrc6svbv\""
May 28 09:36:15.851115 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.850984    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 09:36:15.851468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.851274    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 09:36:15.851468 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.851278    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 09:36:15.853199 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.853176    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 09:36:15.857712 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.857689    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 09:36:15.862858 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.862837    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:15.934528 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.934495    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dc7c9d3-f678-4974-b682-873131fb8765" path="/var/lib/kubelet/pods/5dc7c9d3-f678-4974-b682-873131fb8765/volumes"
May 28 09:36:15.969254 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969254 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969459 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969602 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969602 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969602 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5g5v\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-kube-api-access-t5g5v\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969684 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969684 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969684 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:15.969771 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:15.969764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070545    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070646 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070595    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070823 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070722    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070823 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070791    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070823 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070818    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070940 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070849    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070940 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070884    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.070940 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070910    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5g5v\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-kube-api-access-t5g5v\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071107 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070946    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071107 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070971    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071107 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.070996    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071107 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071023    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071107 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071079    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071109    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071165    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071191    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071239    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071271    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071624 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071400    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071624 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071533    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.071831 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.071807    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.072368 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.072340    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.072980 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.072954    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.073989 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.073661    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.073989 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.073678    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.074188 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.074005    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.074265 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.074213    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98780a05-532b-4692-bb85-56bbe495cfcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.074833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.074697    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.074833 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.074783    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.075319 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.075298    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.075695 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.075670    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.075982 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.075960    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.075982 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.075975    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.076078 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.076015    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98780a05-532b-4692-bb85-56bbe495cfcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.076957 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.076938    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98780a05-532b-4692-bb85-56bbe495cfcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.080437 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.080419    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5g5v\" (UniqueName: \"kubernetes.io/projected/98780a05-532b-4692-bb85-56bbe495cfcb-kube-api-access-t5g5v\") pod \"prometheus-k8s-0\" (UID: \"98780a05-532b-4692-bb85-56bbe495cfcb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.158829 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.158797    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:16.316836 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.316811    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 09:36:16.319550 ip-10-0-135-248 kubenswrapper[2559]: W0528 09:36:16.319522    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98780a05_532b_4692_bb85_56bbe495cfcb.slice/crio-2374f58f7bd90f7170d15ae18098c20ccab03a7b7836ef14a037925773ee7e13 WatchSource:0}: Error finding container 2374f58f7bd90f7170d15ae18098c20ccab03a7b7836ef14a037925773ee7e13: Status 404 returned error can't find the container with id 2374f58f7bd90f7170d15ae18098c20ccab03a7b7836ef14a037925773ee7e13
May 28 09:36:16.792277 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.792226    2559 generic.go:358] "Generic (PLEG): container finished" podID="98780a05-532b-4692-bb85-56bbe495cfcb" containerID="d37dc891f3087bd8d805e419681573b1c2b8705c2553f8f0788359b4643e8403" exitCode=0
May 28 09:36:16.792446 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.792306    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerDied","Data":"d37dc891f3087bd8d805e419681573b1c2b8705c2553f8f0788359b4643e8403"}
May 28 09:36:16.792446 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:16.792347    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"2374f58f7bd90f7170d15ae18098c20ccab03a7b7836ef14a037925773ee7e13"}
May 28 09:36:17.799844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799809    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"cf576baeaacb578e8294c9547510bc1ce75b04177ea47c909ff8fd774d8bc5e7"}
May 28 09:36:17.799844 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799848    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"f256ece28793d2c0ed487688cc4879e2d68e7ce10531c44bfabf47c452f3a05e"}
May 28 09:36:17.800296 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799860    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"3222eb62cb9c5f8ff64e48bf225217a325777963b2824aa5cf336e438aa7b561"}
May 28 09:36:17.800296 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799872    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"a66ce0f47ef5e575176a3ad0bbf25767f1ef04fdeed65c21ceb2fbb157bc0bfa"}
May 28 09:36:17.800296 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799884    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"182229ea59a13531b06f21895ddf000b4b63c0e937cd0ed8160d9e867c5c7025"}
May 28 09:36:17.800296 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.799895    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"98780a05-532b-4692-bb85-56bbe495cfcb","Type":"ContainerStarted","Data":"c1bc6793b73b08285ee1cafff211b1b5f01ee96e3ad8ba1717fcb63818f24c66"}
May 28 09:36:17.830561 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:17.830506    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.830491372 podStartE2EDuration="2.830491372s" podCreationTimestamp="2026-05-28 09:36:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:36:17.829403936 +0000 UTC m=+268.503020356" watchObservedRunningTime="2026-05-28 09:36:17.830491372 +0000 UTC m=+268.504107789"
May 28 09:36:21.159384 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:21.159341    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:36:49.847575 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:36:49.847549    2559 kubelet.go:1628] "Image garbage collection succeeded"
May 28 09:37:16.159948 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:37:16.159915    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:37:16.173964 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:37:16.173941    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 09:37:16.978113 ip-10-0-135-248 kubenswrapper[2559]: I0528 09:37:16.978080    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 10:02:32.795237 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:32.795207    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hw9nz_27ececc8-e8e0-42b9-9042-adebde152eee/global-pull-secret-syncer/0.log"
May 28 10:02:32.958135 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:32.958086    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zj55m_47d46b4e-aa26-4bb1-a2a8-4b44026f242a/konnectivity-agent/0.log"
May 28 10:02:33.013891 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:33.013863    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-248.ec2.internal_086c523654d72a132fa6c94341510b4d/haproxy/0.log"
May 28 10:02:36.373331 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.373303    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpxpk_22c2d849-e37c-4df4-82ae-6f0f8c751c6b/node-exporter/0.log"
May 28 10:02:36.397491 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.397463    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpxpk_22c2d849-e37c-4df4-82ae-6f0f8c751c6b/kube-rbac-proxy/0.log"
May 28 10:02:36.421676 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.421624    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpxpk_22c2d849-e37c-4df4-82ae-6f0f8c751c6b/init-textfile/0.log"
May 28 10:02:36.455095 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.455071    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-7ghnr_e2dfa420-c93a-4f5b-a6c9-d592761dc157/kube-rbac-proxy-main/0.log"
May 28 10:02:36.482769 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.482752    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-7ghnr_e2dfa420-c93a-4f5b-a6c9-d592761dc157/kube-rbac-proxy-self/0.log"
May 28 10:02:36.508549 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.508529    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-7ghnr_e2dfa420-c93a-4f5b-a6c9-d592761dc157/openshift-state-metrics/0.log"
May 28 10:02:36.543125 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.543093    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/prometheus/0.log"
May 28 10:02:36.569391 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.569358    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/config-reloader/0.log"
May 28 10:02:36.595392 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.595370    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/thanos-sidecar/0.log"
May 28 10:02:36.622552 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.622532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/kube-rbac-proxy-web/0.log"
May 28 10:02:36.648665 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.648641    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/kube-rbac-proxy/0.log"
May 28 10:02:36.674161 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.674106    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/kube-rbac-proxy-thanos/0.log"
May 28 10:02:36.701776 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.701759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_98780a05-532b-4692-bb85-56bbe495cfcb/init-config-reloader/0.log"
May 28 10:02:36.732649 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.732626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dq4k9_819b23d4-4d5c-46a7-8388-b74b4da84ab6/prometheus-operator/0.log"
May 28 10:02:36.756348 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.756328    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-dq4k9_819b23d4-4d5c-46a7-8388-b74b4da84ab6/kube-rbac-proxy/0.log"
May 28 10:02:36.955513 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:36.955490    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/thanos-query/0.log"
May 28 10:02:37.000807 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:37.000782    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/kube-rbac-proxy-web/0.log"
May 28 10:02:37.039360 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:37.039333    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/kube-rbac-proxy/0.log"
May 28 10:02:37.066400 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:37.066377    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/prom-label-proxy/0.log"
May 28 10:02:37.096585 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:37.096562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/kube-rbac-proxy-rules/0.log"
May 28 10:02:37.128683 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:37.128662    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f7c79b6c-xhqgz_87c77d21-f828-42d4-b3fe-4e0974848570/kube-rbac-proxy-metrics/0.log"
May 28 10:02:38.909717 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.909680    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"]
May 28 10:02:38.912901 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.912869    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:38.915320 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.915297    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wzj6\"/\"openshift-service-ca.crt\""
May 28 10:02:38.915998 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.915979    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wzj6\"/\"default-dockercfg-pftj9\""
May 28 10:02:38.915998 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.915991    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wzj6\"/\"kube-root-ca.crt\""
May 28 10:02:38.923075 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.923029    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"]
May 28 10:02:38.987111 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.987083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-podres\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:38.987291 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.987129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-proc\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:38.987291 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.987154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfqms\" (UniqueName: \"kubernetes.io/projected/618327d7-475a-4c5b-a97b-4d4ec160b761-kube-api-access-hfqms\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:38.987291 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.987244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-lib-modules\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:38.987291 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:38.987284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-sys\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088382 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088341    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfqms\" (UniqueName: \"kubernetes.io/projected/618327d7-475a-4c5b-a97b-4d4ec160b761-kube-api-access-hfqms\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088531 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088422    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-lib-modules\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088531 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088451    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-sys\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088531 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088490    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-podres\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088674 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088537    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-proc\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088674 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088564    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-sys\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088674 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088606    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-proc\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088674 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088622    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-lib-modules\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.088819 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.088687    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/618327d7-475a-4c5b-a97b-4d4ec160b761-podres\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.100792 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.100762    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfqms\" (UniqueName: \"kubernetes.io/projected/618327d7-475a-4c5b-a97b-4d4ec160b761-kube-api-access-hfqms\") pod \"perf-node-gather-daemonset-l8r54\" (UID: \"618327d7-475a-4c5b-a97b-4d4ec160b761\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.222494 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.222460    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:39.354218 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.354187    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"]
May 28 10:02:39.357329 ip-10-0-135-248 kubenswrapper[2559]: W0528 10:02:39.357296    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod618327d7_475a_4c5b_a97b_4d4ec160b761.slice/crio-8e91886404012aafb4b78ef1202463b11f87a11e31ed390c4898f892f7d98562 WatchSource:0}: Error finding container 8e91886404012aafb4b78ef1202463b11f87a11e31ed390c4898f892f7d98562: Status 404 returned error can't find the container with id 8e91886404012aafb4b78ef1202463b11f87a11e31ed390c4898f892f7d98562
May 28 10:02:39.358982 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:39.358964    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:02:40.132917 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.132878    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54" event={"ID":"618327d7-475a-4c5b-a97b-4d4ec160b761","Type":"ContainerStarted","Data":"173df37aed4175a480651e1bfedebb6bd143e189ca7f2ddb130cbbe32a0c27b4"}
May 28 10:02:40.133347 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.132924    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54" event={"ID":"618327d7-475a-4c5b-a97b-4d4ec160b761","Type":"ContainerStarted","Data":"8e91886404012aafb4b78ef1202463b11f87a11e31ed390c4898f892f7d98562"}
May 28 10:02:40.133347 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.133017    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:40.148734 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.148691    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54" podStartSLOduration=2.148678466 podStartE2EDuration="2.148678466s" podCreationTimestamp="2026-05-28 10:02:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:02:40.147720008 +0000 UTC m=+1850.821336426" watchObservedRunningTime="2026-05-28 10:02:40.148678466 +0000 UTC m=+1850.822294884"
May 28 10:02:40.156023 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.156008    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l578n_83c29454-1a98-4368-b38c-96901375e0eb/dns/0.log"
May 28 10:02:40.179900 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.179880    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l578n_83c29454-1a98-4368-b38c-96901375e0eb/kube-rbac-proxy/0.log"
May 28 10:02:40.256281 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.256228    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9gts4_957525a4-ea1c-44d7-b306-d3fcc0ae8dbd/dns-node-resolver/0.log"
May 28 10:02:40.754642 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:40.754617    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mmtfl_5dec1906-9449-4bb3-ac02-717d625bde6f/node-ca/0.log"
May 28 10:02:41.479799 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:41.479771    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ffccfcd84-vl8s7_52aac343-0f12-420a-b4a4-6ecd4a33f884/router/0.log"
May 28 10:02:41.822872 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:41.822777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j7nk2_bf749018-d6fd-4fa9-8599-3f47a1dc7620/serve-healthcheck-canary/0.log"
May 28 10:02:42.214185 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:42.214160    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rl6g_5e19347c-00df-485d-b860-5080b11007d6/kube-rbac-proxy/0.log"
May 28 10:02:42.240246 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:42.240213    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rl6g_5e19347c-00df-485d-b860-5080b11007d6/exporter/0.log"
May 28 10:02:42.265212 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:42.265187    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4rl6g_5e19347c-00df-485d-b860-5080b11007d6/extractor/0.log"
May 28 10:02:46.145262 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:46.145237    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-l8r54"
May 28 10:02:47.951009 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:47.950981    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/kube-multus-additional-cni-plugins/0.log"
May 28 10:02:47.977743 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:47.977714    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/egress-router-binary-copy/0.log"
May 28 10:02:48.007556 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.007524    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/cni-plugins/0.log"
May 28 10:02:48.042504 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.042476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/bond-cni-plugin/0.log"
May 28 10:02:48.068950 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.068916    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/routeoverride-cni/0.log"
May 28 10:02:48.096968 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.096941    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/whereabouts-cni-bincopy/0.log"
May 28 10:02:48.125598 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.125511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9wdbb_24e3aee5-12fc-402d-a7df-1392399d6c05/whereabouts-cni/0.log"
May 28 10:02:48.583303 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.583277    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vdhs5_f1e9a5df-dc69-4768-a272-119dbdc3cfa6/kube-multus/0.log"
May 28 10:02:48.667193 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.667167    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6bd26_7369f3ea-d49b-49e7-8d44-7088f4de9c42/network-metrics-daemon/0.log"
May 28 10:02:48.691926 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:48.691845    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6bd26_7369f3ea-d49b-49e7-8d44-7088f4de9c42/kube-rbac-proxy/0.log"
May 28 10:02:49.517649 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.517626    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/ovn-controller/0.log"
May 28 10:02:49.553929 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.553894    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/ovn-acl-logging/0.log"
May 28 10:02:49.579721 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.579688    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/kube-rbac-proxy-node/0.log"
May 28 10:02:49.606833 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.606808    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/kube-rbac-proxy-ovn-metrics/0.log"
May 28 10:02:49.630574 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.630550    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/northd/0.log"
May 28 10:02:49.657630 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.657608    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/nbdb/0.log"
May 28 10:02:49.684722 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.684696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/sbdb/0.log"
May 28 10:02:49.774228 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:49.774145    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hlrhk_b9df3dd9-6179-44cc-bed7-7012e7ed0390/ovnkube-controller/0.log"
May 28 10:02:51.368963 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:51.368930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f4hdh_98ef3228-ce41-4908-b1c6-8916c3658e95/network-check-target-container/0.log"
May 28 10:02:52.324340 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:52.324316    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7rsh8_30dc46e4-a552-4aa6-81fc-9fdae20ea956/iptables-alerter/0.log"
May 28 10:02:52.997633 ip-10-0-135-248 kubenswrapper[2559]: I0528 10:02:52.997607    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qfpnf_3b37a980-d2da-4e78-b685-a03abcc21f52/tuned/0.log"