May 26 21:45:05.816888 ip-10-0-138-198 systemd[1]: Starting Kubernetes Kubelet...
May 26 21:45:06.286899 ip-10-0-138-198 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:45:06.286899 ip-10-0-138-198 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 21:45:06.286899 ip-10-0-138-198 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:45:06.286899 ip-10-0-138-198 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 21:45:06.286899 ip-10-0-138-198 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 21:45:06.289549 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.289432    2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 21:45:06.293366 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293345    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:45:06.293366 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293366    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293369    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293374    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293377    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293380    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293383    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293386    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293389    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293393    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293398    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293402    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293409    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293413    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293416    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293419    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293422    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293425    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:45:06.293440 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.293428    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:45:06.295119 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295108    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:45:06.295119 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295117    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:45:06.295119 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295120    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295124    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295127    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295130    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295133    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295136    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295139    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295142    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295146    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295149    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295152    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295154    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295157    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295160    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295164    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295166    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295169    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295171    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295174    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295177    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:45:06.295206 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295180    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295183    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295186    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295189    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295192    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295195    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295198    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295200    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295203    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295205    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295209    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295212    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295214    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295217    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295220    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295223    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295226    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295228    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295231    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295234    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:45:06.295714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295236    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295239    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295241    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295244    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295246    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295251    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295255    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295258    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295260    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295263    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295266    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295268    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295271    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295274    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295277    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295280    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295282    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295286    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295288    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:45:06.296205 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295291    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295294    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295297    2559 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295300    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295302    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295305    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295750    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295756    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295759    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295762    2559 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295765    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295768    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295771    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295773    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295777    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295781    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295784    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295788    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295791    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:45:06.296686 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295794    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295797    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295800    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295803    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295806    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295809    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295812    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295815    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295818    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295821    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295824    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295827    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295829    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295832    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295834    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295837    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295839    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295842    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295844    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:45:06.297146 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295847    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295849    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295852    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295854    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295857    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295859    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295862    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295864    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295867    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295869    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295872    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295874    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295877    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295879    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295882    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295884    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295888    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295891    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295894    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295896    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:45:06.297633 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295900    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295903    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295905    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295908    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295910    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295913    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295916    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295918    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295921    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295923    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295926    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295929    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295932    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295934    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295937    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295940    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295943    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295946    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295949    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:45:06.298244 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295951    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295954    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295957    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295959    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295962    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295964    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295967    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295969    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295973    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295976    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295979    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295982    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295985    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295988    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.295991    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296674    2559 flags.go:64] FLAG: --address="0.0.0.0"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296689    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296696    2559 flags.go:64] FLAG: --anonymous-auth="true"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296701    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296707    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296711    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 21:45:06.298737 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296715    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296720    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296724    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296727    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296730    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296734    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296737    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296740    2559 flags.go:64] FLAG: --cgroup-root=""
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296743    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296746    2559 flags.go:64] FLAG: --client-ca-file=""
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296749    2559 flags.go:64] FLAG: --cloud-config=""
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296752    2559 flags.go:64] FLAG: --cloud-provider="external"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296755    2559 flags.go:64] FLAG: --cluster-dns="[]"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296760    2559 flags.go:64] FLAG: --cluster-domain=""
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296763    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296767    2559 flags.go:64] FLAG: --config-dir=""
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296770    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296774    2559 flags.go:64] FLAG: --container-log-max-files="5"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296778    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296782    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296786    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296789    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296792    2559 flags.go:64] FLAG: --contention-profiling="false"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296796    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 21:45:06.299253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296799    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296802    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296805    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296810    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296814    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296817    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296820    2559 flags.go:64] FLAG: --enable-load-reader="false"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296824    2559 flags.go:64] FLAG: --enable-server="true"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.296827    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297321    2559 flags.go:64] FLAG: --event-burst="100"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297325    2559 flags.go:64] FLAG: --event-qps="50"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297329    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297333    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297336    2559 flags.go:64] FLAG: --eviction-hard=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297340    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297343    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297346    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297349    2559 flags.go:64] FLAG: --eviction-soft=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297352    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297355    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297358    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297361    2559 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297364    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297367    2559 flags.go:64] FLAG: --fail-swap-on="true"
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297370    2559 flags.go:64] FLAG: --feature-gates=""
May 26 21:45:06.299874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297375    2559 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297378    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297381    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297385    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297388    2559 flags.go:64] FLAG: --healthz-port="10248"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297392    2559 flags.go:64] FLAG: --help="false"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297395    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-138-198.ec2.internal"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297398    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297401    2559 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297404    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297408    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297411    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297414    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297417    2559 flags.go:64] FLAG: --image-service-endpoint=""
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297420    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297425    2559 flags.go:64] FLAG: --kube-api-burst="100"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297429    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297432    2559 flags.go:64] FLAG: --kube-api-qps="50"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297435    2559 flags.go:64] FLAG: --kube-reserved=""
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297438    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297441    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297444    2559 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297447    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297450    2559 flags.go:64] FLAG: --lock-file=""
May 26 21:45:06.300474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297453    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297456    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297459    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297465    2559 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297468    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297471    2559 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297474    2559 flags.go:64] FLAG: --logging-format="text"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297478    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297481    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297484    2559 flags.go:64] FLAG: --manifest-url=""
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297487    2559 flags.go:64] FLAG: --manifest-url-header=""
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297492    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297496    2559 flags.go:64] FLAG: --max-open-files="1000000"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297501    2559 flags.go:64] FLAG: --max-pods="110"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297504    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297521    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297525    2559 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297528    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297532    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297534    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297537    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297548    2559 flags.go:64] FLAG: --node-status-max-images="50"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297551    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297555    2559 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 21:45:06.301129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297558    2559 flags.go:64] FLAG: --pod-cidr=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297561    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297567    2559 flags.go:64] FLAG: --pod-manifest-path=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297570    2559 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297574    2559 flags.go:64] FLAG: --pods-per-core="0"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297577    2559 flags.go:64] FLAG: --port="10250"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297580    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297583    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0490c704ef12ba9d2"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297586    2559 flags.go:64] FLAG: --qos-reserved=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297589    2559 flags.go:64] FLAG: --read-only-port="10255"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297592    2559 flags.go:64] FLAG: --register-node="true"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297595    2559 flags.go:64] FLAG: --register-schedulable="true"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297598    2559 flags.go:64] FLAG: --register-with-taints=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297602    2559 flags.go:64] FLAG: --registry-burst="10"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297605    2559 flags.go:64] FLAG: --registry-qps="5"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297608    2559 flags.go:64] FLAG: --reserved-cpus=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297611    2559 flags.go:64] FLAG: --reserved-memory=""
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297614    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297617    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297620    2559 flags.go:64] FLAG: --rotate-certificates="false"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297624    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297627    2559 flags.go:64] FLAG: --runonce="false"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297630    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297633    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297637    2559 flags.go:64] FLAG: --seccomp-default="false"
May 26 21:45:06.301718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297640    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297644    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297647    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297650    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297653    2559 flags.go:64] FLAG: --storage-driver-password="root"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297657    2559 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297660    2559 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297663    2559 flags.go:64] FLAG: --storage-driver-user="root"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297666    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297670    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297673    2559 flags.go:64] FLAG: --system-cgroups=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297676    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297682    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297685    2559 flags.go:64] FLAG: --tls-cert-file=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297688    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297692    2559 flags.go:64] FLAG: --tls-min-version=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297696    2559 flags.go:64] FLAG: --tls-private-key-file=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297698    2559 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297701    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297704    2559 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297708    2559 flags.go:64] FLAG: --v="2"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297713    2559 flags.go:64] FLAG: --version="false"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297717    2559 flags.go:64] FLAG: --vmodule=""
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297722    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.297725    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 21:45:06.302352 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297836    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297840    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297844    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297847    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297850    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297853    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297855    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297858    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297861    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297864    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297868    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297872    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297875    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297878    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297881    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297885    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297888    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297891    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297894    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:45:06.302964 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297897    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297899    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297902    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297905    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297907    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297910    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297913    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297915    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297918    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297920    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297923    2559 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297926    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297928    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297933    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297935    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297938    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297941    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297944    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297946    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297949    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:45:06.303427 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297951    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297954    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297957    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297959    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297962    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297964    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297967    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297969    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297972    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297975    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297979    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297981    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297984    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297986    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297989    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297991    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297994    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297997    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.297999    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298002    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:45:06.303969 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298004    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298007    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298009    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298012    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298014    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298018    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298021    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298023    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298026    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298029    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298031    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298034    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298036    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298039    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298041    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298044    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298047    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298049    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298052    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:45:06.304638 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298055    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298057    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298060    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298063    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298066    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298069    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298073    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.298076    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:45:06.305393 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.298687    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:45:06.307324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.307294    2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 21:45:06.307324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.307323    2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307380    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307386    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307389    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307393    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307396    2559 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307399    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307401    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307404    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307407    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307410    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307412    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307415    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307418    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307420    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307423    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307427    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307430    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307433    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307435    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:45:06.307460 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307438    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307441    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307443    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307446    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307449    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307451    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307454    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307456    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307459    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307463    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307467    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307470    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307473    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307476    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307479    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307481    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307484    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307486    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307489    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:45:06.308101 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307491    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307494    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307497    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307499    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307502    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307505    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307539    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307542    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307545    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307547    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307550    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307553    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307555    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307558    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307560    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307564    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307567    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307569    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307572    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307575    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:45:06.308634 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307578    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307580    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307583    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307586    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307590    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307595    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307598    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307601    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307604    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307606    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307609    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307611    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307614    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307617    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307619    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307622    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307624    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307627    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307631    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:45:06.309137 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307634    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307636    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307639    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307641    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307644    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307646    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307649    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307652    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307655    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.307661    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307764    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307769    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307772    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307775    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307778    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 21:45:06.309617 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307782    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307803    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307808    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307811    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307814    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307817    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307820    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307823    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307826    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307829    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307832    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307835    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307838    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307840    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307843    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307846    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307848    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307855    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307857    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307860    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 21:45:06.310002 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307862    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307865    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307867    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307870    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307873    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307876    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307880    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307883    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307886    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307888    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307891    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307894    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307897    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307901    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307904    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307907    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307909    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307912    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307914    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307917    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 21:45:06.310527 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307919    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307922    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307924    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307927    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307929    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307932    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307935    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307937    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307940    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307942    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307946    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307948    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307951    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307954    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307956    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307959    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307962    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307965    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307968    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307971    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 21:45:06.311028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307973    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307977    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307981    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307984    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307987    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307990    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307992    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307995    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.307998    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308000    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308003    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308005    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308008    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308010    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308013    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308015    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308018    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308020    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308023    2559 feature_gate.go:328] unrecognized feature gate: Example
May 26 21:45:06.311522 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308026    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 21:45:06.312028 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:06.308028    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 21:45:06.312028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.308033    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 21:45:06.312028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.308899    2559 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 21:45:06.312028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.311984    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 21:45:06.313101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.313087    2559 server.go:1019] "Starting client certificate rotation"
May 26 21:45:06.313227 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.313200    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 21:45:06.313286 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.313259    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 21:45:06.341863 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.341831    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 21:45:06.346128 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.346099    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 21:45:06.366701 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.366673    2559 log.go:25] "Validated CRI v1 runtime API"
May 26 21:45:06.372525 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.372488    2559 log.go:25] "Validated CRI v1 image API"
May 26 21:45:06.373157 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.373139    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 21:45:06.374030 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.374008    2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 21:45:06.378480 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.378451    2559 fs.go:135] Filesystem UUIDs: map[56926ea9-7f20-4500-b19d-2dba957e943c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ce68a3d6-0ba7-45df-9216-9504278ee399:/dev/nvme0n1p3]
May 26 21:45:06.378596 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.378477    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 21:45:06.382942 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.382808    2559 manager.go:217] Machine: {Timestamp:2026-05-26 21:45:06.38224758 +0000 UTC m=+0.442525351 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099858 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2105c36875338322bbd62f9e5fe622 SystemUUID:ec2105c3-6875-3383-22bb-d62f9e5fe622 BootID:d00f3a85-f67c-4b12-a5ac-8d880fba8a11 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:d6:d8:40:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:d6:d8:40:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:f7:52:6d:ce:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 21:45:06.383724 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.383710    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 21:45:06.383829 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.383816    2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 21:45:06.386010 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.385977    2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 21:45:06.386173 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.386012    2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 21:45:06.386220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.386184    2559 topology_manager.go:138] "Creating topology manager with none policy"
May 26 21:45:06.386220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.386192    2559 container_manager_linux.go:306] "Creating device plugin manager"
May 26 21:45:06.386220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.386201    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 21:45:06.387252 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.387239    2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 21:45:06.388841 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.388827    2559 state_mem.go:36] "Initialized new in-memory state store"
May 26 21:45:06.388973 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.388963    2559 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 21:45:06.391582 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391568    2559 kubelet.go:491] "Attempting to sync node with API server"
May 26 21:45:06.391639 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391587    2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 21:45:06.391639 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391600    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 21:45:06.391639 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391611    2559 kubelet.go:397] "Adding apiserver pod source"
May 26 21:45:06.391639 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391622    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 21:45:06.391904 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.391880    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtkvd"
May 26 21:45:06.392881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.392868    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 21:45:06.392920 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.392888    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 21:45:06.396241 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.396223    2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 21:45:06.398645 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.398630    2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 21:45:06.399247 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.399226    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtkvd"
May 26 21:45:06.400749 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400735    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400753    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400760    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400766    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400778    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400784    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 21:45:06.400791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400791    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 21:45:06.400952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400796    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 21:45:06.400952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400804    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 21:45:06.400952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400810    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 21:45:06.400952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400825    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 21:45:06.400952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.400831    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 21:45:06.401723 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.401712    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 21:45:06.401754 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.401723    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 21:45:06.405207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.405179    2559 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 21:45:06.405316 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.405223    2559 server.go:1295] "Started kubelet"
May 26 21:45:06.405378 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.405298    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 21:45:06.405428 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.405348    2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 21:45:06.405482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.405425    2559 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 21:45:06.406202 ip-10-0-138-198 systemd[1]: Started Kubernetes Kubelet.
May 26 21:45:06.409433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.408916    2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:06.409433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.409086    2559 server.go:317] "Adding debug handlers to kubelet server"
May 26 21:45:06.409433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.409285    2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 21:45:06.413788 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.413767    2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-198.ec2.internal" not found
May 26 21:45:06.414137 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.414112    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:06.416614 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.416582    2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 21:45:06.417142 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417129    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 21:45:06.417688 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417674    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 21:45:06.417872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417853    2559 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 21:45:06.417872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417871    2559 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 21:45:06.418023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417903    2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 21:45:06.418023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417983    2559 reconstruct.go:97] "Volume reconstruction finished"
May 26 21:45:06.418023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.417994    2559 reconciler.go:26] "Reconciler: start to sync state"
May 26 21:45:06.418349 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418335    2559 factory.go:55] Registering systemd factory
May 26 21:45:06.418397 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418355    2559 factory.go:223] Registration of the systemd container factory successfully
May 26 21:45:06.418597 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418576    2559 factory.go:153] Registering CRI-O factory
May 26 21:45:06.418597 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418593    2559 factory.go:223] Registration of the crio container factory successfully
May 26 21:45:06.418758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418650    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 21:45:06.418758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418670    2559 factory.go:103] Registering Raw factory
May 26 21:45:06.418758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.418682    2559 manager.go:1196] Started watching for new ooms in manager
May 26 21:45:06.418758 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.418679    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-198.ec2.internal\" not found"
May 26 21:45:06.419150 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.419059    2559 manager.go:319] Starting recovery of all containers
May 26 21:45:06.420740 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.420718    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:06.423155 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.423131    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-198.ec2.internal\" not found" node="ip-10-0-138-198.ec2.internal"
May 26 21:45:06.429769 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.429585    2559 manager.go:324] Recovery completed
May 26 21:45:06.430101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.429666    2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-198.ec2.internal" not found
May 26 21:45:06.431331 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.431302    2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 26 21:45:06.434823 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.434807    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:45:06.436876 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.436850    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:45:06.436876 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.436879    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:45:06.437003 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.436890    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasSufficientPID"
May 26 21:45:06.437416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.437392    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 21:45:06.437416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.437408    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 21:45:06.437535 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.437430    2559 state_mem.go:36] "Initialized new in-memory state store"
May 26 21:45:06.440611 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.440587    2559 policy_none.go:49] "None policy: Start"
May 26 21:45:06.440671 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.440617    2559 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 21:45:06.440671 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.440628    2559 state_mem.go:35] "Initializing new in-memory state store"
May 26 21:45:06.480219 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480196    2559 manager.go:341] "Starting Device Plugin manager"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.480235    2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480244    2559 server.go:85] "Starting device plugin registration server"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480498    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480522    2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480705    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480790    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.480798    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.481497    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.481547    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-198.ec2.internal\" not found"
May 26 21:45:06.494854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.486807    2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-198.ec2.internal" not found
May 26 21:45:06.552072 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.551977    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 21:45:06.553208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.553187    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 21:45:06.553208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.553210    2559 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 21:45:06.553400 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.553231    2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 21:45:06.553400 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.553238    2559 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 21:45:06.553400 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:06.553278    2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 21:45:06.556917 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.556898    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:06.580907 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.580881    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 21:45:06.582060 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.582041    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasSufficientMemory"
May 26 21:45:06.582157 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.582073    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasNoDiskPressure"
May 26 21:45:06.582157 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.582083    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeHasSufficientPID"
May 26 21:45:06.582157 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.582108    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-198.ec2.internal"
May 26 21:45:06.591185 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.591161    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-198.ec2.internal"
May 26 21:45:06.654352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.654312    2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"]
May 26 21:45:06.656946 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.656924    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.657037 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.656925    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.682576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.682546    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.687161 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.687142    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.693580 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.693560    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 21:45:06.698755 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.698741    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 21:45:06.719769 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.719731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.819972 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.819893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.819972 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.819932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.819972 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.819965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16d4d4b13ae84244d7a2ba53d2b60ff8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-198.ec2.internal\" (UID: \"16d4d4b13ae84244d7a2ba53d2b60ff8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.820183 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.820003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.920750 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.920712    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.920750 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.920728    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/445c2539f33b6ea94c72c5c0ebce62b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal\" (UID: \"445c2539f33b6ea94c72c5c0ebce62b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.920935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.920776    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16d4d4b13ae84244d7a2ba53d2b60ff8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-198.ec2.internal\" (UID: \"16d4d4b13ae84244d7a2ba53d2b60ff8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.920935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.920814    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16d4d4b13ae84244d7a2ba53d2b60ff8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-198.ec2.internal\" (UID: \"16d4d4b13ae84244d7a2ba53d2b60ff8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:06.996833 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:06.996798    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal"
May 26 21:45:07.001307 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.001284    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"
May 26 21:45:07.313039 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.312995    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 21:45:07.313836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.313145    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 21:45:07.313836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.313145    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 21:45:07.313836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.313162    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 21:45:07.392129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.392093    2559 apiserver.go:52] "Watching apiserver"
May 26 21:45:07.400325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.400290    2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 21:45:07.400634 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.400612    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-m2j8v","openshift-ovn-kubernetes/ovnkube-node-scdhw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9","openshift-dns/node-resolver-szvf5","openshift-multus/multus-2chxj","openshift-multus/multus-additional-cni-plugins-wtlr9","openshift-multus/network-metrics-daemon-zh76m","openshift-network-operator/iptables-alerter-g2q4c","kube-system/konnectivity-agent-6j2hg","kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pfdn2","openshift-image-registry/node-ca-x8pxf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal"]
May 26 21:45:07.401139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.401099    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 21:40:06 +0000 UTC" deadline="2028-02-11 10:57:53.509221134 +0000 UTC"
May 26 21:45:07.401197 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.401140    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15013h12m46.108084635s"
May 26 21:45:07.401936 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.401920    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:07.402021 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.402000    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:07.403002 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.402984    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.404392 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.404373    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.405388 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.405364    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvdhb\""
May 26 21:45:07.405628 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.405586    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.408413 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408385    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 21:45:07.408590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408483    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 21:45:07.408590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408504    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 21:45:07.408590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408545    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 21:45:07.408758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408613    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 21:45:07.408758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408613    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s7gzh\""
May 26 21:45:07.408758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408643    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 21:45:07.408758 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408611    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 21:45:07.408923 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.408893    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2chxj"
May 26 21:45:07.409588 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.409287    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 21:45:07.409588 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.409403    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 21:45:07.409588 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.409473    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rrcbv\""
May 26 21:45:07.409765 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.409630    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 21:45:07.409765 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.409680    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 21:45:07.411287 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.411262    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.411627 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.411610    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 21:45:07.411825 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.411806    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 21:45:07.411825 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.411818    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 21:45:07.412023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.411919    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 21:45:07.412367 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.412351    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-86wbn\""
May 26 21:45:07.412819 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.412801    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.412926 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.412903    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:07.413987 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.413949    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 21:45:07.413987 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.413963    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kr5xw\""
May 26 21:45:07.414169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.413986    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 21:45:07.414439 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.414412    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.415838 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.415821    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.416895 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.416879    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 21:45:07.416978 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.416932    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nk85c\""
May 26 21:45:07.417193 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.417177    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.417376 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.417357    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 21:45:07.417956 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.417938    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 21:45:07.418058 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.417974    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 21:45:07.418315 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.418299    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.420800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.420738    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 21:45:07.420872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.420797    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 21:45:07.420872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.420817    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rsh8x\""
May 26 21:45:07.420979 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.420874    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tsqcc\""
May 26 21:45:07.421066 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.421053    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 21:45:07.421351 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.421335    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 21:45:07.421700 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.421684    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 21:45:07.421881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.421862    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 21:45:07.421976 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.421963    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6vz7\""
May 26 21:45:07.422458 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.422441    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 21:45:07.422906 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.422884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xx9\" (UniqueName: \"kubernetes.io/projected/92a5cbc6-9a68-4458-87c9-cbd779ce5825-kube-api-access-p6xx9\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.422983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.422922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.422983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.422942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-sys-fs\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.423087 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.422996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-host\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423087 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-env-overrides\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423087 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2c4\" (UniqueName: \"kubernetes.io/projected/650f3896-9729-45d3-9539-4c0f5b642861-kube-api-access-jp2c4\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-sys\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-var-lib-kubelet\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-hostroot\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-systemd-units\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9102bd27-7108-4126-9919-da77752a8355-agent-certs\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-systemd\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423250 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/659313aa-8cc9-496c-998a-ac6f8cc65dd1-hosts-file\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gd7c\" (UniqueName: \"kubernetes.io/projected/659313aa-8cc9-496c-998a-ac6f8cc65dd1-kube-api-access-4gd7c\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-ovn\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmqf\" (UniqueName: \"kubernetes.io/projected/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kube-api-access-wpmqf\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-conf\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-run\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrpr\" (UniqueName: \"kubernetes.io/projected/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-kube-api-access-vxrpr\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.423498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-node-log\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-config\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-cni-binary-copy\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-etc-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-script-lib\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-device-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysconfig\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-tuned\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.423800 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-system-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-bin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-bin\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-socket-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423911    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-registration-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-kubernetes\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-cnibin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.423974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgw5p\" (UniqueName: \"kubernetes.io/projected/74ad8b6e-01f2-489c-a196-2aa387895095-kube-api-access-cgw5p\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cnibin\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f3896-9729-45d3-9539-4c0f5b642861-iptables-alerter-script\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-slash\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-netd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-serviceca\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-lib-modules\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.424259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5nxb\" (UniqueName: \"kubernetes.io/projected/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-kube-api-access-z5nxb\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-socket-dir-parent\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-conf-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-etc-kubernetes\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3896-9729-45d3-9539-4c0f5b642861-host-slash\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-kubelet\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-multus-daemon-config\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-os-release\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-kubelet\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-netns\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-systemd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovn-node-metrics-cert\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9102bd27-7108-4126-9919-da77752a8355-konnectivity-ca\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-system-cni-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-var-lib-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-multus-certs\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.424918 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-host\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424660    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-os-release\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrhd\" (UniqueName: \"kubernetes.io/projected/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-kube-api-access-qfrhd\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-tmp\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659313aa-8cc9-496c-998a-ac6f8cc65dd1-tmp-dir\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-k8s-cni-cncf-io\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-netns\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-multus\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9k2c\" (UniqueName: \"kubernetes.io/projected/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-kube-api-access-p9k2c\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-log-socket\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-modprobe-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.425409 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.424917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:07.427283 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.427262    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 21:45:07.458410 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.458381    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4bqlv"
May 26 21:45:07.466195 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.466166    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4bqlv"
May 26 21:45:07.518760 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.518740    2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 21:45:07.525252 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525228    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.525353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525264    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-ovn\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525292    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmqf\" (UniqueName: \"kubernetes.io/projected/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kube-api-access-wpmqf\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.525353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525318    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-conf\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.525353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525340    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-run\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525366    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525388    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525340    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-ovn\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525394    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrpr\" (UniqueName: \"kubernetes.io/projected/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-kube-api-access-vxrpr\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-run\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525440    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-node-log\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525452    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-conf\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.525536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525475    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-node-log\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525822 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.525557    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:07.525822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525559    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525822 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.525659    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:08.02561405 +0000 UTC m=+2.085891822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:07.525822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.525822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525725    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-config\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525819    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-cni-binary-copy\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-etc-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525862    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-script-lib\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525928    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-etc-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525968    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.525994    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-device-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526012    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysconfig\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526053    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysconfig\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526052    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-tuned\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526082    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-system-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526088    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-device-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526099    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-bin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526135    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526146    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-system-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526164    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-bin\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526139    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-bin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526211    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-socket-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526212    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-config\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-bin\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526275    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-registration-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526297    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-kubernetes\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526315    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-socket-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526331    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-cnibin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.526433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526355    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgw5p\" (UniqueName: \"kubernetes.io/projected/74ad8b6e-01f2-489c-a196-2aa387895095-kube-api-access-cgw5p\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526369    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-registration-dir\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526380    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cnibin\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-kubernetes\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526408    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f3896-9729-45d3-9539-4c0f5b642861-iptables-alerter-script\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526384    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526424    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-cnibin\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526436    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-cni-binary-copy\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526455    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cnibin\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526483    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-slash\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526501    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-netd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovnkube-script-lib\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526538    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-serviceca\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526563    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526581    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-slash\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526589    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-lib-modules\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526593    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-cni-netd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526635    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5nxb\" (UniqueName: \"kubernetes.io/projected/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-kube-api-access-z5nxb\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.527191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526659    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-socket-dir-parent\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526681    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-conf-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526713    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526705    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-etc-kubernetes\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526722    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-lib-modules\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-sysctl-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526766    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-socket-dir-parent\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526767    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-etc-kubernetes\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526766    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3896-9729-45d3-9539-4c0f5b642861-host-slash\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526808    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-kubelet\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-conf-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526827    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-multus-daemon-config\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526851    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-os-release\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526853    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3896-9729-45d3-9539-4c0f5b642861-host-slash\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526888    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-kubelet\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526914    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-os-release\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526917    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-kubelet\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526936    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650f3896-9729-45d3-9539-4c0f5b642861-iptables-alerter-script\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.528028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526944    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-netns\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526957    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-kubelet\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526971    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-systemd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.526989    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-netns\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527025    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovn-node-metrics-cert\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527056    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-systemd\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527097    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9102bd27-7108-4126-9919-da77752a8355-konnectivity-ca\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527131    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-system-cni-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527155    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-var-lib-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527167    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-serviceca\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527178    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-multus-certs\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527205    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527221    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-system-cni-dir\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527234    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527258    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-host\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527279    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-multus-certs\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527283    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.528875 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527322    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-run-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527325    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-var-lib-openvswitch\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527322    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74ad8b6e-01f2-489c-a196-2aa387895095-multus-daemon-config\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-host\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527620    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9102bd27-7108-4126-9919-da77752a8355-konnectivity-ca\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527669    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-os-release\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527696    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrhd\" (UniqueName: \"kubernetes.io/projected/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-kube-api-access-qfrhd\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527721    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527745    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-tmp\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527765    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-os-release\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527768    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659313aa-8cc9-496c-998a-ac6f8cc65dd1-tmp-dir\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527809    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527813    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-k8s-cni-cncf-io\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527844    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-k8s-cni-cncf-io\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-host-run-ovn-kubernetes\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527917    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-netns\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527945    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-multus\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.529715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527952    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-run-netns\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.527984    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9k2c\" (UniqueName: \"kubernetes.io/projected/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-kube-api-access-p9k2c\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528011    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-log-socket\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528036    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-modprobe-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528037    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659313aa-8cc9-496c-998a-ac6f8cc65dd1-tmp-dir\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528088    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528099    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-log-socket\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528119    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xx9\" (UniqueName: \"kubernetes.io/projected/92a5cbc6-9a68-4458-87c9-cbd779ce5825-kube-api-access-p6xx9\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528149    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528234    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-host-var-lib-cni-multus\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528358    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-sys-fs\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528405    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-host\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528379    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-modprobe-d\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528430    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-env-overrides\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528458    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2c4\" (UniqueName: \"kubernetes.io/projected/650f3896-9729-45d3-9539-4c0f5b642861-kube-api-access-jp2c4\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-sys-fs\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.530550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528481    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-sys\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528542    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-var-lib-kubelet\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528566    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-hostroot\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528590    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-systemd-units\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528622    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9102bd27-7108-4126-9919-da77752a8355-agent-certs\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528673    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-host\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528709    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-systemd\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528738    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/659313aa-8cc9-496c-998a-ac6f8cc65dd1-hosts-file\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528764    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gd7c\" (UniqueName: \"kubernetes.io/projected/659313aa-8cc9-496c-998a-ac6f8cc65dd1-kube-api-access-4gd7c\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528792    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528876    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-multus-cni-dir\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528875    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92a5cbc6-9a68-4458-87c9-cbd779ce5825-env-overrides\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528948    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-var-lib-kubelet\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528991    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-sys\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.528992    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/659313aa-8cc9-496c-998a-ac6f8cc65dd1-hosts-file\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.529020    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92a5cbc6-9a68-4458-87c9-cbd779ce5825-systemd-units\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.529072    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74ad8b6e-01f2-489c-a196-2aa387895095-hostroot\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.529131    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-systemd\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.531323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.530233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-etc-tuned\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.532025 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.530366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92a5cbc6-9a68-4458-87c9-cbd779ce5825-ovn-node-metrics-cert\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.532025 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.530686    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-tmp\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.532025 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.531608    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9102bd27-7108-4126-9919-da77752a8355-agent-certs\") pod \"konnectivity-agent-6j2hg\" (UID: \"9102bd27-7108-4126-9919-da77752a8355\") " pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.533095 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.533065    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445c2539f33b6ea94c72c5c0ebce62b4.slice/crio-b2f05df9e5d3b5d4b674dbaa00cac982cb8286c664b80c529a99a6c812b16231 WatchSource:0}: Error finding container b2f05df9e5d3b5d4b674dbaa00cac982cb8286c664b80c529a99a6c812b16231: Status 404 returned error can't find the container with id b2f05df9e5d3b5d4b674dbaa00cac982cb8286c664b80c529a99a6c812b16231
May 26 21:45:07.533416 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.533392    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d4d4b13ae84244d7a2ba53d2b60ff8.slice/crio-929380cfbfcbf96bce9ec731d2b3f4b26f9c2403279b5b3e7965da0cacf868de WatchSource:0}: Error finding container 929380cfbfcbf96bce9ec731d2b3f4b26f9c2403279b5b3e7965da0cacf868de: Status 404 returned error can't find the container with id 929380cfbfcbf96bce9ec731d2b3f4b26f9c2403279b5b3e7965da0cacf868de
May 26 21:45:07.534708 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.534602    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrpr\" (UniqueName: \"kubernetes.io/projected/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-kube-api-access-vxrpr\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:07.534708 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.534642    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmqf\" (UniqueName: \"kubernetes.io/projected/d1bdb142-4f11-4a7f-8f26-e3166e88a4e6-kube-api-access-wpmqf\") pod \"aws-ebs-csi-driver-node-mghn9\" (UID: \"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.534907 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.534748    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:07.534907 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.534766    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:07.534907 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.534795    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:07.534907 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:07.534851    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:08.034832382 +0000 UTC m=+2.095110157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:07.536207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.536169    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5nxb\" (UniqueName: \"kubernetes.io/projected/a2e1fb91-0b41-4d03-bef5-a1362ab2bc45-kube-api-access-z5nxb\") pod \"tuned-pfdn2\" (UID: \"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.537298 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.537173    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrhd\" (UniqueName: \"kubernetes.io/projected/b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3-kube-api-access-qfrhd\") pod \"node-ca-x8pxf\" (UID: \"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3\") " pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.537298 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.537254    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gd7c\" (UniqueName: \"kubernetes.io/projected/659313aa-8cc9-496c-998a-ac6f8cc65dd1-kube-api-access-4gd7c\") pod \"node-resolver-szvf5\" (UID: \"659313aa-8cc9-496c-998a-ac6f8cc65dd1\") " pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.537703 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.537683    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgw5p\" (UniqueName: \"kubernetes.io/projected/74ad8b6e-01f2-489c-a196-2aa387895095-kube-api-access-cgw5p\") pod \"multus-2chxj\" (UID: \"74ad8b6e-01f2-489c-a196-2aa387895095\") " pod="openshift-multus/multus-2chxj"
May 26 21:45:07.537961 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.537922    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2c4\" (UniqueName: \"kubernetes.io/projected/650f3896-9729-45d3-9539-4c0f5b642861-kube-api-access-jp2c4\") pod \"iptables-alerter-g2q4c\" (UID: \"650f3896-9729-45d3-9539-4c0f5b642861\") " pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.538058 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.538017    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:45:07.538399 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.538375    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9k2c\" (UniqueName: \"kubernetes.io/projected/66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd-kube-api-access-p9k2c\") pod \"multus-additional-cni-plugins-wtlr9\" (UID: \"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd\") " pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.538492 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.538429    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xx9\" (UniqueName: \"kubernetes.io/projected/92a5cbc6-9a68-4458-87c9-cbd779ce5825-kube-api-access-p6xx9\") pod \"ovnkube-node-scdhw\" (UID: \"92a5cbc6-9a68-4458-87c9-cbd779ce5825\") " pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.556194 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.556161    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfdn2"
May 26 21:45:07.556791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.556730    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal" event={"ID":"445c2539f33b6ea94c72c5c0ebce62b4","Type":"ContainerStarted","Data":"b2f05df9e5d3b5d4b674dbaa00cac982cb8286c664b80c529a99a6c812b16231"}
May 26 21:45:07.558636 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.558608    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal" event={"ID":"16d4d4b13ae84244d7a2ba53d2b60ff8","Type":"ContainerStarted","Data":"929380cfbfcbf96bce9ec731d2b3f4b26f9c2403279b5b3e7965da0cacf868de"}
May 26 21:45:07.561600 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.561585    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x8pxf"
May 26 21:45:07.563796 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.563740    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e1fb91_0b41_4d03_bef5_a1362ab2bc45.slice/crio-c410cabf6fa520d93c310769c182b666f27abdaeaf698abed2857131d7b7b429 WatchSource:0}: Error finding container c410cabf6fa520d93c310769c182b666f27abdaeaf698abed2857131d7b7b429: Status 404 returned error can't find the container with id c410cabf6fa520d93c310769c182b666f27abdaeaf698abed2857131d7b7b429
May 26 21:45:07.569861 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.569836    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cdc66e_8aae_4be5_a8a7_66a6c45f63a3.slice/crio-cae5469dc0b9ef50bf6b4ecdfb00d306ae2167eff5bc5c3e907f0dec3e6186ad WatchSource:0}: Error finding container cae5469dc0b9ef50bf6b4ecdfb00d306ae2167eff5bc5c3e907f0dec3e6186ad: Status 404 returned error can't find the container with id cae5469dc0b9ef50bf6b4ecdfb00d306ae2167eff5bc5c3e907f0dec3e6186ad
May 26 21:45:07.735486 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.735451    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:07.741975 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.741948    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a5cbc6_9a68_4458_87c9_cbd779ce5825.slice/crio-a0c2e4e2ff3017dcd21f4802252e57034635a15b1c70bc38f2c1857be22fac2c WatchSource:0}: Error finding container a0c2e4e2ff3017dcd21f4802252e57034635a15b1c70bc38f2c1857be22fac2c: Status 404 returned error can't find the container with id a0c2e4e2ff3017dcd21f4802252e57034635a15b1c70bc38f2c1857be22fac2c
May 26 21:45:07.754943 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.754914    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9"
May 26 21:45:07.761646 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.761618    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bdb142_4f11_4a7f_8f26_e3166e88a4e6.slice/crio-0195fe2fff3862f5bc401a2c4cd588455554566e0f3d08e94e72ed2d78578965 WatchSource:0}: Error finding container 0195fe2fff3862f5bc401a2c4cd588455554566e0f3d08e94e72ed2d78578965: Status 404 returned error can't find the container with id 0195fe2fff3862f5bc401a2c4cd588455554566e0f3d08e94e72ed2d78578965
May 26 21:45:07.774952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.774925    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-szvf5"
May 26 21:45:07.780960 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.780931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659313aa_8cc9_496c_998a_ac6f8cc65dd1.slice/crio-97d6aac8cd54f1850add6c626ae745f9683ba2a952d7457e4036d602551f8ef0 WatchSource:0}: Error finding container 97d6aac8cd54f1850add6c626ae745f9683ba2a952d7457e4036d602551f8ef0: Status 404 returned error can't find the container with id 97d6aac8cd54f1850add6c626ae745f9683ba2a952d7457e4036d602551f8ef0
May 26 21:45:07.786858 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.786834    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2chxj"
May 26 21:45:07.792737 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.792713    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ad8b6e_01f2_489c_a196_2aa387895095.slice/crio-f3e034e3392d4e572e561fc9534021c9dc0f8ea83661fac0143ce867311eab7d WatchSource:0}: Error finding container f3e034e3392d4e572e561fc9534021c9dc0f8ea83661fac0143ce867311eab7d: Status 404 returned error can't find the container with id f3e034e3392d4e572e561fc9534021c9dc0f8ea83661fac0143ce867311eab7d
May 26 21:45:07.802629 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.802599    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wtlr9"
May 26 21:45:07.809190 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.809167    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ebf775_aa1b_4b1d_9e63_e17a8f8c61dd.slice/crio-2b00d7e10afcb463c16f871b521d228915e32ea4a1f2c74b6b3e9f35512c4a14 WatchSource:0}: Error finding container 2b00d7e10afcb463c16f871b521d228915e32ea4a1f2c74b6b3e9f35512c4a14: Status 404 returned error can't find the container with id 2b00d7e10afcb463c16f871b521d228915e32ea4a1f2c74b6b3e9f35512c4a14
May 26 21:45:07.814302 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.814248    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2q4c"
May 26 21:45:07.820714 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.820691    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650f3896_9729_45d3_9539_4c0f5b642861.slice/crio-9dc94024352b9f9e75d7df8a03c6206ef96aec8e7b04a1b0875de9d5ac1f93ba WatchSource:0}: Error finding container 9dc94024352b9f9e75d7df8a03c6206ef96aec8e7b04a1b0875de9d5ac1f93ba: Status 404 returned error can't find the container with id 9dc94024352b9f9e75d7df8a03c6206ef96aec8e7b04a1b0875de9d5ac1f93ba
May 26 21:45:07.822356 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:07.822340    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:07.829003 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:45:07.828976    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9102bd27_7108_4126_9919_da77752a8355.slice/crio-ee679b79591cbc525e82459271b093ba5061b5ff344e4a4bf71a4d8349f2c58a WatchSource:0}: Error finding container ee679b79591cbc525e82459271b093ba5061b5ff344e4a4bf71a4d8349f2c58a: Status 404 returned error can't find the container with id ee679b79591cbc525e82459271b093ba5061b5ff344e4a4bf71a4d8349f2c58a
May 26 21:45:08.032461 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.032420    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:08.032660 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.032620    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:08.032727 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.032681    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:09.032662311 +0000 UTC m=+3.092940070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:08.133780 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.133740    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:08.133964 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.133944    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:08.134037 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.133969    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:08.134037 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.133984    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:08.134149 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:08.134051    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:09.134028773 +0000 UTC m=+3.194306545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:08.467260 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.466926    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 21:40:07 +0000 UTC" deadline="2028-03-11 12:17:03.515017572 +0000 UTC"
May 26 21:45:08.467260 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.467199    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15710h31m55.047823705s"
May 26 21:45:08.523735 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.523367    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:08.586693 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.586600    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6j2hg" event={"ID":"9102bd27-7108-4126-9919-da77752a8355","Type":"ContainerStarted","Data":"ee679b79591cbc525e82459271b093ba5061b5ff344e4a4bf71a4d8349f2c58a"}
May 26 21:45:08.589252 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.589186    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-szvf5" event={"ID":"659313aa-8cc9-496c-998a-ac6f8cc65dd1","Type":"ContainerStarted","Data":"97d6aac8cd54f1850add6c626ae745f9683ba2a952d7457e4036d602551f8ef0"}
May 26 21:45:08.605811 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.605716    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9" event={"ID":"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6","Type":"ContainerStarted","Data":"0195fe2fff3862f5bc401a2c4cd588455554566e0f3d08e94e72ed2d78578965"}
May 26 21:45:08.622898 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.622822    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x8pxf" event={"ID":"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3","Type":"ContainerStarted","Data":"cae5469dc0b9ef50bf6b4ecdfb00d306ae2167eff5bc5c3e907f0dec3e6186ad"}
May 26 21:45:08.633950 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.633861    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2q4c" event={"ID":"650f3896-9729-45d3-9539-4c0f5b642861","Type":"ContainerStarted","Data":"9dc94024352b9f9e75d7df8a03c6206ef96aec8e7b04a1b0875de9d5ac1f93ba"}
May 26 21:45:08.653172 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.653130    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerStarted","Data":"2b00d7e10afcb463c16f871b521d228915e32ea4a1f2c74b6b3e9f35512c4a14"}
May 26 21:45:08.669402 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.669371    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:08.673183 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.673146    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2chxj" event={"ID":"74ad8b6e-01f2-489c-a196-2aa387895095","Type":"ContainerStarted","Data":"f3e034e3392d4e572e561fc9534021c9dc0f8ea83661fac0143ce867311eab7d"}
May 26 21:45:08.686360 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.686321    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"a0c2e4e2ff3017dcd21f4802252e57034635a15b1c70bc38f2c1857be22fac2c"}
May 26 21:45:08.704579 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.704480    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfdn2" event={"ID":"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45","Type":"ContainerStarted","Data":"c410cabf6fa520d93c310769c182b666f27abdaeaf698abed2857131d7b7b429"}
May 26 21:45:08.919602 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:08.919332    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 21:45:09.042690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.042524    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:09.042690 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.042693    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:09.042926 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.042756    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:11.042737106 +0000 UTC m=+5.103014880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:09.143936 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.143898    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:09.144177 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.144094    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:09.144177 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.144115    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:09.144177 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.144127    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:09.144420 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.144199    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:11.144178108 +0000 UTC m=+5.204455882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:09.468471 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.468309    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 21:40:07 +0000 UTC" deadline="2027-11-21 16:11:18.375012837 +0000 UTC"
May 26 21:45:09.468471 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.468348    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13050h26m8.906668832s"
May 26 21:45:09.555070 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.554326    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:09.555070 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.554456    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:09.555070 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:09.554890    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:09.555070 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:09.555019    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:11.062254 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:11.062107    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:11.062254 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.062259    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:11.062803 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.062328    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:15.062309113 +0000 UTC m=+9.122586871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:11.163426 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:11.163387    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:11.163653 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.163565    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:11.163653 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.163592    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:11.163653 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.163605    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:11.163808 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.163667    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:15.163647496 +0000 UTC m=+9.223925268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:11.553927 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:11.553894    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:11.554115 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.554033    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:11.554572 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:11.554412    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:11.554572 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:11.554526    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:13.554413 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:13.554376    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:13.554913 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:13.554534    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:13.554913 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:13.554693    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:13.554913 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:13.554807    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:15.099844 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:15.099798    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:15.100318 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.099969    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:15.100318 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.100050    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.100027724 +0000 UTC m=+17.160305495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:15.200794 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:15.200752    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:15.200993 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.200916    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:15.200993 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.200935    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:15.200993 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.200947    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:15.201152 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.201007    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:23.200987604 +0000 UTC m=+17.261265379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:15.554318 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:15.554280    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:15.554530 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.554425    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:15.554614 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:15.554533    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:15.554676 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:15.554627    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:17.553740 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:17.553712    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:17.554181 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:17.553718    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:17.554181 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:17.553823    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:17.554181 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:17.553944    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:19.554397 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:19.554324    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:19.554857 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:19.554470    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:19.554857 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:19.554535    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:19.554857 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:19.554636    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:21.553481 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:21.553444    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:21.553952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:21.553444    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:21.553952 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:21.553611    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:21.553952 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:21.553657    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:23.160819 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:23.160769    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:23.161241 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.160923    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:23.161241 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.161004    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:45:39.160984161 +0000 UTC m=+33.221261923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:23.262068 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:23.262032    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:23.262263 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.262178    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:23.262263 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.262198    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:23.262263 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.262212    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:23.262390 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.262279    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:39.262258477 +0000 UTC m=+33.322536236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:23.554027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:23.553988    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:23.554200 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:23.554033    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:23.554200 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.554146    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:23.554335 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:23.554244    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:25.553473 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:25.553430    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:25.553937 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:25.553600    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:25.553937 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:25.553630    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:25.553937 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:25.553760    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:27.553846 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.553536    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:27.554741 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.553536    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:27.554741 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:27.553941    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:27.554741 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:27.554052    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:27.745162 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.745124    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="36797c254156e8cdfbbe57bc8db58181c29ecfba1b81a3147a8be21196bc2993" exitCode=0
May 26 21:45:27.745345 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.745206    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"36797c254156e8cdfbbe57bc8db58181c29ecfba1b81a3147a8be21196bc2993"}
May 26 21:45:27.746795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.746587    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2chxj" event={"ID":"74ad8b6e-01f2-489c-a196-2aa387895095","Type":"ContainerStarted","Data":"6ed3b37c5b6e79b1b2417dda9fb6ef3af20bb18dc004f595831d417cac6f05b3"}
May 26 21:45:27.749344 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749323    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"571651be908d5282137196029d6013ac9a94ae55057f85040fe1afbad6ba6408"}
May 26 21:45:27.749419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749353    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"96b98f8a69261a301fb1cc102f964a9040dbfec5d6da4e1b9d4fd33281f88800"}
May 26 21:45:27.749419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749368    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"5cce997aa47db26f80a19147913630ce6ee7b416c5773c3019c3b9765d776ea5"}
May 26 21:45:27.749419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749378    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"d7ece6c17a2e58a13a2c453614374443f27814ec4dcee7485d3402753b315081"}
May 26 21:45:27.749419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749386    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"e3a6f128a80d36960d158c34fe47c4be30d84b798805df69949323efa31dbffb"}
May 26 21:45:27.749419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.749394    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"e4d55b04c07ecc57201534bc620fd4e50acb6b5c9d070b405de71f3e9190ec95"}
May 26 21:45:27.750544 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.750503    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfdn2" event={"ID":"a2e1fb91-0b41-4d03-bef5-a1362ab2bc45","Type":"ContainerStarted","Data":"2710a31afe7a1cd355459940eacfd3028096c884b1054e1d49a84b1d8813dbec"}
May 26 21:45:27.751662 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.751636    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal" event={"ID":"16d4d4b13ae84244d7a2ba53d2b60ff8","Type":"ContainerStarted","Data":"62427e0951e3f4a1789b2dde21050ac6ce7a5cf2c371afb697b9a2fdfb1cea88"}
May 26 21:45:27.752944 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.752921    2559 generic.go:358] "Generic (PLEG): container finished" podID="445c2539f33b6ea94c72c5c0ebce62b4" containerID="b15a8fe3a4a62eb1d1a3902eba3b8d38815b24288b50a9fca561706129b30eb7" exitCode=0
May 26 21:45:27.753031 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.752999    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal" event={"ID":"445c2539f33b6ea94c72c5c0ebce62b4","Type":"ContainerDied","Data":"b15a8fe3a4a62eb1d1a3902eba3b8d38815b24288b50a9fca561706129b30eb7"}
May 26 21:45:27.754241 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.754221    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6j2hg" event={"ID":"9102bd27-7108-4126-9919-da77752a8355","Type":"ContainerStarted","Data":"b3a082ca7b621f9f52517822b44e7d81dd39aa2149f44efb41dee14b870881e0"}
May 26 21:45:27.755387 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.755361    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-szvf5" event={"ID":"659313aa-8cc9-496c-998a-ac6f8cc65dd1","Type":"ContainerStarted","Data":"8ea0b49c0d3f25fa95315942f245c78fb53c5c16faa1a4a456cee3436d7bbd5b"}
May 26 21:45:27.756559 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.756538    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9" event={"ID":"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6","Type":"ContainerStarted","Data":"888bb43c91f78dd32c6663b0858259d57bd2624e5e182ba047de3b7eb685e7fd"}
May 26 21:45:27.757898 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.757876    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x8pxf" event={"ID":"b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3","Type":"ContainerStarted","Data":"dd86be9d5342edc2269d0db3b5ac2d84360a2b379a4f96fa136946d4f5a7d01c"}
May 26 21:45:27.782036 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.781979    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-szvf5" podStartSLOduration=2.940602739 podStartE2EDuration="21.781963462s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.782398992 +0000 UTC m=+1.842676749" lastFinishedPulling="2026-05-26 21:45:26.623759694 +0000 UTC m=+20.684037472" observedRunningTime="2026-05-26 21:45:27.781669237 +0000 UTC m=+21.841947017" watchObservedRunningTime="2026-05-26 21:45:27.781963462 +0000 UTC m=+21.842241244"
May 26 21:45:27.800685 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.800627    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6j2hg" podStartSLOduration=3.007537977 podStartE2EDuration="21.800607272s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.830602641 +0000 UTC m=+1.890880399" lastFinishedPulling="2026-05-26 21:45:26.623671937 +0000 UTC m=+20.683949694" observedRunningTime="2026-05-26 21:45:27.79981901 +0000 UTC m=+21.860096791" watchObservedRunningTime="2026-05-26 21:45:27.800607272 +0000 UTC m=+21.860885049"
May 26 21:45:27.832447 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.832395    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2chxj" podStartSLOduration=2.578446487 podStartE2EDuration="21.832380459s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.794344248 +0000 UTC m=+1.854622006" lastFinishedPulling="2026-05-26 21:45:27.048278203 +0000 UTC m=+21.108555978" observedRunningTime="2026-05-26 21:45:27.832198314 +0000 UTC m=+21.892476095" watchObservedRunningTime="2026-05-26 21:45:27.832380459 +0000 UTC m=+21.892658238"
May 26 21:45:27.848980 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.848926    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pfdn2" podStartSLOduration=2.751235192 podStartE2EDuration="21.848906525s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.565603204 +0000 UTC m=+1.625880967" lastFinishedPulling="2026-05-26 21:45:26.663274526 +0000 UTC m=+20.723552300" observedRunningTime="2026-05-26 21:45:27.848729959 +0000 UTC m=+21.909007739" watchObservedRunningTime="2026-05-26 21:45:27.848906525 +0000 UTC m=+21.909184306"
May 26 21:45:27.866559 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:27.866494    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x8pxf" podStartSLOduration=2.814291429 podStartE2EDuration="21.866474819s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.571405385 +0000 UTC m=+1.631683143" lastFinishedPulling="2026-05-26 21:45:26.62358877 +0000 UTC m=+20.683866533" observedRunningTime="2026-05-26 21:45:27.865990784 +0000 UTC m=+21.926268565" watchObservedRunningTime="2026-05-26 21:45:27.866474819 +0000 UTC m=+21.926752601"
May 26 21:45:28.690735 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.690681    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 21:45:28.761946 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.761904    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal" event={"ID":"445c2539f33b6ea94c72c5c0ebce62b4","Type":"ContainerStarted","Data":"eb59c1bd2d20ab902c31a173dd816eff13f27ce751470ebbfcd0c4332940f2f3"}
May 26 21:45:28.763799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.763761    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9" event={"ID":"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6","Type":"ContainerStarted","Data":"233f07e741718573c7f16c382c12a31dd9871dc63480321a5b3e71a34f196afe"}
May 26 21:45:28.765735 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.765233    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2q4c" event={"ID":"650f3896-9729-45d3-9539-4c0f5b642861","Type":"ContainerStarted","Data":"5a0c9a61186f1cc85e3740af6a47b297f32bfcb741728ed3af9a22b7140b3806"}
May 26 21:45:28.777102 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.777045    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-198.ec2.internal" podStartSLOduration=22.777028602 podStartE2EDuration="22.777028602s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:45:27.884981171 +0000 UTC m=+21.945258951" watchObservedRunningTime="2026-05-26 21:45:28.777028602 +0000 UTC m=+22.837306384"
May 26 21:45:28.777301 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.777275    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-198.ec2.internal" podStartSLOduration=22.777269051 podStartE2EDuration="22.777269051s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:45:28.776782719 +0000 UTC m=+22.837060500" watchObservedRunningTime="2026-05-26 21:45:28.777269051 +0000 UTC m=+22.837546832"
May 26 21:45:28.790344 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:28.790286    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g2q4c" podStartSLOduration=3.9486061770000003 podStartE2EDuration="22.790266427s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.822249116 +0000 UTC m=+1.882526875" lastFinishedPulling="2026-05-26 21:45:26.663909368 +0000 UTC m=+20.724187125" observedRunningTime="2026-05-26 21:45:28.789910238 +0000 UTC m=+22.850188020" watchObservedRunningTime="2026-05-26 21:45:28.790266427 +0000 UTC m=+22.850544209"
May 26 21:45:29.023484 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.023394    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:29.024130 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.024112    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:29.493764 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.493649    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T21:45:28.690709519Z","UUID":"2cd3e979-7126-4bcd-8b01-e0b5fc0ccd52","Handler":null,"Name":"","Endpoint":""}
May 26 21:45:29.496366 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.496343    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 21:45:29.496366 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.496373    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 21:45:29.554410 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.554371    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:29.554410 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:29.554387    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:29.554660 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:29.554481    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:29.554660 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:29.554562    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:30.346728 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:30.346690    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:30.347323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:30.347306    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6j2hg"
May 26 21:45:30.772812 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:30.772528    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"7d97402419294acfb675ed458bf5b134bd8c0dfadcf8013cbdec3189ea102b32"}
May 26 21:45:30.774717 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:30.774685    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9" event={"ID":"d1bdb142-4f11-4a7f-8f26-e3166e88a4e6","Type":"ContainerStarted","Data":"c94aae40527162d7a62c4bcf123631fec9a89c2fe59f2033d3946abe49b45a24"}
May 26 21:45:30.794607 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:30.793926    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mghn9" podStartSLOduration=2.883401671 podStartE2EDuration="24.793900255s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.763656177 +0000 UTC m=+1.823933935" lastFinishedPulling="2026-05-26 21:45:29.674154745 +0000 UTC m=+23.734432519" observedRunningTime="2026-05-26 21:45:30.792499708 +0000 UTC m=+24.852777485" watchObservedRunningTime="2026-05-26 21:45:30.793900255 +0000 UTC m=+24.854178036"
May 26 21:45:31.554253 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:31.554214    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:31.554792 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:31.554233    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:31.554792 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:31.554351    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:31.554792 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:31.554444    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:32.780691 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.780467    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="5eb0e4f3ba79ba08e29112da7ca2016b7060e659fa84e0d0a09da5737907cd1f" exitCode=0
May 26 21:45:32.781560 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.780550    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"5eb0e4f3ba79ba08e29112da7ca2016b7060e659fa84e0d0a09da5737907cd1f"}
May 26 21:45:32.784118 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.783995    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" event={"ID":"92a5cbc6-9a68-4458-87c9-cbd779ce5825","Type":"ContainerStarted","Data":"e935b15b8381b3e579b2b38c3f44859ac6ff2f8d5e50c459186cd28acf1db1db"}
May 26 21:45:32.784364 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.784332    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:32.799565 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.799541    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:32.827739 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:32.827693    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw" podStartSLOduration=7.5766233750000005 podStartE2EDuration="26.827677221s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.74352975 +0000 UTC m=+1.803807509" lastFinishedPulling="2026-05-26 21:45:26.994583582 +0000 UTC m=+21.054861355" observedRunningTime="2026-05-26 21:45:32.826147745 +0000 UTC m=+26.886425525" watchObservedRunningTime="2026-05-26 21:45:32.827677221 +0000 UTC m=+26.887955001"
May 26 21:45:33.553915 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.553882    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:33.554068 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.553882    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:33.554068 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:33.554003    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:33.554068 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:33.554058    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:33.791378 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.791332    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerStarted","Data":"bd69287e0661bca859e900719cd0ee9ffb82c21bc3cdc1a11e3d045aafb03d12"}
May 26 21:45:33.791844 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.791460    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 21:45:33.792034 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.792012    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:33.809075 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:33.808863    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:34.006022 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.005974    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zh76m"]
May 26 21:45:34.006163 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.006137    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:34.006299 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:34.006263    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:34.006775 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.006741    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2j8v"]
May 26 21:45:34.006905 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.006848    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:34.006964 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:34.006946    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:34.795095 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.795062    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="bd69287e0661bca859e900719cd0ee9ffb82c21bc3cdc1a11e3d045aafb03d12" exitCode=0
May 26 21:45:34.795587 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.795152    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"bd69287e0661bca859e900719cd0ee9ffb82c21bc3cdc1a11e3d045aafb03d12"}
May 26 21:45:34.795587 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:34.795383    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 21:45:35.152929 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:35.152845    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:45:35.554550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:35.554350    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:35.554683 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:35.554359    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:35.554683 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:35.554622    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:35.554795 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:35.554726    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:35.799371 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:35.799340    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="870b4dc726a576e88816d70dcd11ea8b6a3d9208c949124da5ae638d605c1afb" exitCode=0
May 26 21:45:35.799845 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:35.799430    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"870b4dc726a576e88816d70dcd11ea8b6a3d9208c949124da5ae638d605c1afb"}
May 26 21:45:37.554467 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:37.554425    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:37.555133 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:37.554575    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:37.555133 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:37.554627    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:37.555133 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:37.554756    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:39.183808 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.183770    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:39.184372 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.183937    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:39.184372 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.184023    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:46:11.183999343 +0000 UTC m=+65.244277103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 21:45:39.284575 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.284531    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:39.284802 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.284716    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 21:45:39.284802 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.284740    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 21:45:39.284802 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.284753    2559 projected.go:194] Error preparing data for projected volume kube-api-access-lsvk2 for pod openshift-network-diagnostics/network-check-target-m2j8v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:39.284967 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.284822    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2 podName:2ec300b6-6190-4279-adad-77a315ee3d02 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:11.28480107 +0000 UTC m=+65.345078829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvk2" (UniqueName: "kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2") pod "network-check-target-m2j8v" (UID: "2ec300b6-6190-4279-adad-77a315ee3d02") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 21:45:39.554302 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.554263    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:39.554483 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.554263    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:39.554483 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.554410    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:45:39.554625 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.554491    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m2j8v" podUID="2ec300b6-6190-4279-adad-77a315ee3d02"
May 26 21:45:39.709299 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.709268    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-198.ec2.internal" event="NodeReady"
May 26 21:45:39.709498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.709419    2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 21:45:39.752477 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.752436    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7tfrz"]
May 26 21:45:39.808625 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.808587    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fz44k"]
May 26 21:45:39.808803 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.808759    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.811792 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.811766    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 21:45:39.812292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.812270    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhpgm\""
May 26 21:45:39.812385 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.812347    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 21:45:39.825798 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.825763    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7tfrz"]
May 26 21:45:39.825798 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.825798    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fz44k"]
May 26 21:45:39.826024 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.825892    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:39.828168 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.828145    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 21:45:39.828585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.828424    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lg2j\""
May 26 21:45:39.828585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.828460    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 21:45:39.828585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.828474    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 21:45:39.888208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.888169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-tmp-dir\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.888208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.888214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-config-volume\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.888454 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.888242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.888454 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.888361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh96z\" (UniqueName: \"kubernetes.io/projected/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-kube-api-access-qh96z\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6h7h\" (UniqueName: \"kubernetes.io/projected/b48147e8-cdaa-48a8-bde3-65da728464f6-kube-api-access-t6h7h\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989774    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-tmp-dir\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989807    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-config-volume\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989834    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.989917    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh96z\" (UniqueName: \"kubernetes.io/projected/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-kube-api-access-qh96z\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.990010    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:39.990093    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:45:40.490071965 +0000 UTC m=+34.550349741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:39.990401 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.990266    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-tmp-dir\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:39.990943 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:39.990590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-config-volume\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:40.001987 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.001955    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh96z\" (UniqueName: \"kubernetes.io/projected/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-kube-api-access-qh96z\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:40.091110 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.091071    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6h7h\" (UniqueName: \"kubernetes.io/projected/b48147e8-cdaa-48a8-bde3-65da728464f6-kube-api-access-t6h7h\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:40.091397 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.091136    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:40.091397 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.091257    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:40.091397 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.091318    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:40.591298637 +0000 UTC m=+34.651576405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:45:40.102576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.102544    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6h7h\" (UniqueName: \"kubernetes.io/projected/b48147e8-cdaa-48a8-bde3-65da728464f6-kube-api-access-t6h7h\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:40.493555 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.493496    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:40.494238 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.493674    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:40.494238 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.493756    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:45:41.493733445 +0000 UTC m=+35.554011206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:40.594067 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:40.594027    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:40.594238 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.594207    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:40.594301 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:40.594288    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:41.59426588 +0000 UTC m=+35.654543641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:45:41.501291 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.501260    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:41.501804 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:41.501399    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:41.501804 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:41.501473    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:45:43.501450369 +0000 UTC m=+37.561728131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:41.553473 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.553437    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:45:41.553653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.553436    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:45:41.557241 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.557218    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwrc\""
May 26 21:45:41.557368 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.557265    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqzm9\""
May 26 21:45:41.557368 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.557265    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 21:45:41.557368 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.557265    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 21:45:41.557368 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.557271    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 21:45:41.601699 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.601655    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:41.601865 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:41.601819    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:41.601910 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:41.601882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:43.601866022 +0000 UTC m=+37.662143784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:45:41.814332 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:41.814131    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerStarted","Data":"54d887877f84a65a85e81ba588a18eb458aae90134aa2ce77cf87b06d9bed3c8"}
May 26 21:45:42.818443 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:42.818413    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="54d887877f84a65a85e81ba588a18eb458aae90134aa2ce77cf87b06d9bed3c8" exitCode=0
May 26 21:45:42.818829 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:42.818470    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"54d887877f84a65a85e81ba588a18eb458aae90134aa2ce77cf87b06d9bed3c8"}
May 26 21:45:43.516254 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:43.516220    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:43.516437 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:43.516390    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:43.516480 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:43.516458    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:45:47.516442976 +0000 UTC m=+41.576720737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:43.617121 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:43.617085    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:43.617275 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:43.617194    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:43.617275 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:43.617248    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:47.617234347 +0000 UTC m=+41.677512119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:45:43.822403 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:43.822368    2559 generic.go:358] "Generic (PLEG): container finished" podID="66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd" containerID="94300d479a9c347d2db4156ae834efa3d77c9a783b53be512f46197079cc77d1" exitCode=0
May 26 21:45:43.822791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:43.822433    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerDied","Data":"94300d479a9c347d2db4156ae834efa3d77c9a783b53be512f46197079cc77d1"}
May 26 21:45:44.827894 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:44.827849    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" event={"ID":"66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd","Type":"ContainerStarted","Data":"5f18c7b516ae8aa4291d8958b1497364d6fb00159adf5d813ea92355b9ececf5"}
May 26 21:45:47.545232 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:47.545181    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:47.545756 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:47.545361    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:47.545756 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:47.545452    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:45:55.545429178 +0000 UTC m=+49.605706969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:47.646390 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:47.646349    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:47.646600 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:47.646494    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:47.646600 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:47.646584    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:45:55.646565012 +0000 UTC m=+49.706842784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:45:55.601493 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:55.601450    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:45:55.601969 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:55.601592    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:45:55.601969 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:55.601644    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:46:11.601631172 +0000 UTC m=+65.661908930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:45:55.702257 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:45:55.702224    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:45:55.702399 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:55.702377    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:45:55.702459 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:45:55.702449    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:11.702433063 +0000 UTC m=+65.762710820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:46:06.811986 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:06.811954    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scdhw"
May 26 21:46:06.838633 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:06.838574    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wtlr9" podStartSLOduration=27.070625301 podStartE2EDuration="1m0.838560701s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:45:07.81068959 +0000 UTC m=+1.870967348" lastFinishedPulling="2026-05-26 21:45:41.578624976 +0000 UTC m=+35.638902748" observedRunningTime="2026-05-26 21:45:44.853696092 +0000 UTC m=+38.913973884" watchObservedRunningTime="2026-05-26 21:46:06.838560701 +0000 UTC m=+60.898838539"
May 26 21:46:11.208652 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.208611    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:46:11.211578 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.211561    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 21:46:11.219483 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.219464    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 21:46:11.219564 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.219553    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:47:15.219534179 +0000 UTC m=+129.279811936 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : secret "metrics-daemon-secret" not found
May 26 21:46:11.309149 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.309120    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:46:11.312042 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.312024    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 21:46:11.321651 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.321633    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 21:46:11.333096 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.333074    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvk2\" (UniqueName: \"kubernetes.io/projected/2ec300b6-6190-4279-adad-77a315ee3d02-kube-api-access-lsvk2\") pod \"network-check-target-m2j8v\" (UID: \"2ec300b6-6190-4279-adad-77a315ee3d02\") " pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:46:11.566795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.566768    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwrc\""
May 26 21:46:11.574214 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.574193    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:46:11.611349 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.611296    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:46:11.611555 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.611477    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:46:11.611638 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.611557    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:46:43.611535865 +0000 UTC m=+97.671813626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:46:11.712110 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.712080    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:46:11.712253 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.712197    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:46:11.712294 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:11.712277    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:46:43.712263645 +0000 UTC m=+97.772541403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:46:11.747010 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.746982    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m2j8v"]
May 26 21:46:11.752667 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:46:11.752634    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec300b6_6190_4279_adad_77a315ee3d02.slice/crio-0001f36b7646070f85352b3f9e87e731abd677d5ce10f861419e3ea9ba58d9e6 WatchSource:0}: Error finding container 0001f36b7646070f85352b3f9e87e731abd677d5ce10f861419e3ea9ba58d9e6: Status 404 returned error can't find the container with id 0001f36b7646070f85352b3f9e87e731abd677d5ce10f861419e3ea9ba58d9e6
May 26 21:46:11.878757 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:11.878668    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2j8v" event={"ID":"2ec300b6-6190-4279-adad-77a315ee3d02","Type":"ContainerStarted","Data":"0001f36b7646070f85352b3f9e87e731abd677d5ce10f861419e3ea9ba58d9e6"}
May 26 21:46:14.885016 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:14.884969    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m2j8v" event={"ID":"2ec300b6-6190-4279-adad-77a315ee3d02","Type":"ContainerStarted","Data":"ff7297b8e6112e68e9a856a248d412394b9b46bb52cb496afc3785bf7ffd0a8b"}
May 26 21:46:14.885405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:14.885097    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:46:43.630166 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:43.630116    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:46:43.630593 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:43.630263    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 21:46:43.630593 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:43.630345    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls podName:ca3b6416-bb7c-4530-b616-d44ad2dea1ce nodeName:}" failed. No retries permitted until 2026-05-26 21:47:47.630326832 +0000 UTC m=+161.690604589 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls") pod "dns-default-7tfrz" (UID: "ca3b6416-bb7c-4530-b616-d44ad2dea1ce") : secret "dns-default-metrics-tls" not found
May 26 21:46:43.730474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:43.730425    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:46:43.730658 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:43.730597    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 21:46:43.730703 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:43.730668    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert podName:b48147e8-cdaa-48a8-bde3-65da728464f6 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:47.730652399 +0000 UTC m=+161.790930162 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert") pod "ingress-canary-fz44k" (UID: "b48147e8-cdaa-48a8-bde3-65da728464f6") : secret "canary-serving-cert" not found
May 26 21:46:45.889070 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:45.889037    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m2j8v"
May 26 21:46:45.904599 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:45.904552    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m2j8v" podStartSLOduration=97.193866926 podStartE2EDuration="1m39.90453654s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:46:11.75532975 +0000 UTC m=+65.815607509" lastFinishedPulling="2026-05-26 21:46:14.465999351 +0000 UTC m=+68.526277123" observedRunningTime="2026-05-26 21:46:14.914975393 +0000 UTC m=+68.975253172" watchObservedRunningTime="2026-05-26 21:46:45.90453654 +0000 UTC m=+99.964814319"
May 26 21:46:57.531772 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.531737    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"]
May 26 21:46:57.533471 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.533449    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.537013 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.536993    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8lmgd\""
May 26 21:46:57.537119 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.537017    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 21:46:57.538335 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.538275    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 21:46:57.538335 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.538289    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 26 21:46:57.538335 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.538330    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 26 21:46:57.544087 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.544062    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"]
May 26 21:46:57.624783 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.624737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddgj\" (UniqueName: \"kubernetes.io/projected/95018038-aca8-49a6-b439-396474be6c8b-kube-api-access-rddgj\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.624965 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.624791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.624965 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.624898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95018038-aca8-49a6-b439-396474be6c8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.726075 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.726033    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95018038-aca8-49a6-b439-396474be6c8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.726282 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.726093    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rddgj\" (UniqueName: \"kubernetes.io/projected/95018038-aca8-49a6-b439-396474be6c8b-kube-api-access-rddgj\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.726282 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.726127    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.726282 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:57.726237    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:46:57.726438 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:57.726315    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:46:58.226294506 +0000 UTC m=+112.286572265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:46:57.726747 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.726725    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95018038-aca8-49a6-b439-396474be6c8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:57.735908 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:57.735885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddgj\" (UniqueName: \"kubernetes.io/projected/95018038-aca8-49a6-b439-396474be6c8b-kube-api-access-rddgj\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:58.230328 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:58.230275    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:58.230532 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:58.230433    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:46:58.230585 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:58.230537    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:46:59.230502355 +0000 UTC m=+113.290780112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:46:59.237206 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:46:59.237167    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:46:59.237614 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:59.237307    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:46:59.237614 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:46:59.237372    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:47:01.237355062 +0000 UTC m=+115.297632826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:47:01.252917 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:01.252847    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:01.253317 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:01.253000    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:47:01.253317 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:01.253069    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:47:05.253052693 +0000 UTC m=+119.313330451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:47:04.078606 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:04.078579    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-szvf5_659313aa-8cc9-496c-998a-ac6f8cc65dd1/dns-node-resolver/0.log"
May 26 21:47:04.877839 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:04.877811    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x8pxf_b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3/node-ca/0.log"
May 26 21:47:05.284150 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:05.284048    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:05.284533 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:05.284204    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:47:05.284533 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:05.284276    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:47:13.284260599 +0000 UTC m=+127.344538362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:47:07.449836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.449802    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"]
May 26 21:47:07.451772 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.451756    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.454307 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.454285    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 26 21:47:07.455307 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.455288    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 26 21:47:07.455420 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.455331    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 26 21:47:07.455420 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.455385    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 26 21:47:07.455561 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.455437    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jkbz6\""
May 26 21:47:07.462434 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.462414    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"]
May 26 21:47:07.593190 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.593155    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"]
May 26 21:47:07.595140 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.595123    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"
May 26 21:47:07.598225 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.598203    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 21:47:07.598761 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.598739    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 21:47:07.598882 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.598739    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-94hsb\""
May 26 21:47:07.603230 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.603209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eda3c55-5fe4-4bfb-961a-693afe15f009-config\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.603385 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.603270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smq4f\" (UniqueName: \"kubernetes.io/projected/4eda3c55-5fe4-4bfb-961a-693afe15f009-kube-api-access-smq4f\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.603385 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.603366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eda3c55-5fe4-4bfb-961a-693afe15f009-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.606781 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.606758    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"]
May 26 21:47:07.704007 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.703909    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eda3c55-5fe4-4bfb-961a-693afe15f009-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.704007 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.703954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxghp\" (UniqueName: \"kubernetes.io/projected/0609e0e7-5e06-4603-b1f5-fa2a4965cc3b-kube-api-access-sxghp\") pod \"volume-data-source-validator-5cf8c89d64-jjmzl\" (UID: \"0609e0e7-5e06-4603-b1f5-fa2a4965cc3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"
May 26 21:47:07.704007 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.703994    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eda3c55-5fe4-4bfb-961a-693afe15f009-config\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.704293 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.704193    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smq4f\" (UniqueName: \"kubernetes.io/projected/4eda3c55-5fe4-4bfb-961a-693afe15f009-kube-api-access-smq4f\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.704550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.704533    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eda3c55-5fe4-4bfb-961a-693afe15f009-config\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.706305 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.706283    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eda3c55-5fe4-4bfb-961a-693afe15f009-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.717952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.717924    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dxlzl"]
May 26 21:47:07.719744 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.719729    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.722441 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.722403    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 26 21:47:07.722591 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.722497    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 26 21:47:07.722816 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.722800    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 26 21:47:07.722897 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.722832    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qq959\""
May 26 21:47:07.724734 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.724716    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 26 21:47:07.731602 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.731581    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smq4f\" (UniqueName: \"kubernetes.io/projected/4eda3c55-5fe4-4bfb-961a-693afe15f009-kube-api-access-smq4f\") pod \"kube-storage-version-migrator-operator-565644f49-fw8r8\" (UID: \"4eda3c55-5fe4-4bfb-961a-693afe15f009\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.732771 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.732750    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 26 21:47:07.738211 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.738187    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dxlzl"]
May 26 21:47:07.759891 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.759856    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"
May 26 21:47:07.805055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.805019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f433079-97b3-4e0f-8094-f7e013e26d2c-serving-cert\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.805202 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.805078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-config\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.805202 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.805123    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxghp\" (UniqueName: \"kubernetes.io/projected/0609e0e7-5e06-4603-b1f5-fa2a4965cc3b-kube-api-access-sxghp\") pod \"volume-data-source-validator-5cf8c89d64-jjmzl\" (UID: \"0609e0e7-5e06-4603-b1f5-fa2a4965cc3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"
May 26 21:47:07.805316 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.805207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjz2t\" (UniqueName: \"kubernetes.io/projected/8f433079-97b3-4e0f-8094-f7e013e26d2c-kube-api-access-vjz2t\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.805375 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.805353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-trusted-ca\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.817186 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.817152    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxghp\" (UniqueName: \"kubernetes.io/projected/0609e0e7-5e06-4603-b1f5-fa2a4965cc3b-kube-api-access-sxghp\") pod \"volume-data-source-validator-5cf8c89d64-jjmzl\" (UID: \"0609e0e7-5e06-4603-b1f5-fa2a4965cc3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"
May 26 21:47:07.882412 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.882377    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8"]
May 26 21:47:07.886308 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:07.886278    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eda3c55_5fe4_4bfb_961a_693afe15f009.slice/crio-d064c3db66bb522fe6109b14b137395b91e61812513278c148ce8e390840827d WatchSource:0}: Error finding container d064c3db66bb522fe6109b14b137395b91e61812513278c148ce8e390840827d: Status 404 returned error can't find the container with id d064c3db66bb522fe6109b14b137395b91e61812513278c148ce8e390840827d
May 26 21:47:07.903703 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.903674    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"
May 26 21:47:07.906565 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.906539    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f433079-97b3-4e0f-8094-f7e013e26d2c-serving-cert\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.906707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.906575    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-config\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.906707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.906607    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjz2t\" (UniqueName: \"kubernetes.io/projected/8f433079-97b3-4e0f-8094-f7e013e26d2c-kube-api-access-vjz2t\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.906707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.906650    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-trusted-ca\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.907264 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.907238    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-config\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.907379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.907363    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f433079-97b3-4e0f-8094-f7e013e26d2c-trusted-ca\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.909095 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.909075    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f433079-97b3-4e0f-8094-f7e013e26d2c-serving-cert\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.916222 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.916195    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjz2t\" (UniqueName: \"kubernetes.io/projected/8f433079-97b3-4e0f-8094-f7e013e26d2c-kube-api-access-vjz2t\") pod \"console-operator-76dff48d59-dxlzl\" (UID: \"8f433079-97b3-4e0f-8094-f7e013e26d2c\") " pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:07.984439 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:07.984392    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8" event={"ID":"4eda3c55-5fe4-4bfb-961a-693afe15f009","Type":"ContainerStarted","Data":"d064c3db66bb522fe6109b14b137395b91e61812513278c148ce8e390840827d"}
May 26 21:47:08.028952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:08.028915    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:08.031326 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:08.031303    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl"]
May 26 21:47:08.034699 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:08.034674    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0609e0e7_5e06_4603_b1f5_fa2a4965cc3b.slice/crio-e242c436a8fe97bb720b66125e33ff0edc74f2029bbcdff6a501127ff6e832e4 WatchSource:0}: Error finding container e242c436a8fe97bb720b66125e33ff0edc74f2029bbcdff6a501127ff6e832e4: Status 404 returned error can't find the container with id e242c436a8fe97bb720b66125e33ff0edc74f2029bbcdff6a501127ff6e832e4
May 26 21:47:08.153748 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:08.153709    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-dxlzl"]
May 26 21:47:08.158262 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:08.158232    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f433079_97b3_4e0f_8094_f7e013e26d2c.slice/crio-957f0c119856b88f40dd6be16362f98d6cff04acebb791de87998272a9f3ada5 WatchSource:0}: Error finding container 957f0c119856b88f40dd6be16362f98d6cff04acebb791de87998272a9f3ada5: Status 404 returned error can't find the container with id 957f0c119856b88f40dd6be16362f98d6cff04acebb791de87998272a9f3ada5
May 26 21:47:08.988301 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:08.988243    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" event={"ID":"8f433079-97b3-4e0f-8094-f7e013e26d2c","Type":"ContainerStarted","Data":"957f0c119856b88f40dd6be16362f98d6cff04acebb791de87998272a9f3ada5"}
May 26 21:47:08.989963 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:08.989927    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl" event={"ID":"0609e0e7-5e06-4603-b1f5-fa2a4965cc3b","Type":"ContainerStarted","Data":"e242c436a8fe97bb720b66125e33ff0edc74f2029bbcdff6a501127ff6e832e4"}
May 26 21:47:10.995262 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.995224    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8" event={"ID":"4eda3c55-5fe4-4bfb-961a-693afe15f009","Type":"ContainerStarted","Data":"60c18a8c858eb1c9932d3135f6e7a210130d44e57c1b06d9e529db403e24d87b"}
May 26 21:47:10.996716 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.996699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/0.log"
May 26 21:47:10.996807 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.996736    2559 generic.go:358] "Generic (PLEG): container finished" podID="8f433079-97b3-4e0f-8094-f7e013e26d2c" containerID="d29848d8b32a6461684dc8e83ddf34ba246280cf261ab1c643cd5c64c0b7b651" exitCode=255
May 26 21:47:10.996861 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.996809    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" event={"ID":"8f433079-97b3-4e0f-8094-f7e013e26d2c","Type":"ContainerDied","Data":"d29848d8b32a6461684dc8e83ddf34ba246280cf261ab1c643cd5c64c0b7b651"}
May 26 21:47:10.997025 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.997002    2559 scope.go:117] "RemoveContainer" containerID="d29848d8b32a6461684dc8e83ddf34ba246280cf261ab1c643cd5c64c0b7b651"
May 26 21:47:10.998146 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:10.998120    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl" event={"ID":"0609e0e7-5e06-4603-b1f5-fa2a4965cc3b","Type":"ContainerStarted","Data":"35daa3599483264362520406594deac07c356a69e297b2209cf67264e6f890c5"}
May 26 21:47:11.024792 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:11.024743    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8" podStartSLOduration=1.4289511049999999 podStartE2EDuration="4.024730169s" podCreationTimestamp="2026-05-26 21:47:07 +0000 UTC" firstStartedPulling="2026-05-26 21:47:07.888036396 +0000 UTC m=+121.948314153" lastFinishedPulling="2026-05-26 21:47:10.483815446 +0000 UTC m=+124.544093217" observedRunningTime="2026-05-26 21:47:11.020638136 +0000 UTC m=+125.080915916" watchObservedRunningTime="2026-05-26 21:47:11.024730169 +0000 UTC m=+125.085007948"
May 26 21:47:11.079689 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:11.079531    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-jjmzl" podStartSLOduration=2.135446366 podStartE2EDuration="4.079488974s" podCreationTimestamp="2026-05-26 21:47:07 +0000 UTC" firstStartedPulling="2026-05-26 21:47:08.036757133 +0000 UTC m=+122.097034892" lastFinishedPulling="2026-05-26 21:47:09.980799739 +0000 UTC m=+124.041077500" observedRunningTime="2026-05-26 21:47:11.079316178 +0000 UTC m=+125.139593957" watchObservedRunningTime="2026-05-26 21:47:11.079488974 +0000 UTC m=+125.139766754"
May 26 21:47:12.001293 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.001261    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:47:12.001789 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.001718    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/0.log"
May 26 21:47:12.001789 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.001756    2559 generic.go:358] "Generic (PLEG): container finished" podID="8f433079-97b3-4e0f-8094-f7e013e26d2c" containerID="a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84" exitCode=255
May 26 21:47:12.002088 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.002051    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" event={"ID":"8f433079-97b3-4e0f-8094-f7e013e26d2c","Type":"ContainerDied","Data":"a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84"}
May 26 21:47:12.002184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.002114    2559 scope.go:117] "RemoveContainer" containerID="d29848d8b32a6461684dc8e83ddf34ba246280cf261ab1c643cd5c64c0b7b651"
May 26 21:47:12.002226 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.002199    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"]
May 26 21:47:12.002452 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.002435    2559 scope.go:117] "RemoveContainer" containerID="a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84"
May 26 21:47:12.002636 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:12.002617    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dxlzl_openshift-console-operator(8f433079-97b3-4e0f-8094-f7e013e26d2c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" podUID="8f433079-97b3-4e0f-8094-f7e013e26d2c"
May 26 21:47:12.004475 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.004459    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"
May 26 21:47:12.007259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.007238    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 26 21:47:12.007357 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.007262    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tshmw\""
May 26 21:47:12.008718 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.008701    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 26 21:47:12.016059 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.016038    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"]
May 26 21:47:12.144277 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.144236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw4xv\" (UniqueName: \"kubernetes.io/projected/21dc6327-6598-4473-95b6-d98ce0032fc4-kube-api-access-tw4xv\") pod \"migrator-b985f5d89-4w7nh\" (UID: \"21dc6327-6598-4473-95b6-d98ce0032fc4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"
May 26 21:47:12.245035 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.244998    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw4xv\" (UniqueName: \"kubernetes.io/projected/21dc6327-6598-4473-95b6-d98ce0032fc4-kube-api-access-tw4xv\") pod \"migrator-b985f5d89-4w7nh\" (UID: \"21dc6327-6598-4473-95b6-d98ce0032fc4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"
May 26 21:47:12.253370 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.253318    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw4xv\" (UniqueName: \"kubernetes.io/projected/21dc6327-6598-4473-95b6-d98ce0032fc4-kube-api-access-tw4xv\") pod \"migrator-b985f5d89-4w7nh\" (UID: \"21dc6327-6598-4473-95b6-d98ce0032fc4\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"
May 26 21:47:12.314435 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.314400    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"
May 26 21:47:12.433842 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:12.433811    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh"]
May 26 21:47:12.437120 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:12.437085    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21dc6327_6598_4473_95b6_d98ce0032fc4.slice/crio-d70d06adf3d1acf184eb1eb979ea59507d2c98732b7add884e20b81bc162d198 WatchSource:0}: Error finding container d70d06adf3d1acf184eb1eb979ea59507d2c98732b7add884e20b81bc162d198: Status 404 returned error can't find the container with id d70d06adf3d1acf184eb1eb979ea59507d2c98732b7add884e20b81bc162d198
May 26 21:47:13.006013 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:13.005979    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:47:13.006446 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:13.006408    2559 scope.go:117] "RemoveContainer" containerID="a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84"
May 26 21:47:13.006689 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:13.006657    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dxlzl_openshift-console-operator(8f433079-97b3-4e0f-8094-f7e013e26d2c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" podUID="8f433079-97b3-4e0f-8094-f7e013e26d2c"
May 26 21:47:13.007275 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:13.007244    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh" event={"ID":"21dc6327-6598-4473-95b6-d98ce0032fc4","Type":"ContainerStarted","Data":"d70d06adf3d1acf184eb1eb979ea59507d2c98732b7add884e20b81bc162d198"}
May 26 21:47:13.355265 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:13.355217    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:13.355458 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:13.355397    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 21:47:13.355525 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:13.355483    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls podName:95018038-aca8-49a6-b439-396474be6c8b nodeName:}" failed. No retries permitted until 2026-05-26 21:47:29.355460944 +0000 UTC m=+143.415738705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-jndhf" (UID: "95018038-aca8-49a6-b439-396474be6c8b") : secret "cluster-monitoring-operator-tls" not found
May 26 21:47:14.013328 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.013239    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh" event={"ID":"21dc6327-6598-4473-95b6-d98ce0032fc4","Type":"ContainerStarted","Data":"cdea28a3bda5262ed8b83d0b0180bdacb147df41ecabf26c30f04fcd11e06ffd"}
May 26 21:47:14.013328 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.013278    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh" event={"ID":"21dc6327-6598-4473-95b6-d98ce0032fc4","Type":"ContainerStarted","Data":"ae7e6989b486647e9c4610255f215be854e68f53d27f3662cdb82cec07456e6b"}
May 26 21:47:14.033302 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.033251    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-4w7nh" podStartSLOduration=1.922978977 podStartE2EDuration="3.033236823s" podCreationTimestamp="2026-05-26 21:47:11 +0000 UTC" firstStartedPulling="2026-05-26 21:47:12.438936914 +0000 UTC m=+126.499214672" lastFinishedPulling="2026-05-26 21:47:13.549194757 +0000 UTC m=+127.609472518" observedRunningTime="2026-05-26 21:47:14.03208636 +0000 UTC m=+128.092364141" watchObservedRunningTime="2026-05-26 21:47:14.033236823 +0000 UTC m=+128.093514625"
May 26 21:47:14.161317 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.161285    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nhvdc"]
May 26 21:47:14.163106 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.163081    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.166962 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.166940    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t7m4h\""
May 26 21:47:14.167093 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.167008    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 26 21:47:14.167247 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.167231    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 26 21:47:14.167293 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.167272    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 26 21:47:14.167375 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.167360    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 26 21:47:14.178439 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.178410    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nhvdc"]
May 26 21:47:14.264403 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.264308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-key\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.264403 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.264349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxz5x\" (UniqueName: \"kubernetes.io/projected/dea1c52f-1a34-4acd-9250-ecb5f615df21-kube-api-access-dxz5x\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.264626 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.264465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-cabundle\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.364959 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.364924    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-cabundle\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.365054 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.364984    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-key\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.365054 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.365004    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxz5x\" (UniqueName: \"kubernetes.io/projected/dea1c52f-1a34-4acd-9250-ecb5f615df21-kube-api-access-dxz5x\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.365612 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.365592    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-cabundle\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.367352 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.367323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dea1c52f-1a34-4acd-9250-ecb5f615df21-signing-key\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.374200 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.374177    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxz5x\" (UniqueName: \"kubernetes.io/projected/dea1c52f-1a34-4acd-9250-ecb5f615df21-kube-api-access-dxz5x\") pod \"service-ca-67d667c7d-nhvdc\" (UID: \"dea1c52f-1a34-4acd-9250-ecb5f615df21\") " pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.472046 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.472008    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-nhvdc"
May 26 21:47:14.600565 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:14.600529    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nhvdc"]
May 26 21:47:14.603398 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:14.603370    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea1c52f_1a34_4acd_9250_ecb5f615df21.slice/crio-b84dffe31c100047aa488caa616a4e5bed936da479b40b398b299bc5bcfdb24c WatchSource:0}: Error finding container b84dffe31c100047aa488caa616a4e5bed936da479b40b398b299bc5bcfdb24c: Status 404 returned error can't find the container with id b84dffe31c100047aa488caa616a4e5bed936da479b40b398b299bc5bcfdb24c
May 26 21:47:15.017031 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:15.016988    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-nhvdc" event={"ID":"dea1c52f-1a34-4acd-9250-ecb5f615df21","Type":"ContainerStarted","Data":"b84dffe31c100047aa488caa616a4e5bed936da479b40b398b299bc5bcfdb24c"}
May 26 21:47:15.272097 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:15.272008    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:47:15.272253 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:15.272193    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 21:47:15.272315 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:15.272264    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs podName:53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe nodeName:}" failed. No retries permitted until 2026-05-26 21:49:17.272244056 +0000 UTC m=+251.332521818 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs") pod "network-metrics-daemon-zh76m" (UID: "53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe") : secret "metrics-daemon-secret" not found
May 26 21:47:17.025716 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:17.025677    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-nhvdc" event={"ID":"dea1c52f-1a34-4acd-9250-ecb5f615df21","Type":"ContainerStarted","Data":"c3144e0cbf9dfbd389be896260927e5edf0ecb65b065d0ef9ebef6661403592a"}
May 26 21:47:17.042215 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:17.042155    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-nhvdc" podStartSLOduration=1.304793703 podStartE2EDuration="3.042134828s" podCreationTimestamp="2026-05-26 21:47:14 +0000 UTC" firstStartedPulling="2026-05-26 21:47:14.605201088 +0000 UTC m=+128.665478846" lastFinishedPulling="2026-05-26 21:47:16.342542198 +0000 UTC m=+130.402819971" observedRunningTime="2026-05-26 21:47:17.041335439 +0000 UTC m=+131.101613216" watchObservedRunningTime="2026-05-26 21:47:17.042134828 +0000 UTC m=+131.102412611"
May 26 21:47:18.029209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:18.029166    2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:18.029209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:18.029207    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:18.029806 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:18.029758    2559 scope.go:117] "RemoveContainer" containerID="a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84"
May 26 21:47:18.029989 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:18.029965    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-dxlzl_openshift-console-operator(8f433079-97b3-4e0f-8094-f7e013e26d2c)\"" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" podUID="8f433079-97b3-4e0f-8094-f7e013e26d2c"
May 26 21:47:29.382707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:29.382668    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:29.385043 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:29.385023    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95018038-aca8-49a6-b439-396474be6c8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-jndhf\" (UID: \"95018038-aca8-49a6-b439-396474be6c8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:29.644854 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:29.644764    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8lmgd\""
May 26 21:47:29.652842 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:29.652811    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"
May 26 21:47:29.774598 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:29.774561    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf"]
May 26 21:47:29.777560 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:29.777483    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95018038_aca8_49a6_b439_396474be6c8b.slice/crio-d6e4f546260d4ee211b78ba6ef1aa7ac15bff07af7ebe00da09310fde38a73b7 WatchSource:0}: Error finding container d6e4f546260d4ee211b78ba6ef1aa7ac15bff07af7ebe00da09310fde38a73b7: Status 404 returned error can't find the container with id d6e4f546260d4ee211b78ba6ef1aa7ac15bff07af7ebe00da09310fde38a73b7
May 26 21:47:30.058925 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:30.058886    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf" event={"ID":"95018038-aca8-49a6-b439-396474be6c8b","Type":"ContainerStarted","Data":"d6e4f546260d4ee211b78ba6ef1aa7ac15bff07af7ebe00da09310fde38a73b7"}
May 26 21:47:31.554099 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:31.554063    2559 scope.go:117] "RemoveContainer" containerID="a9e41e819224d5f7881291f60acac4c4f6dd9a06d620bcecd2663193e563ef84"
May 26 21:47:32.068144 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.068119    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:47:32.068333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.068244    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" event={"ID":"8f433079-97b3-4e0f-8094-f7e013e26d2c","Type":"ContainerStarted","Data":"137ca18587c40ba5cca1fff99b65ce41cd8e49c8c65aaf319c3c336846ceb0ab"}
May 26 21:47:32.068578 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.068545    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:32.069624 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.069600    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf" event={"ID":"95018038-aca8-49a6-b439-396474be6c8b","Type":"ContainerStarted","Data":"bf73c5f46d3fa2fc9b12b2ba7f6b50e70df77350801bce2655ec9ee80a441b68"}
May 26 21:47:32.087842 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.087797    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl" podStartSLOduration=22.744974979 podStartE2EDuration="25.087783736s" podCreationTimestamp="2026-05-26 21:47:07 +0000 UTC" firstStartedPulling="2026-05-26 21:47:08.163421741 +0000 UTC m=+122.223699500" lastFinishedPulling="2026-05-26 21:47:10.506230485 +0000 UTC m=+124.566508257" observedRunningTime="2026-05-26 21:47:32.087588278 +0000 UTC m=+146.147866059" watchObservedRunningTime="2026-05-26 21:47:32.087783736 +0000 UTC m=+146.148061510"
May 26 21:47:32.103868 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.103821    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-jndhf" podStartSLOduration=33.19955199 podStartE2EDuration="35.103807672s" podCreationTimestamp="2026-05-26 21:46:57 +0000 UTC" firstStartedPulling="2026-05-26 21:47:29.779320421 +0000 UTC m=+143.839598180" lastFinishedPulling="2026-05-26 21:47:31.683576105 +0000 UTC m=+145.743853862" observedRunningTime="2026-05-26 21:47:32.103050393 +0000 UTC m=+146.163328174" watchObservedRunningTime="2026-05-26 21:47:32.103807672 +0000 UTC m=+146.164085452"
May 26 21:47:32.384735 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:32.384655    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-dxlzl"
May 26 21:47:36.964801 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.964770    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:47:36.966780 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.966760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:36.972264 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.972239    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 21:47:36.972548 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.972522    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 21:47:36.973255 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.973231    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xnc2k\""
May 26 21:47:36.973354 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.973274    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 21:47:36.977619 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.977600    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 21:47:36.991113 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:36.991081    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:47:37.035529 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035708 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035708 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035561    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035708 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zx6r\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.035826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.035807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136674 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136631    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136674 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136669    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zx6r\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136941 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136693    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136941 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136818    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136941 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136904    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.136941 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136931    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.137137 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.136956    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.137137 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.137008    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.137424 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.137397    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.137705 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.137682    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.137799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.137747    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.139372 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.139346    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.139460 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.139423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.139460 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.139427    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.151662 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.151632    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.153610 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.153593    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zx6r\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r\") pod \"image-registry-68c6cfdfd5-8trns\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") " pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.164329 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.164303    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:47:37.164546 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.164533    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:37.231799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.231664    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6xbqc"]
May 26 21:47:37.234694 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.234660    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.243065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.242594    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 21:47:37.243065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.242859    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 21:47:37.243065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.242893    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 21:47:37.243065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.242934    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6lp6h\""
May 26 21:47:37.243360 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.243283    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 21:47:37.256317 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.256274    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xbqc"]
May 26 21:47:37.339114 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.339081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be82593e-0e08-4f90-9831-bd59abbb58c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.339114 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.339124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2r9\" (UniqueName: \"kubernetes.io/projected/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-api-access-ll2r9\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.339324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.339147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be82593e-0e08-4f90-9831-bd59abbb58c8-crio-socket\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.339324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.339242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.339324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.339265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be82593e-0e08-4f90-9831-bd59abbb58c8-data-volume\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.347444 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.347414    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:47:37.354874 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:37.354835    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377e66b7_7425_48bc_90db_4d4037f49779.slice/crio-61446edaef96c94936f0572810a71749a8b7b21f728821d52827a15935e0c59e WatchSource:0}: Error finding container 61446edaef96c94936f0572810a71749a8b7b21f728821d52827a15935e0c59e: Status 404 returned error can't find the container with id 61446edaef96c94936f0572810a71749a8b7b21f728821d52827a15935e0c59e
May 26 21:47:37.440118 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440086    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440118 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440123    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be82593e-0e08-4f90-9831-bd59abbb58c8-data-volume\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440330 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440258    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be82593e-0e08-4f90-9831-bd59abbb58c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440330 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440301    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2r9\" (UniqueName: \"kubernetes.io/projected/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-api-access-ll2r9\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440399 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440331    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be82593e-0e08-4f90-9831-bd59abbb58c8-crio-socket\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440449 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440434    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be82593e-0e08-4f90-9831-bd59abbb58c8-crio-socket\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440499 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440463    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be82593e-0e08-4f90-9831-bd59abbb58c8-data-volume\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.440675 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.440657    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.442504 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.442485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be82593e-0e08-4f90-9831-bd59abbb58c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.447714 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.447695    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2r9\" (UniqueName: \"kubernetes.io/projected/be82593e-0e08-4f90-9831-bd59abbb58c8-kube-api-access-ll2r9\") pod \"insights-runtime-extractor-6xbqc\" (UID: \"be82593e-0e08-4f90-9831-bd59abbb58c8\") " pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.545243 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.545214    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xbqc"
May 26 21:47:37.671741 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:37.671715    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xbqc"]
May 26 21:47:37.674264 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:37.674239    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe82593e_0e08_4f90_9831_bd59abbb58c8.slice/crio-7d5e0aa9a879dd79ba74c748c1ea797454ac4008157efa1c64cc0c68f142199b WatchSource:0}: Error finding container 7d5e0aa9a879dd79ba74c748c1ea797454ac4008157efa1c64cc0c68f142199b: Status 404 returned error can't find the container with id 7d5e0aa9a879dd79ba74c748c1ea797454ac4008157efa1c64cc0c68f142199b
May 26 21:47:38.085666 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.085632    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xbqc" event={"ID":"be82593e-0e08-4f90-9831-bd59abbb58c8","Type":"ContainerStarted","Data":"2d18bb62e34837001f14410b76a70a9dfb0d6c43d89c126cb4ca2dc22e6a882a"}
May 26 21:47:38.085666 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.085668    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xbqc" event={"ID":"be82593e-0e08-4f90-9831-bd59abbb58c8","Type":"ContainerStarted","Data":"7d5e0aa9a879dd79ba74c748c1ea797454ac4008157efa1c64cc0c68f142199b"}
May 26 21:47:38.086901 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.086877    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" event={"ID":"377e66b7-7425-48bc-90db-4d4037f49779","Type":"ContainerStarted","Data":"305e8f4ecfd5b5a61f9a3684d213d1d42157d220a28fa2f3a67b2e3cfc25cd25"}
May 26 21:47:38.087007 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.086906    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" event={"ID":"377e66b7-7425-48bc-90db-4d4037f49779","Type":"ContainerStarted","Data":"61446edaef96c94936f0572810a71749a8b7b21f728821d52827a15935e0c59e"}
May 26 21:47:38.087056 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.087029    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:38.106536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:38.106469    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" podStartSLOduration=2.106453633 podStartE2EDuration="2.106453633s" podCreationTimestamp="2026-05-26 21:47:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:47:38.106234099 +0000 UTC m=+152.166511884" watchObservedRunningTime="2026-05-26 21:47:38.106453633 +0000 UTC m=+152.166731412"
May 26 21:47:39.091460 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:39.091418    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xbqc" event={"ID":"be82593e-0e08-4f90-9831-bd59abbb58c8","Type":"ContainerStarted","Data":"1030d927c174835428304ff9a4fa8e0457f0b0e718389384d23f38706ab4dce8"}
May 26 21:47:40.098895 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.098862    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xbqc" event={"ID":"be82593e-0e08-4f90-9831-bd59abbb58c8","Type":"ContainerStarted","Data":"70c74dbdd9fe5e6a1ead1ee31a3a751b1b1517687037965b4c28780fd40c6a56"}
May 26 21:47:40.116229 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.116177    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6xbqc" podStartSLOduration=0.825462056 podStartE2EDuration="3.116162868s" podCreationTimestamp="2026-05-26 21:47:37 +0000 UTC" firstStartedPulling="2026-05-26 21:47:37.725219262 +0000 UTC m=+151.785497033" lastFinishedPulling="2026-05-26 21:47:40.015920087 +0000 UTC m=+154.076197845" observedRunningTime="2026-05-26 21:47:40.115692993 +0000 UTC m=+154.175970772" watchObservedRunningTime="2026-05-26 21:47:40.116162868 +0000 UTC m=+154.176440651"
May 26 21:47:40.222313 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.222277    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"]
May 26 21:47:40.224375 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.224358    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.226866 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.226844    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 26 21:47:40.226866 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.226865    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-27csw\""
May 26 21:47:40.227088 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.227076    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 26 21:47:40.227161 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.227140    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 21:47:40.242565 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.242535    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"]
May 26 21:47:40.262653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.262619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f81b66-a242-4ee5-b39a-01b5ecd4065b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.262653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.262659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.262847 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.262689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb685\" (UniqueName: \"kubernetes.io/projected/23f81b66-a242-4ee5-b39a-01b5ecd4065b-kube-api-access-mb685\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.262847 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.262758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.364024 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.363991    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f81b66-a242-4ee5-b39a-01b5ecd4065b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.364205 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.364034    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.364205 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.364063    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb685\" (UniqueName: \"kubernetes.io/projected/23f81b66-a242-4ee5-b39a-01b5ecd4065b-kube-api-access-mb685\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.364205 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.364086    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.364773 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.364749    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f81b66-a242-4ee5-b39a-01b5ecd4065b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.366543 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.366522    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.366642 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.366620    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f81b66-a242-4ee5-b39a-01b5ecd4065b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.375710 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.375685    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb685\" (UniqueName: \"kubernetes.io/projected/23f81b66-a242-4ee5-b39a-01b5ecd4065b-kube-api-access-mb685\") pod \"prometheus-operator-7779bbdd78-cjgn9\" (UID: \"23f81b66-a242-4ee5-b39a-01b5ecd4065b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.533376 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.533321    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"
May 26 21:47:40.656566 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:40.656452    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9"]
May 26 21:47:40.659484 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:40.659450    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f81b66_a242_4ee5_b39a_01b5ecd4065b.slice/crio-dcbf8b5090088cf3da158ad712d9da46a85d9d4e0d0731477ec2ba14db991f04 WatchSource:0}: Error finding container dcbf8b5090088cf3da158ad712d9da46a85d9d4e0d0731477ec2ba14db991f04: Status 404 returned error can't find the container with id dcbf8b5090088cf3da158ad712d9da46a85d9d4e0d0731477ec2ba14db991f04
May 26 21:47:41.102747 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:41.102714    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9" event={"ID":"23f81b66-a242-4ee5-b39a-01b5ecd4065b","Type":"ContainerStarted","Data":"dcbf8b5090088cf3da158ad712d9da46a85d9d4e0d0731477ec2ba14db991f04"}
May 26 21:47:42.106631 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:42.106594    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9" event={"ID":"23f81b66-a242-4ee5-b39a-01b5ecd4065b","Type":"ContainerStarted","Data":"5daa01054590bb91311505a7008b463667d47b96b4f179c2a2a32f7b273c3d98"}
May 26 21:47:42.820169 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:42.820113    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7tfrz" podUID="ca3b6416-bb7c-4530-b616-d44ad2dea1ce"
May 26 21:47:42.836990 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:42.836948    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fz44k" podUID="b48147e8-cdaa-48a8-bde3-65da728464f6"
May 26 21:47:43.111175 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:43.111088    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:47:43.111175 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:43.111106    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9" event={"ID":"23f81b66-a242-4ee5-b39a-01b5ecd4065b","Type":"ContainerStarted","Data":"76b02e0265cdf891bafcbe46490d42900f2288178efba0b4626b1a18c2b404db"}
May 26 21:47:43.111611 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:43.111279    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tfrz"
May 26 21:47:43.129144 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:43.129093    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cjgn9" podStartSLOduration=1.745762918 podStartE2EDuration="3.129080048s" podCreationTimestamp="2026-05-26 21:47:40 +0000 UTC" firstStartedPulling="2026-05-26 21:47:40.661275522 +0000 UTC m=+154.721553282" lastFinishedPulling="2026-05-26 21:47:42.044592654 +0000 UTC m=+156.104870412" observedRunningTime="2026-05-26 21:47:43.127975222 +0000 UTC m=+157.188253017" watchObservedRunningTime="2026-05-26 21:47:43.129080048 +0000 UTC m=+157.189357828"
May 26 21:47:44.568641 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:44.568593    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zh76m" podUID="53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe"
May 26 21:47:44.599111 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.599066    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"]
May 26 21:47:44.629160 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.629124    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rsxpc"]
May 26 21:47:44.629361 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.629335    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.632260 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.632031    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 21:47:44.632260 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.632056    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 21:47:44.632633 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.632617    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 21:47:44.632836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.632745    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-56bmm\""
May 26 21:47:44.653782 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.653735    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"]
May 26 21:47:44.653948 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.653879    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.657058 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.657033    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 21:47:44.657183 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.657134    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 21:47:44.657287 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.657265    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-424c5\""
May 26 21:47:44.657407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.657329    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 21:47:44.701000 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.700946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-root\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c2zc\" (UniqueName: \"kubernetes.io/projected/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-api-access-9c2zc\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-textfile\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l88t\" (UniqueName: \"kubernetes.io/projected/962fad0d-3048-4467-964f-fdd03f3af139-kube-api-access-2l88t\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-wtmp\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701424 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.701424 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.701424 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4bd670b-e309-47b1-abe8-8c4997bfc03e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.701531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-sys\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701608 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-tls\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701608 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-metrics-client-ca\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.701608 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.701582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802364 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802319    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-wtmp\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802376    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802414    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802443    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-wtmp\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802549    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4bd670b-e309-47b1-abe8-8c4997bfc03e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802599    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-sys\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802630    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-tls\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802654    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-metrics-client-ca\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802682    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802721    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-root\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802756    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c2zc\" (UniqueName: \"kubernetes.io/projected/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-api-access-9c2zc\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802802    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.802843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802833    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-textfile\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.803208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802864    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.803208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802892    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l88t\" (UniqueName: \"kubernetes.io/projected/962fad0d-3048-4467-964f-fdd03f3af139-kube-api-access-2l88t\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.803208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.802933    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4bd670b-e309-47b1-abe8-8c4997bfc03e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.803384 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.803435 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803416    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-root\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.803486 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803441    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.803550 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803536    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-textfile\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.803598 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803578    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962fad0d-3048-4467-964f-fdd03f3af139-sys\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.804042 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.803985    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962fad0d-3048-4467-964f-fdd03f3af139-metrics-client-ca\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.804745 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.804723    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.805619 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.805598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.805818 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.805786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.806151 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.806130    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.806254 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.806233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/962fad0d-3048-4467-964f-fdd03f3af139-node-exporter-tls\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.811621 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.811598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c2zc\" (UniqueName: \"kubernetes.io/projected/d4bd670b-e309-47b1-abe8-8c4997bfc03e-kube-api-access-9c2zc\") pod \"kube-state-metrics-54fd6bc5c4-qh5zt\" (UID: \"d4bd670b-e309-47b1-abe8-8c4997bfc03e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.812048 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.812029    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l88t\" (UniqueName: \"kubernetes.io/projected/962fad0d-3048-4467-964f-fdd03f3af139-kube-api-access-2l88t\") pod \"node-exporter-rsxpc\" (UID: \"962fad0d-3048-4467-964f-fdd03f3af139\") " pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.940911 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.940827    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"
May 26 21:47:44.964448 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:44.964408    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rsxpc"
May 26 21:47:44.975574 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:44.975534    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962fad0d_3048_4467_964f_fdd03f3af139.slice/crio-5bb208d9524a7b384c50519f1fc1f7d31f19a988b68c9e032bf8a0d1b0507cc0 WatchSource:0}: Error finding container 5bb208d9524a7b384c50519f1fc1f7d31f19a988b68c9e032bf8a0d1b0507cc0: Status 404 returned error can't find the container with id 5bb208d9524a7b384c50519f1fc1f7d31f19a988b68c9e032bf8a0d1b0507cc0
May 26 21:47:45.089023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.088983    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt"]
May 26 21:47:45.092297 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:45.092272    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4bd670b_e309_47b1_abe8_8c4997bfc03e.slice/crio-9ca8094d235f3f7dddcf3265d34f634052ba4acdac3d935b18de844362a6102b WatchSource:0}: Error finding container 9ca8094d235f3f7dddcf3265d34f634052ba4acdac3d935b18de844362a6102b: Status 404 returned error can't find the container with id 9ca8094d235f3f7dddcf3265d34f634052ba4acdac3d935b18de844362a6102b
May 26 21:47:45.116402 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.116363    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsxpc" event={"ID":"962fad0d-3048-4467-964f-fdd03f3af139","Type":"ContainerStarted","Data":"5bb208d9524a7b384c50519f1fc1f7d31f19a988b68c9e032bf8a0d1b0507cc0"}
May 26 21:47:45.117336 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.117301    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt" event={"ID":"d4bd670b-e309-47b1-abe8-8c4997bfc03e","Type":"ContainerStarted","Data":"9ca8094d235f3f7dddcf3265d34f634052ba4acdac3d935b18de844362a6102b"}
May 26 21:47:45.631152 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.631109    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:47:45.636327 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.634356    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.637594    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.637878    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.638073    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.638299    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.638466    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 21:47:45.639019 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.638755    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-srtq5\""
May 26 21:47:45.639586 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.639564    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 21:47:45.640504 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.640126    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 21:47:45.640504 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.640231    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 21:47:45.640504 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.640337    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 21:47:45.649004 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.648976    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:47:45.710915 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.710877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711098 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.710939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711098 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.710985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711098 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711098 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711098 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thcj\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711620 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.711620 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.711484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.812988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813044    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813069    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813095    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813147    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813185    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813213    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813257    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813283    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813312    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813337    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5thcj\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813371    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.813715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.813433    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.814043 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:45.814019    2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 26 21:47:45.814128 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:45.814103    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls podName:0c0fd904-a664-4842-bf05-b77e1041ef52 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:46.31408048 +0000 UTC m=+160.374358255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52") : secret "alertmanager-main-tls" not found
May 26 21:47:45.814419 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:45.814399    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle podName:0c0fd904-a664-4842-bf05-b77e1041ef52 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:46.314380533 +0000 UTC m=+160.374658313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52") : configmap references non-existent config key: ca-bundle.crt
May 26 21:47:45.816822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.815816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.816822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.816438    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.817794 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.817767    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.818012 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.817989    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.819528 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.819385    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.819528 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.819472    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.820570 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.820520    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.821339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.820977    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.821339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.821049    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.822167 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.822126    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:45.825874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:45.825812    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thcj\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:46.122191 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:46.122133    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsxpc" event={"ID":"962fad0d-3048-4467-964f-fdd03f3af139","Type":"ContainerStarted","Data":"eab15383b9f54352fd3a83b4caa2d2e23f7bbe8bcc1cb6bd7cdd1efcc0f98edb"}
May 26 21:47:46.319655 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:46.319617    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:46.319821 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:46.319710    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:46.319902 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:46.319881    2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 26 21:47:46.319977 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:46.319965    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls podName:0c0fd904-a664-4842-bf05-b77e1041ef52 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:47.319943413 +0000 UTC m=+161.380221188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52") : secret "alertmanager-main-tls" not found
May 26 21:47:46.320690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:46.320653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:47.125638 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.125601    2559 generic.go:358] "Generic (PLEG): container finished" podID="962fad0d-3048-4467-964f-fdd03f3af139" containerID="eab15383b9f54352fd3a83b4caa2d2e23f7bbe8bcc1cb6bd7cdd1efcc0f98edb" exitCode=0
May 26 21:47:47.126089 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.125671    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsxpc" event={"ID":"962fad0d-3048-4467-964f-fdd03f3af139","Type":"ContainerDied","Data":"eab15383b9f54352fd3a83b4caa2d2e23f7bbe8bcc1cb6bd7cdd1efcc0f98edb"}
May 26 21:47:47.127588 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.127566    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt" event={"ID":"d4bd670b-e309-47b1-abe8-8c4997bfc03e","Type":"ContainerStarted","Data":"d3af74e1d42a522847b4b0ee757627c0dba25669006221da7c8744d6d4fc7ab7"}
May 26 21:47:47.127668 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.127594    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt" event={"ID":"d4bd670b-e309-47b1-abe8-8c4997bfc03e","Type":"ContainerStarted","Data":"3f8071b9655dcfb03db78465e42240d21fd5c450c0f8b92fd2ccb50ecb381311"}
May 26 21:47:47.127668 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.127606    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt" event={"ID":"d4bd670b-e309-47b1-abe8-8c4997bfc03e","Type":"ContainerStarted","Data":"fb1bc64b210b5d3c5cfcf648728243ab573d5b9df7a78c61bb404d610cfbda85"}
May 26 21:47:47.167230 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.166769    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qh5zt" podStartSLOduration=1.77124052 podStartE2EDuration="3.166751779s" podCreationTimestamp="2026-05-26 21:47:44 +0000 UTC" firstStartedPulling="2026-05-26 21:47:45.094596585 +0000 UTC m=+159.154874349" lastFinishedPulling="2026-05-26 21:47:46.490107851 +0000 UTC m=+160.550385608" observedRunningTime="2026-05-26 21:47:47.166625402 +0000 UTC m=+161.226903215" watchObservedRunningTime="2026-05-26 21:47:47.166751779 +0000 UTC m=+161.227029560"
May 26 21:47:47.328319 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.328282    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:47.330690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.330659    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:47.451022 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.450944    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:47:47.595447 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.595410    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:47:47.598317 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:47.598290    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice/crio-05856162a30ca6c16a14a1da567a207a514c5ce6fff766257c8219cb05cf0371 WatchSource:0}: Error finding container 05856162a30ca6c16a14a1da567a207a514c5ce6fff766257c8219cb05cf0371: Status 404 returned error can't find the container with id 05856162a30ca6c16a14a1da567a207a514c5ce6fff766257c8219cb05cf0371
May 26 21:47:47.631262 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.631217    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:47:47.633488 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.633459    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3b6416-bb7c-4530-b616-d44ad2dea1ce-metrics-tls\") pod \"dns-default-7tfrz\" (UID: \"ca3b6416-bb7c-4530-b616-d44ad2dea1ce\") " pod="openshift-dns/dns-default-7tfrz"
May 26 21:47:47.732722 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.732628    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:47:47.735022 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.734996    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b48147e8-cdaa-48a8-bde3-65da728464f6-cert\") pod \"ingress-canary-fz44k\" (UID: \"b48147e8-cdaa-48a8-bde3-65da728464f6\") " pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:47:47.914779 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.914744    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lg2j\""
May 26 21:47:47.914779 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.914761    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhpgm\""
May 26 21:47:47.922845 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.922806    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fz44k"
May 26 21:47:47.922845 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:47.922829    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7tfrz"
May 26 21:47:48.060878 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.060846    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7tfrz"]
May 26 21:47:48.064645 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:48.064617    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3b6416_bb7c_4530_b616_d44ad2dea1ce.slice/crio-ec63608586f4f28fb41cd9887b92970f87328713db61051b368fbbf4e18eaa1d WatchSource:0}: Error finding container ec63608586f4f28fb41cd9887b92970f87328713db61051b368fbbf4e18eaa1d: Status 404 returned error can't find the container with id ec63608586f4f28fb41cd9887b92970f87328713db61051b368fbbf4e18eaa1d
May 26 21:47:48.076440 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.076412    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fz44k"]
May 26 21:47:48.079295 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:48.079270    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48147e8_cdaa_48a8_bde3_65da728464f6.slice/crio-7711630f6a667d4d86ea6d9c499081d58f0e5a19030eac0b1365592868d70417 WatchSource:0}: Error finding container 7711630f6a667d4d86ea6d9c499081d58f0e5a19030eac0b1365592868d70417: Status 404 returned error can't find the container with id 7711630f6a667d4d86ea6d9c499081d58f0e5a19030eac0b1365592868d70417
May 26 21:47:48.131244 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.131205    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fz44k" event={"ID":"b48147e8-cdaa-48a8-bde3-65da728464f6","Type":"ContainerStarted","Data":"7711630f6a667d4d86ea6d9c499081d58f0e5a19030eac0b1365592868d70417"}
May 26 21:47:48.132983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.132957    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsxpc" event={"ID":"962fad0d-3048-4467-964f-fdd03f3af139","Type":"ContainerStarted","Data":"3e57a5abcf5ae84347b18a0e623912a5d6f59a7a12bc300e3259682814648577"}
May 26 21:47:48.133092 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.132989    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsxpc" event={"ID":"962fad0d-3048-4467-964f-fdd03f3af139","Type":"ContainerStarted","Data":"76a7c9c28332bff754536f6c4d6fe513b32db789abc64ed886116505e5c4fae3"}
May 26 21:47:48.134005 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.133976    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"05856162a30ca6c16a14a1da567a207a514c5ce6fff766257c8219cb05cf0371"}
May 26 21:47:48.134883 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.134862    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tfrz" event={"ID":"ca3b6416-bb7c-4530-b616-d44ad2dea1ce","Type":"ContainerStarted","Data":"ec63608586f4f28fb41cd9887b92970f87328713db61051b368fbbf4e18eaa1d"}
May 26 21:47:48.151461 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:48.151412    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rsxpc" podStartSLOduration=3.130895968 podStartE2EDuration="4.151397988s" podCreationTimestamp="2026-05-26 21:47:44 +0000 UTC" firstStartedPulling="2026-05-26 21:47:44.97781272 +0000 UTC m=+159.038090481" lastFinishedPulling="2026-05-26 21:47:45.998314744 +0000 UTC m=+160.058592501" observedRunningTime="2026-05-26 21:47:48.150382005 +0000 UTC m=+162.210659785" watchObservedRunningTime="2026-05-26 21:47:48.151397988 +0000 UTC m=+162.211675819"
May 26 21:47:49.073343 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.072580    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f446f46f5-6bzhp"]
May 26 21:47:49.076541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.076437    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.079168 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.079142    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 26 21:47:49.079305 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.079272    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 26 21:47:49.079305 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.079280    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 26 21:47:49.080178 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.080154    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fsn3n6s3imcrf\""
May 26 21:47:49.080324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.080237    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5rz9j\""
May 26 21:47:49.080324 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.080262    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 21:47:49.085351 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.085141    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f446f46f5-6bzhp"]
May 26 21:47:49.139723 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.139666    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a" exitCode=0
May 26 21:47:49.139723 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.139712    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"}
May 26 21:47:49.147048 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.146981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147186 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147068    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-client-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147186 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-metrics-server-audit-profiles\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147186 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8rm\" (UniqueName: \"kubernetes.io/projected/9022167b-4578-421b-8504-1f04850153cb-kube-api-access-gb8rm\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147345 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-client-certs\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147345 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9022167b-4578-421b-8504-1f04850153cb-audit-log\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.147345 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.147255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-tls\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248423    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-metrics-server-audit-profiles\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248484    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8rm\" (UniqueName: \"kubernetes.io/projected/9022167b-4578-421b-8504-1f04850153cb-kube-api-access-gb8rm\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248557    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-client-certs\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248599    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9022167b-4578-421b-8504-1f04850153cb-audit-log\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248634    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-tls\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248780    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.249276 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.248905    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-client-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.250320 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.249914    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-metrics-server-audit-profiles\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.250320 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.250279    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9022167b-4578-421b-8504-1f04850153cb-audit-log\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.250829 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.250784    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9022167b-4578-421b-8504-1f04850153cb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.253547 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.252789    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-client-ca-bundle\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.253547 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.253497    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-client-certs\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.253988 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.253939    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9022167b-4578-421b-8504-1f04850153cb-secret-metrics-server-tls\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.258612 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.258590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8rm\" (UniqueName: \"kubernetes.io/projected/9022167b-4578-421b-8504-1f04850153cb-kube-api-access-gb8rm\") pod \"metrics-server-6f446f46f5-6bzhp\" (UID: \"9022167b-4578-421b-8504-1f04850153cb\") " pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.389727 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.389586    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:47:49.411212 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.411175    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"]
May 26 21:47:49.415622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.415592    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:49.418317 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.418290    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-7wk6r\""
May 26 21:47:49.419351 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.419323    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 21:47:49.424142 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.424111    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"]
May 26 21:47:49.549856 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.549822    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f446f46f5-6bzhp"]
May 26 21:47:49.551832 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.551687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kfq8t\" (UID: \"77302910-fa5e-4a08-b058-ca576bb2b4e7\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:49.652884 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.652792    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kfq8t\" (UID: \"77302910-fa5e-4a08-b058-ca576bb2b4e7\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:49.653055 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:49.652968    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 26 21:47:49.653055 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:49.653045    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert podName:77302910-fa5e-4a08-b058-ca576bb2b4e7 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:50.153023164 +0000 UTC m=+164.213300929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-kfq8t" (UID: "77302910-fa5e-4a08-b058-ca576bb2b4e7") : secret "monitoring-plugin-cert" not found
May 26 21:47:49.787617 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.787332    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"]
May 26 21:47:49.791528 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.791487    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.794983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.794498    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 21:47:49.794983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.794661    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2fxrp\""
May 26 21:47:49.794983 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.794971    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 21:47:49.795237 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.795006    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 21:47:49.795237 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.795012    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 21:47:49.795237 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.795165    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 21:47:49.803823 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.801244    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 21:47:49.806603 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.806552    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"]
May 26 21:47:49.854826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.854726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.854826 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.854783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.854895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8txd\" (UniqueName: \"kubernetes.io/projected/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-kube-api-access-t8txd\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.854941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-serving-certs-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.854987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-metrics-client-ca\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.855048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-federate-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.855074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.855220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.855118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.956643 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956415    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-metrics-client-ca\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.956643 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956542    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-federate-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.956643 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956571    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.956643 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956626    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956677    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956721    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956782    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8txd\" (UniqueName: \"kubernetes.io/projected/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-kube-api-access-t8txd\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957023 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.956810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-serving-certs-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957278 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.957213    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-metrics-client-ca\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957547 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.957454    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-serving-certs-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.957973 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.957918    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.960546 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.960231    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-telemeter-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.960766 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.960727    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.961451 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.961413    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.962189 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.962149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-federate-client-tls\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:49.966205 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:49.966181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8txd\" (UniqueName: \"kubernetes.io/projected/c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2-kube-api-access-t8txd\") pod \"telemeter-client-7d96c8864d-pnzxp\" (UID: \"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2\") " pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:50.109144 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.109049    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"
May 26 21:47:50.144118 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.144080    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tfrz" event={"ID":"ca3b6416-bb7c-4530-b616-d44ad2dea1ce","Type":"ContainerStarted","Data":"68fe80abcd908e66d2284b08c56624f566dbead0271678280139f2d59f3bca6a"}
May 26 21:47:50.158266 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.158029    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kfq8t\" (UID: \"77302910-fa5e-4a08-b058-ca576bb2b4e7\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:50.158266 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:50.158197    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9022167b_4578_421b_8504_1f04850153cb.slice/crio-8b2f1f10f300dfa7ebe76f772000e09cd8a5d456c04795ddbe75e2a176056fe5 WatchSource:0}: Error finding container 8b2f1f10f300dfa7ebe76f772000e09cd8a5d456c04795ddbe75e2a176056fe5: Status 404 returned error can't find the container with id 8b2f1f10f300dfa7ebe76f772000e09cd8a5d456c04795ddbe75e2a176056fe5
May 26 21:47:50.158526 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:50.158278    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 26 21:47:50.158526 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:47:50.158347    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert podName:77302910-fa5e-4a08-b058-ca576bb2b4e7 nodeName:}" failed. No retries permitted until 2026-05-26 21:47:51.158329084 +0000 UTC m=+165.218606849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-kfq8t" (UID: "77302910-fa5e-4a08-b058-ca576bb2b4e7") : secret "monitoring-plugin-cert" not found
May 26 21:47:50.341222 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.341184    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d96c8864d-pnzxp"]
May 26 21:47:50.344947 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:50.344907    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c61d3c_3d0f_49b6_bf61_ffda9d7a05b2.slice/crio-92adeb2fa5e5343c11fb43c8d32d1347f5aba8a7f27128629fd44b4a9c6d85a0 WatchSource:0}: Error finding container 92adeb2fa5e5343c11fb43c8d32d1347f5aba8a7f27128629fd44b4a9c6d85a0: Status 404 returned error can't find the container with id 92adeb2fa5e5343c11fb43c8d32d1347f5aba8a7f27128629fd44b4a9c6d85a0
May 26 21:47:50.778208 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.777707    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:47:50.784139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.784104    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.787405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.786860    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 21:47:50.787405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.786906    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 21:47:50.787405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.786941    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 21:47:50.787405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.787247    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 21:47:50.787812 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.787785    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 21:47:50.788864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.787990    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 21:47:50.788864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.788181    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 21:47:50.789037 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.788915    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 21:47:50.791919 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.789140    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tqrn6\""
May 26 21:47:50.791919 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.789325    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 21:47:50.791919 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.789342    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 21:47:50.791919 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.789604    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 21:47:50.791919 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.789962    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20hoq1hhbi35m\""
May 26 21:47:50.792414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.792168    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 21:47:50.793316 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.793198    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:47:50.867221 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qmr\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867269    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867417 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.867762 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.868065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.868065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.868065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.868065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.867962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.868065 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.868017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969692 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969637    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969702    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969760    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969788    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969825    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969850    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.969889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969873    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969916    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969955    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.969984    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970017    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970046    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45qmr\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970078    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970116    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970150    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970161    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970187    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.970223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.970217    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.973388 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.973211    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.974447 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.974420    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.974605 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.974449    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.975137 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.975094    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.975383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.975358    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.976272 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.976251    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.976468 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.976423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.976686 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.976634    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.977258 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.977217    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.977791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.977768    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.977903 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.977793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.978203 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.978161    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.979315 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.978895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.979315 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.979280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.980360 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.980307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qmr\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.987139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.984407    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.987139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.984611    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:50.987139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:50.986150    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:51.102869 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.102823    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:47:51.150369 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.150314    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fz44k" event={"ID":"b48147e8-cdaa-48a8-bde3-65da728464f6","Type":"ContainerStarted","Data":"af1ad991988a583a38ed4f895957f64921f8c3472f871b4d246a1d36980d9123"}
May 26 21:47:51.151836 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.151782    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp" event={"ID":"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2","Type":"ContainerStarted","Data":"92adeb2fa5e5343c11fb43c8d32d1347f5aba8a7f27128629fd44b4a9c6d85a0"}
May 26 21:47:51.152957 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.152915    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp" event={"ID":"9022167b-4578-421b-8504-1f04850153cb","Type":"ContainerStarted","Data":"8b2f1f10f300dfa7ebe76f772000e09cd8a5d456c04795ddbe75e2a176056fe5"}
May 26 21:47:51.155527 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.155230    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7tfrz" event={"ID":"ca3b6416-bb7c-4530-b616-d44ad2dea1ce","Type":"ContainerStarted","Data":"12b3caf362ad3e4a7c26b5e9eef55b04a744cc10a21a1b7110afa5c66d8a793c"}
May 26 21:47:51.155623 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.155533    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7tfrz"
May 26 21:47:51.168448 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.167137    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fz44k" podStartSLOduration=130.027355812 podStartE2EDuration="2m12.167117735s" podCreationTimestamp="2026-05-26 21:45:39 +0000 UTC" firstStartedPulling="2026-05-26 21:47:48.081281161 +0000 UTC m=+162.141558918" lastFinishedPulling="2026-05-26 21:47:50.22104308 +0000 UTC m=+164.281320841" observedRunningTime="2026-05-26 21:47:51.166223935 +0000 UTC m=+165.226501719" watchObservedRunningTime="2026-05-26 21:47:51.167117735 +0000 UTC m=+165.227395517"
May 26 21:47:51.175256 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.174904    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kfq8t\" (UID: \"77302910-fa5e-4a08-b058-ca576bb2b4e7\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:51.179435 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.179376    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77302910-fa5e-4a08-b058-ca576bb2b4e7-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kfq8t\" (UID: \"77302910-fa5e-4a08-b058-ca576bb2b4e7\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:51.187053 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.186992    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7tfrz" podStartSLOduration=130.80005268 podStartE2EDuration="2m12.186972173s" podCreationTimestamp="2026-05-26 21:45:39 +0000 UTC" firstStartedPulling="2026-05-26 21:47:48.066747594 +0000 UTC m=+162.127025353" lastFinishedPulling="2026-05-26 21:47:49.453667082 +0000 UTC m=+163.513944846" observedRunningTime="2026-05-26 21:47:51.183550242 +0000 UTC m=+165.243828023" watchObservedRunningTime="2026-05-26 21:47:51.186972173 +0000 UTC m=+165.247249954"
May 26 21:47:51.237294 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.237259    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:51.291466 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.291438    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:47:51.299254 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:51.299217    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fbeff9_c1f4_4db2_8c03_dbb44e66e4e7.slice/crio-dbb6b497f8a4dde26fc3579c8e9da0d00500ca07dd348d23a5448e9ed8b9f76b WatchSource:0}: Error finding container dbb6b497f8a4dde26fc3579c8e9da0d00500ca07dd348d23a5448e9ed8b9f76b: Status 404 returned error can't find the container with id dbb6b497f8a4dde26fc3579c8e9da0d00500ca07dd348d23a5448e9ed8b9f76b
May 26 21:47:51.466957 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:51.465707    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"]
May 26 21:47:51.476974 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:47:51.476938    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77302910_fa5e_4a08_b058_ca576bb2b4e7.slice/crio-a982b119cc5790c3af66b85e26f7f8fc50cea22c063aa0f3b0454eb96b6dea56 WatchSource:0}: Error finding container a982b119cc5790c3af66b85e26f7f8fc50cea22c063aa0f3b0454eb96b6dea56: Status 404 returned error can't find the container with id a982b119cc5790c3af66b85e26f7f8fc50cea22c063aa0f3b0454eb96b6dea56
May 26 21:47:52.161315 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.160984    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp" event={"ID":"9022167b-4578-421b-8504-1f04850153cb","Type":"ContainerStarted","Data":"3948602b834dd00aff8a54d9f9568478c53bfc8ad309603ee6f6db61448e0015"}
May 26 21:47:52.162745 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.162703    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t" event={"ID":"77302910-fa5e-4a08-b058-ca576bb2b4e7","Type":"ContainerStarted","Data":"a982b119cc5790c3af66b85e26f7f8fc50cea22c063aa0f3b0454eb96b6dea56"}
May 26 21:47:52.166063 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.166033    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"}
May 26 21:47:52.166206 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.166069    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"}
May 26 21:47:52.166206 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.166083    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"}
May 26 21:47:52.166206 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.166096    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"}
May 26 21:47:52.166206 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.166109    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"}
May 26 21:47:52.167590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.167489    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5" exitCode=0
May 26 21:47:52.167703 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.167548    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"}
May 26 21:47:52.167703 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.167632    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"dbb6b497f8a4dde26fc3579c8e9da0d00500ca07dd348d23a5448e9ed8b9f76b"}
May 26 21:47:52.181710 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:52.181625    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp" podStartSLOduration=1.3395996669999999 podStartE2EDuration="3.181605743s" podCreationTimestamp="2026-05-26 21:47:49 +0000 UTC" firstStartedPulling="2026-05-26 21:47:50.163043627 +0000 UTC m=+164.223321388" lastFinishedPulling="2026-05-26 21:47:52.00504969 +0000 UTC m=+166.065327464" observedRunningTime="2026-05-26 21:47:52.179685578 +0000 UTC m=+166.239963361" watchObservedRunningTime="2026-05-26 21:47:52.181605743 +0000 UTC m=+166.241883525"
May 26 21:47:54.177653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.177605    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t" event={"ID":"77302910-fa5e-4a08-b058-ca576bb2b4e7","Type":"ContainerStarted","Data":"ed47e01cc9cc050052c276515f81fec7a94639939d89c2d1e11e35d20401b7ae"}
May 26 21:47:54.178135 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.177827    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:54.185280 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.185253    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t"
May 26 21:47:54.186146 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.186119    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerStarted","Data":"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"}
May 26 21:47:54.188269 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.188242    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp" event={"ID":"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2","Type":"ContainerStarted","Data":"1b3ae6e7ff38172c5a65e5cae30e3ac3b4ee7ca75303093a18166c5a539ce80a"}
May 26 21:47:54.188429 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.188276    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp" event={"ID":"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2","Type":"ContainerStarted","Data":"b0ee50b155c548ae3b89a0a8deaed46d261653b91062c42dfd9ed4da4150f4d8"}
May 26 21:47:54.188429 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.188291    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp" event={"ID":"c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2","Type":"ContainerStarted","Data":"3642b0a845f24f8f701d2a305dbef260a2f3080a8510225f69399705781e3e4f"}
May 26 21:47:54.197470 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.197411    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kfq8t" podStartSLOduration=3.398653507 podStartE2EDuration="5.197392178s" podCreationTimestamp="2026-05-26 21:47:49 +0000 UTC" firstStartedPulling="2026-05-26 21:47:51.479229023 +0000 UTC m=+165.539506786" lastFinishedPulling="2026-05-26 21:47:53.277967683 +0000 UTC m=+167.338245457" observedRunningTime="2026-05-26 21:47:54.19633123 +0000 UTC m=+168.256609011" watchObservedRunningTime="2026-05-26 21:47:54.197392178 +0000 UTC m=+168.257669960"
May 26 21:47:54.226799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.226738    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.4933757930000002 podStartE2EDuration="9.226718225s" podCreationTimestamp="2026-05-26 21:47:45 +0000 UTC" firstStartedPulling="2026-05-26 21:47:47.600128978 +0000 UTC m=+161.660406735" lastFinishedPulling="2026-05-26 21:47:53.333471403 +0000 UTC m=+167.393749167" observedRunningTime="2026-05-26 21:47:54.22461176 +0000 UTC m=+168.284889541" watchObservedRunningTime="2026-05-26 21:47:54.226718225 +0000 UTC m=+168.286996005"
May 26 21:47:54.268444 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:54.268384    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d96c8864d-pnzxp" podStartSLOduration=2.338156358 podStartE2EDuration="5.268367494s" podCreationTimestamp="2026-05-26 21:47:49 +0000 UTC" firstStartedPulling="2026-05-26 21:47:50.347669279 +0000 UTC m=+164.407947042" lastFinishedPulling="2026-05-26 21:47:53.277880421 +0000 UTC m=+167.338158178" observedRunningTime="2026-05-26 21:47:54.266879707 +0000 UTC m=+168.327157493" watchObservedRunningTime="2026-05-26 21:47:54.268367494 +0000 UTC m=+168.328645275"
May 26 21:47:56.197827 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:56.197735    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"}
May 26 21:47:56.197827 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:56.197776    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"}
May 26 21:47:58.092959 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.092929    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:47:58.206120 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.206087    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"}
May 26 21:47:58.206280 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.206122    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"}
May 26 21:47:58.206280 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.206144    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"}
May 26 21:47:58.206280 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.206152    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerStarted","Data":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"}
May 26 21:47:58.236422 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:58.236348    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.192742784 podStartE2EDuration="8.236327917s" podCreationTimestamp="2026-05-26 21:47:50 +0000 UTC" firstStartedPulling="2026-05-26 21:47:52.169177443 +0000 UTC m=+166.229455216" lastFinishedPulling="2026-05-26 21:47:57.212762573 +0000 UTC m=+171.273040349" observedRunningTime="2026-05-26 21:47:58.234832368 +0000 UTC m=+172.295110149" watchObservedRunningTime="2026-05-26 21:47:58.236327917 +0000 UTC m=+172.296605700"
May 26 21:47:59.553603 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:47:59.553566    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:48:01.103771 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:01.103720    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:48:01.170294 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:01.170259    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7tfrz"
May 26 21:48:03.105030 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.104975    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" podUID="377e66b7-7425-48bc-90db-4d4037f49779" containerName="registry" containerID="cri-o://305e8f4ecfd5b5a61f9a3684d213d1d42157d220a28fa2f3a67b2e3cfc25cd25" gracePeriod=30
May 26 21:48:03.223809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.223776    2559 generic.go:358] "Generic (PLEG): container finished" podID="377e66b7-7425-48bc-90db-4d4037f49779" containerID="305e8f4ecfd5b5a61f9a3684d213d1d42157d220a28fa2f3a67b2e3cfc25cd25" exitCode=0
May 26 21:48:03.223943 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.223825    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" event={"ID":"377e66b7-7425-48bc-90db-4d4037f49779","Type":"ContainerDied","Data":"305e8f4ecfd5b5a61f9a3684d213d1d42157d220a28fa2f3a67b2e3cfc25cd25"}
May 26 21:48:03.376661 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.376369    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:48:03.508073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508038    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zx6r\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508073 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508089    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508304 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508145    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508304 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508169    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508304 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508200    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508478 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508397    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508478 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508458    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508625 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508536    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token\") pod \"377e66b7-7425-48bc-90db-4d4037f49779\" (UID: \"377e66b7-7425-48bc-90db-4d4037f49779\") "
May 26 21:48:03.508729 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508705    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:48:03.508787 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508757    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:48:03.508888 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508867    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-registry-certificates\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.508948 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.508895    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/377e66b7-7425-48bc-90db-4d4037f49779-trusted-ca\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.511184 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.511149    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r" (OuterVolumeSpecName: "kube-api-access-9zx6r") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "kube-api-access-9zx6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:03.511452 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.511410    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:03.511570 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.511493    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:48:03.511756 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.511721    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:48:03.511842 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.511810    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:48:03.521695 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.521488    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "377e66b7-7425-48bc-90db-4d4037f49779" (UID: "377e66b7-7425-48bc-90db-4d4037f49779"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:48:03.609862 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609813    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-installation-pull-secrets\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.609862 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609848    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/377e66b7-7425-48bc-90db-4d4037f49779-image-registry-private-configuration\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.609862 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609864    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-bound-sa-token\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.610104 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609877    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zx6r\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-kube-api-access-9zx6r\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.610104 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609890    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/377e66b7-7425-48bc-90db-4d4037f49779-ca-trust-extracted\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:03.610104 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:03.609903    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/377e66b7-7425-48bc-90db-4d4037f49779-registry-tls\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:48:04.228147 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.228116    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns" event={"ID":"377e66b7-7425-48bc-90db-4d4037f49779","Type":"ContainerDied","Data":"61446edaef96c94936f0572810a71749a8b7b21f728821d52827a15935e0c59e"}
May 26 21:48:04.228585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.228158    2559 scope.go:117] "RemoveContainer" containerID="305e8f4ecfd5b5a61f9a3684d213d1d42157d220a28fa2f3a67b2e3cfc25cd25"
May 26 21:48:04.228585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.228125    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c6cfdfd5-8trns"
May 26 21:48:04.251987 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.251954    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:48:04.256328 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.256302    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68c6cfdfd5-8trns"]
May 26 21:48:04.558062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:04.558027    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377e66b7-7425-48bc-90db-4d4037f49779" path="/var/lib/kubelet/pods/377e66b7-7425-48bc-90db-4d4037f49779/volumes"
May 26 21:48:09.389761 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:09.389725    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:48:09.389761 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:09.389770    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:48:11.714445 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:11.714416    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fz44k_b48147e8-cdaa-48a8-bde3-65da728464f6/serve-healthcheck-canary/0.log"
May 26 21:48:27.303239 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:27.303199    2559 generic.go:358] "Generic (PLEG): container finished" podID="4eda3c55-5fe4-4bfb-961a-693afe15f009" containerID="60c18a8c858eb1c9932d3135f6e7a210130d44e57c1b06d9e529db403e24d87b" exitCode=0
May 26 21:48:27.303697 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:27.303278    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8" event={"ID":"4eda3c55-5fe4-4bfb-961a-693afe15f009","Type":"ContainerDied","Data":"60c18a8c858eb1c9932d3135f6e7a210130d44e57c1b06d9e529db403e24d87b"}
May 26 21:48:27.303697 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:27.303624    2559 scope.go:117] "RemoveContainer" containerID="60c18a8c858eb1c9932d3135f6e7a210130d44e57c1b06d9e529db403e24d87b"
May 26 21:48:28.307651 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:28.307616    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-fw8r8" event={"ID":"4eda3c55-5fe4-4bfb-961a-693afe15f009","Type":"ContainerStarted","Data":"c6b426aba446c497c0307cc3b84729abfeb1e57d37504eecd46b00cc77cc5f14"}
May 26 21:48:29.395843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:29.395812    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:48:29.400094 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:29.400070    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f446f46f5-6bzhp"
May 26 21:48:51.103997 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:51.103963    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:48:51.123896 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:51.123858    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:48:51.392528 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:48:51.392430    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:05.029822 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.029780    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:05.030702 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.030640    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="alertmanager" containerID="cri-o://3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723" gracePeriod=120
May 26 21:49:05.031325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.030852    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy" containerID="cri-o://fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5" gracePeriod=120
May 26 21:49:05.031325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.030970    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="prom-label-proxy" containerID="cri-o://a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86" gracePeriod=120
May 26 21:49:05.031325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.031062    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-web" containerID="cri-o://68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0" gracePeriod=120
May 26 21:49:05.031325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.031034    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-metric" containerID="cri-o://7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802" gracePeriod=120
May 26 21:49:05.031325 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.031085    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="config-reloader" containerID="cri-o://076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2" gracePeriod=120
May 26 21:49:05.421209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421177    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86" exitCode=0
May 26 21:49:05.421209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421203    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5" exitCode=0
May 26 21:49:05.421209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421209    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2" exitCode=0
May 26 21:49:05.421209 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421215    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723" exitCode=0
May 26 21:49:05.421490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421258    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"}
May 26 21:49:05.421490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421296    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"}
May 26 21:49:05.421490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421306    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"}
May 26 21:49:05.421490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:05.421317    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"}
May 26 21:49:06.275931 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.275906    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.390092 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.389997    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390092 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390033    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5thcj\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390092 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390059    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390092 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390092    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390111    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390132    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390165    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.390416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390204    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390764    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390819    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390892    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390899    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.390986    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391032    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets\") pod \"0c0fd904-a664-4842-bf05-b77e1041ef52\" (UID: \"0c0fd904-a664-4842-bf05-b77e1041ef52\") "
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391314    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391360    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391461    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391482    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-alertmanager-main-db\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.391576 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.391499    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c0fd904-a664-4842-bf05-b77e1041ef52-metrics-client-ca\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.393381 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.393351    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.393498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.393475    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume" (OuterVolumeSpecName: "config-volume") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.393621 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.393599    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj" (OuterVolumeSpecName: "kube-api-access-5thcj") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "kube-api-access-5thcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:49:06.394149 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.394123    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.394852 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.394828    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:49:06.394989 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.394974    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out" (OuterVolumeSpecName: "config-out") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:49:06.395369 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.395340    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.395590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.395571    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.399423 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.399392    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.406062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.406038    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config" (OuterVolumeSpecName: "web-config") pod "0c0fd904-a664-4842-bf05-b77e1041ef52" (UID: "0c0fd904-a664-4842-bf05-b77e1041ef52"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:06.427641 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427608    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802" exitCode=0
May 26 21:49:06.427641 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427635    2559 generic.go:358] "Generic (PLEG): container finished" podID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerID="68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0" exitCode=0
May 26 21:49:06.427881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427686    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"}
May 26 21:49:06.427881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427730    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.427881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427734    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"}
May 26 21:49:06.427881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427749    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c0fd904-a664-4842-bf05-b77e1041ef52","Type":"ContainerDied","Data":"05856162a30ca6c16a14a1da567a207a514c5ce6fff766257c8219cb05cf0371"}
May 26 21:49:06.427881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.427769    2559 scope.go:117] "RemoveContainer" containerID="a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"
May 26 21:49:06.436179 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.436150    2559 scope.go:117] "RemoveContainer" containerID="7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"
May 26 21:49:06.444101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.444074    2559 scope.go:117] "RemoveContainer" containerID="fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"
May 26 21:49:06.450522 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.450494    2559 scope.go:117] "RemoveContainer" containerID="68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"
May 26 21:49:06.455376 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.455350    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:06.457542 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.457525    2559 scope.go:117] "RemoveContainer" containerID="076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"
May 26 21:49:06.463736 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.463715    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:06.464871 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.464850    2559 scope.go:117] "RemoveContainer" containerID="3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"
May 26 21:49:06.471474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.471449    2559 scope.go:117] "RemoveContainer" containerID="e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"
May 26 21:49:06.478234 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.478203    2559 scope.go:117] "RemoveContainer" containerID="a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"
May 26 21:49:06.478493 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.478462    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86\": container with ID starting with a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86 not found: ID does not exist" containerID="a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"
May 26 21:49:06.478582 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.478494    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"} err="failed to get container status \"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86\": rpc error: code = NotFound desc = could not find container \"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86\": container with ID starting with a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86 not found: ID does not exist"
May 26 21:49:06.478582 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.478550    2559 scope.go:117] "RemoveContainer" containerID="7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"
May 26 21:49:06.478812 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.478794    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802\": container with ID starting with 7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802 not found: ID does not exist" containerID="7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"
May 26 21:49:06.478860 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.478818    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"} err="failed to get container status \"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802\": rpc error: code = NotFound desc = could not find container \"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802\": container with ID starting with 7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802 not found: ID does not exist"
May 26 21:49:06.478860 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.478836    2559 scope.go:117] "RemoveContainer" containerID="fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"
May 26 21:49:06.479072 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.479054    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5\": container with ID starting with fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5 not found: ID does not exist" containerID="fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"
May 26 21:49:06.479111 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479077    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"} err="failed to get container status \"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5\": rpc error: code = NotFound desc = could not find container \"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5\": container with ID starting with fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5 not found: ID does not exist"
May 26 21:49:06.479111 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479092    2559 scope.go:117] "RemoveContainer" containerID="68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"
May 26 21:49:06.479300 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.479285    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0\": container with ID starting with 68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0 not found: ID does not exist" containerID="68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"
May 26 21:49:06.479339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479306    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"} err="failed to get container status \"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0\": rpc error: code = NotFound desc = could not find container \"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0\": container with ID starting with 68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0 not found: ID does not exist"
May 26 21:49:06.479339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479321    2559 scope.go:117] "RemoveContainer" containerID="076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"
May 26 21:49:06.479547 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.479528    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2\": container with ID starting with 076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2 not found: ID does not exist" containerID="076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"
May 26 21:49:06.479595 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479551    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"} err="failed to get container status \"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2\": rpc error: code = NotFound desc = could not find container \"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2\": container with ID starting with 076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2 not found: ID does not exist"
May 26 21:49:06.479595 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479566    2559 scope.go:117] "RemoveContainer" containerID="3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"
May 26 21:49:06.479755 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.479740    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723\": container with ID starting with 3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723 not found: ID does not exist" containerID="3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"
May 26 21:49:06.479795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479763    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"} err="failed to get container status \"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723\": rpc error: code = NotFound desc = could not find container \"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723\": container with ID starting with 3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723 not found: ID does not exist"
May 26 21:49:06.479795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.479780    2559 scope.go:117] "RemoveContainer" containerID="e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"
May 26 21:49:06.480001 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.479985    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a\": container with ID starting with e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a not found: ID does not exist" containerID="e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"
May 26 21:49:06.480055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480003    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"} err="failed to get container status \"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a\": rpc error: code = NotFound desc = could not find container \"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a\": container with ID starting with e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a not found: ID does not exist"
May 26 21:49:06.480055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480022    2559 scope.go:117] "RemoveContainer" containerID="a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"
May 26 21:49:06.480247 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480217    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86"} err="failed to get container status \"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86\": rpc error: code = NotFound desc = could not find container \"a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86\": container with ID starting with a40586e0cf31613ae3bcd7e4f39ba1bb2c8bf4f495352ee7d7e13b53364eae86 not found: ID does not exist"
May 26 21:49:06.480302 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480248    2559 scope.go:117] "RemoveContainer" containerID="7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"
May 26 21:49:06.480475 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480454    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802"} err="failed to get container status \"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802\": rpc error: code = NotFound desc = could not find container \"7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802\": container with ID starting with 7b9a86dc86f0f493f9aec8c06a0866ed52079722152cbfc497f02b225e399802 not found: ID does not exist"
May 26 21:49:06.480538 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480476    2559 scope.go:117] "RemoveContainer" containerID="fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"
May 26 21:49:06.480754 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480736    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5"} err="failed to get container status \"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5\": rpc error: code = NotFound desc = could not find container \"fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5\": container with ID starting with fe26b086e5da3922dcdb2dda09551edf8caf5a12a961ac3af223a5db393626a5 not found: ID does not exist"
May 26 21:49:06.480808 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480755    2559 scope.go:117] "RemoveContainer" containerID="68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"
May 26 21:49:06.480948 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480930    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0"} err="failed to get container status \"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0\": rpc error: code = NotFound desc = could not find container \"68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0\": container with ID starting with 68887697a5e563359f27ce9df4e438400220284b787e282a8d3f4fbb8d1fe7e0 not found: ID does not exist"
May 26 21:49:06.480985 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.480949    2559 scope.go:117] "RemoveContainer" containerID="076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"
May 26 21:49:06.481124 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.481106    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2"} err="failed to get container status \"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2\": rpc error: code = NotFound desc = could not find container \"076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2\": container with ID starting with 076bc5cde1f73a14d66efa5c78b11c121faee543c0020f95a0273cc6c1999ec2 not found: ID does not exist"
May 26 21:49:06.481163 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.481127    2559 scope.go:117] "RemoveContainer" containerID="3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"
May 26 21:49:06.481320 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.481294    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723"} err="failed to get container status \"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723\": rpc error: code = NotFound desc = could not find container \"3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723\": container with ID starting with 3b98ab3b98cf4e9af77348c02828e566e234d9f2143555a6ff9578dfb08b6723 not found: ID does not exist"
May 26 21:49:06.481320 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.481320    2559 scope.go:117] "RemoveContainer" containerID="e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"
May 26 21:49:06.481573 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.481555    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a"} err="failed to get container status \"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a\": rpc error: code = NotFound desc = could not find container \"e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a\": container with ID starting with e1ea073f1fcfc35dc38529d2c73c4925737d19ba37c123e4eb1b1982b387364a not found: ID does not exist"
May 26 21:49:06.492618 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492594    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-config-volume\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492618 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492617    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5thcj\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-kube-api-access-5thcj\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492629    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492639    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492650    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c0fd904-a664-4842-bf05-b77e1041ef52-config-out\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492659    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492669    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-secret-alertmanager-main-tls\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492678    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-web-config\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492687    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c0fd904-a664-4842-bf05-b77e1041ef52-cluster-tls-config\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.492809 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.492695    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c0fd904-a664-4842-bf05-b77e1041ef52-tls-assets\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:06.495015 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.494991    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:06.495317 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495305    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="config-reloader"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495318    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="config-reloader"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495330    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="alertmanager"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495336    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="alertmanager"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495342    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-web"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495348    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-web"
May 26 21:49:06.495355 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495356    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495362    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495370    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="init-config-reloader"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495376    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="init-config-reloader"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495383    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377e66b7-7425-48bc-90db-4d4037f49779" containerName="registry"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495388    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="377e66b7-7425-48bc-90db-4d4037f49779" containerName="registry"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495395    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="prom-label-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495400    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="prom-label-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495409    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-metric"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495414    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-metric"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495460    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-metric"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495470    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="config-reloader"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495475    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495481    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="kube-rbac-proxy-web"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495488    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="prom-label-proxy"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495494    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" containerName="alertmanager"
May 26 21:49:06.495541 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.495500    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="377e66b7-7425-48bc-90db-4d4037f49779" containerName="registry"
May 26 21:49:06.499321 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.499303    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.502503 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.502484    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 21:49:06.502503 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.502484    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 21:49:06.502683 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.502485    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-srtq5\""
May 26 21:49:06.502683 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.502636    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 21:49:06.503354 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.503335    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 21:49:06.504950 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.504932    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 21:49:06.505045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.504977    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 21:49:06.505045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.504984    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 21:49:06.505045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.505021    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 21:49:06.510258 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.510239    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 21:49:06.522359 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.522332    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:06.562585 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.560593    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c0fd904-a664-4842-bf05-b77e1041ef52" path="/var/lib/kubelet/pods/0c0fd904-a664-4842-bf05-b77e1041ef52/volumes"
May 26 21:49:06.593769 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.593935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.593935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.593935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.593935 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594064 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.593965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594064 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594064 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259z4\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-kube-api-access-259z4\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594154 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594154 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594216 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594216 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.594277 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.594215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.694872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694767    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.694872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694812    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.694872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694830    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.694872 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694860    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694916    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-259z4\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-kube-api-access-259z4\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694949    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.694971    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695019    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695048    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695072    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695104    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695207 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695137    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695680 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695236    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.695680 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.695652    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.696503 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.696471    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca4b824d-edf5-456b-b563-6d33a5db3b5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.697904 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.697764    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698057    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698109    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698314 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698363 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698310    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698423 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698408    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.698882 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.698864    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.699795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.699775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca4b824d-edf5-456b-b563-6d33a5db3b5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.716339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.716313    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-259z4\" (UniqueName: \"kubernetes.io/projected/ca4b824d-edf5-456b-b563-6d33a5db3b5d-kube-api-access-259z4\") pod \"alertmanager-main-0\" (UID: \"ca4b824d-edf5-456b-b563-6d33a5db3b5d\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.811768 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.811733    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 21:49:06.952169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:06.952092    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 21:49:06.955608 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:49:06.955576    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4b824d_edf5_456b_b563_6d33a5db3b5d.slice/crio-baad0cfbf4c0af53a3593ac31dda8235a75d3a8126ad86e94c006e7066891530 WatchSource:0}: Error finding container baad0cfbf4c0af53a3593ac31dda8235a75d3a8126ad86e94c006e7066891530: Status 404 returned error can't find the container with id baad0cfbf4c0af53a3593ac31dda8235a75d3a8126ad86e94c006e7066891530
May 26 21:49:06.991789 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:06.991757    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:07.432929 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:07.432896    2559 generic.go:358] "Generic (PLEG): container finished" podID="ca4b824d-edf5-456b-b563-6d33a5db3b5d" containerID="84c2d9dc3d76650e15cae23d866c5fa0291c0515d36ef18961413f2dcf9b7ad4" exitCode=0
May 26 21:49:07.433306 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:07.432965    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerDied","Data":"84c2d9dc3d76650e15cae23d866c5fa0291c0515d36ef18961413f2dcf9b7ad4"}
May 26 21:49:07.433306 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:07.432987    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"baad0cfbf4c0af53a3593ac31dda8235a75d3a8126ad86e94c006e7066891530"}
May 26 21:49:07.644665 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:07.644636    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:08.439465 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439427    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"16d12ac58689a1649c09ddb713f9ed194051ae28bc7a5bfcb52c1375ea8b24f2"}
May 26 21:49:08.439465 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439470    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"810e65f3c78a052af75e097f2789412f7ec8ef77a01b4af774af13f2beb4241a"}
May 26 21:49:08.439964 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439484    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"c0c355ce4abf209f53fe4da61346f34c71573cedacdd86d5faa30d0812430e18"}
May 26 21:49:08.439964 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439496    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"bdf07db8938e811b7ce05e037d39b1792b50eb885043bae1416a12931ab6a81e"}
May 26 21:49:08.439964 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439532    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"65092fe9f8d2463e568f485be3d7a65a0e93dfe98610935b9a88818b6c191dcf"}
May 26 21:49:08.439964 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.439545    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca4b824d-edf5-456b-b563-6d33a5db3b5d","Type":"ContainerStarted","Data":"6eedf8adbed19eebd99da3285606acb3cdc8d5a2eddfd6df8f325acaadc54fe2"}
May 26 21:49:08.473028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:08.472978    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.472962694 podStartE2EDuration="2.472962694s" podCreationTimestamp="2026-05-26 21:49:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:49:08.470835387 +0000 UTC m=+242.531113202" watchObservedRunningTime="2026-05-26 21:49:08.472962694 +0000 UTC m=+242.533240473"
May 26 21:49:09.377474 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377442    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377888    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="prometheus" containerID="cri-o://d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db" gracePeriod=600
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377933    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57" gracePeriod=600
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377945    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="config-reloader" containerID="cri-o://3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65" gracePeriod=600
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377908    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy" containerID="cri-o://7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1" gracePeriod=600
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377945    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="thanos-sidecar" containerID="cri-o://24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804" gracePeriod=600
May 26 21:49:09.378116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.377941    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-web" containerID="cri-o://60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385" gracePeriod=600
May 26 21:49:09.638436 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.638412    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:09.723871 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723840    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723884    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45qmr\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723906    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723929    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723946    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723980    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.723997    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724012    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724030    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724045 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724051    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724066    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724081    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724108    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724133    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724150    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724189    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724204    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724244    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy\") pod \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\" (UID: \"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7\") "
May 26 21:49:09.724531 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724288    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:09.724938 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.724584    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.725087 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.725059    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:49:09.725158 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.725086    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:09.725542 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.725235    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:09.726690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.726662    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.726690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.726672    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr" (OuterVolumeSpecName: "kube-api-access-45qmr") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "kube-api-access-45qmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:49:09.727031 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.727008    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:09.727591 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.727320    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config" (OuterVolumeSpecName: "config") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.728101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.727835    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:49:09.728182 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.728157    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out" (OuterVolumeSpecName: "config-out") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 21:49:09.728182 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.728165    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.728295 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.728169    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:49:09.728761 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.728731    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.729351 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.729326    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.729881 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.729862    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.730046 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.730020    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.730130 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.730071    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.741562 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.741532    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config" (OuterVolumeSpecName: "web-config") pod "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" (UID: "a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 21:49:09.825062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825021    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-metrics-client-ca\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825053    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-metrics-client-certs\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825063    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-kube-rbac-proxy\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825062 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825072    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45qmr\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-kube-api-access-45qmr\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825081    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-db\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825091    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825102    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825112    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825121    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-tls-assets\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825129    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825137    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-config-out\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825146    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825156    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-web-config\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825164    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825172    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-grpc-tls\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825181    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:09.825333 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:09.825192    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:49:10.449622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449585    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57" exitCode=0
May 26 21:49:10.449622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449614    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1" exitCode=0
May 26 21:49:10.449622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449620    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385" exitCode=0
May 26 21:49:10.449622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449627    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804" exitCode=0
May 26 21:49:10.449622 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449632    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65" exitCode=0
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449636    2559 generic.go:358] "Generic (PLEG): container finished" podID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db" exitCode=0
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449673    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449706    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449723    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449711    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449855    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449871    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449888    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449901    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"}
May 26 21:49:10.449967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.449912    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7","Type":"ContainerDied","Data":"dbb6b497f8a4dde26fc3579c8e9da0d00500ca07dd348d23a5448e9ed8b9f76b"}
May 26 21:49:10.457540 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.457505    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.464272 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.464255    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.470962 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.470941    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.477319 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.477304    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.484042 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.484018    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.487773 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.487748    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:10.494920 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.493046    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.494920 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.493312    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:10.502070 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502040    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.502376 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.502353    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.502456 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502392    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.502456 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502420    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.502720 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.502700    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.502808 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502722    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.502808 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502736    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.502974 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.502958    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.503014 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502978    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.503014 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.502992    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.503206 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.503185    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.503279 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503212    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.503279 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503229    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.503437 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.503421    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.503493 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503443    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.503493 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503463    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.503690 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.503675    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.503799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503695    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.503799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503716    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.503926 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:10.503911    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.503960 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503929    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.503960 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.503943    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.504181 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504157    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.504227 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504182    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.504380 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504364    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.504423 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504380    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.504625 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504607    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.504667 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504626    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.504847 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504829    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.504847 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.504847    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.505055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505039    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.505094 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505055    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.505258 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505239    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.505323 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505260    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.505479 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505461    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.505556 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505479    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.505698 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505681    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.505765 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505698    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.505908 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505890    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.505972 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.505908    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.506101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506084    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.506164 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506101    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.506272 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506253    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.506339 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506274    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.506521 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506488    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.506572 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506529    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.506746 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506728    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.506791 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506746    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.506967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506947    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.507016 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.506968    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.507174 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507153    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.507218 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507175    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.507368 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507350    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.507434 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507371    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.507624 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507606    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.507677 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507625    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.507811 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507794    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.507861 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.507812    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.508017 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508001    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.508055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508018    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.508213 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508197    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.508257 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508213    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.508421 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508402    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.508476 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508421    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.508653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508637    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.508707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508654    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.508859 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508840    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.508933 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.508870    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.509063 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509048    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.509116 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509063    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.509245 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509231    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.509288 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509246    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.509458 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509431    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.509542 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509460    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.509687 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509670    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.509754 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509689    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.509902 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509882    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.509952 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.509906    2559 scope.go:117] "RemoveContainer" containerID="e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"
May 26 21:49:10.510105 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510084    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57"} err="failed to get container status \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": rpc error: code = NotFound desc = could not find container \"e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57\": container with ID starting with e3df864184e751ca16bc1726f639d3f4b1eca2239ba3a71cf314e881a7bc5c57 not found: ID does not exist"
May 26 21:49:10.510166 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510107    2559 scope.go:117] "RemoveContainer" containerID="7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"
May 26 21:49:10.510313 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510295    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1"} err="failed to get container status \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": rpc error: code = NotFound desc = could not find container \"7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1\": container with ID starting with 7d2f949e66505a049115e283ae263046e6549f57067144df8a139fc46117c9b1 not found: ID does not exist"
May 26 21:49:10.510349 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510313    2559 scope.go:117] "RemoveContainer" containerID="60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"
May 26 21:49:10.510530 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510500    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385"} err="failed to get container status \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": rpc error: code = NotFound desc = could not find container \"60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385\": container with ID starting with 60211d664f5cf3daef7343a52fc7feb0e2ab6afd3645e1b3d1fa24e1c788b385 not found: ID does not exist"
May 26 21:49:10.510574 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510530    2559 scope.go:117] "RemoveContainer" containerID="24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"
May 26 21:49:10.510703 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510689    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804"} err="failed to get container status \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": rpc error: code = NotFound desc = could not find container \"24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804\": container with ID starting with 24342c7cab2af6c65333b0b7f99761733dce2918791ed9fa7ab878fff815e804 not found: ID does not exist"
May 26 21:49:10.510744 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510703    2559 scope.go:117] "RemoveContainer" containerID="3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"
May 26 21:49:10.510889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510871    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65"} err="failed to get container status \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": rpc error: code = NotFound desc = could not find container \"3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65\": container with ID starting with 3bd328622b15ddba81c20bb0a4acdfa1fb43b33a7ab8d1f830157b7a43a3bd65 not found: ID does not exist"
May 26 21:49:10.510950 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.510891    2559 scope.go:117] "RemoveContainer" containerID="d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"
May 26 21:49:10.511082 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.511067    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db"} err="failed to get container status \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": rpc error: code = NotFound desc = could not find container \"d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db\": container with ID starting with d888bc5ecf09ba832528fd9e6ea082fce433e1596f9c55e1a5786a3892f538db not found: ID does not exist"
May 26 21:49:10.511082 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.511081    2559 scope.go:117] "RemoveContainer" containerID="066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"
May 26 21:49:10.511259 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.511242    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5"} err="failed to get container status \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": rpc error: code = NotFound desc = could not find container \"066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5\": container with ID starting with 066ab0d3036df5ef0c9f1af93c30679f23e8dabb86f87cabdebb140c504f63f5 not found: ID does not exist"
May 26 21:49:10.552752 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.552715    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:10.553049 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553036    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-thanos"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553051    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-thanos"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553061    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="config-reloader"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553066    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="config-reloader"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553074    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="init-config-reloader"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553082    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="init-config-reloader"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553092    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="prometheus"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553097    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="prometheus"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553104    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy"
May 26 21:49:10.553108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553108    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553114    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-web"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553119    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-web"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553130    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="thanos-sidecar"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553134    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="thanos-sidecar"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553195    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553203    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="config-reloader"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553210    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="prometheus"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553216    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-thanos"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553223    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="kube-rbac-proxy-web"
May 26 21:49:10.553383 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.553228    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" containerName="thanos-sidecar"
May 26 21:49:10.557682 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.557659    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.560955 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.560899    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 21:49:10.564551 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.564503    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20hoq1hhbi35m\""
May 26 21:49:10.564714 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.564588    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 21:49:10.564714 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.564622    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 21:49:10.564850 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.564752    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tqrn6\""
May 26 21:49:10.564901 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.564859    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 21:49:10.565457 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.565428    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 21:49:10.565745 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.565721    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7" path="/var/lib/kubelet/pods/a3fbeff9-c1f4-4db2-8c03-dbb44e66e4e7/volumes"
May 26 21:49:10.565910 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.565894    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 21:49:10.566212 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.566195    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 21:49:10.569707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.569671    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 21:49:10.569855 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.569833    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 21:49:10.569976 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.569882    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 21:49:10.571311 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.571289    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 21:49:10.575877 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.575860    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 21:49:10.593843 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.593813    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:10.631584 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631584 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config-out\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.631790 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.631933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632020 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.632005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632225 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.632099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-web-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632225 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.632121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv2wm\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-kube-api-access-hv2wm\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.632225 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.632154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.732864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732781    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.732864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732817    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.732864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732857    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732887    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732929    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732971    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.732999    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733032    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733065    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-web-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733091    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hv2wm\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-kube-api-access-hv2wm\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733138    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733201    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733230    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733271    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733297    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config-out\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733331    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733368    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.733414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733407    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.734181 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.733792    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.734181 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.734055    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736377 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736054    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736377 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736076    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736377 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736118    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736642 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736527    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736863    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.736993 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.736972    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-web-config\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.737472 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.737444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.737805 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.737779    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.737884 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.737778    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.737949 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.737880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.738305 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.738270    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/412d9510-1bb4-4556-abdf-bfd5ce2c6307-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.738605 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.738584    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.738864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.738845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.739156 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.739138    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/412d9510-1bb4-4556-abdf-bfd5ce2c6307-config-out\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.739220 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.739137    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/412d9510-1bb4-4556-abdf-bfd5ce2c6307-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.750176 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.750150    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv2wm\" (UniqueName: \"kubernetes.io/projected/412d9510-1bb4-4556-abdf-bfd5ce2c6307-kube-api-access-hv2wm\") pod \"prometheus-k8s-0\" (UID: \"412d9510-1bb4-4556-abdf-bfd5ce2c6307\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:10.871050 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:10.871009    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:11.015170 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:11.015069    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 21:49:11.017889 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:49:11.017858    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412d9510_1bb4_4556_abdf_bfd5ce2c6307.slice/crio-f15cf75adbff74ff60e383ae624db73afbacd6601502340bbc675c1ff07930ea WatchSource:0}: Error finding container f15cf75adbff74ff60e383ae624db73afbacd6601502340bbc675c1ff07930ea: Status 404 returned error can't find the container with id f15cf75adbff74ff60e383ae624db73afbacd6601502340bbc675c1ff07930ea
May 26 21:49:11.454678 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:11.454646    2559 generic.go:358] "Generic (PLEG): container finished" podID="412d9510-1bb4-4556-abdf-bfd5ce2c6307" containerID="0ac2e71ab7920bf019d0ea0a6089ffaa8c7eed146ab5efff15a6297d90faa784" exitCode=0
May 26 21:49:11.454829 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:11.454715    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerDied","Data":"0ac2e71ab7920bf019d0ea0a6089ffaa8c7eed146ab5efff15a6297d90faa784"}
May 26 21:49:11.454829 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:11.454736    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"f15cf75adbff74ff60e383ae624db73afbacd6601502340bbc675c1ff07930ea"}
May 26 21:49:12.460555 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460504    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"9e442452be24ff6104d46efbc057b044298a3a602ee00746307ce5072d9ef025"}
May 26 21:49:12.460555 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460558    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"03dc838a13374cee0adca3a8e22ea5bfe95ae371d6521378d67e8390d74e4eb1"}
May 26 21:49:12.460951 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460568    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"a77ff53e8a4b1440e285984435d56425b9b50d99b8addec65361c6d2eafd3be9"}
May 26 21:49:12.460951 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460577    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"62e497abeff9cdd761b679294c3d8fac67ce13dc5ff01a7f00fbb9872db5659a"}
May 26 21:49:12.460951 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460586    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"553c4240b2cd2798b3b3084fe7e5325d5cc57938a9654a586d73bab9c4908336"}
May 26 21:49:12.460951 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:12.460595    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"412d9510-1bb4-4556-abdf-bfd5ce2c6307","Type":"ContainerStarted","Data":"011e96d7afc86fced7cf672021b56ff203ee818c75b39b5a22a123ce270dd2ce"}
May 26 21:49:15.871223 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:15.871173    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:49:17.029771 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:17.029731    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:17.298030 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.297985    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:49:17.300405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.300377    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe-metrics-certs\") pod \"network-metrics-daemon-zh76m\" (UID: \"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe\") " pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:49:17.556980 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.556901    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqzm9\""
May 26 21:49:17.564555 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.564487    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zh76m"
May 26 21:49:17.703482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.703411    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.703388642 podStartE2EDuration="7.703388642s" podCreationTimestamp="2026-05-26 21:49:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 21:49:12.512060186 +0000 UTC m=+246.572337967" watchObservedRunningTime="2026-05-26 21:49:17.703388642 +0000 UTC m=+251.763666423"
May 26 21:49:17.704813 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:17.704782    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zh76m"]
May 26 21:49:17.708991 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:49:17.708961    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f801ac_eb4a_4f9b_8270_0bf2f09ea0fe.slice/crio-f5632903f162887e82ae6a2d7ba30a87253bdffde8f99c37530f83a68104dbdc WatchSource:0}: Error finding container f5632903f162887e82ae6a2d7ba30a87253bdffde8f99c37530f83a68104dbdc: Status 404 returned error can't find the container with id f5632903f162887e82ae6a2d7ba30a87253bdffde8f99c37530f83a68104dbdc
May 26 21:49:18.479834 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:18.479790    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh76m" event={"ID":"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe","Type":"ContainerStarted","Data":"f5632903f162887e82ae6a2d7ba30a87253bdffde8f99c37530f83a68104dbdc"}
May 26 21:49:19.484379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:19.484332    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh76m" event={"ID":"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe","Type":"ContainerStarted","Data":"a6cdee920157c446e807eb60c68326d15c5c1f324844d604e2b8251525527d90"}
May 26 21:49:19.484379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:19.484377    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zh76m" event={"ID":"53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe","Type":"ContainerStarted","Data":"5eb2b161bac8d0a54d7644f9045cf786660a1183ebcf81a672b82a1fac181411"}
May 26 21:49:19.504277 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:19.504223    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zh76m" podStartSLOduration=252.599947692 podStartE2EDuration="4m13.504206952s" podCreationTimestamp="2026-05-26 21:45:06 +0000 UTC" firstStartedPulling="2026-05-26 21:49:17.711111765 +0000 UTC m=+251.771389524" lastFinishedPulling="2026-05-26 21:49:18.615371025 +0000 UTC m=+252.675648784" observedRunningTime="2026-05-26 21:49:19.502749945 +0000 UTC m=+253.563027725" watchObservedRunningTime="2026-05-26 21:49:19.504206952 +0000 UTC m=+253.564484726"
May 26 21:49:22.685591 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:22.685557    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:27.037874 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:27.037796    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:37.076627 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:37.076587    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:37.647478 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:37.647442    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:42.183687 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:42.183654    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:42.184091 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:42.183791    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:47.085106 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:47.085070    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:52.685152 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:52.685122    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:53.495175 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.495136    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mxv77"]
May 26 21:49:53.498909 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.498886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.501811 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.501790    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 21:49:53.507851 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.507821    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxv77"]
May 26 21:49:53.620536 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.620453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-original-pull-secret\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.620739 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.620565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-dbus\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.620739 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.620623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-kubelet-config\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.721996 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.721954    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-original-pull-secret\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.722379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.722014    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-dbus\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.722379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.722065    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-kubelet-config\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.722379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.722145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-kubelet-config\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.722379 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.722220    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-dbus\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.724340 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.724320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5aa2cf08-9b44-4576-a1d6-f0c6e2e14939-original-pull-secret\") pod \"global-pull-secret-syncer-mxv77\" (UID: \"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939\") " pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.808590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.808556    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv77"
May 26 21:49:53.937404 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:53.937375    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxv77"]
May 26 21:49:53.939672 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:49:53.939634    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa2cf08_9b44_4576_a1d6_f0c6e2e14939.slice/crio-bd6b655ee57bbc8a969075c5517000a5d0332e0e73ed1b8dafc3a42115f7a45f WatchSource:0}: Error finding container bd6b655ee57bbc8a969075c5517000a5d0332e0e73ed1b8dafc3a42115f7a45f: Status 404 returned error can't find the container with id bd6b655ee57bbc8a969075c5517000a5d0332e0e73ed1b8dafc3a42115f7a45f
May 26 21:49:54.584724 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:54.584687    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxv77" event={"ID":"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939","Type":"ContainerStarted","Data":"bd6b655ee57bbc8a969075c5517000a5d0332e0e73ed1b8dafc3a42115f7a45f"}
May 26 21:49:57.094540 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:49:57.094493    2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fd904_a664_4842_bf05_b77e1041ef52.slice\": RecentStats: unable to find data in memory cache]"
May 26 21:49:58.598366 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:58.598313    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxv77" event={"ID":"5aa2cf08-9b44-4576-a1d6-f0c6e2e14939","Type":"ContainerStarted","Data":"b847f046bbf5ac0db5ea75ffc42d077f0015f0bfad8f7ebd80132608bf6ef2d3"}
May 26 21:49:58.632717 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:49:58.632662    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mxv77" podStartSLOduration=2.074150498 podStartE2EDuration="5.632649217s" podCreationTimestamp="2026-05-26 21:49:53 +0000 UTC" firstStartedPulling="2026-05-26 21:49:53.941362274 +0000 UTC m=+288.001640049" lastFinishedPulling="2026-05-26 21:49:57.49986101 +0000 UTC m=+291.560138768" observedRunningTime="2026-05-26 21:49:58.632174892 +0000 UTC m=+292.692452683" watchObservedRunningTime="2026-05-26 21:49:58.632649217 +0000 UTC m=+292.692926996"
May 26 21:50:06.434736 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:06.434696    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:50:06.435527 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:06.435491    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:50:06.446503 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:06.446480    2559 kubelet.go:1628] "Image garbage collection succeeded"
May 26 21:50:10.871955 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:10.871917    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:50:10.887686 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:10.887649    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:50:11.651728 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:11.651700    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 21:50:57.632672 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.632587    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-298hz"]
May 26 21:50:57.634801 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.634785    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.637107 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.637081    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 26 21:50:57.638131 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.638112    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 26 21:50:57.638131 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.638125    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pvnn9\""
May 26 21:50:57.643366 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.643345    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-298hz"]
May 26 21:50:57.711042 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.710987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.711228 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.711095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwj4s\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-kube-api-access-wwj4s\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.811999 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.811948    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwj4s\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-kube-api-access-wwj4s\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.812176 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.812029    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.820591 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.820561    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.820707 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.820626    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwj4s\" (UniqueName: \"kubernetes.io/projected/5f4f27ba-1235-4661-8527-49c21792ca74-kube-api-access-wwj4s\") pod \"cert-manager-cainjector-68b757865b-298hz\" (UID: \"5f4f27ba-1235-4661-8527-49c21792ca74\") " pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:57.958699 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:57.958613    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-298hz"
May 26 21:50:58.083239 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:58.083196    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-298hz"]
May 26 21:50:58.086112 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:50:58.086080    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f4f27ba_1235_4661_8527_49c21792ca74.slice/crio-bb2bd9f3b44b5e04b4644d85834e0f858afdd2c3da3126a40c7030a3e2396e06 WatchSource:0}: Error finding container bb2bd9f3b44b5e04b4644d85834e0f858afdd2c3da3126a40c7030a3e2396e06: Status 404 returned error can't find the container with id bb2bd9f3b44b5e04b4644d85834e0f858afdd2c3da3126a40c7030a3e2396e06
May 26 21:50:58.087985 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:58.087971    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:50:58.781783 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:50:58.781740    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-298hz" event={"ID":"5f4f27ba-1235-4661-8527-49c21792ca74","Type":"ContainerStarted","Data":"bb2bd9f3b44b5e04b4644d85834e0f858afdd2c3da3126a40c7030a3e2396e06"}
May 26 21:51:01.793445 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:01.793398    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-298hz" event={"ID":"5f4f27ba-1235-4661-8527-49c21792ca74","Type":"ContainerStarted","Data":"9b3e40dabe3b111d46db742736375cbc61ff89d8382ecaa89c0d4524d1512e85"}
May 26 21:51:01.808749 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:01.808691    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-298hz" podStartSLOduration=2.018543045 podStartE2EDuration="4.808676312s" podCreationTimestamp="2026-05-26 21:50:57 +0000 UTC" firstStartedPulling="2026-05-26 21:50:58.088097662 +0000 UTC m=+352.148375420" lastFinishedPulling="2026-05-26 21:51:00.878230924 +0000 UTC m=+354.938508687" observedRunningTime="2026-05-26 21:51:01.808137602 +0000 UTC m=+355.868415394" watchObservedRunningTime="2026-05-26 21:51:01.808676312 +0000 UTC m=+355.868954092"
May 26 21:51:29.947917 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.947882    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"]
May 26 21:51:29.950367 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.950347    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:29.953723 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.953699    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 21:51:29.953855 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.953736    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 21:51:29.954027 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.953991    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 21:51:29.954155 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.954065    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6lhxs\""
May 26 21:51:29.954613 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.954592    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 21:51:29.978655 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:29.978624    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"]
May 26 21:51:30.095923 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.095878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wj48\" (UniqueName: \"kubernetes.io/projected/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-kube-api-access-9wj48\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.096104 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.096005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.096104 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.096047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.197235 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.197195    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wj48\" (UniqueName: \"kubernetes.io/projected/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-kube-api-access-9wj48\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.197445 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.197280    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.197445 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.197301    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.199771 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.199710    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.199866 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.199832    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.222835 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.222800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wj48\" (UniqueName: \"kubernetes.io/projected/e99f7aeb-c681-4d6c-82d4-22f45b5529c3-kube-api-access-9wj48\") pod \"opendatahub-operator-controller-manager-58ddc889d6-zkqvk\" (UID: \"e99f7aeb-c681-4d6c-82d4-22f45b5529c3\") " pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.261680 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.261633    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:30.404170 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.404132    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"]
May 26 21:51:30.408976 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:51:30.408947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99f7aeb_c681_4d6c_82d4_22f45b5529c3.slice/crio-e9634925a7c42d6962e2e95c033b0a619eb8942cc9f8f419f18fcad30b555551 WatchSource:0}: Error finding container e9634925a7c42d6962e2e95c033b0a619eb8942cc9f8f419f18fcad30b555551: Status 404 returned error can't find the container with id e9634925a7c42d6962e2e95c033b0a619eb8942cc9f8f419f18fcad30b555551
May 26 21:51:30.885548 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:30.885496    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk" event={"ID":"e99f7aeb-c681-4d6c-82d4-22f45b5529c3","Type":"ContainerStarted","Data":"e9634925a7c42d6962e2e95c033b0a619eb8942cc9f8f419f18fcad30b555551"}
May 26 21:51:33.426189 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.426150    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"]
May 26 21:51:33.428908 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.428886    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.431685 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.431658    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwjs8\""
May 26 21:51:33.432712 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.432691    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 26 21:51:33.432817 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.432769    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 26 21:51:33.432876 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.432806    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 26 21:51:33.432876 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.432831    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 26 21:51:33.432963 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.432832    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 26 21:51:33.452269 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.452235    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"]
May 26 21:51:33.530542 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.530485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aad8e95b-6245-419f-a27b-0d5d1c086ac2-manager-config\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.530736 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.530606    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.530736 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.530639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbgkc\" (UniqueName: \"kubernetes.io/projected/aad8e95b-6245-419f-a27b-0d5d1c086ac2-kube-api-access-tbgkc\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.530736 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.530710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-metrics-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.631887 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.631852    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aad8e95b-6245-419f-a27b-0d5d1c086ac2-manager-config\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.631887 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.631893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.632138 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.631913    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbgkc\" (UniqueName: \"kubernetes.io/projected/aad8e95b-6245-419f-a27b-0d5d1c086ac2-kube-api-access-tbgkc\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.632138 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.631990    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-metrics-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.632588 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.632563    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aad8e95b-6245-419f-a27b-0d5d1c086ac2-manager-config\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.634563 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.634541    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.634674 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.634588    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aad8e95b-6245-419f-a27b-0d5d1c086ac2-metrics-cert\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.641072 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.641045    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbgkc\" (UniqueName: \"kubernetes.io/projected/aad8e95b-6245-419f-a27b-0d5d1c086ac2-kube-api-access-tbgkc\") pod \"lws-controller-manager-79df896c85-bqd9b\" (UID: \"aad8e95b-6245-419f-a27b-0d5d1c086ac2\") " pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.739085 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.738996    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:33.887885 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.887693    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"]
May 26 21:51:33.890612 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:51:33.890584    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad8e95b_6245_419f_a27b_0d5d1c086ac2.slice/crio-aa352d08a5466760615a6a03c9f68740125eea82c337c79191658128954ee59e WatchSource:0}: Error finding container aa352d08a5466760615a6a03c9f68740125eea82c337c79191658128954ee59e: Status 404 returned error can't find the container with id aa352d08a5466760615a6a03c9f68740125eea82c337c79191658128954ee59e
May 26 21:51:33.898036 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.898008    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b" event={"ID":"aad8e95b-6245-419f-a27b-0d5d1c086ac2","Type":"ContainerStarted","Data":"aa352d08a5466760615a6a03c9f68740125eea82c337c79191658128954ee59e"}
May 26 21:51:33.899547 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.899492    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk" event={"ID":"e99f7aeb-c681-4d6c-82d4-22f45b5529c3","Type":"ContainerStarted","Data":"bbc5bcb940ca6caca854ec88cc46e30c932b4ac222f7f80680465ea0e1961e57"}
May 26 21:51:33.899699 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.899684    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:33.923786 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:33.923729    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk" podStartSLOduration=2.45696374 podStartE2EDuration="4.923713981s" podCreationTimestamp="2026-05-26 21:51:29 +0000 UTC" firstStartedPulling="2026-05-26 21:51:30.410676175 +0000 UTC m=+384.470953932" lastFinishedPulling="2026-05-26 21:51:32.877426414 +0000 UTC m=+386.937704173" observedRunningTime="2026-05-26 21:51:33.922276377 +0000 UTC m=+387.982554168" watchObservedRunningTime="2026-05-26 21:51:33.923713981 +0000 UTC m=+387.983991761"
May 26 21:51:36.913453 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:36.913414    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b" event={"ID":"aad8e95b-6245-419f-a27b-0d5d1c086ac2","Type":"ContainerStarted","Data":"acf6095108b2fde4e69ab3a3fee866946acf67dde931106cb9e6386c470391c4"}
May 26 21:51:36.913972 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:36.913462    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:36.937440 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:36.937380    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b" podStartSLOduration=1.562718053 podStartE2EDuration="3.937364103s" podCreationTimestamp="2026-05-26 21:51:33 +0000 UTC" firstStartedPulling="2026-05-26 21:51:33.892428245 +0000 UTC m=+387.952706002" lastFinishedPulling="2026-05-26 21:51:36.267074289 +0000 UTC m=+390.327352052" observedRunningTime="2026-05-26 21:51:36.931177749 +0000 UTC m=+390.991455533" watchObservedRunningTime="2026-05-26 21:51:36.937364103 +0000 UTC m=+390.997641882"
May 26 21:51:44.907037 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:44.907002    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58ddc889d6-zkqvk"
May 26 21:51:47.919374 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:47.919343    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79df896c85-bqd9b"
May 26 21:51:48.720028 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.719987    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-689f6fc89-m965w"]
May 26 21:51:48.722844 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.722816    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.725312 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.725286    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 21:51:48.726350 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.726317    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r5jl5\""
May 26 21:51:48.726470 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.726362    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 26 21:51:48.726470 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.726392    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 26 21:51:48.726470 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.726392    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 21:51:48.734049 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.734021    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-689f6fc89-m965w"]
May 26 21:51:48.763418 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.763371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5da5e827-f821-469f-a30b-bf836100715a-tls-certs\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.763615 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.763434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da5e827-f821-469f-a30b-bf836100715a-tmp\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.763615 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.763463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cms2\" (UniqueName: \"kubernetes.io/projected/5da5e827-f821-469f-a30b-bf836100715a-kube-api-access-8cms2\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.864830 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.864787    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5da5e827-f821-469f-a30b-bf836100715a-tls-certs\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.864830 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.864845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da5e827-f821-469f-a30b-bf836100715a-tmp\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.865101 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.864870    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cms2\" (UniqueName: \"kubernetes.io/projected/5da5e827-f821-469f-a30b-bf836100715a-kube-api-access-8cms2\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.867235 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.867206    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da5e827-f821-469f-a30b-bf836100715a-tmp\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.867461 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.867440    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5da5e827-f821-469f-a30b-bf836100715a-tls-certs\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:48.877676 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:48.877641    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cms2\" (UniqueName: \"kubernetes.io/projected/5da5e827-f821-469f-a30b-bf836100715a-kube-api-access-8cms2\") pod \"kube-auth-proxy-689f6fc89-m965w\" (UID: \"5da5e827-f821-469f-a30b-bf836100715a\") " pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:49.033624 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:49.033537    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w"
May 26 21:51:49.176117 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:49.176091    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-689f6fc89-m965w"]
May 26 21:51:49.178329 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:51:49.178299    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da5e827_f821_469f_a30b_bf836100715a.slice/crio-0806df0baaf285a23e6e436140f50faaa4230bbd63d47dd1aea2e0496fb878d4 WatchSource:0}: Error finding container 0806df0baaf285a23e6e436140f50faaa4230bbd63d47dd1aea2e0496fb878d4: Status 404 returned error can't find the container with id 0806df0baaf285a23e6e436140f50faaa4230bbd63d47dd1aea2e0496fb878d4
May 26 21:51:49.959813 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:49.959769    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w" event={"ID":"5da5e827-f821-469f-a30b-bf836100715a","Type":"ContainerStarted","Data":"0806df0baaf285a23e6e436140f50faaa4230bbd63d47dd1aea2e0496fb878d4"}
May 26 21:51:52.975612 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:52.975576    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w" event={"ID":"5da5e827-f821-469f-a30b-bf836100715a","Type":"ContainerStarted","Data":"5cd02aeb9e878051c6322fe49de0c4609a36f95184ee9a495c4b51882e47098a"}
May 26 21:51:52.995979 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:51:52.995875    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-689f6fc89-m965w" podStartSLOduration=1.443185781 podStartE2EDuration="4.995860697s" podCreationTimestamp="2026-05-26 21:51:48 +0000 UTC" firstStartedPulling="2026-05-26 21:51:49.180003835 +0000 UTC m=+403.240281593" lastFinishedPulling="2026-05-26 21:51:52.732678752 +0000 UTC m=+406.792956509" observedRunningTime="2026-05-26 21:51:52.993961864 +0000 UTC m=+407.054239672" watchObservedRunningTime="2026-05-26 21:51:52.995860697 +0000 UTC m=+407.056138479"
May 26 21:53:34.081247 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.081211    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"]
May 26 21:53:34.084648 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.084625    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.087029 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.087007    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 26 21:53:34.087715 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.087696    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 21:53:34.088071 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.088053    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hgpff\""
May 26 21:53:34.088136 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.088075    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 26 21:53:34.088136 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.088089    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 21:53:34.094049 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.094028    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"]
May 26 21:53:34.104499 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.104464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.104617 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.104563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.104664 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.104617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhzk\" (UniqueName: \"kubernetes.io/projected/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-kube-api-access-bhhzk\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.206130 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.206085    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.206302 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:53:34.206231    2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
May 26 21:53:34.206302 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:53:34.206293    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert podName:7c5e0ce0-c96b-4352-ad63-1eaf52f2e653 nodeName:}" failed. No retries permitted until 2026-05-26 21:53:34.706276921 +0000 UTC m=+508.766554679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-z5v52" (UID: "7c5e0ce0-c96b-4352-ad63-1eaf52f2e653") : secret "plugin-serving-cert" not found
May 26 21:53:34.206302 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.206231    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.206430 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.206354    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhzk\" (UniqueName: \"kubernetes.io/projected/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-kube-api-access-bhhzk\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.206969 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.206948    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.216932 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.216902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhzk\" (UniqueName: \"kubernetes.io/projected/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-kube-api-access-bhhzk\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.710893 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.710853    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.713255 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.713229    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c5e0ce0-c96b-4352-ad63-1eaf52f2e653-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-z5v52\" (UID: \"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:34.995362 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:34.995280    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"
May 26 21:53:35.125365 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:35.125337    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52"]
May 26 21:53:35.127647 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:53:35.127625    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c5e0ce0_c96b_4352_ad63_1eaf52f2e653.slice/crio-f3764d5aaecf6650900ae2dbfa63fef35f2beeabec786445df98489ce6ab1a9b WatchSource:0}: Error finding container f3764d5aaecf6650900ae2dbfa63fef35f2beeabec786445df98489ce6ab1a9b: Status 404 returned error can't find the container with id f3764d5aaecf6650900ae2dbfa63fef35f2beeabec786445df98489ce6ab1a9b
May 26 21:53:35.321859 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:35.321816    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52" event={"ID":"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653","Type":"ContainerStarted","Data":"f3764d5aaecf6650900ae2dbfa63fef35f2beeabec786445df98489ce6ab1a9b"}
May 26 21:53:59.411035 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:59.410995    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52" event={"ID":"7c5e0ce0-c96b-4352-ad63-1eaf52f2e653","Type":"ContainerStarted","Data":"0475f1c99bc2e85034ece4911ca7ed0d5075b075bf90639b76d558d33ed23435"}
May 26 21:53:59.430934 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:53:59.430880    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-z5v52" podStartSLOduration=1.6761375950000001 podStartE2EDuration="25.430866339s" podCreationTimestamp="2026-05-26 21:53:34 +0000 UTC" firstStartedPulling="2026-05-26 21:53:35.128889081 +0000 UTC m=+509.189166842" lastFinishedPulling="2026-05-26 21:53:58.883617814 +0000 UTC m=+532.943895586" observedRunningTime="2026-05-26 21:53:59.428280178 +0000 UTC m=+533.488557959" watchObservedRunningTime="2026-05-26 21:53:59.430866339 +0000 UTC m=+533.491144118"
May 26 21:54:17.163345 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.163303    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:17.318802 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.318764    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:17.318802 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.318800    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:17.319053 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.318936    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.322630 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.322605    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 26 21:54:17.405612 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.405574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.405803 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.405631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx6tr\" (UniqueName: \"kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.506490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.506410    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.506490 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.506479    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx6tr\" (UniqueName: \"kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.507139 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.507113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.525407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.525371    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx6tr\" (UniqueName: \"kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr\") pod \"limitador-limitador-7d549b5b-wckcf\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.629927 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.629891    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:17.763303 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:17.763275    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:17.766191 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:54:17.766155    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67971249_aa38_4d51_9c11_3eeaaef3901d.slice/crio-da7f50932f240ff4eb7bb42300d573e35fa9f7dc103a70e7f6a4a3d1bdc36d76 WatchSource:0}: Error finding container da7f50932f240ff4eb7bb42300d573e35fa9f7dc103a70e7f6a4a3d1bdc36d76: Status 404 returned error can't find the container with id da7f50932f240ff4eb7bb42300d573e35fa9f7dc103a70e7f6a4a3d1bdc36d76
May 26 21:54:18.481205 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:18.481163    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" event={"ID":"67971249-aa38-4d51-9c11-3eeaaef3901d","Type":"ContainerStarted","Data":"da7f50932f240ff4eb7bb42300d573e35fa9f7dc103a70e7f6a4a3d1bdc36d76"}
May 26 21:54:22.497124 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:22.497081    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" event={"ID":"67971249-aa38-4d51-9c11-3eeaaef3901d","Type":"ContainerStarted","Data":"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"}
May 26 21:54:22.497549 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:22.497164    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:22.514753 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:22.514699    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" podStartSLOduration=1.398183355 podStartE2EDuration="5.514684088s" podCreationTimestamp="2026-05-26 21:54:17 +0000 UTC" firstStartedPulling="2026-05-26 21:54:17.768490674 +0000 UTC m=+551.828768435" lastFinishedPulling="2026-05-26 21:54:21.884991405 +0000 UTC m=+555.945269168" observedRunningTime="2026-05-26 21:54:22.512704915 +0000 UTC m=+556.572982700" watchObservedRunningTime="2026-05-26 21:54:22.514684088 +0000 UTC m=+556.574961867"
May 26 21:54:31.533447 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:31.533411    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:31.533889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:31.533667    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" podUID="67971249-aa38-4d51-9c11-3eeaaef3901d" containerName="limitador" containerID="cri-o://46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0" gracePeriod=30
May 26 21:54:31.534284 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:31.534266    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:32.067108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.067082    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:32.143038 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.142945    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file\") pod \"67971249-aa38-4d51-9c11-3eeaaef3901d\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") "
May 26 21:54:32.143186 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.143044    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx6tr\" (UniqueName: \"kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr\") pod \"67971249-aa38-4d51-9c11-3eeaaef3901d\" (UID: \"67971249-aa38-4d51-9c11-3eeaaef3901d\") "
May 26 21:54:32.143317 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.143296    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file" (OuterVolumeSpecName: "config-file") pod "67971249-aa38-4d51-9c11-3eeaaef3901d" (UID: "67971249-aa38-4d51-9c11-3eeaaef3901d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 21:54:32.145212 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.145181    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr" (OuterVolumeSpecName: "kube-api-access-tx6tr") pod "67971249-aa38-4d51-9c11-3eeaaef3901d" (UID: "67971249-aa38-4d51-9c11-3eeaaef3901d"). InnerVolumeSpecName "kube-api-access-tx6tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:54:32.243738 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.243699    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67971249-aa38-4d51-9c11-3eeaaef3901d-config-file\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:54:32.243738 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.243731    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx6tr\" (UniqueName: \"kubernetes.io/projected/67971249-aa38-4d51-9c11-3eeaaef3901d-kube-api-access-tx6tr\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:54:32.533959 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.533873    2559 generic.go:358] "Generic (PLEG): container finished" podID="67971249-aa38-4d51-9c11-3eeaaef3901d" containerID="46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0" exitCode=0
May 26 21:54:32.533959 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.533946    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf"
May 26 21:54:32.534416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.533969    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" event={"ID":"67971249-aa38-4d51-9c11-3eeaaef3901d","Type":"ContainerDied","Data":"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"}
May 26 21:54:32.534416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.534010    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wckcf" event={"ID":"67971249-aa38-4d51-9c11-3eeaaef3901d","Type":"ContainerDied","Data":"da7f50932f240ff4eb7bb42300d573e35fa9f7dc103a70e7f6a4a3d1bdc36d76"}
May 26 21:54:32.534416 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.534026    2559 scope.go:117] "RemoveContainer" containerID="46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"
May 26 21:54:32.542766 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.542745    2559 scope.go:117] "RemoveContainer" containerID="46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"
May 26 21:54:32.543006 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:54:32.542987    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0\": container with ID starting with 46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0 not found: ID does not exist" containerID="46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"
May 26 21:54:32.543042 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.543016    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0"} err="failed to get container status \"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0\": rpc error: code = NotFound desc = could not find container \"46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0\": container with ID starting with 46a189c3802f4850acafec5c32f434c15a0f5a2c58e876618e9909b5c87871c0 not found: ID does not exist"
May 26 21:54:32.559861 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.559835    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:32.559861 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:32.559866    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wckcf"]
May 26 21:54:33.127498 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.127442    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7tkhq"]
May 26 21:54:33.128031 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.128010    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67971249-aa38-4d51-9c11-3eeaaef3901d" containerName="limitador"
May 26 21:54:33.128031 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.128030    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67971249-aa38-4d51-9c11-3eeaaef3901d" containerName="limitador"
May 26 21:54:33.128189 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.128101    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="67971249-aa38-4d51-9c11-3eeaaef3901d" containerName="limitador"
May 26 21:54:33.130851 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.130825    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.133241 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.133218    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sg26z\""
May 26 21:54:33.133343 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.133218    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 26 21:54:33.139777 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.139751    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7tkhq"]
May 26 21:54:33.252960 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.252919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1e551f02-ad94-4216-83a1-0083e464fe22-data\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.253146 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.253019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqnjk\" (UniqueName: \"kubernetes.io/projected/1e551f02-ad94-4216-83a1-0083e464fe22-kube-api-access-gqnjk\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.354133 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.354088    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1e551f02-ad94-4216-83a1-0083e464fe22-data\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.354310 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.354160    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqnjk\" (UniqueName: \"kubernetes.io/projected/1e551f02-ad94-4216-83a1-0083e464fe22-kube-api-access-gqnjk\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.354477 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.354456    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1e551f02-ad94-4216-83a1-0083e464fe22-data\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.361909 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.361879    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqnjk\" (UniqueName: \"kubernetes.io/projected/1e551f02-ad94-4216-83a1-0083e464fe22-kube-api-access-gqnjk\") pod \"postgres-68c4fbbd6f-7tkhq\" (UID: \"1e551f02-ad94-4216-83a1-0083e464fe22\") " pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.442780 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.442689    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:33.576144 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:33.575690    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7tkhq"]
May 26 21:54:33.578930 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:54:33.578896    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e551f02_ad94_4216_83a1_0083e464fe22.slice/crio-8494abf0bca6e3a882a1bbb685dbfba2152d7822da32131a64d5478ad81eaf59 WatchSource:0}: Error finding container 8494abf0bca6e3a882a1bbb685dbfba2152d7822da32131a64d5478ad81eaf59: Status 404 returned error can't find the container with id 8494abf0bca6e3a882a1bbb685dbfba2152d7822da32131a64d5478ad81eaf59
May 26 21:54:34.544178 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:34.544105    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7tkhq" event={"ID":"1e551f02-ad94-4216-83a1-0083e464fe22","Type":"ContainerStarted","Data":"8494abf0bca6e3a882a1bbb685dbfba2152d7822da32131a64d5478ad81eaf59"}
May 26 21:54:34.561469 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:34.561434    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67971249-aa38-4d51-9c11-3eeaaef3901d" path="/var/lib/kubelet/pods/67971249-aa38-4d51-9c11-3eeaaef3901d/volumes"
May 26 21:54:43.576419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:43.576379    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7tkhq" event={"ID":"1e551f02-ad94-4216-83a1-0083e464fe22","Type":"ContainerStarted","Data":"8487c30ac6baaf7b4f56956b7d6f08b4c5c3183e90d555b9ac0de8d3b71b3970"}
May 26 21:54:43.576807 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:43.576522    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:43.593502 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:43.593455    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-7tkhq" podStartSLOduration=1.1844709820000001 podStartE2EDuration="10.593441106s" podCreationTimestamp="2026-05-26 21:54:33 +0000 UTC" firstStartedPulling="2026-05-26 21:54:33.580274531 +0000 UTC m=+567.640552293" lastFinishedPulling="2026-05-26 21:54:42.989244659 +0000 UTC m=+577.049522417" observedRunningTime="2026-05-26 21:54:43.592551035 +0000 UTC m=+577.652828817" watchObservedRunningTime="2026-05-26 21:54:43.593441106 +0000 UTC m=+577.653718886"
May 26 21:54:49.608821 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:49.608795    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-7tkhq"
May 26 21:54:55.494414 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.494378    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:54:55.571819 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.571776    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:54:55.572002 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.571961    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:55.574874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.574852    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 21:54:55.574874 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.574870    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nv4cd\""
May 26 21:54:55.649486 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.649445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wkjw\" (UniqueName: \"kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw\") pod \"maas-controller-79bdbdfdcc-t2sgp\" (UID: \"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb\") " pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:55.750575 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.750466    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wkjw\" (UniqueName: \"kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw\") pod \"maas-controller-79bdbdfdcc-t2sgp\" (UID: \"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb\") " pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:55.759629 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.759595    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wkjw\" (UniqueName: \"kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw\") pod \"maas-controller-79bdbdfdcc-t2sgp\" (UID: \"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb\") " pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:55.883055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:55.883011    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:56.013300 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:56.013274    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:54:56.016223 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:54:56.016186    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode873bfae_b0fb_49ff_90a1_070b6ddaa7bb.slice/crio-9751d6411633ff3c930160a734880eaa3dd1d0c1c6f85e5343b5030bd54f8ea5 WatchSource:0}: Error finding container 9751d6411633ff3c930160a734880eaa3dd1d0c1c6f85e5343b5030bd54f8ea5: Status 404 returned error can't find the container with id 9751d6411633ff3c930160a734880eaa3dd1d0c1c6f85e5343b5030bd54f8ea5
May 26 21:54:56.622552 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:56.622496    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" event={"ID":"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb","Type":"ContainerStarted","Data":"9751d6411633ff3c930160a734880eaa3dd1d0c1c6f85e5343b5030bd54f8ea5"}
May 26 21:54:58.630575 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:58.630537    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" event={"ID":"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb","Type":"ContainerStarted","Data":"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"}
May 26 21:54:58.631032 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:58.630668    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:54:58.648350 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:54:58.648298    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" podStartSLOduration=1.143381214 podStartE2EDuration="3.648284451s" podCreationTimestamp="2026-05-26 21:54:55 +0000 UTC" firstStartedPulling="2026-05-26 21:54:56.017568396 +0000 UTC m=+590.077846157" lastFinishedPulling="2026-05-26 21:54:58.52247162 +0000 UTC m=+592.582749394" observedRunningTime="2026-05-26 21:54:58.645548001 +0000 UTC m=+592.705825778" watchObservedRunningTime="2026-05-26 21:54:58.648284451 +0000 UTC m=+592.708562230"
May 26 21:55:06.464956 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:06.464925    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:55:06.466169 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:06.466141    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 21:55:09.639137 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:09.639103    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:55:30.487594 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.487492    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5f4f767b59-5j6sg"]
May 26 21:55:30.491844 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.491827    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.494357 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.494333    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 26 21:55:30.494357 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.494349    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ndlt2\""
May 26 21:55:30.499462 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.499216    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f4f767b59-5j6sg"]
May 26 21:55:30.570460 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.570426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn965\" (UniqueName: \"kubernetes.io/projected/402ddc2e-7f7b-4ebb-8827-56e959887427-kube-api-access-kn965\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.570654 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.570597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/402ddc2e-7f7b-4ebb-8827-56e959887427-maas-api-tls\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.671408 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.671372    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/402ddc2e-7f7b-4ebb-8827-56e959887427-maas-api-tls\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.671600 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.671447    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn965\" (UniqueName: \"kubernetes.io/projected/402ddc2e-7f7b-4ebb-8827-56e959887427-kube-api-access-kn965\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.674380 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.674354    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/402ddc2e-7f7b-4ebb-8827-56e959887427-maas-api-tls\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.680863 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.680834    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn965\" (UniqueName: \"kubernetes.io/projected/402ddc2e-7f7b-4ebb-8827-56e959887427-kube-api-access-kn965\") pod \"maas-api-5f4f767b59-5j6sg\" (UID: \"402ddc2e-7f7b-4ebb-8827-56e959887427\") " pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.804136 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.804112    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:30.848943 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.848910    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mzl46"]
May 26 21:55:30.859387 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.858325    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:30.862419 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.861789    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 26 21:55:30.862582 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.862536    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mzl46"]
May 26 21:55:30.939108 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.939071    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f4f767b59-5j6sg"]
May 26 21:55:30.940487 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:55:30.940448    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402ddc2e_7f7b_4ebb_8827_56e959887427.slice/crio-c1534de616a4aa1558df058525bc3ec7bad5ae9b73f73b91fb86e1c29dd780ea WatchSource:0}: Error finding container c1534de616a4aa1558df058525bc3ec7bad5ae9b73f73b91fb86e1c29dd780ea: Status 404 returned error can't find the container with id c1534de616a4aa1558df058525bc3ec7bad5ae9b73f73b91fb86e1c29dd780ea
May 26 21:55:30.974444 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:30.974409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7kt\" (UniqueName: \"kubernetes.io/projected/7270aa03-6ea9-4d7f-b6a8-2764660bd9e5-kube-api-access-zf7kt\") pod \"payload-processing-58b6c8fdc7-mzl46\" (UID: \"7270aa03-6ea9-4d7f-b6a8-2764660bd9e5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:31.075690 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.075606    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7kt\" (UniqueName: \"kubernetes.io/projected/7270aa03-6ea9-4d7f-b6a8-2764660bd9e5-kube-api-access-zf7kt\") pod \"payload-processing-58b6c8fdc7-mzl46\" (UID: \"7270aa03-6ea9-4d7f-b6a8-2764660bd9e5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:31.083726 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.083698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7kt\" (UniqueName: \"kubernetes.io/projected/7270aa03-6ea9-4d7f-b6a8-2764660bd9e5-kube-api-access-zf7kt\") pod \"payload-processing-58b6c8fdc7-mzl46\" (UID: \"7270aa03-6ea9-4d7f-b6a8-2764660bd9e5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:31.176396 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.176362    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:31.312568 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.312534    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mzl46"]
May 26 21:55:31.315995 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:55:31.315965    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7270aa03_6ea9_4d7f_b6a8_2764660bd9e5.slice/crio-df1b86cb03ce17a675bf143ef8e59cf94ae11415486de6c2aee55a97f1fd3d88 WatchSource:0}: Error finding container df1b86cb03ce17a675bf143ef8e59cf94ae11415486de6c2aee55a97f1fd3d88: Status 404 returned error can't find the container with id df1b86cb03ce17a675bf143ef8e59cf94ae11415486de6c2aee55a97f1fd3d88
May 26 21:55:31.750975 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.750926    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f4f767b59-5j6sg" event={"ID":"402ddc2e-7f7b-4ebb-8827-56e959887427","Type":"ContainerStarted","Data":"c1534de616a4aa1558df058525bc3ec7bad5ae9b73f73b91fb86e1c29dd780ea"}
May 26 21:55:31.752095 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:31.752064    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46" event={"ID":"7270aa03-6ea9-4d7f-b6a8-2764660bd9e5","Type":"ContainerStarted","Data":"df1b86cb03ce17a675bf143ef8e59cf94ae11415486de6c2aee55a97f1fd3d88"}
May 26 21:55:32.756353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:32.756268    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f4f767b59-5j6sg" event={"ID":"402ddc2e-7f7b-4ebb-8827-56e959887427","Type":"ContainerStarted","Data":"57e3ae09b533341e8f724088aea6131e39b306212f411bbd507e7da353d73f1c"}
May 26 21:55:32.756772 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:32.756368    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:32.772898 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:32.772847    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5f4f767b59-5j6sg" podStartSLOduration=1.213595776 podStartE2EDuration="2.772831346s" podCreationTimestamp="2026-05-26 21:55:30 +0000 UTC" firstStartedPulling="2026-05-26 21:55:30.941823083 +0000 UTC m=+625.002100841" lastFinishedPulling="2026-05-26 21:55:32.501058647 +0000 UTC m=+626.561336411" observedRunningTime="2026-05-26 21:55:32.771150428 +0000 UTC m=+626.831428243" watchObservedRunningTime="2026-05-26 21:55:32.772831346 +0000 UTC m=+626.833109163"
May 26 21:55:34.765353 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:34.765315    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46" event={"ID":"7270aa03-6ea9-4d7f-b6a8-2764660bd9e5","Type":"ContainerStarted","Data":"695ec8c440d0f3d66e663965eeb06333502b1e856886eec8ce0ebe6f619ec5eb"}
May 26 21:55:34.765870 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:34.765413    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:55:34.782526 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:34.782441    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46" podStartSLOduration=1.973888755 podStartE2EDuration="4.782422956s" podCreationTimestamp="2026-05-26 21:55:30 +0000 UTC" firstStartedPulling="2026-05-26 21:55:31.31770844 +0000 UTC m=+625.377986201" lastFinishedPulling="2026-05-26 21:55:34.12624263 +0000 UTC m=+628.186520402" observedRunningTime="2026-05-26 21:55:34.781460298 +0000 UTC m=+628.841738079" watchObservedRunningTime="2026-05-26 21:55:34.782422956 +0000 UTC m=+628.842700738"
May 26 21:55:38.766977 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:38.766946    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5f4f767b59-5j6sg"
May 26 21:55:45.771124 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:55:45.771088    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-mzl46"
May 26 21:56:07.311082 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.311051    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"]
May 26 21:56:07.315814 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.315789    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.318203 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.318178    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 21:56:07.319285 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.319266    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 21:56:07.319285 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.319275    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 26 21:56:07.319433 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.319275    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c55w2\""
May 26 21:56:07.325380 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.325356    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"]
May 26 21:56:07.405669 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b6be97-3f7a-4aee-982b-b91f5575c543-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.405864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.405864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.405864 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.406040 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wj4\" (UniqueName: \"kubernetes.io/projected/17b6be97-3f7a-4aee-982b-b91f5575c543-kube-api-access-f7wj4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.406040 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.405931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507082 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507036    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wj4\" (UniqueName: \"kubernetes.io/projected/17b6be97-3f7a-4aee-982b-b91f5575c543-kube-api-access-f7wj4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507082 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507087    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507318 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507141    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b6be97-3f7a-4aee-982b-b91f5575c543-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507318 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507162    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507318 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507188    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507318 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507229    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507593 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507504    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507653 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.507709 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.507671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.509669 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.509637    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17b6be97-3f7a-4aee-982b-b91f5575c543-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.509885 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.509866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17b6be97-3f7a-4aee-982b-b91f5575c543-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.515316 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.515289    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wj4\" (UniqueName: \"kubernetes.io/projected/17b6be97-3f7a-4aee-982b-b91f5575c543-kube-api-access-f7wj4\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x\" (UID: \"17b6be97-3f7a-4aee-982b-b91f5575c543\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.627759 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.627667    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:07.765170 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.765142    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"]
May 26 21:56:07.767253 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:56:07.767229    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b6be97_3f7a_4aee_982b_b91f5575c543.slice/crio-ee22c35faabfa63cdc058d6b2174b759af1e010b95deec92059694d81e7cb40a WatchSource:0}: Error finding container ee22c35faabfa63cdc058d6b2174b759af1e010b95deec92059694d81e7cb40a: Status 404 returned error can't find the container with id ee22c35faabfa63cdc058d6b2174b759af1e010b95deec92059694d81e7cb40a
May 26 21:56:07.769189 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.769170    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 21:56:07.881189 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:07.881102    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x" event={"ID":"17b6be97-3f7a-4aee-982b-b91f5575c543","Type":"ContainerStarted","Data":"ee22c35faabfa63cdc058d6b2174b759af1e010b95deec92059694d81e7cb40a"}
May 26 21:56:13.908332 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:13.908291    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x" event={"ID":"17b6be97-3f7a-4aee-982b-b91f5575c543","Type":"ContainerStarted","Data":"a422611a0894a8dfe20b570b1d30961cf2265ee48972a59185377d40492cb8f0"}
May 26 21:56:18.926468 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:18.926428    2559 generic.go:358] "Generic (PLEG): container finished" podID="17b6be97-3f7a-4aee-982b-b91f5575c543" containerID="a422611a0894a8dfe20b570b1d30961cf2265ee48972a59185377d40492cb8f0" exitCode=0
May 26 21:56:18.926889 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:18.926500    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x" event={"ID":"17b6be97-3f7a-4aee-982b-b91f5575c543","Type":"ContainerDied","Data":"a422611a0894a8dfe20b570b1d30961cf2265ee48972a59185377d40492cb8f0"}
May 26 21:56:20.935195 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:20.935160    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x" event={"ID":"17b6be97-3f7a-4aee-982b-b91f5575c543","Type":"ContainerStarted","Data":"b71b4428c8388b60d3bae02c058837ad90449c7e1bab2bc7045c8548a0581be6"}
May 26 21:56:20.935633 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:20.935379    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:20.954712 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:20.954662    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x" podStartSLOduration=1.789005479 podStartE2EDuration="13.954647183s" podCreationTimestamp="2026-05-26 21:56:07 +0000 UTC" firstStartedPulling="2026-05-26 21:56:07.769328292 +0000 UTC m=+661.829606050" lastFinishedPulling="2026-05-26 21:56:19.934969994 +0000 UTC m=+673.995247754" observedRunningTime="2026-05-26 21:56:20.95293225 +0000 UTC m=+675.013210034" watchObservedRunningTime="2026-05-26 21:56:20.954647183 +0000 UTC m=+675.014924962"
May 26 21:56:21.116063 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.116024    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"]
May 26 21:56:21.118806 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.118786    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.121238 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.121218    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 26 21:56:21.129122 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.129101    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"]
May 26 21:56:21.247263 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.247263 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.247482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb888448-b9b4-4230-a9e9-a407378c3995-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.247482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btklv\" (UniqueName: \"kubernetes.io/projected/cb888448-b9b4-4230-a9e9-a407378c3995-kube-api-access-btklv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.247482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.247482 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.247465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.348799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.348762    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb888448-b9b4-4230-a9e9-a407378c3995-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.348799 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.348802    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btklv\" (UniqueName: \"kubernetes.io/projected/cb888448-b9b4-4230-a9e9-a407378c3995-kube-api-access-btklv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.348854    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.348916    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.348958    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349055 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.349000    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349376 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.349353    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349455 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.349403    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.349505 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.349459    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.351316 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.351295    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb888448-b9b4-4230-a9e9-a407378c3995-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.351460 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.351446    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb888448-b9b4-4230-a9e9-a407378c3995-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.356813 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.356792    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btklv\" (UniqueName: \"kubernetes.io/projected/cb888448-b9b4-4230-a9e9-a407378c3995-kube-api-access-btklv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-24cmw\" (UID: \"cb888448-b9b4-4230-a9e9-a407378c3995\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.430256 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.430220    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:21.567997 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.567819    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"]
May 26 21:56:21.570765 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:56:21.570735    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb888448_b9b4_4230_a9e9_a407378c3995.slice/crio-73de15bd4d82f8e87262b3a1b93084878c9cc2ea30460d4b736dbc7e4d35e254 WatchSource:0}: Error finding container 73de15bd4d82f8e87262b3a1b93084878c9cc2ea30460d4b736dbc7e4d35e254: Status 404 returned error can't find the container with id 73de15bd4d82f8e87262b3a1b93084878c9cc2ea30460d4b736dbc7e4d35e254
May 26 21:56:21.940129 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.940085    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw" event={"ID":"cb888448-b9b4-4230-a9e9-a407378c3995","Type":"ContainerStarted","Data":"8324e45331ad639ad4e3716d40beb71a3ed5c437b7755e3b1483c05cf7f732ea"}
May 26 21:56:21.940546 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:21.940137    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw" event={"ID":"cb888448-b9b4-4230-a9e9-a407378c3995","Type":"ContainerStarted","Data":"73de15bd4d82f8e87262b3a1b93084878c9cc2ea30460d4b736dbc7e4d35e254"}
May 26 21:56:27.965190 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:27.965149    2559 generic.go:358] "Generic (PLEG): container finished" podID="cb888448-b9b4-4230-a9e9-a407378c3995" containerID="8324e45331ad639ad4e3716d40beb71a3ed5c437b7755e3b1483c05cf7f732ea" exitCode=0
May 26 21:56:27.965652 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:27.965225    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw" event={"ID":"cb888448-b9b4-4230-a9e9-a407378c3995","Type":"ContainerDied","Data":"8324e45331ad639ad4e3716d40beb71a3ed5c437b7755e3b1483c05cf7f732ea"}
May 26 21:56:28.970170 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:28.970129    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw" event={"ID":"cb888448-b9b4-4230-a9e9-a407378c3995","Type":"ContainerStarted","Data":"c16a5017636a6aeee0fbf26d75c7aa1d2e1294002f60375e72d0bbc47e91bd86"}
May 26 21:56:28.970590 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:28.970361    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:56:28.991656 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:28.991607    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw" podStartSLOduration=7.811122739 podStartE2EDuration="7.991594532s" podCreationTimestamp="2026-05-26 21:56:21 +0000 UTC" firstStartedPulling="2026-05-26 21:56:27.966000691 +0000 UTC m=+682.026278449" lastFinishedPulling="2026-05-26 21:56:28.146472469 +0000 UTC m=+682.206750242" observedRunningTime="2026-05-26 21:56:28.989941955 +0000 UTC m=+683.050219769" watchObservedRunningTime="2026-05-26 21:56:28.991594532 +0000 UTC m=+683.051872312"
May 26 21:56:31.952997 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:31.952959    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x"
May 26 21:56:39.986284 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:56:39.986251    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-24cmw"
May 26 21:58:18.562133 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:18.562094    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:58:18.562684 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:18.562318    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" podUID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" containerName="manager" containerID="cri-o://3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb" gracePeriod=30
May 26 21:58:18.817996 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:18.817918    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:58:18.915795 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:18.915763    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wkjw\" (UniqueName: \"kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw\") pod \"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb\" (UID: \"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb\") "
May 26 21:58:18.917905 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:18.917872    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw" (OuterVolumeSpecName: "kube-api-access-7wkjw") pod "e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" (UID: "e873bfae-b0fb-49ff-90a1-070b6ddaa7bb"). InnerVolumeSpecName "kube-api-access-7wkjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 21:58:19.016986 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.016942    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wkjw\" (UniqueName: \"kubernetes.io/projected/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb-kube-api-access-7wkjw\") on node \"ip-10-0-138-198.ec2.internal\" DevicePath \"\""
May 26 21:58:19.364225 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.364187    2559 generic.go:358] "Generic (PLEG): container finished" podID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" containerID="3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb" exitCode=0
May 26 21:58:19.364407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.364252    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp"
May 26 21:58:19.364407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.364265    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" event={"ID":"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb","Type":"ContainerDied","Data":"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"}
May 26 21:58:19.364407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.364303    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-t2sgp" event={"ID":"e873bfae-b0fb-49ff-90a1-070b6ddaa7bb","Type":"ContainerDied","Data":"9751d6411633ff3c930160a734880eaa3dd1d0c1c6f85e5343b5030bd54f8ea5"}
May 26 21:58:19.364407 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.364319    2559 scope.go:117] "RemoveContainer" containerID="3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"
May 26 21:58:19.372967 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.372950    2559 scope.go:117] "RemoveContainer" containerID="3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"
May 26 21:58:19.373207 ip-10-0-138-198 kubenswrapper[2559]: E0526 21:58:19.373192    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb\": container with ID starting with 3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb not found: ID does not exist" containerID="3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"
May 26 21:58:19.373257 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.373214    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb"} err="failed to get container status \"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb\": rpc error: code = NotFound desc = could not find container \"3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb\": container with ID starting with 3fa30575ebe6fc98e910103802fe249f7064181e71307aae1310c10ca8653dfb not found: ID does not exist"
May 26 21:58:19.385692 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.385665    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:58:19.389783 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:19.389761    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-t2sgp"]
May 26 21:58:20.150770 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.150732    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-l8z49"]
May 26 21:58:20.151300 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.151280    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" containerName="manager"
May 26 21:58:20.151378 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.151303    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" containerName="manager"
May 26 21:58:20.151451 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.151439    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" containerName="manager"
May 26 21:58:20.155890 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.155867    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:20.158405 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.158378    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 21:58:20.158544 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.158416    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nv4cd\""
May 26 21:58:20.163866 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.163843    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-l8z49"]
May 26 21:58:20.230649 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.230606    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2x5\" (UniqueName: \"kubernetes.io/projected/45aa79b9-0a65-4bda-98f2-029f634357c1-kube-api-access-nd2x5\") pod \"maas-controller-79bdbdfdcc-l8z49\" (UID: \"45aa79b9-0a65-4bda-98f2-029f634357c1\") " pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:20.331730 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.331691    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2x5\" (UniqueName: \"kubernetes.io/projected/45aa79b9-0a65-4bda-98f2-029f634357c1-kube-api-access-nd2x5\") pod \"maas-controller-79bdbdfdcc-l8z49\" (UID: \"45aa79b9-0a65-4bda-98f2-029f634357c1\") " pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:20.343505 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.343466    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2x5\" (UniqueName: \"kubernetes.io/projected/45aa79b9-0a65-4bda-98f2-029f634357c1-kube-api-access-nd2x5\") pod \"maas-controller-79bdbdfdcc-l8z49\" (UID: \"45aa79b9-0a65-4bda-98f2-029f634357c1\") " pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:20.467292 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.467195    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:20.560035 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.560004    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e873bfae-b0fb-49ff-90a1-070b6ddaa7bb" path="/var/lib/kubelet/pods/e873bfae-b0fb-49ff-90a1-070b6ddaa7bb/volumes"
May 26 21:58:20.597243 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:20.597216    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79bdbdfdcc-l8z49"]
May 26 21:58:20.602404 ip-10-0-138-198 kubenswrapper[2559]: W0526 21:58:20.602367    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aa79b9_0a65_4bda_98f2_029f634357c1.slice/crio-8f281475bf259e271953cf8553025a6dbba8ea65e1104537a2bf84896a1163a7 WatchSource:0}: Error finding container 8f281475bf259e271953cf8553025a6dbba8ea65e1104537a2bf84896a1163a7: Status 404 returned error can't find the container with id 8f281475bf259e271953cf8553025a6dbba8ea65e1104537a2bf84896a1163a7
May 26 21:58:21.373626 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:21.373584    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49" event={"ID":"45aa79b9-0a65-4bda-98f2-029f634357c1","Type":"ContainerStarted","Data":"5efb498d5e109b8638406ee0968c6178ccdf4b47a2b0632e2e23b97362de4479"}
May 26 21:58:21.373626 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:21.373632    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49" event={"ID":"45aa79b9-0a65-4bda-98f2-029f634357c1","Type":"ContainerStarted","Data":"8f281475bf259e271953cf8553025a6dbba8ea65e1104537a2bf84896a1163a7"}
May 26 21:58:21.374051 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:21.373731    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 21:58:21.392004 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:21.391931    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49" podStartSLOduration=1.018932541 podStartE2EDuration="1.391910112s" podCreationTimestamp="2026-05-26 21:58:20 +0000 UTC" firstStartedPulling="2026-05-26 21:58:20.60322164 +0000 UTC m=+794.663499397" lastFinishedPulling="2026-05-26 21:58:20.976199205 +0000 UTC m=+795.036476968" observedRunningTime="2026-05-26 21:58:21.389478534 +0000 UTC m=+795.449756313" watchObservedRunningTime="2026-05-26 21:58:21.391910112 +0000 UTC m=+795.452187893"
May 26 21:58:32.382810 ip-10-0-138-198 kubenswrapper[2559]: I0526 21:58:32.382738    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79bdbdfdcc-l8z49"
May 26 22:00:06.490390 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:00:06.490280    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:00:06.494179 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:00:06.494149    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:05:06.518418 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:05:06.518380    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:05:06.523044 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:05:06.523019    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:10:06.545423 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:10:06.545392    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:10:06.550983 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:10:06.550958    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:15:06.572471 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:15:06.572442    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:15:06.579380 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:15:06.579342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:19:31.257221 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:31.257104    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f4f767b59-5j6sg_402ddc2e-7f7b-4ebb-8827-56e959887427/maas-api/0.log"
May 26 22:19:31.589418 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:31.589391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79bdbdfdcc-l8z49_45aa79b9-0a65-4bda-98f2-029f634357c1/manager/0.log"
May 26 22:19:32.058558 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:32.058506    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58ddc889d6-zkqvk_e99f7aeb-c681-4d6c-82d4-22f45b5529c3/manager/0.log"
May 26 22:19:32.179120 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:32.179068    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7tkhq_1e551f02-ad94-4216-83a1-0083e464fe22/postgres/0.log"
May 26 22:19:33.806042 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:33.806014    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-z5v52_7c5e0ce0-c96b-4352-ad63-1eaf52f2e653/kuadrant-console-plugin/0.log"
May 26 22:19:34.888752 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:34.888718    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-689f6fc89-m965w_5da5e827-f821-469f-a30b-bf836100715a/kube-auth-proxy/0.log"
May 26 22:19:35.241144 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:35.241058    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-mzl46_7270aa03-6ea9-4d7f-b6a8-2764660bd9e5/payload-processing/0.log"
May 26 22:19:35.942782 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:35.942751    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-24cmw_cb888448-b9b4-4230-a9e9-a407378c3995/storage-initializer/0.log"
May 26 22:19:35.950235 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:35.950205    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-24cmw_cb888448-b9b4-4230-a9e9-a407378c3995/main/0.log"
May 26 22:19:36.177818 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:36.177790    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x_17b6be97-3f7a-4aee-982b-b91f5575c543/storage-initializer/0.log"
May 26 22:19:36.185869 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:36.185826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-p2p4x_17b6be97-3f7a-4aee-982b-b91f5575c543/main/0.log"
May 26 22:19:40.597989 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.597958    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fhwx9/must-gather-gcz76"]
May 26 22:19:40.602002 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.601980    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.605959 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.605938    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhwx9\"/\"kube-root-ca.crt\""
May 26 22:19:40.607009 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.606974    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fhwx9\"/\"default-dockercfg-42src\""
May 26 22:19:40.607146 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.606974    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhwx9\"/\"openshift-service-ca.crt\""
May 26 22:19:40.622677 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.622645    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/must-gather-gcz76"]
May 26 22:19:40.641260 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.641229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3994b-a4d2-404e-87fc-6deeac02c84e-must-gather-output\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.641440 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.641293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzwn\" (UniqueName: \"kubernetes.io/projected/21f3994b-a4d2-404e-87fc-6deeac02c84e-kube-api-access-lxzwn\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.743955 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.743907    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3994b-a4d2-404e-87fc-6deeac02c84e-must-gather-output\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.743955 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.743955    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzwn\" (UniqueName: \"kubernetes.io/projected/21f3994b-a4d2-404e-87fc-6deeac02c84e-kube-api-access-lxzwn\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.744291 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.744269    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3994b-a4d2-404e-87fc-6deeac02c84e-must-gather-output\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.755727 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.755706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzwn\" (UniqueName: \"kubernetes.io/projected/21f3994b-a4d2-404e-87fc-6deeac02c84e-kube-api-access-lxzwn\") pod \"must-gather-gcz76\" (UID: \"21f3994b-a4d2-404e-87fc-6deeac02c84e\") " pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:40.912297 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:40.912214    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/must-gather-gcz76"
May 26 22:19:41.043787 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:41.043758    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/must-gather-gcz76"]
May 26 22:19:41.046090 ip-10-0-138-198 kubenswrapper[2559]: W0526 22:19:41.046060    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21f3994b_a4d2_404e_87fc_6deeac02c84e.slice/crio-2c265f5151f4cc2e04ee348c1f7281ed103ef8611020f8f00b1e41c66e223af7 WatchSource:0}: Error finding container 2c265f5151f4cc2e04ee348c1f7281ed103ef8611020f8f00b1e41c66e223af7: Status 404 returned error can't find the container with id 2c265f5151f4cc2e04ee348c1f7281ed103ef8611020f8f00b1e41c66e223af7
May 26 22:19:41.047696 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:41.047677    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 22:19:41.956626 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:41.956551    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/must-gather-gcz76" event={"ID":"21f3994b-a4d2-404e-87fc-6deeac02c84e","Type":"ContainerStarted","Data":"adfab5909a4c29257162df6607c521a4fb248698890dba177dba6e290c349d5c"}
May 26 22:19:41.956626 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:41.956594    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/must-gather-gcz76" event={"ID":"21f3994b-a4d2-404e-87fc-6deeac02c84e","Type":"ContainerStarted","Data":"2c265f5151f4cc2e04ee348c1f7281ed103ef8611020f8f00b1e41c66e223af7"}
May 26 22:19:42.963586 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:42.963544    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/must-gather-gcz76" event={"ID":"21f3994b-a4d2-404e-87fc-6deeac02c84e","Type":"ContainerStarted","Data":"b70c6decaf17cd790ab66fe067e4708c57fbdde6e044ed12d2f7a52de39ea40a"}
May 26 22:19:43.441224 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:43.441191    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mxv77_5aa2cf08-9b44-4576-a1d6-f0c6e2e14939/global-pull-secret-syncer/0.log"
May 26 22:19:43.531138 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:43.531108    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6j2hg_9102bd27-7108-4126-9919-da77752a8355/konnectivity-agent/0.log"
May 26 22:19:43.644395 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:43.644357    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-198.ec2.internal_16d4d4b13ae84244d7a2ba53d2b60ff8/haproxy/0.log"
May 26 22:19:48.345987 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:48.345952    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-z5v52_7c5e0ce0-c96b-4352-ad63-1eaf52f2e653/kuadrant-console-plugin/0.log"
May 26 22:19:50.056096 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.056065    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/alertmanager/0.log"
May 26 22:19:50.082121 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.082091    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/config-reloader/0.log"
May 26 22:19:50.121402 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.121367    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/kube-rbac-proxy-web/0.log"
May 26 22:19:50.142212 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.142185    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/kube-rbac-proxy/0.log"
May 26 22:19:50.164275 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.164241    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/kube-rbac-proxy-metric/0.log"
May 26 22:19:50.187079 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.187050    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/prom-label-proxy/0.log"
May 26 22:19:50.210213 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.210179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca4b824d-edf5-456b-b563-6d33a5db3b5d/init-config-reloader/0.log"
May 26 22:19:50.253176 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.253137    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-jndhf_95018038-aca8-49a6-b439-396474be6c8b/cluster-monitoring-operator/0.log"
May 26 22:19:50.281063 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.281025    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qh5zt_d4bd670b-e309-47b1-abe8-8c4997bfc03e/kube-state-metrics/0.log"
May 26 22:19:50.301431 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.301403    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qh5zt_d4bd670b-e309-47b1-abe8-8c4997bfc03e/kube-rbac-proxy-main/0.log"
May 26 22:19:50.326634 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.326603    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qh5zt_d4bd670b-e309-47b1-abe8-8c4997bfc03e/kube-rbac-proxy-self/0.log"
May 26 22:19:50.360257 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.360223    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f446f46f5-6bzhp_9022167b-4578-421b-8504-1f04850153cb/metrics-server/0.log"
May 26 22:19:50.389152 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.389120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-kfq8t_77302910-fa5e-4a08-b058-ca576bb2b4e7/monitoring-plugin/0.log"
May 26 22:19:50.570292 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.570220    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsxpc_962fad0d-3048-4467-964f-fdd03f3af139/node-exporter/0.log"
May 26 22:19:50.596972 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.596939    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsxpc_962fad0d-3048-4467-964f-fdd03f3af139/kube-rbac-proxy/0.log"
May 26 22:19:50.619936 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.619900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsxpc_962fad0d-3048-4467-964f-fdd03f3af139/init-textfile/0.log"
May 26 22:19:50.724261 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.724234    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/prometheus/0.log"
May 26 22:19:50.746526 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.746476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/config-reloader/0.log"
May 26 22:19:50.769077 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.769047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/thanos-sidecar/0.log"
May 26 22:19:50.792166 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.792138    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/kube-rbac-proxy-web/0.log"
May 26 22:19:50.815071 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.815017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/kube-rbac-proxy/0.log"
May 26 22:19:50.840960 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.840874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/kube-rbac-proxy-thanos/0.log"
May 26 22:19:50.862880 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.862853    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_412d9510-1bb4-4556-abdf-bfd5ce2c6307/init-config-reloader/0.log"
May 26 22:19:50.892762 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.892733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cjgn9_23f81b66-a242-4ee5-b39a-01b5ecd4065b/prometheus-operator/0.log"
May 26 22:19:50.911946 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.911912    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cjgn9_23f81b66-a242-4ee5-b39a-01b5ecd4065b/kube-rbac-proxy/0.log"
May 26 22:19:50.963491 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.963363    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d96c8864d-pnzxp_c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2/telemeter-client/0.log"
May 26 22:19:50.988237 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:50.988197    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d96c8864d-pnzxp_c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2/reload/0.log"
May 26 22:19:51.011744 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:51.011714    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d96c8864d-pnzxp_c2c61d3c-3d0f-49b6-bf61-ffda9d7a05b2/kube-rbac-proxy/0.log"
May 26 22:19:52.112429 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.112363    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fhwx9/must-gather-gcz76" podStartSLOduration=11.33041223 podStartE2EDuration="12.11234432s" podCreationTimestamp="2026-05-26 22:19:40 +0000 UTC" firstStartedPulling="2026-05-26 22:19:41.047836558 +0000 UTC m=+2075.108114316" lastFinishedPulling="2026-05-26 22:19:41.829768648 +0000 UTC m=+2075.890046406" observedRunningTime="2026-05-26 22:19:42.979224346 +0000 UTC m=+2077.039502126" watchObservedRunningTime="2026-05-26 22:19:52.11234432 +0000 UTC m=+2086.172622101"
May 26 22:19:52.114152 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.114122    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"]
May 26 22:19:52.120244 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.120215    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.128636 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.128602    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"]
May 26 22:19:52.166223 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.166175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-sys\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.166379 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.166251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-proc\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.166379 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.166281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-lib-modules\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.166379 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.166306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-podres\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.166379 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.166345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pch\" (UniqueName: \"kubernetes.io/projected/14386b35-96c9-436a-a1d2-c7b43fb5cd48-kube-api-access-59pch\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267587 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267548    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-sys\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267760 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267641    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-proc\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267760 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267681    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-lib-modules\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267760 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267705    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-podres\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267760 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-sys\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267760 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267748    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59pch\" (UniqueName: \"kubernetes.io/projected/14386b35-96c9-436a-a1d2-c7b43fb5cd48-kube-api-access-59pch\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267993 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-proc\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267993 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267829    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-podres\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.267993 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.267848    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14386b35-96c9-436a-a1d2-c7b43fb5cd48-lib-modules\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.276354 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.276322    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pch\" (UniqueName: \"kubernetes.io/projected/14386b35-96c9-436a-a1d2-c7b43fb5cd48-kube-api-access-59pch\") pod \"perf-node-gather-daemonset-gdhn8\" (UID: \"14386b35-96c9-436a-a1d2-c7b43fb5cd48\") " pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.438732 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.438625    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:52.619173 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.617622    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"]
May 26 22:19:52.626259 ip-10-0-138-198 kubenswrapper[2559]: W0526 22:19:52.624084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod14386b35_96c9_436a_a1d2_c7b43fb5cd48.slice/crio-ff2bbaa3bd16db8b721526312fe0ba00113ad6d0b7ae1e7e796d0daa76be5ccc WatchSource:0}: Error finding container ff2bbaa3bd16db8b721526312fe0ba00113ad6d0b7ae1e7e796d0daa76be5ccc: Status 404 returned error can't find the container with id ff2bbaa3bd16db8b721526312fe0ba00113ad6d0b7ae1e7e796d0daa76be5ccc
May 26 22:19:52.781826 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.781792    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:19:52.786635 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:52.786600    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/2.log"
May 26 22:19:53.011534 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:53.011427    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8" event={"ID":"14386b35-96c9-436a-a1d2-c7b43fb5cd48","Type":"ContainerStarted","Data":"7434c220af0b58d22f4f1abf7b62b5d1d2bf0a5b75189d06e701b477c295d755"}
May 26 22:19:53.011534 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:53.011466    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8" event={"ID":"14386b35-96c9-436a-a1d2-c7b43fb5cd48","Type":"ContainerStarted","Data":"ff2bbaa3bd16db8b721526312fe0ba00113ad6d0b7ae1e7e796d0daa76be5ccc"}
May 26 22:19:53.011534 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:53.011504    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:53.029412 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:53.029350    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8" podStartSLOduration=1.02932979 podStartE2EDuration="1.02932979s" podCreationTimestamp="2026-05-26 22:19:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 22:19:53.025526721 +0000 UTC m=+2087.085804519" watchObservedRunningTime="2026-05-26 22:19:53.02932979 +0000 UTC m=+2087.089607570"
May 26 22:19:53.785967 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:53.785939    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-jjmzl_0609e0e7-5e06-4603-b1f5-fa2a4965cc3b/volume-data-source-validator/0.log"
May 26 22:19:54.642212 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:54.642179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7tfrz_ca3b6416-bb7c-4530-b616-d44ad2dea1ce/dns/0.log"
May 26 22:19:54.664134 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:54.664106    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7tfrz_ca3b6416-bb7c-4530-b616-d44ad2dea1ce/kube-rbac-proxy/0.log"
May 26 22:19:54.756438 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:54.756414    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-szvf5_659313aa-8cc9-496c-998a-ac6f8cc65dd1/dns-node-resolver/0.log"
May 26 22:19:55.276293 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:55.276259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x8pxf_b2cdc66e-8aae-4be5-a8a7-66a6c45f63a3/node-ca/0.log"
May 26 22:19:56.214764 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:56.214739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-689f6fc89-m965w_5da5e827-f821-469f-a30b-bf836100715a/kube-auth-proxy/0.log"
May 26 22:19:56.370716 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:56.370680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-mzl46_7270aa03-6ea9-4d7f-b6a8-2764660bd9e5/payload-processing/0.log"
May 26 22:19:56.916591 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:56.916563    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fz44k_b48147e8-cdaa-48a8-bde3-65da728464f6/serve-healthcheck-canary/0.log"
May 26 22:19:57.430685 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:57.430650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xbqc_be82593e-0e08-4f90-9831-bd59abbb58c8/kube-rbac-proxy/0.log"
May 26 22:19:57.452069 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:57.452040    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xbqc_be82593e-0e08-4f90-9831-bd59abbb58c8/exporter/0.log"
May 26 22:19:57.474614 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:57.474586    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xbqc_be82593e-0e08-4f90-9831-bd59abbb58c8/extractor/0.log"
May 26 22:19:59.028968 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:59.028941    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fhwx9/perf-node-gather-daemonset-gdhn8"
May 26 22:19:59.492113 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:59.492083    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f4f767b59-5j6sg_402ddc2e-7f7b-4ebb-8827-56e959887427/maas-api/0.log"
May 26 22:19:59.618264 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:59.618236    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79bdbdfdcc-l8z49_45aa79b9-0a65-4bda-98f2-029f634357c1/manager/0.log"
May 26 22:19:59.759130 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:59.759050    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58ddc889d6-zkqvk_e99f7aeb-c681-4d6c-82d4-22f45b5529c3/manager/0.log"
May 26 22:19:59.783097 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:19:59.783062    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7tkhq_1e551f02-ad94-4216-83a1-0083e464fe22/postgres/0.log"
May 26 22:20:01.018758 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:01.018721    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79df896c85-bqd9b_aad8e95b-6245-419f-a27b-0d5d1c086ac2/manager/0.log"
May 26 22:20:05.407159 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:05.407125    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-4w7nh_21dc6327-6598-4473-95b6-d98ce0032fc4/migrator/0.log"
May 26 22:20:05.429687 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:05.429654    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-4w7nh_21dc6327-6598-4473-95b6-d98ce0032fc4/graceful-termination/0.log"
May 26 22:20:05.786946 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:05.786855    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-fw8r8_4eda3c55-5fe4-4bfb-961a-693afe15f009/kube-storage-version-migrator-operator/1.log"
May 26 22:20:05.788024 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:05.788001    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-fw8r8_4eda3c55-5fe4-4bfb-961a-693afe15f009/kube-storage-version-migrator-operator/0.log"
May 26 22:20:06.607901 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:06.607868    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:20:06.618470 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:06.618444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-dxlzl_8f433079-97b3-4e0f-8094-f7e013e26d2c/console-operator/1.log"
May 26 22:20:06.790666 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:06.790624    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2chxj_74ad8b6e-01f2-489c-a196-2aa387895095/kube-multus/0.log"
May 26 22:20:07.186498 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.186467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/kube-multus-additional-cni-plugins/0.log"
May 26 22:20:07.208380 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.208350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/egress-router-binary-copy/0.log"
May 26 22:20:07.233450 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.233420    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/cni-plugins/0.log"
May 26 22:20:07.256024 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.255998    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/bond-cni-plugin/0.log"
May 26 22:20:07.277898 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.277866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/routeoverride-cni/0.log"
May 26 22:20:07.299490 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.299462    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/whereabouts-cni-bincopy/0.log"
May 26 22:20:07.320728 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.320699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtlr9_66ebf775-aa1b-4b1d-9e63-e17a8f8c61dd/whereabouts-cni/0.log"
May 26 22:20:07.472639 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.472546    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zh76m_53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe/network-metrics-daemon/0.log"
May 26 22:20:07.492850 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:07.492776    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zh76m_53f801ac-eb4a-4f9b-8270-0bf2f09ea0fe/kube-rbac-proxy/0.log"
May 26 22:20:08.954113 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:08.954087    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/ovn-controller/0.log"
May 26 22:20:08.983927 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:08.983892    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/ovn-acl-logging/0.log"
May 26 22:20:09.003858 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.003831    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/kube-rbac-proxy-node/0.log"
May 26 22:20:09.026233 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.026204    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/kube-rbac-proxy-ovn-metrics/0.log"
May 26 22:20:09.045145 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.045114    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/northd/0.log"
May 26 22:20:09.069673 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.069646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/nbdb/0.log"
May 26 22:20:09.091426 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.091402    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/sbdb/0.log"
May 26 22:20:09.209809 ip-10-0-138-198 kubenswrapper[2559]: I0526 22:20:09.209733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scdhw_92a5cbc6-9a68-4458-87c9-cbd779ce5825/ovnkube-controller/0.log"