May 28 17:43:52.266130 ip-10-0-137-72 systemd[1]: Starting Kubernetes Kubelet...
May 28 17:43:52.774406 ip-10-0-137-72 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:43:52.774406 ip-10-0-137-72 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 17:43:52.774406 ip-10-0-137-72 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:43:52.774406 ip-10-0-137-72 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 17:43:52.774406 ip-10-0-137-72 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:43:52.777911 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.777803    2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 17:43:52.783534 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783513    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:43:52.783534 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783530    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:43:52.783534 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783537    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783541    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783545    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783550    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783554    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783558    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783561    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783565    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783568    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783572    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783576    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783579    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783583    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783594    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783598    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783602    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783606    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783610    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783615    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783619    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:43:52.783729 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783622    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783627    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783631    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783635    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783639    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783643    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783647    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783651    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783655    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783659    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783663    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783667    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783671    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783676    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783683    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783689    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783693    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783698    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783702    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783707    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:43:52.784539 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783713    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783718    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783722    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783726    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783730    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783734    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783738    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783743    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783751    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783757    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783762    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783767    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783772    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783776    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783782    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783786    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783790    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783795    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783799    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:43:52.785307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783803    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783807    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783812    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783816    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783820    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783824    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783828    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783837    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783841    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783845    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783849    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783854    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783859    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783863    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783868    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783894    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783898    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783902    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783906    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783910    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:43:52.785854 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783914    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783918    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783922    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783926    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.783930    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784550    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784558    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784564    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784569    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784573    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784577    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784582    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784586    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784590    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784594    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784598    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784602    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784606    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784611    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784616    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:43:52.786377 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784620    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784625    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784629    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784633    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784637    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784641    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784646    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784651    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784657    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784663    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784668    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784672    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784676    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784681    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784685    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784690    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784694    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784699    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784702    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:43:52.787110 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784706    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784711    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784715    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784719    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784723    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784727    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784732    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784735    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784739    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784743    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784747    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784751    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784756    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784760    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784767    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784773    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784778    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784782    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784786    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784790    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:43:52.787893 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784795    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784799    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784803    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784808    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784813    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784817    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784821    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784826    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784830    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784834    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784838    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784842    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784846    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784850    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784854    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784858    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784863    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784867    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784893    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784898    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:43:52.788763 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784902    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784906    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784910    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784915    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784923    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784928    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784932    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784936    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784940    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784944    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784948    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.784952    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786595    2566 flags.go:64] FLAG: --address="0.0.0.0"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786617    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786628    2566 flags.go:64] FLAG: --anonymous-auth="true"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786636    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786642    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786648    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786655    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786662    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786667    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 17:43:52.789303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786672    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786678    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786683    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786688    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786693    2566 flags.go:64] FLAG: --cgroup-root=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786699    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786704    2566 flags.go:64] FLAG: --client-ca-file=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786708    2566 flags.go:64] FLAG: --cloud-config=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786713    2566 flags.go:64] FLAG: --cloud-provider="external"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786717    2566 flags.go:64] FLAG: --cluster-dns="[]"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786724    2566 flags.go:64] FLAG: --cluster-domain=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786729    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786734    2566 flags.go:64] FLAG: --config-dir=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786739    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786744    2566 flags.go:64] FLAG: --container-log-max-files="5"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786752    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786756    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786761    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786767    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786772    2566 flags.go:64] FLAG: --contention-profiling="false"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786776    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786781    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786786    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786791    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786798    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 17:43:52.789796 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786803    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786808    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786813    2566 flags.go:64] FLAG: --enable-load-reader="false"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786818    2566 flags.go:64] FLAG: --enable-server="true"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786822    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786829    2566 flags.go:64] FLAG: --event-burst="100"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786834    2566 flags.go:64] FLAG: --event-qps="50"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786838    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786843    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786848    2566 flags.go:64] FLAG: --eviction-hard=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786854    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786859    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786864    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786869    2566 flags.go:64] FLAG: --eviction-soft=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786893    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786899    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786904    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786909    2566 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786913    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786918    2566 flags.go:64] FLAG: --fail-swap-on="true"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786923    2566 flags.go:64] FLAG: --feature-gates=""
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786930    2566 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786936    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786941    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786946    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786951    2566 flags.go:64] FLAG: --healthz-port="10248"
May 28 17:43:52.790399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786957    2566 flags.go:64] FLAG: --help="false"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786962    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-137-72.ec2.internal"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786967    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786972    2566 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786977    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786983    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786988    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786994    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.786999    2566 flags.go:64] FLAG: --image-service-endpoint=""
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787004    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787009    2566 flags.go:64] FLAG: --kube-api-burst="100"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787013    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787019    2566 flags.go:64] FLAG: --kube-api-qps="50"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787023    2566 flags.go:64] FLAG: --kube-reserved=""
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787028    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787033    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787038    2566 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787043    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787048    2566 flags.go:64] FLAG: --lock-file=""
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787053    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787058    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787063    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787072    2566 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 17:43:52.791036 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787077    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787082    2566 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787087    2566 flags.go:64] FLAG: --logging-format="text"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787092    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787098    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787103    2566 flags.go:64] FLAG: --manifest-url=""
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787108    2566 flags.go:64] FLAG: --manifest-url-header=""
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787115    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787119    2566 flags.go:64] FLAG: --max-open-files="1000000"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787126    2566 flags.go:64] FLAG: --max-pods="110"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787130    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787135    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787141    2566 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787146    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787151    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787156    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787161    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787174    2566 flags.go:64] FLAG: --node-status-max-images="50"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787179    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787185    2566 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787189    2566 flags.go:64] FLAG: --pod-cidr=""
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787194    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787202    2566 flags.go:64] FLAG: --pod-manifest-path=""
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787207    2566 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 17:43:52.791572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787212    2566 flags.go:64] FLAG: --pods-per-core="0"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787217    2566 flags.go:64] FLAG: --port="10250"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787222    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787227    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0652c4cdfc5fb7411"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787232    2566 flags.go:64] FLAG: --qos-reserved=""
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787237    2566 flags.go:64] FLAG: --read-only-port="10255"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787242    2566 flags.go:64] FLAG: --register-node="true"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787247    2566 flags.go:64] FLAG: --register-schedulable="true"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787252    2566 flags.go:64] FLAG: --register-with-taints=""
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787257    2566 flags.go:64] FLAG: --registry-burst="10"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787262    2566 flags.go:64] FLAG: --registry-qps="5"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787267    2566 flags.go:64] FLAG: --reserved-cpus=""
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787272    2566 flags.go:64] FLAG: --reserved-memory=""
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787279    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787284    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787289    2566 flags.go:64] FLAG: --rotate-certificates="false"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787294    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787299    2566 flags.go:64] FLAG: --runonce="false"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787304    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787309    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787314    2566 flags.go:64] FLAG: --seccomp-default="false"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787319    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787324    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787329    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787334    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787339    2566 flags.go:64] FLAG: --storage-driver-password="root"
May 28 17:43:52.792183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787346    2566 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787351    2566 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787356    2566 flags.go:64] FLAG: --storage-driver-user="root"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787361    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787366    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787371    2566 flags.go:64] FLAG: --system-cgroups=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787375    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787384    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787390    2566 flags.go:64] FLAG: --tls-cert-file=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787394    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787498    2566 flags.go:64] FLAG: --tls-min-version=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787503    2566 flags.go:64] FLAG: --tls-private-key-file=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787508    2566 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787514    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787520    2566 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787525    2566 flags.go:64] FLAG: --v="2"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787548    2566 flags.go:64] FLAG: --version="false"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787556    2566 flags.go:64] FLAG: --vmodule=""
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787571    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.787631    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.787994    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788003    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788009    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788014    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:43:52.792787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788020    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788025    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788035    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788039    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788046    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788051    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788056    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788060    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788064    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788070    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788074    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788079    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788083    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788088    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788093    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788102    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788107    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788111    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788115    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788120    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:43:52.793418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788124    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788128    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788132    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788137    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788142    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788146    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788150    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788157    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788167    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788171    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788175    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788180    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788184    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788188    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788192    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788197    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788201    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788205    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788209    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788213    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:43:52.793990 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788223    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788227    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788232    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788237    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788241    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788245    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788249    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788254    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788259    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788263    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788268    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788272    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788279    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788290    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788295    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788301    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788306    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788311    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788315    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:43:52.794506 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788322    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788326    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788331    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788335    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788340    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788344    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788355    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788359    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788364    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788368    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788373    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788377    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788381    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788385    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788389    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788394    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788399    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788467    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788489    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788505    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:43:52.794999 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788631    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:43:52.795494 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788638    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:43:52.795494 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.788643    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:43:52.795494 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.789618    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:43:52.796666 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.796647    2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 17:43:52.796707 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.796668    2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796718    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796723    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796727    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796730    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796733    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:43:52.796735 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796736    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796739    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796742    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796744    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796747    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796750    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796753    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796755    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796758    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796760    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796763    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796765    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796767    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796770    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796772    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796775    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796777    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796779    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796782    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:43:52.796892 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796786    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796788    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796792    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796796    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796799    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796802    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796804    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796807    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796809    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796812    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796814    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796817    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796820    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796822    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796825    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796828    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796831    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796835    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796839    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:43:52.797353 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796842    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796846    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796848    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796851    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796853    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796856    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796859    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796861    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796864    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796866    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796868    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796887    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796891    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796893    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796897    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796900    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796903    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796906    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796909    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796912    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:43:52.797811 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796914    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796916    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796919    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796921    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796924    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796926    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796928    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796931    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796934    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796937    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796940    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796943    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796945    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796948    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796950    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796953    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796955    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796958    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796960    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796962    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:43:52.798305 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796965    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796967    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.796970    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.796974    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797069    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797073    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797076    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797079    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797082    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797085    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797087    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797090    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797092    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797095    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797098    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797100    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:43:52.798789 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797103    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797106    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797108    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797111    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797114    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797116    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797119    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797121    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797124    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797126    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797129    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797131    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797134    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797136    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797139    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797141    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797144    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797147    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797149    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797151    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:43:52.799191 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797154    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797156    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797159    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797161    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797165    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797168    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797171    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797174    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797177    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797180    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797182    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797185    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797187    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797189    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797192    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797194    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797197    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797200    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797203    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:43:52.799675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797205    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797207    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797210    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797212    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797214    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797218    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797220    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797223    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797225    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797227    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797230    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797232    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797234    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797237    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797239    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797241    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797244    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797246    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797249    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797251    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:43:52.800141 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797253    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797256    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797258    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797260    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797263    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797265    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797267    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797270    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797272    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797275    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797277    2566 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797280    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797283    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797286    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:52.797289    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:43:52.800618 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.797294    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:43:52.801073 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.798155    2566 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 17:43:52.804093 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.804078    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 17:43:52.805203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.805192    2566 server.go:1019] "Starting client certificate rotation"
May 28 17:43:52.805313 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.805296    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:43:52.805347 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.805337    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:43:52.834318 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.834299    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:43:52.836403 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.836385    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:43:52.862379 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.862359    2566 log.go:25] "Validated CRI v1 runtime API"
May 28 17:43:52.868514 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.868500    2566 log.go:25] "Validated CRI v1 image API"
May 28 17:43:52.870100 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.870078    2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 17:43:52.874508 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.874482    2566 fs.go:135] Filesystem UUIDs: map[2f2e22ac-8905-4ec7-86cb-dc6a91078cd3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7e029378-dd80-49f5-9480-61cccedb759e:/dev/nvme0n1p4]
May 28 17:43:52.874606 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.874507    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 17:43:52.877285 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.877263    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:43:52.879204 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.879089    2566 manager.go:217] Machine: {Timestamp:2026-05-28 17:43:52.878542422 +0000 UTC m=+0.480858036 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117658 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f44e8eae577f4bce6875b00cab0c SystemUUID:ec20f44e-8eae-577f-4bce-6875b00cab0c BootID:f54d8273-479b-42a3-bee5-c6c430225427 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:13:b7:52:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:13:b7:52:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:02:87:93:d6:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 17:43:52.879204 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.879195    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 17:43:52.879364 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.879289    2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 17:43:52.882288 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.882267    2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 17:43:52.882429 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.882292    2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 17:43:52.882490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.882448    2566 topology_manager.go:138] "Creating topology manager with none policy"
May 28 17:43:52.882490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.882457    2566 container_manager_linux.go:306] "Creating device plugin manager"
May 28 17:43:52.882490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.882465    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:43:52.883358 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.883348    2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:43:52.885932 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.885921    2566 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:43:52.886037 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.886028    2566 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 17:43:52.889197 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.889186    2566 kubelet.go:491] "Attempting to sync node with API server"
May 28 17:43:52.889238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.889202    2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 17:43:52.889238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.889214    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 17:43:52.889238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.889223    2566 kubelet.go:397] "Adding apiserver pod source"
May 28 17:43:52.889238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.889232    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 17:43:52.890461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.890448    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:43:52.890498 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.890469    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:43:52.898965 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.898946    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vt45w"
May 28 17:43:52.899960 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.899947    2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 17:43:52.900373 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.900348    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 17:43:52.900423 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.900386    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 17:43:52.902597 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.902581    2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 17:43:52.903300 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903288    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vt45w"
May 28 17:43:52.903769 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903757    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903774    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903781    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903786    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903793    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903800    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903805    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903811    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903818    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903823    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 17:43:52.903845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.903831    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 17:43:52.904175 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.904164    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 17:43:52.904222 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.904211    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 17:43:52.904256 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.904225    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 17:43:52.907351 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907338    2566 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 17:43:52.907400 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907370    2566 server.go:1295] "Started kubelet"
May 28 17:43:52.907605 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907551    2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 17:43:52.907655 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907621    2566 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 17:43:52.907655 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907622    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 17:43:52.907890 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.907594    2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 17:43:52.908186 ip-10-0-137-72 systemd[1]: Started Kubernetes Kubelet.
May 28 17:43:52.913160 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.913141    2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 17:43:52.913760 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.913741    2566 server.go:317] "Adding debug handlers to kubelet server"
May 28 17:43:52.920165 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.920140    2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 17:43:52.921486 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.921465    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 17:43:52.922139 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922111    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 17:43:52.922221 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922181    2566 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 17:43:52.922221 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922190    2566 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 17:43:52.922322 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922309    2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 17:43:52.922371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922356    2566 reconstruct.go:97] "Volume reconstruction finished"
May 28 17:43:52.922371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.922361    2566 reconciler.go:26] "Reconciler: start to sync state"
May 28 17:43:52.923038 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923018    2566 factory.go:55] Registering systemd factory
May 28 17:43:52.923038 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923036    2566 factory.go:223] Registration of the systemd container factory successfully
May 28 17:43:52.923153 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.923071    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:52.923275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923257    2566 factory.go:153] Registering CRI-O factory
May 28 17:43:52.923275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923278    2566 factory.go:223] Registration of the crio container factory successfully
May 28 17:43:52.923388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923329    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 17:43:52.923388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923349    2566 factory.go:103] Registering Raw factory
May 28 17:43:52.923388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923363    2566 manager.go:1196] Started watching for new ooms in manager
May 28 17:43:52.923767 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.923750    2566 manager.go:319] Starting recovery of all containers
May 28 17:43:52.927943 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.927762    2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:52.930168 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.930126    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-72.ec2.internal\" not found" node="ip-10-0-137-72.ec2.internal"
May 28 17:43:52.933267 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.933252    2566 manager.go:324] Recovery completed
May 28 17:43:52.937403 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.937390    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:52.939292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939275    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:52.939356 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939301    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:52.939356 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939312    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:52.939782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939771    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 17:43:52.939782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939782    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 17:43:52.939897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.939799    2566 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:43:52.943520 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.943507    2566 policy_none.go:49] "None policy: Start"
May 28 17:43:52.943573 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.943524    2566 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 17:43:52.943573 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.943535    2566 state_mem.go:35] "Initializing new in-memory state store"
May 28 17:43:52.976484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.976465    2566 manager.go:341] "Starting Device Plugin manager"
May 28 17:43:52.976582 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.976506    2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 17:43:52.976582 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.976521    2566 server.go:85] "Starting device plugin registration server"
May 28 17:43:52.976788 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.976774    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 17:43:52.976897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.976789    2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 17:43:52.976958 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.976926    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 17:43:52.977022 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.977016    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 17:43:52.977077 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:52.977025    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 17:43:52.977532 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.977512    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 17:43:52.977613 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:52.977553    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.025115 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.025034    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 17:43:53.029159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.026368    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 17:43:53.029159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.026393    2566 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 17:43:53.029159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.026412    2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 17:43:53.029159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.026419    2566 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 17:43:53.029159 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.026464    2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 17:43:53.029390 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.029298    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:53.078364 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.078345    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:53.079791 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.079774    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:53.079898 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.079813    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:53.079898 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.079830    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:53.079898 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.079861    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-72.ec2.internal"
May 28 17:43:53.087695 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.087679    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-72.ec2.internal"
May 28 17:43:53.087780 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.087706    2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-72.ec2.internal\": node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.105890 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.105853    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.127214 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.127190    2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"]
May 28 17:43:53.127273 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.127261    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:53.128140 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.128127    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:53.128214 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.128154    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:53.128214 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.128164    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:53.129157 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129145    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:53.129299 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129287    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.129336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129314    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:53.129828 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129812    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:53.129936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129816    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:53.129936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129840    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:53.129936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129850    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:53.129936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129855    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:53.129936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.129865    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:53.131125 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.131111    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.131164 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.131137    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:43:53.131815 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.131791    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:43:53.131815 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.131816    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:43:53.131940 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.131826    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeHasSufficientPID"
May 28 17:43:53.145440 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.145417    2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-72.ec2.internal\" not found" node="ip-10-0-137-72.ec2.internal"
May 28 17:43:53.149179 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.149164    2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-72.ec2.internal\" not found" node="ip-10-0-137-72.ec2.internal"
May 28 17:43:53.206365 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.206341    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.224710 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.224688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.224790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.224715    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.224790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.224733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70500e0cbc178c2892ee8356da629133-config\") pod \"kube-apiserver-proxy-ip-10-0-137-72.ec2.internal\" (UID: \"70500e0cbc178c2892ee8356da629133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.306898 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.306821    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.325212 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325181    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.325212 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325210    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.325336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325230    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70500e0cbc178c2892ee8356da629133-config\") pod \"kube-apiserver-proxy-ip-10-0-137-72.ec2.internal\" (UID: \"70500e0cbc178c2892ee8356da629133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.325336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325267    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.325336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325279    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4960472cb699c1fa55dbbe0ee2f6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal\" (UID: \"fda4960472cb699c1fa55dbbe0ee2f6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.325336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.325282    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70500e0cbc178c2892ee8356da629133-config\") pod \"kube-apiserver-proxy-ip-10-0-137-72.ec2.internal\" (UID: \"70500e0cbc178c2892ee8356da629133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.407582 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.407553    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.448007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.447988    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.451748 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.451730    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.508156 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.508125    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.608656 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.608594    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.709062 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.709030    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-72.ec2.internal\" not found"
May 28 17:43:53.722308 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.722291    2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:53.805107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.805085    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 17:43:53.805589 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.805213    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:43:53.805589 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.805252    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:43:53.805589 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.805252    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:43:53.823117 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.823086    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.844975 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.844954    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:43:53.847188 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.847174    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"
May 28 17:43:53.855370 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.855352    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:43:53.889581 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.889517    2566 apiserver.go:52] "Watching apiserver"
May 28 17:43:53.899129 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.899112    2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 17:43:53.900502 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.900477    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg","openshift-cluster-node-tuning-operator/tuned-k97vx","openshift-image-registry/node-ca-8lsd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-9ccx2","openshift-multus/network-metrics-daemon-4tp8t","openshift-dns/node-resolver-nzvts","openshift-multus/multus-hhdtw","openshift-network-diagnostics/network-check-target-4zvgt","openshift-network-operator/iptables-alerter-ww6fx","openshift-ovn-kubernetes/ovnkube-node-sphfp","kube-system/konnectivity-agent-jg5wq","kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal"]
May 28 17:43:53.902924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.902904    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.905177 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905129    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:38:52 +0000 UTC" deadline="2028-02-28 13:08:50.36795942 +0000 UTC"
May 28 17:43:53.905177 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905175    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15379h24m56.462786721s"
May 28 17:43:53.905298 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905188    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 17:43:53.905353 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905335    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vm4kr\""
May 28 17:43:53.905397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905373    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 17:43:53.905397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.905335    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 17:43:53.906576 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.906555    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.908517 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.908501    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:53.908730 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.908708    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 17:43:53.909074 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.909047    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 17:43:53.909157 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.909138    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b64f4\""
May 28 17:43:53.911076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.910741    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.911076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.910749    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 17:43:53.911076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.910920    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 17:43:53.911076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.910947    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 17:43:53.911076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.911067    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:53.911364 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.911153    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:43:53.911532 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.911510    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sx9fv\""
May 28 17:43:53.913415 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.913109    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:53.914064 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.913724    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 17:43:53.915545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.914181    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gkwhx\""
May 28 17:43:53.915545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.914967    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 17:43:53.915545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.915033    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 17:43:53.915545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.915214    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 17:43:53.915545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.915318    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 17:43:53.916990 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.916971    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.917083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.917074    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wf9zl\""
May 28 17:43:53.917143 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.917097    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 17:43:53.917272 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.917250    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 17:43:53.919264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.919245    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:53.919344 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:53.919323    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:43:53.919465 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.919445    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 17:43:53.919531 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.919465    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8lrq8\""
May 28 17:43:53.921350 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.921332    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:53.921552 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.921538    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 17:43:53.923855 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.923838    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rdxpg\""
May 28 17:43:53.924026 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.924009    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 17:43:53.924131 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.924117    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 17:43:53.924183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.924122    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 17:43:53.924295 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.924282    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.926278 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926260    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pcj2d\""
May 28 17:43:53.926345 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926332    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:53.926553 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926538    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 17:43:53.926553 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926550    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 17:43:53.926685 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926628    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 17:43:53.926785 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926768    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 17:43:53.926849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.926785    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 17:43:53.927056 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.927044    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 17:43:53.928486 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928469    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dwtzx\""
May 28 17:43:53.928663 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928643    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 17:43:53.928821 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928803    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-netns\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.928920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928833    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-var-lib-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.928920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4plr\" (UniqueName: \"kubernetes.io/projected/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-kube-api-access-l4plr\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.928920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928892    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.928920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928913    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 17:43:53.928920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-socket-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-etc-selinux\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928965    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-socket-dir-parent\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.928995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-modprobe-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hkt\" (UniqueName: \"kubernetes.io/projected/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kube-api-access-v4hkt\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929106    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1249ec67-7684-4c13-abe2-6f86248a2b46-iptables-alerter-script\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:53.929173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929147    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-slash\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-bin\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929274    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jmh\" (UniqueName: \"kubernetes.io/projected/6fdb331b-6643-474c-8f05-18ebf190a5a1-kube-api-access-n8jmh\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929330    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-system-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929358    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-systemd\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.929426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-var-lib-kubelet\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929430    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-systemd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5b9f\" (UniqueName: \"kubernetes.io/projected/c212ad0c-d183-48c7-aae9-e0d9075b4806-kube-api-access-g5b9f\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdb331b-6643-474c-8f05-18ebf190a5a1-serviceca\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-multus\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929598    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-script-lib\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-multus-daemon-config\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.929697 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929703    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-system-cni-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdb331b-6643-474c-8f05-18ebf190a5a1-host\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929805    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-sys-fs\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929858    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-kubernetes\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-sys\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929925    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2d350eb-aaba-4257-b10f-9fafd3d2f119-tmp-dir\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-etc-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.929989    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-config\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-cnibin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-netns\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-kubelet\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-registration-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-device-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-cni-binary-copy\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-conf\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930334    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-os-release\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovn-node-metrics-cert\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-k8s-cni-cncf-io\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930428    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-kubelet\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930481    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-etc-kubernetes\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930519    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-bin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930540    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-lib-modules\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930560    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-tmp\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930580    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlb2\" (UniqueName: \"kubernetes.io/projected/1249ec67-7684-4c13-abe2-6f86248a2b46-kube-api-access-djlb2\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:53.930758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930632    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76fvm\" (UniqueName: \"kubernetes.io/projected/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-kube-api-access-76fvm\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930672    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2d350eb-aaba-4257-b10f-9fafd3d2f119-hosts-file\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930739    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930765    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-env-overrides\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-host\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-hostroot\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cnibin\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwn7f\" (UniqueName: \"kubernetes.io/projected/e2d350eb-aaba-4257-b10f-9fafd3d2f119-kube-api-access-jwn7f\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-systemd-units\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930925    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p25qg\" (UniqueName: \"kubernetes.io/projected/ebf68954-31e5-4ab5-88af-146f6093d424-kube-api-access-p25qg\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930939    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-conf-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1249ec67-7684-4c13-abe2-6f86248a2b46-host-slash\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.930994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-ovn\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-node-log\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-log-socket\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-netd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:53.931276 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-os-release\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.931805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931109    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-multus-certs\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.931805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7c8w\" (UniqueName: \"kubernetes.io/projected/f253f198-f451-4072-9b36-337145fd4e38-kube-api-access-d7c8w\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:53.931805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysconfig\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.931805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-run\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.931805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.931195    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-tuned\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:53.936736 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.936717    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:43:53.954615 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.954596    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjtf8"
May 28 17:43:53.963141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.963126    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjtf8"
May 28 17:43:53.976852 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:53.976831    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70500e0cbc178c2892ee8356da629133.slice/crio-5969a29a761479e7991e3f8af90b2bb6e424e008f16ace6b43e50214977ab224 WatchSource:0}: Error finding container 5969a29a761479e7991e3f8af90b2bb6e424e008f16ace6b43e50214977ab224: Status 404 returned error can't find the container with id 5969a29a761479e7991e3f8af90b2bb6e424e008f16ace6b43e50214977ab224
May 28 17:43:53.981817 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:53.981784    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:43:53.985083 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:53.984914    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda4960472cb699c1fa55dbbe0ee2f6b.slice/crio-2201b5d20ec67d188d883c387c6478bb81bad74d06aa86bedb698187a1c58b85 WatchSource:0}: Error finding container 2201b5d20ec67d188d883c387c6478bb81bad74d06aa86bedb698187a1c58b85: Status 404 returned error can't find the container with id 2201b5d20ec67d188d883c387c6478bb81bad74d06aa86bedb698187a1c58b85
May 28 17:43:54.023094 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.023078    2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 17:43:54.028751 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.028716    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal" event={"ID":"fda4960472cb699c1fa55dbbe0ee2f6b","Type":"ContainerStarted","Data":"2201b5d20ec67d188d883c387c6478bb81bad74d06aa86bedb698187a1c58b85"}
May 28 17:43:54.029560 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.029543    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal" event={"ID":"70500e0cbc178c2892ee8356da629133","Type":"ContainerStarted","Data":"5969a29a761479e7991e3f8af90b2bb6e424e008f16ace6b43e50214977ab224"}
May 28 17:43:54.031782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031766    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-script-lib\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.031836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031792    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-multus-daemon-config\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.031836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031809    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.031836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031825    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-system-cni-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031839    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031855    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031890    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdb331b-6643-474c-8f05-18ebf190a5a1-host\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031932    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-sys-fs\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031940    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-system-cni-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031940    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fdb331b-6643-474c-8f05-18ebf190a5a1-host\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.032007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031987    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.031994    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-kubernetes\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032013    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-sys-fs\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032041    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-sys\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032045    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-kubernetes\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032066    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2d350eb-aaba-4257-b10f-9fafd3d2f119-tmp-dir\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032092    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-etc-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032097    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-sys\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032115    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-config\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032138    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-etc-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032141    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032205    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-cnibin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.032234    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032300    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-cnibin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.032343 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.032352    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:54.532321608 +0000 UTC m=+2.134637212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032362    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-netns\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032231    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-netns\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032417    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2d350eb-aaba-4257-b10f-9fafd3d2f119-tmp-dir\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032433    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-kubelet\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032461    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032479    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-script-lib\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032479    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032507    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-registration-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032529    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-kubelet\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032534    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-device-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032532    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-multus-daemon-config\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032568    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-cni-binary-copy\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032593    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-conf\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032595    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-device-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovnkube-config\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-registration-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032618    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-os-release\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032642    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovn-node-metrics-cert\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032664    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-k8s-cni-cncf-io\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032678    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-kubelet\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032695    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-etc-kubernetes\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032701    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-os-release\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032712    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysctl-conf\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032719    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-bin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032729    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-kubelet\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032735    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-k8s-cni-cncf-io\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032754    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-etc-kubernetes\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032763    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-bin\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032781    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-lib-modules\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032808    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-tmp\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032832    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djlb2\" (UniqueName: \"kubernetes.io/projected/1249ec67-7684-4c13-abe2-6f86248a2b46-kube-api-access-djlb2\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032848    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.033804 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/640355f2-a1ca-40cf-a0ca-9408de6159e5-agent-certs\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032910    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76fvm\" (UniqueName: \"kubernetes.io/projected/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-kube-api-access-76fvm\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032922    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-lib-modules\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032944    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.032981    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2d350eb-aaba-4257-b10f-9fafd3d2f119-hosts-file\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033006    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033039    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033075    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f253f198-f451-4072-9b36-337145fd4e38-cni-binary-copy\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033094    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2d350eb-aaba-4257-b10f-9fafd3d2f119-hosts-file\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033009    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-ovn-kubernetes\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033131    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-env-overrides\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033155    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-host\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033179    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-hostroot\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033204    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cnibin\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033228    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwn7f\" (UniqueName: \"kubernetes.io/projected/e2d350eb-aaba-4257-b10f-9fafd3d2f119-kube-api-access-jwn7f\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033235    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-host\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033255    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-systemd-units\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033267    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-hostroot\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.034654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033272    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cnibin\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033281    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p25qg\" (UniqueName: \"kubernetes.io/projected/ebf68954-31e5-4ab5-88af-146f6093d424-kube-api-access-p25qg\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033308    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-systemd-units\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033311    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-conf-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033339    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033351    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-conf-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033346    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1249ec67-7684-4c13-abe2-6f86248a2b46-host-slash\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033373    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1249ec67-7684-4c13-abe2-6f86248a2b46-host-slash\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033395    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-ovn\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033421    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-node-log\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033439    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-ovn\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033446    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-log-socket\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033490    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c212ad0c-d183-48c7-aae9-e0d9075b4806-env-overrides\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033493    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-log-socket\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033511    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-netd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033496    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-node-log\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033551    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-os-release\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033562    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-netd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.035255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033568    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-multus-certs\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033604    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7c8w\" (UniqueName: \"kubernetes.io/projected/f253f198-f451-4072-9b36-337145fd4e38-kube-api-access-d7c8w\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033620    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysconfig\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033619    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-run-multus-certs\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033620    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-os-release\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033680    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-run\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033707    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-tuned\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033744    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-netns\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033771    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-var-lib-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033798    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4plr\" (UniqueName: \"kubernetes.io/projected/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-kube-api-access-l4plr\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033827    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033850    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-run-netns\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033854    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-socket-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033916    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-etc-selinux\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033947    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-socket-dir-parent\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033971    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-socket-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.033995    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-modprobe-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036047 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034021    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034031    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034061    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hkt\" (UniqueName: \"kubernetes.io/projected/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kube-api-access-v4hkt\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034085    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-socket-dir-parent\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034088    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1249ec67-7684-4c13-abe2-6f86248a2b46-iptables-alerter-script\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034102    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-sysconfig\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034115    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-slash\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034137    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-var-lib-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034156    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034166    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3dd549bb-6bc7-497c-a9dd-7e2d70298915-etc-selinux\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034182    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-bin\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034218    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-modprobe-d\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034224    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jmh\" (UniqueName: \"kubernetes.io/projected/6fdb331b-6643-474c-8f05-18ebf190a5a1-kube-api-access-n8jmh\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034063    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-run\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034249    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-system-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034269    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-openvswitch\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034274    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-systemd\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.036594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034278    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034307    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-slash\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034330    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-host-cni-bin\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034358    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-var-lib-kubelet\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034343    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-systemd\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034389    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034416    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-systemd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034426    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-var-lib-kubelet\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034360    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-system-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034451    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5b9f\" (UniqueName: \"kubernetes.io/projected/c212ad0c-d183-48c7-aae9-e0d9075b4806-kube-api-access-g5b9f\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034486    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c212ad0c-d183-48c7-aae9-e0d9075b4806-run-systemd\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034491    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/640355f2-a1ca-40cf-a0ca-9408de6159e5-konnectivity-ca\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034519    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdb331b-6643-474c-8f05-18ebf190a5a1-serviceca\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034580    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034644    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-multus-cni-dir\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034668    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1249ec67-7684-4c13-abe2-6f86248a2b46-iptables-alerter-script\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034726    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-multus\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.034796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f253f198-f451-4072-9b36-337145fd4e38-host-var-lib-cni-multus\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.037126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.035170    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fdb331b-6643-474c-8f05-18ebf190a5a1-serviceca\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.037622 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.036266    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-tmp\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.037622 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.036335    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c212ad0c-d183-48c7-aae9-e0d9075b4806-ovn-node-metrics-cert\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.037622 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.036525    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-etc-tuned\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.044569 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.044547    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:43:54.044670 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.044574    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:43:54.044670 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.044587    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:54.044670 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.044639    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:54.544622147 +0000 UTC m=+2.146937739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:54.046161 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.046134    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwn7f\" (UniqueName: \"kubernetes.io/projected/e2d350eb-aaba-4257-b10f-9fafd3d2f119-kube-api-access-jwn7f\") pod \"node-resolver-nzvts\" (UID: \"e2d350eb-aaba-4257-b10f-9fafd3d2f119\") " pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.047107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.046665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4plr\" (UniqueName: \"kubernetes.io/projected/8c4a7d7f-49a9-4e90-922b-1bbd9785b56e-kube-api-access-l4plr\") pod \"multus-additional-cni-plugins-9ccx2\" (UID: \"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e\") " pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.047107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.047002    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlb2\" (UniqueName: \"kubernetes.io/projected/1249ec67-7684-4c13-abe2-6f86248a2b46-kube-api-access-djlb2\") pod \"iptables-alerter-ww6fx\" (UID: \"1249ec67-7684-4c13-abe2-6f86248a2b46\") " pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.047107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.047004    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76fvm\" (UniqueName: \"kubernetes.io/projected/d38d8dc6-c5df-414c-b4c0-bb39f36c2435-kube-api-access-76fvm\") pod \"tuned-k97vx\" (UID: \"d38d8dc6-c5df-414c-b4c0-bb39f36c2435\") " pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.047107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.047028    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5b9f\" (UniqueName: \"kubernetes.io/projected/c212ad0c-d183-48c7-aae9-e0d9075b4806-kube-api-access-g5b9f\") pod \"ovnkube-node-sphfp\" (UID: \"c212ad0c-d183-48c7-aae9-e0d9075b4806\") " pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.047107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.047067    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p25qg\" (UniqueName: \"kubernetes.io/projected/ebf68954-31e5-4ab5-88af-146f6093d424-kube-api-access-p25qg\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:54.047425 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.047276    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hkt\" (UniqueName: \"kubernetes.io/projected/3dd549bb-6bc7-497c-a9dd-7e2d70298915-kube-api-access-v4hkt\") pod \"aws-ebs-csi-driver-node-h99vg\" (UID: \"3dd549bb-6bc7-497c-a9dd-7e2d70298915\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.048142 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.048124    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jmh\" (UniqueName: \"kubernetes.io/projected/6fdb331b-6643-474c-8f05-18ebf190a5a1-kube-api-access-n8jmh\") pod \"node-ca-8lsd6\" (UID: \"6fdb331b-6643-474c-8f05-18ebf190a5a1\") " pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.048268 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.048255    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7c8w\" (UniqueName: \"kubernetes.io/projected/f253f198-f451-4072-9b36-337145fd4e38-kube-api-access-d7c8w\") pod \"multus-hhdtw\" (UID: \"f253f198-f451-4072-9b36-337145fd4e38\") " pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.135988 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.135966    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/640355f2-a1ca-40cf-a0ca-9408de6159e5-agent-certs\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.136107 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.136017    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/640355f2-a1ca-40cf-a0ca-9408de6159e5-konnectivity-ca\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.136409 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.136394    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/640355f2-a1ca-40cf-a0ca-9408de6159e5-konnectivity-ca\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.138134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.138116    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/640355f2-a1ca-40cf-a0ca-9408de6159e5-agent-certs\") pod \"konnectivity-agent-jg5wq\" (UID: \"640355f2-a1ca-40cf-a0ca-9408de6159e5\") " pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.229253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.229179    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg"
May 28 17:43:54.236078 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.236056    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd549bb_6bc7_497c_a9dd_7e2d70298915.slice/crio-88101c0a2d4fb2c701c9c4a70824d78b0c04edae8cfdbffb2afddc4f819b6934 WatchSource:0}: Error finding container 88101c0a2d4fb2c701c9c4a70824d78b0c04edae8cfdbffb2afddc4f819b6934: Status 404 returned error can't find the container with id 88101c0a2d4fb2c701c9c4a70824d78b0c04edae8cfdbffb2afddc4f819b6934
May 28 17:43:54.246482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.246462    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k97vx"
May 28 17:43:54.252217 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.252187    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38d8dc6_c5df_414c_b4c0_bb39f36c2435.slice/crio-14e3e82b5372b442082e463973c07e4511802fd920574883e3a07ec1803ba240 WatchSource:0}: Error finding container 14e3e82b5372b442082e463973c07e4511802fd920574883e3a07ec1803ba240: Status 404 returned error can't find the container with id 14e3e82b5372b442082e463973c07e4511802fd920574883e3a07ec1803ba240
May 28 17:43:54.261963 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.261945    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8lsd6"
May 28 17:43:54.268307 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.268287    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdb331b_6643_474c_8f05_18ebf190a5a1.slice/crio-e04caaa772f6dad7048b920e7b013f472d7981132660a23c9c428a659e0147ac WatchSource:0}: Error finding container e04caaa772f6dad7048b920e7b013f472d7981132660a23c9c428a659e0147ac: Status 404 returned error can't find the container with id e04caaa772f6dad7048b920e7b013f472d7981132660a23c9c428a659e0147ac
May 28 17:43:54.289613 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.289595    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9ccx2"
May 28 17:43:54.295132 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.295113    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzvts"
May 28 17:43:54.295597 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.295541    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4a7d7f_49a9_4e90_922b_1bbd9785b56e.slice/crio-5973b6747bed5e3e9658970aa81dd773350bf1544ebe5d5202a64eabfb084ae8 WatchSource:0}: Error finding container 5973b6747bed5e3e9658970aa81dd773350bf1544ebe5d5202a64eabfb084ae8: Status 404 returned error can't find the container with id 5973b6747bed5e3e9658970aa81dd773350bf1544ebe5d5202a64eabfb084ae8
May 28 17:43:54.300619 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.300600    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhdtw"
May 28 17:43:54.300759 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.300740    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d350eb_aaba_4257_b10f_9fafd3d2f119.slice/crio-273b2ad2f4edcee74fcbc2ed296193d431cb833fbd5c3ad3d8dec1006dcfb349 WatchSource:0}: Error finding container 273b2ad2f4edcee74fcbc2ed296193d431cb833fbd5c3ad3d8dec1006dcfb349: Status 404 returned error can't find the container with id 273b2ad2f4edcee74fcbc2ed296193d431cb833fbd5c3ad3d8dec1006dcfb349
May 28 17:43:54.306921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.306904    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ww6fx"
May 28 17:43:54.307364 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.307345    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf253f198_f451_4072_9b36_337145fd4e38.slice/crio-1cfc99d184cb7883aa1d68bde5633119c681d505ceeb816573d098ee5ca06a66 WatchSource:0}: Error finding container 1cfc99d184cb7883aa1d68bde5633119c681d505ceeb816573d098ee5ca06a66: Status 404 returned error can't find the container with id 1cfc99d184cb7883aa1d68bde5633119c681d505ceeb816573d098ee5ca06a66
May 28 17:43:54.312184 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.312165    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:43:54.312585 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.312567    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1249ec67_7684_4c13_abe2_6f86248a2b46.slice/crio-16f949ac1e3921cc2d4ea41b4688a45504c416cad2e2832af571af6e2d8291fb WatchSource:0}: Error finding container 16f949ac1e3921cc2d4ea41b4688a45504c416cad2e2832af571af6e2d8291fb: Status 404 returned error can't find the container with id 16f949ac1e3921cc2d4ea41b4688a45504c416cad2e2832af571af6e2d8291fb
May 28 17:43:54.316791 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.316776    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:43:54.318904 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.318860    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc212ad0c_d183_48c7_aae9_e0d9075b4806.slice/crio-8af423c6002c64ce8def6495508a5526e6d277ec4330194decf34304dd6bff03 WatchSource:0}: Error finding container 8af423c6002c64ce8def6495508a5526e6d277ec4330194decf34304dd6bff03: Status 404 returned error can't find the container with id 8af423c6002c64ce8def6495508a5526e6d277ec4330194decf34304dd6bff03
May 28 17:43:54.323418 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:43:54.323396    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640355f2_a1ca_40cf_a0ca_9408de6159e5.slice/crio-e7d54a74f78f4b4590451bb49bd0463cf817c8569d1be7d7f575f42b8492fe39 WatchSource:0}: Error finding container e7d54a74f78f4b4590451bb49bd0463cf817c8569d1be7d7f575f42b8492fe39: Status 404 returned error can't find the container with id e7d54a74f78f4b4590451bb49bd0463cf817c8569d1be7d7f575f42b8492fe39
May 28 17:43:54.381382 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.381352    2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:54.538763 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.538681    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:54.538921 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.538809    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:54.538921 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.538896    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:55.538856117 +0000 UTC m=+3.141171723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:54.639441 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.639414    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:54.639598 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.639571    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:43:54.639598 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.639587    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:43:54.639598 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.639596    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:54.639724 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:54.639648    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:55.639630786 +0000 UTC m=+3.241946382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:54.743210 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.743165    2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:54.964391 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.964344    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:38:53 +0000 UTC" deadline="2027-11-05 14:16:14.634602003 +0000 UTC"
May 28 17:43:54.964391 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:54.964381    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12620h32m19.670224654s"
May 28 17:43:55.028519 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.028006    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:55.028519 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.028139    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:43:55.057438 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.057397    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ww6fx" event={"ID":"1249ec67-7684-4c13-abe2-6f86248a2b46","Type":"ContainerStarted","Data":"16f949ac1e3921cc2d4ea41b4688a45504c416cad2e2832af571af6e2d8291fb"}
May 28 17:43:55.080650 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.080609    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhdtw" event={"ID":"f253f198-f451-4072-9b36-337145fd4e38","Type":"ContainerStarted","Data":"1cfc99d184cb7883aa1d68bde5633119c681d505ceeb816573d098ee5ca06a66"}
May 28 17:43:55.088179 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.088142    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k97vx" event={"ID":"d38d8dc6-c5df-414c-b4c0-bb39f36c2435","Type":"ContainerStarted","Data":"14e3e82b5372b442082e463973c07e4511802fd920574883e3a07ec1803ba240"}
May 28 17:43:55.101716 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.101678    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jg5wq" event={"ID":"640355f2-a1ca-40cf-a0ca-9408de6159e5","Type":"ContainerStarted","Data":"e7d54a74f78f4b4590451bb49bd0463cf817c8569d1be7d7f575f42b8492fe39"}
May 28 17:43:55.117808 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.117770    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzvts" event={"ID":"e2d350eb-aaba-4257-b10f-9fafd3d2f119","Type":"ContainerStarted","Data":"273b2ad2f4edcee74fcbc2ed296193d431cb833fbd5c3ad3d8dec1006dcfb349"}
May 28 17:43:55.120364 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.120326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerStarted","Data":"5973b6747bed5e3e9658970aa81dd773350bf1544ebe5d5202a64eabfb084ae8"}
May 28 17:43:55.131349 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.131280    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8lsd6" event={"ID":"6fdb331b-6643-474c-8f05-18ebf190a5a1","Type":"ContainerStarted","Data":"e04caaa772f6dad7048b920e7b013f472d7981132660a23c9c428a659e0147ac"}
May 28 17:43:55.146670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.146642    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg" event={"ID":"3dd549bb-6bc7-497c-a9dd-7e2d70298915","Type":"ContainerStarted","Data":"88101c0a2d4fb2c701c9c4a70824d78b0c04edae8cfdbffb2afddc4f819b6934"}
May 28 17:43:55.155868 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.155834    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"8af423c6002c64ce8def6495508a5526e6d277ec4330194decf34304dd6bff03"}
May 28 17:43:55.367303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.367224    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:55.553645 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.551720    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:55.553645 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.551867    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:55.553645 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.551948    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:57.551929659 +0000 UTC m=+5.154245264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:55.653037 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.652959    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:55.653186 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.653148    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:43:55.653186 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.653176    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:43:55.653295 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.653191    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:55.653295 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:55.653249    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:57.653230365 +0000 UTC m=+5.255545961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:55.964756 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.964685    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:38:53 +0000 UTC" deadline="2028-01-12 13:25:32.141094271 +0000 UTC"
May 28 17:43:55.964756 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:55.964722    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h41m36.176375997s"
May 28 17:43:56.027134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:56.027095    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:56.027307 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:56.027241    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:43:56.392605 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:56.392527    2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:43:57.036072 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:57.036035    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:57.036503 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.036230    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:43:57.568897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:57.568485    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:57.568897 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.568713    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:57.568897 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.568791    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:01.568770227 +0000 UTC m=+9.171085832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:43:57.669854 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:57.669816    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:57.670025 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.669996    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:43:57.670025 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.670014    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:43:57.670025 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.670027    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:57.670127 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:57.670085    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:01.670066867 +0000 UTC m=+9.272382481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:43:58.027106 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:58.027070    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:58.027285 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:58.027221    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:43:59.027739 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:59.027704    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:43:59.028178 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:59.027829    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:43:59.030301 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:43:59.030278    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:43:59.030420 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:43:59.030399    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:01.027918 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:01.027253    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:01.027918 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.027394    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:01.027918 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:01.027794    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:01.027918 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.027867    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:01.602691 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:01.602657    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:01.602856 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.602803    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:01.602931 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.602863    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:09.602845858 +0000 UTC m=+17.205161456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:01.704093 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:01.704052    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:01.704286 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.704263    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:44:01.704400 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.704292    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:44:01.704400 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.704304    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:01.704400 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:01.704368    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:09.704348191 +0000 UTC m=+17.306663786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:03.027495 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:03.027464    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:03.027870 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:03.027592    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:03.027954 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:03.027929    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:03.028058 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:03.028035    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:05.027519 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:05.027490    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:05.027954 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:05.027490    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:05.027954 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:05.027626    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:05.027954 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:05.027665    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:07.027346 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:07.027286    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:07.027789 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:07.027420    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:07.027789 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:07.027485    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:07.027789 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:07.027601    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:09.026612 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:09.026573    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:09.027060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:09.026573    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:09.027060 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.026719    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:09.027060 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.026800    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:09.664391 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:09.664358    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:09.664618 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.664493    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:09.664618 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.664559    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:25.664538548 +0000 UTC m=+33.266854159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:09.765343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:09.765310    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:09.765532 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.765491    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:44:09.765532 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.765519    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:44:09.765532 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.765534    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:09.765662 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:09.765590    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:25.765574285 +0000 UTC m=+33.367889876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:11.027104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:11.027067    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:11.027104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:11.027106    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:11.027507 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:11.027205    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:11.027507 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:11.027307    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:13.027550 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:13.027515    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:13.028079 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:13.027628    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:13.028079 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:13.027726    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:13.028079 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:13.027851    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:14.192654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.192497    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal" event={"ID":"70500e0cbc178c2892ee8356da629133","Type":"ContainerStarted","Data":"0d685b2c16f94998611478a0ad2213af664fffb5e8a5669221d5d31ed61b39e7"}
May 28 17:44:14.193731 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.193714    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jg5wq" event={"ID":"640355f2-a1ca-40cf-a0ca-9408de6159e5","Type":"ContainerStarted","Data":"aba09bb08a2af318974058b8f7da8dae331bb2d46c01783027f23eb6755e1b49"}
May 28 17:44:14.194915 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.194898    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzvts" event={"ID":"e2d350eb-aaba-4257-b10f-9fafd3d2f119","Type":"ContainerStarted","Data":"bc068d1cdde198a04f697917421015b4043b2150a6cc5641f6989af94797ce82"}
May 28 17:44:14.196189 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.196165    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="e4b1780e3736ce3b8f6e6e7bc1054ebd3d81437a23b260fa4ca92291bccce08e" exitCode=0
May 28 17:44:14.196293 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.196237    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"e4b1780e3736ce3b8f6e6e7bc1054ebd3d81437a23b260fa4ca92291bccce08e"}
May 28 17:44:14.197552 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.197531    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8lsd6" event={"ID":"6fdb331b-6643-474c-8f05-18ebf190a5a1","Type":"ContainerStarted","Data":"7d9e24aa0d78ccae69c5974d912ad4c133b721bc3d9ec452137efcd5ec9c941b"}
May 28 17:44:14.199050 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.199003    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg" event={"ID":"3dd549bb-6bc7-497c-a9dd-7e2d70298915","Type":"ContainerStarted","Data":"a387ad907d8a6e6a6ee18ce808eaace1590caa47e995854ff11c8863383c2b36"}
May 28 17:44:14.201382 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.201362    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"8dccd75bb5dfc07e9cee65fb91163661fb7074775664306ea8e8a16d3d158dd1"}
May 28 17:44:14.201470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.201386    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"b2272afeb220726ec4a21f4e48198102648d3efcb29050d178350a6eae090237"}
May 28 17:44:14.201470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.201396    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"bf82093aff0a16b3c00c20da0ea0c042edfa74548d04ad14a46fafa0f0cc3827"}
May 28 17:44:14.201470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.201405    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"bf9a99523a7b86962d47644ba74655683445c0b9ecc1b28dc06e3e1f6163b1ae"}
May 28 17:44:14.201470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.201414    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"dae98b8cdfb05280e8a154cc1804c41cd24dbdf358a211bad3624626427e318f"}
May 28 17:44:14.202860 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.202842    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhdtw" event={"ID":"f253f198-f451-4072-9b36-337145fd4e38","Type":"ContainerStarted","Data":"bc8b55312b8d017bb212ddc07c8702f26a230ed77dea41dfb2421b4fa052495c"}
May 28 17:44:14.204117 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.204096    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k97vx" event={"ID":"d38d8dc6-c5df-414c-b4c0-bb39f36c2435","Type":"ContainerStarted","Data":"e540af07d67f016a79202924e632861c12f009de4e92aa8d31068c038f0beb29"}
May 28 17:44:14.205320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.205301    2566 generic.go:358] "Generic (PLEG): container finished" podID="fda4960472cb699c1fa55dbbe0ee2f6b" containerID="4c41a7158d47e07401faf0da1ca70be70b007090f43b7cf23c780945fe28e552" exitCode=0
May 28 17:44:14.205394 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.205326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal" event={"ID":"fda4960472cb699c1fa55dbbe0ee2f6b","Type":"ContainerDied","Data":"4c41a7158d47e07401faf0da1ca70be70b007090f43b7cf23c780945fe28e552"}
May 28 17:44:14.207838 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.207803    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-72.ec2.internal" podStartSLOduration=21.207794077 podStartE2EDuration="21.207794077s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:44:14.207535981 +0000 UTC m=+21.809851593" watchObservedRunningTime="2026-05-28 17:44:14.207794077 +0000 UTC m=+21.810109689"
May 28 17:44:14.242134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.242081    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8lsd6" podStartSLOduration=6.945970523 podStartE2EDuration="21.242044041s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.269690105 +0000 UTC m=+1.872005696" lastFinishedPulling="2026-05-28 17:44:08.565763623 +0000 UTC m=+16.168079214" observedRunningTime="2026-05-28 17:44:14.220753997 +0000 UTC m=+21.823069630" watchObservedRunningTime="2026-05-28 17:44:14.242044041 +0000 UTC m=+21.844359655"
May 28 17:44:14.258486 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.258054    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nzvts" podStartSLOduration=2.355609356 podStartE2EDuration="21.258036747s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.304520986 +0000 UTC m=+1.906836588" lastFinishedPulling="2026-05-28 17:44:13.206948377 +0000 UTC m=+20.809263979" observedRunningTime="2026-05-28 17:44:14.257490072 +0000 UTC m=+21.859805690" watchObservedRunningTime="2026-05-28 17:44:14.258036747 +0000 UTC m=+21.860352360"
May 28 17:44:14.275946 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.275904    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-hhdtw" podStartSLOduration=2.346949958 podStartE2EDuration="21.275892924s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.309718312 +0000 UTC m=+1.912033903" lastFinishedPulling="2026-05-28 17:44:13.238661265 +0000 UTC m=+20.840976869" observedRunningTime="2026-05-28 17:44:14.27568777 +0000 UTC m=+21.878003384" watchObservedRunningTime="2026-05-28 17:44:14.275892924 +0000 UTC m=+21.878208534"
May 28 17:44:14.290412 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.290363    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jg5wq" podStartSLOduration=6.791751538 podStartE2EDuration="21.290346589s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.324863327 +0000 UTC m=+1.927178922" lastFinishedPulling="2026-05-28 17:44:08.823458366 +0000 UTC m=+16.425773973" observedRunningTime="2026-05-28 17:44:14.28976802 +0000 UTC m=+21.892083660" watchObservedRunningTime="2026-05-28 17:44:14.290346589 +0000 UTC m=+21.892662203"
May 28 17:44:14.324699 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:14.324658    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k97vx" podStartSLOduration=2.369166186 podStartE2EDuration="21.324645486s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.253674275 +0000 UTC m=+1.855989867" lastFinishedPulling="2026-05-28 17:44:13.209153575 +0000 UTC m=+20.811469167" observedRunningTime="2026-05-28 17:44:14.324423888 +0000 UTC m=+21.926739502" watchObservedRunningTime="2026-05-28 17:44:14.324645486 +0000 UTC m=+21.926961099"
May 28 17:44:15.027439 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.027405    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:15.027582 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.027410    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:15.027582 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:15.027532    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:15.027699 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:15.027645    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:15.036127 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.036106    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 17:44:15.208501 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.208464    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal" event={"ID":"fda4960472cb699c1fa55dbbe0ee2f6b","Type":"ContainerStarted","Data":"d4347c4a55eb5882bf84c8b6cb7c0ac2448b49afeefc7cc927e2fb242b5278bc"}
May 28 17:44:15.210398 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.210373    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg" event={"ID":"3dd549bb-6bc7-497c-a9dd-7e2d70298915","Type":"ContainerStarted","Data":"ea9bf87efa793a26b8bfc2a8d68a1086513349d15d21199849f2b0138dad13e3"}
May 28 17:44:15.213290 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.213265    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"30b6b41f0843b07cc6b6d8a45cbc7f8266f89640f15f1f1b262fb5a8f44dc89c"}
May 28 17:44:15.214708 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.214634    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ww6fx" event={"ID":"1249ec67-7684-4c13-abe2-6f86248a2b46","Type":"ContainerStarted","Data":"e2be92131dd599120cf66d2bbf729f28520b9f00cead5c500fddd19c76371bc2"}
May 28 17:44:15.235467 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.235422    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-72.ec2.internal" podStartSLOduration=22.235405816 podStartE2EDuration="22.235405816s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:44:15.222158586 +0000 UTC m=+22.824474201" watchObservedRunningTime="2026-05-28 17:44:15.235405816 +0000 UTC m=+22.837721430"
May 28 17:44:15.992318 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.992217    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:44:15.036124471Z","UUID":"d4992985-c2ac-4bf6-b7d0-438e3d80c5a0","Handler":null,"Name":"","Endpoint":""}
May 28 17:44:15.995263 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.995236    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 17:44:15.995263 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:15.995265    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 17:44:17.027009 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.026969    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:17.027497 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:17.027104    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:17.027497 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.027173    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:17.027497 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:17.027291    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:17.220401 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.220370    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg" event={"ID":"3dd549bb-6bc7-497c-a9dd-7e2d70298915","Type":"ContainerStarted","Data":"6b1ea9ce48a0616d7c33068246943fd0a4100c11b41732fdea93bc5f53798a13"}
May 28 17:44:17.223613 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.223585    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"139bf07957d24115785b008a71bbc924328b4adb3c2f47f99e5e8129688f6b57"}
May 28 17:44:17.238448 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.238399    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ww6fx" podStartSLOduration=5.3456691 podStartE2EDuration="24.238388411s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.314400993 +0000 UTC m=+1.916716586" lastFinishedPulling="2026-05-28 17:44:13.2071203 +0000 UTC m=+20.809435897" observedRunningTime="2026-05-28 17:44:15.235214673 +0000 UTC m=+22.837530287" watchObservedRunningTime="2026-05-28 17:44:17.238388411 +0000 UTC m=+24.840704024"
May 28 17:44:17.238694 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.238667    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h99vg" podStartSLOduration=2.284063506 podStartE2EDuration="24.238662022s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.23766555 +0000 UTC m=+1.839981141" lastFinishedPulling="2026-05-28 17:44:16.192264052 +0000 UTC m=+23.794579657" observedRunningTime="2026-05-28 17:44:17.237986153 +0000 UTC m=+24.840301767" watchObservedRunningTime="2026-05-28 17:44:17.238662022 +0000 UTC m=+24.840977634"
May 28 17:44:17.936896 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.936850    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:44:17.937748 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:17.937724    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:44:18.226090 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:18.226054    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:44:18.226623 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:18.226597    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jg5wq"
May 28 17:44:19.026761 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.026590    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:19.026951 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.026629    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:19.026951 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:19.026840    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:19.026951 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:19.026910    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:19.230361 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.230318    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" event={"ID":"c212ad0c-d183-48c7-aae9-e0d9075b4806","Type":"ContainerStarted","Data":"ceaad498fbeae4331f8eeeccb02ad025ef653eff4b81fc26b62db0a6fa798c56"}
May 28 17:44:19.231274 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.230667    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:19.231274 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.230693    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:19.231274 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.230708    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:19.232156 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.232128    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="3263d6cb4ddde7ae9b3f39a388ced14ce6e54430dd5b508047efdf29ac21c24f" exitCode=0
May 28 17:44:19.232292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.232219    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"3263d6cb4ddde7ae9b3f39a388ced14ce6e54430dd5b508047efdf29ac21c24f"}
May 28 17:44:19.247341 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.247322    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:19.247449 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.247405    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:19.256959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:19.256924    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp" podStartSLOduration=7.022496577 podStartE2EDuration="26.25691362s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.320793086 +0000 UTC m=+1.923108681" lastFinishedPulling="2026-05-28 17:44:13.55521013 +0000 UTC m=+21.157525724" observedRunningTime="2026-05-28 17:44:19.254660061 +0000 UTC m=+26.856975674" watchObservedRunningTime="2026-05-28 17:44:19.25691362 +0000 UTC m=+26.859229233"
May 28 17:44:20.467186 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:20.466849    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4zvgt"]
May 28 17:44:20.467620 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:20.467234    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:20.467620 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:20.467334    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:20.469988 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:20.469967    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4tp8t"]
May 28 17:44:20.470062 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:20.470056    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:20.470167 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:20.470150    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:21.237328 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:21.237293    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="e2cdc7bb84a93b9f2b987d612e4a4b9b943720ab6b993de782e9d43616356e4c" exitCode=0
May 28 17:44:21.237506 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:21.237385    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"e2cdc7bb84a93b9f2b987d612e4a4b9b943720ab6b993de782e9d43616356e4c"}
May 28 17:44:22.026955 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:22.026924    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:22.027316 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:22.026924    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:22.027316 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:22.027028    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:22.027316 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:22.027100    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:23.243212 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:23.243175    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="5b38e6b96ce923b1a76e59459f7ffbc303a07c9ccea01afb6644e22aa9618c40" exitCode=0
May 28 17:44:23.243620 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:23.243215    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"5b38e6b96ce923b1a76e59459f7ffbc303a07c9ccea01afb6644e22aa9618c40"}
May 28 17:44:24.026857 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:24.026821    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:24.027061 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:24.026828    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:24.027061 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:24.026951    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:24.027061 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:24.027025    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:25.688600 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:25.688397    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:25.689090 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.688556    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:25.689090 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.688712    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:57.688689696 +0000 UTC m=+65.291005303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:44:25.789610 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:25.789567    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:25.789771 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.789729    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:44:25.789771 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.789746    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:44:25.789771 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.789758    2566 projected.go:194] Error preparing data for projected volume kube-api-access-qplrx for pod openshift-network-diagnostics/network-check-target-4zvgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:25.789948 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:25.789817    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx podName:81fdbfb7-10e6-4d61-9ac2-2aad97241518 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:57.789799375 +0000 UTC m=+65.392114975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qplrx" (UniqueName: "kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx") pod "network-check-target-4zvgt" (UID: "81fdbfb7-10e6-4d61-9ac2-2aad97241518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:44:26.026691 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.026658    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:26.026850 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.026658    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:26.026850 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.026789    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:44:26.027067 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.026890    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zvgt" podUID="81fdbfb7-10e6-4d61-9ac2-2aad97241518"
May 28 17:44:26.230393 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.230310    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-72.ec2.internal" event="NodeReady"
May 28 17:44:26.230554 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.230469    2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 17:44:26.280437 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.280408    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jjbxb"]
May 28 17:44:26.283599 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.283577    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5dzs6"]
May 28 17:44:26.283752 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.283629    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.286135 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.286102    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v9cdg\""
May 28 17:44:26.286255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.286141    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 17:44:26.286773 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.286733    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.286899 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.286794    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 17:44:26.289285 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.289258    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 17:44:26.290859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.289589    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 17:44:26.290859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.289804    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dtch\""
May 28 17:44:26.290859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.289863    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 17:44:26.293723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.293706    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jjbxb"]
May 28 17:44:26.295922 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.295900    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5dzs6"]
May 28 17:44:26.393628 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.393801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-config-volume\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.393801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7k9x\" (UniqueName: \"kubernetes.io/projected/d265c80d-d2b6-4855-b5cf-84a70c447d26-kube-api-access-m7k9x\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.393801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.393948 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zh7\" (UniqueName: \"kubernetes.io/projected/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-kube-api-access-v7zh7\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.393948 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.393856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-tmp-dir\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.494583 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494506    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7k9x\" (UniqueName: \"kubernetes.io/projected/d265c80d-d2b6-4855-b5cf-84a70c447d26-kube-api-access-m7k9x\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.494583 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494554    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.494583 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494583    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zh7\" (UniqueName: \"kubernetes.io/projected/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-kube-api-access-v7zh7\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494615    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-tmp-dir\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494653    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.494664    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.494737    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:26.994714306 +0000 UTC m=+34.597029923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.494737    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.494780    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:26.994767106 +0000 UTC m=+34.597082700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:26.494839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.494816    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-config-volume\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.495155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.495025    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-tmp-dir\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.495316 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.495289    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-config-volume\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.505007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.504985    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zh7\" (UniqueName: \"kubernetes.io/projected/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-kube-api-access-v7zh7\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.506519 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.506496    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7k9x\" (UniqueName: \"kubernetes.io/projected/d265c80d-d2b6-4855-b5cf-84a70c447d26-kube-api-access-m7k9x\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.998740 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.998703    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:26.999317 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:26.998767    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:26.999317 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.998868    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:26.999317 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.998958    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:27.998941972 +0000 UTC m=+35.601257563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:26.999317 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.998890    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:26.999317 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:26.999054    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:27.999037782 +0000 UTC m=+35.601353374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:28.007588 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.007558    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:28.008000 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.007634    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:28.008000 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:28.007726    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:28.008000 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:28.007737    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:28.008000 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:28.007797    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:30.00777958 +0000 UTC m=+37.610095188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:28.008000 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:28.007814    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:30.007807834 +0000 UTC m=+37.610123425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:28.026801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.026779    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:28.026801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.026789    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:28.030667 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.030644    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:44:28.030764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.030691    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:44:28.030764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.030743    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:44:28.030864 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.030648    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7tvx\""
May 28 17:44:28.030864 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:28.030646    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wt76\""
May 28 17:44:29.258640 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:29.258590    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerStarted","Data":"904143d52071db9396e4c91d2e6c074eccec5038faf45a859a0e51547fa6fff6"}
May 28 17:44:30.022069 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:30.022038    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:30.022271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:30.022131    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:30.022271 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:30.022194    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:30.022271 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:30.022233    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:30.022271 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:30.022266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:34.022248536 +0000 UTC m=+41.624564132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:30.022444 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:30.022299    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:34.022283355 +0000 UTC m=+41.624598950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:30.262410 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:30.262375    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="904143d52071db9396e4c91d2e6c074eccec5038faf45a859a0e51547fa6fff6" exitCode=0
May 28 17:44:30.262806 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:30.262420    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"904143d52071db9396e4c91d2e6c074eccec5038faf45a859a0e51547fa6fff6"}
May 28 17:44:31.267402 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:31.267373    2566 generic.go:358] "Generic (PLEG): container finished" podID="8c4a7d7f-49a9-4e90-922b-1bbd9785b56e" containerID="602faee74fa6a71cfa3a909c8b299081181d23d18ce0c56949ad34044cf58fa5" exitCode=0
May 28 17:44:31.267763 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:31.267427    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerDied","Data":"602faee74fa6a71cfa3a909c8b299081181d23d18ce0c56949ad34044cf58fa5"}
May 28 17:44:32.272305 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:32.272270    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" event={"ID":"8c4a7d7f-49a9-4e90-922b-1bbd9785b56e","Type":"ContainerStarted","Data":"d70d7c27882fc3c588f285c4e72ac5249594679ddbfb56129fd670933633daf3"}
May 28 17:44:32.294442 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:32.294389    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9ccx2" podStartSLOduration=4.472133594 podStartE2EDuration="39.294375636s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:43:54.297676815 +0000 UTC m=+1.899992410" lastFinishedPulling="2026-05-28 17:44:29.119918855 +0000 UTC m=+36.722234452" observedRunningTime="2026-05-28 17:44:32.292547309 +0000 UTC m=+39.894862922" watchObservedRunningTime="2026-05-28 17:44:32.294375636 +0000 UTC m=+39.896691249"
May 28 17:44:34.047735 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:34.047698    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:34.048175 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:34.047781    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:34.048175 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:34.047841    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:34.048175 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:34.047905    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:34.048175 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:34.047918    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:42.04789952 +0000 UTC m=+49.650215112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:34.048175 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:34.047960    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:42.047942886 +0000 UTC m=+49.650258497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:42.108454 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:42.108411    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:42.108943 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:42.108502    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:42.108943 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:42.108571    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:42.108943 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:42.108588    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:42.108943 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:42.108643    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:58.108624725 +0000 UTC m=+65.710940316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:42.108943 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:42.108659    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:44:58.108650872 +0000 UTC m=+65.710966462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:51.248325 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:51.248297    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sphfp"
May 28 17:44:57.710235 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.710188    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:44:57.712944 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.712925    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:44:57.720917 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:57.720897    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 17:44:57.720983 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:57.720974    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:01.720953215 +0000 UTC m=+129.323268820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : secret "metrics-daemon-secret" not found
May 28 17:44:57.811248 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.811208    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:57.813636 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.813619    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:44:57.823544 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.823530    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:44:57.835060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:57.835031    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qplrx\" (UniqueName: \"kubernetes.io/projected/81fdbfb7-10e6-4d61-9ac2-2aad97241518-kube-api-access-qplrx\") pod \"network-check-target-4zvgt\" (UID: \"81fdbfb7-10e6-4d61-9ac2-2aad97241518\") " pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:58.042949 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.042859    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7tvx\""
May 28 17:44:58.050550 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.050530    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:44:58.115905 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.115631    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:44:58.115905 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.115711    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:44:58.115905 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:58.115834    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:44:58.116139 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:58.115969    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:30.115950563 +0000 UTC m=+97.718266156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:44:58.122902 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:58.116405    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:44:58.122902 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:44:58.116451    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:45:30.11643763 +0000 UTC m=+97.718753235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:44:58.220031 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.220002    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4zvgt"]
May 28 17:44:58.223466 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:44:58.223438    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fdbfb7_10e6_4d61_9ac2_2aad97241518.slice/crio-509c9d78c4e15710b82e48e6a64d81a8979b5bbb198c2143d395f439426011eb WatchSource:0}: Error finding container 509c9d78c4e15710b82e48e6a64d81a8979b5bbb198c2143d395f439426011eb: Status 404 returned error can't find the container with id 509c9d78c4e15710b82e48e6a64d81a8979b5bbb198c2143d395f439426011eb
May 28 17:44:58.326425 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:44:58.326341    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4zvgt" event={"ID":"81fdbfb7-10e6-4d61-9ac2-2aad97241518","Type":"ContainerStarted","Data":"509c9d78c4e15710b82e48e6a64d81a8979b5bbb198c2143d395f439426011eb"}
May 28 17:45:02.335918 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:02.335859    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4zvgt" event={"ID":"81fdbfb7-10e6-4d61-9ac2-2aad97241518","Type":"ContainerStarted","Data":"0d2e62ff17da29b84695a449b5c5d45c2b519b95ead1b08edcf6c4fd7f7de21c"}
May 28 17:45:02.336292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:02.335999    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:45:30.127858 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:30.127803    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:45:30.127858 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:30.127869    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:45:30.128367 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:30.127979    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:45:30.128367 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:30.127999    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:45:30.128367 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:30.128035    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls podName:78ab029c-9e9f-4a47-8ffa-f80b058c08ab nodeName:}" failed. No retries permitted until 2026-05-28 17:46:34.128021765 +0000 UTC m=+161.730337355 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls") pod "dns-default-jjbxb" (UID: "78ab029c-9e9f-4a47-8ffa-f80b058c08ab") : secret "dns-default-metrics-tls" not found
May 28 17:45:30.128367 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:30.128063    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert podName:d265c80d-d2b6-4855-b5cf-84a70c447d26 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:34.12804513 +0000 UTC m=+161.730360722 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert") pod "ingress-canary-5dzs6" (UID: "d265c80d-d2b6-4855-b5cf-84a70c447d26") : secret "canary-serving-cert" not found
May 28 17:45:33.340304 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:33.340270    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4zvgt"
May 28 17:45:33.355253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:33.355203    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4zvgt" podStartSLOduration=97.288091676 podStartE2EDuration="1m40.355190972s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:44:58.225413513 +0000 UTC m=+65.827729108" lastFinishedPulling="2026-05-28 17:45:01.292512805 +0000 UTC m=+68.894828404" observedRunningTime="2026-05-28 17:45:02.351166224 +0000 UTC m=+69.953481837" watchObservedRunningTime="2026-05-28 17:45:33.355190972 +0000 UTC m=+100.957506584"
May 28 17:45:44.663911 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.663860    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"]
May 28 17:45:44.665644 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.665623    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"
May 28 17:45:44.670252 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.669963    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 17:45:44.670567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.670548    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nxldb\""
May 28 17:45:44.670641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.670603    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 17:45:44.670933 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.670911    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"]
May 28 17:45:44.672460 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.672441    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:45:44.672580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.672565    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.674054 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.674035    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.674729 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.674713    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 28 17:45:44.674814 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.674718    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 28 17:45:44.674945 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.674928    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 28 17:45:44.675203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.675187    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pxd4z\""
May 28 17:45:44.675269 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.675212    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 28 17:45:44.676435 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.676422    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvn4l\""
May 28 17:45:44.676672 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.676657    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 17:45:44.676793 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.676703    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 17:45:44.676793 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.676786    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 17:45:44.678185 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.678166    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"]
May 28 17:45:44.681376 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.681352    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 17:45:44.682147 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.682109    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"]
May 28 17:45:44.684629 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.684606    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:45:44.724852 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.724818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jltl2\" (UniqueName: \"kubernetes.io/projected/02e840c8-91a8-42f8-a2d7-26c48dc97853-kube-api-access-jltl2\") pod \"volume-data-source-validator-5cf8c89d64-nkfts\" (UID: \"02e840c8-91a8-42f8-a2d7-26c48dc97853\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"
May 28 17:45:44.825610 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825573    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jltl2\" (UniqueName: \"kubernetes.io/projected/02e840c8-91a8-42f8-a2d7-26c48dc97853-kube-api-access-jltl2\") pod \"volume-data-source-validator-5cf8c89d64-nkfts\" (UID: \"02e840c8-91a8-42f8-a2d7-26c48dc97853\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98581b63-98ea-461d-9310-95de1e026120-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.825790 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.826085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2fkt\" (UniqueName: \"kubernetes.io/projected/98581b63-98ea-461d-9310-95de1e026120-kube-api-access-x2fkt\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.826085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98581b63-98ea-461d-9310-95de1e026120-config\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.826085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.826085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2xb\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.826085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.825970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.833898 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.833849    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jltl2\" (UniqueName: \"kubernetes.io/projected/02e840c8-91a8-42f8-a2d7-26c48dc97853-kube-api-access-jltl2\") pod \"volume-data-source-validator-5cf8c89d64-nkfts\" (UID: \"02e840c8-91a8-42f8-a2d7-26c48dc97853\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"
May 28 17:45:44.869477 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.869450    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b87c96c96-nxhj2"]
May 28 17:45:44.871356 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.871327    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.874604 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.874580    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 17:45:44.874726 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.874674    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 17:45:44.874805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.874788    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 17:45:44.875012 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.874994    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j92tm\""
May 28 17:45:44.875115 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.875036    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 17:45:44.875180 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.875140    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 17:45:44.875649 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.875628    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 17:45:44.882657 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.882636    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b87c96c96-nxhj2"]
May 28 17:45:44.926455 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926375    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.926455 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926405    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.926455 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926426    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926486    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2fkt\" (UniqueName: \"kubernetes.io/projected/98581b63-98ea-461d-9310-95de1e026120-kube-api-access-x2fkt\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-stats-auth\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926565    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98581b63-98ea-461d-9310-95de1e026120-config\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926590    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-default-certificate\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926691    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.926723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926719    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2xb\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926767    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926853    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926908    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7q2\" (UniqueName: \"kubernetes.io/projected/c24a4791-2753-49c9-8ac0-830b1bcb4747-kube-api-access-cv7q2\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:44.926957    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.926968    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98581b63-98ea-461d-9310-95de1e026120-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:44.926976    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f746bc59-kvfkq: secret "image-registry-tls" not found
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.927004    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927119 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:44.927096    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls podName:e01af382-4d8e-4445-9e0a-ff554ca770da nodeName:}" failed. No retries permitted until 2026-05-28 17:45:45.427078857 +0000 UTC m=+113.029394463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls") pod "image-registry-57f746bc59-kvfkq" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da") : secret "image-registry-tls" not found
May 28 17:45:44.927517 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.927266    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98581b63-98ea-461d-9310-95de1e026120-config\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.927708 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.927686    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.927837 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.927823    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.929286 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.929266    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98581b63-98ea-461d-9310-95de1e026120-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.929616 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.929598    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.929724 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.929701    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.935318 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.935294    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.935418 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.935327    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2fkt\" (UniqueName: \"kubernetes.io/projected/98581b63-98ea-461d-9310-95de1e026120-kube-api-access-x2fkt\") pod \"kube-storage-version-migrator-operator-565644f49-lfz7j\" (UID: \"98581b63-98ea-461d-9310-95de1e026120\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:44.935418 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.935401    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2xb\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:44.979914 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.979860    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"
May 28 17:45:44.988724 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:44.988695    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.028239    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-stats-auth\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.028276    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-default-certificate\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.028294    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.028311    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.028368    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7q2\" (UniqueName: \"kubernetes.io/projected/c24a4791-2753-49c9-8ac0-830b1bcb4747-kube-api-access-cv7q2\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.028729    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:45.528713549 +0000 UTC m=+113.131029143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.028847    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 17:45:45.029470 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.028954    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:45.528934413 +0000 UTC m=+113.131250024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : secret "router-metrics-certs-default" not found
May 28 17:45:45.032264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.032168    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-default-certificate\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.032909 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.032856    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-stats-auth\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.040223 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.040155    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7q2\" (UniqueName: \"kubernetes.io/projected/c24a4791-2753-49c9-8ac0-830b1bcb4747-kube-api-access-cv7q2\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.109067 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.109036    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts"]
May 28 17:45:45.112389 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:45:45.112361    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e840c8_91a8_42f8_a2d7_26c48dc97853.slice/crio-ff9d25444ac66d6910cc9764377b164cedf37062e9056bcb7659df201ca08aa9 WatchSource:0}: Error finding container ff9d25444ac66d6910cc9764377b164cedf37062e9056bcb7659df201ca08aa9: Status 404 returned error can't find the container with id ff9d25444ac66d6910cc9764377b164cedf37062e9056bcb7659df201ca08aa9
May 28 17:45:45.127533 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.124902    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j"]
May 28 17:45:45.128685 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:45:45.128657    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98581b63_98ea_461d_9310_95de1e026120.slice/crio-c164ce01fca10028564c49a150ae5ad41f357c00f5ba54e05d5c61dd81b336a9 WatchSource:0}: Error finding container c164ce01fca10028564c49a150ae5ad41f357c00f5ba54e05d5c61dd81b336a9: Status 404 returned error can't find the container with id c164ce01fca10028564c49a150ae5ad41f357c00f5ba54e05d5c61dd81b336a9
May 28 17:45:45.414890 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.414831    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j" event={"ID":"98581b63-98ea-461d-9310-95de1e026120","Type":"ContainerStarted","Data":"c164ce01fca10028564c49a150ae5ad41f357c00f5ba54e05d5c61dd81b336a9"}
May 28 17:45:45.415672 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.415650    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts" event={"ID":"02e840c8-91a8-42f8-a2d7-26c48dc97853","Type":"ContainerStarted","Data":"ff9d25444ac66d6910cc9764377b164cedf37062e9056bcb7659df201ca08aa9"}
May 28 17:45:45.430122 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.430101    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:45.430228 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.430217    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:45:45.430264 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.430230    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f746bc59-kvfkq: secret "image-registry-tls" not found
May 28 17:45:45.430296 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.430286    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls podName:e01af382-4d8e-4445-9e0a-ff554ca770da nodeName:}" failed. No retries permitted until 2026-05-28 17:45:46.430272264 +0000 UTC m=+114.032587855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls") pod "image-registry-57f746bc59-kvfkq" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da") : secret "image-registry-tls" not found
May 28 17:45:45.530641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.530586    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.530641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:45.530638    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:45.530842 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.530730    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 17:45:45.530842 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.530770    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:46.530752983 +0000 UTC m=+114.133068578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:45:45.530945 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:45.530849    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:46.530842263 +0000 UTC m=+114.133157854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : secret "router-metrics-certs-default" not found
May 28 17:45:46.438375 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:46.438337    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:46.438779 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.438454    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:45:46.438779 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.438467    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f746bc59-kvfkq: secret "image-registry-tls" not found
May 28 17:45:46.438779 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.438534    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls podName:e01af382-4d8e-4445-9e0a-ff554ca770da nodeName:}" failed. No retries permitted until 2026-05-28 17:45:48.43850856 +0000 UTC m=+116.040824152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls") pod "image-registry-57f746bc59-kvfkq" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da") : secret "image-registry-tls" not found
May 28 17:45:46.539104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:46.539037    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:46.539259 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:46.539117    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:46.539259 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.539226    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:48.539204071 +0000 UTC m=+116.141519672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:45:46.539393 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.539255    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 17:45:46.539393 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:46.539309    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:48.539296889 +0000 UTC m=+116.141612484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : secret "router-metrics-certs-default" not found
May 28 17:45:47.420360 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:47.420326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j" event={"ID":"98581b63-98ea-461d-9310-95de1e026120","Type":"ContainerStarted","Data":"9b7e5bd873aae76ccf8b8bc5a0bbf62872feb6a077dba6c963cb2a1073fbffd2"}
May 28 17:45:47.421646 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:47.421621    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts" event={"ID":"02e840c8-91a8-42f8-a2d7-26c48dc97853","Type":"ContainerStarted","Data":"f9ff0720f23861e85e59b46acea7f3462971cbadf1415a623f16ea04dfd995ab"}
May 28 17:45:47.435630 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:47.435591    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j" podStartSLOduration=1.369178694 podStartE2EDuration="3.435578352s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:45:45.130670586 +0000 UTC m=+112.732986176" lastFinishedPulling="2026-05-28 17:45:47.19707024 +0000 UTC m=+114.799385834" observedRunningTime="2026-05-28 17:45:47.434206281 +0000 UTC m=+115.036521895" watchObservedRunningTime="2026-05-28 17:45:47.435578352 +0000 UTC m=+115.037893966"
May 28 17:45:47.448860 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:47.448787    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-nkfts" podStartSLOduration=1.986203071 podStartE2EDuration="3.448773883s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:45:45.114385184 +0000 UTC m=+112.716700778" lastFinishedPulling="2026-05-28 17:45:46.576955988 +0000 UTC m=+114.179271590" observedRunningTime="2026-05-28 17:45:47.448610054 +0000 UTC m=+115.050925666" watchObservedRunningTime="2026-05-28 17:45:47.448773883 +0000 UTC m=+115.051089497"
May 28 17:45:48.456333 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:48.456301    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:48.456750 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.456476    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:45:48.456750 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.456498    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f746bc59-kvfkq: secret "image-registry-tls" not found
May 28 17:45:48.456750 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.456565    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls podName:e01af382-4d8e-4445-9e0a-ff554ca770da nodeName:}" failed. No retries permitted until 2026-05-28 17:45:52.456543214 +0000 UTC m=+120.058858827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls") pod "image-registry-57f746bc59-kvfkq" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da") : secret "image-registry-tls" not found
May 28 17:45:48.557397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:48.557346    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:48.557599 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:48.557501    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:48.557599 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.557517    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 17:45:48.557599 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.557590    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:52.557568948 +0000 UTC m=+120.159884541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : secret "router-metrics-certs-default" not found
May 28 17:45:48.557770 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:48.557608    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:52.557599024 +0000 UTC m=+120.159914614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:45:52.163556 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:52.163526    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzvts_e2d350eb-aaba-4257-b10f-9fafd3d2f119/dns-node-resolver/0.log"
May 28 17:45:52.486803 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:52.486773    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:45:52.486966 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.486935    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:45:52.486966 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.486955    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f746bc59-kvfkq: secret "image-registry-tls" not found
May 28 17:45:52.487035 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.487010    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls podName:e01af382-4d8e-4445-9e0a-ff554ca770da nodeName:}" failed. No retries permitted until 2026-05-28 17:46:00.486993695 +0000 UTC m=+128.089309292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls") pod "image-registry-57f746bc59-kvfkq" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da") : secret "image-registry-tls" not found
May 28 17:45:52.587612 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:52.587582    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:52.587612 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:52.587612    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:45:52.587762 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.587740    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 17:45:52.587762 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.587753    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:00.587730686 +0000 UTC m=+128.190046277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:45:52.587829 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:45:52.587782    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:00.587768773 +0000 UTC m=+128.190084370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : secret "router-metrics-certs-default" not found
May 28 17:45:53.163384 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:53.163356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8lsd6_6fdb331b-6643-474c-8f05-18ebf190a5a1/node-ca/0.log"
May 28 17:45:54.565023 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:45:54.564990    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-lfz7j_98581b63-98ea-461d-9310-95de1e026120/kube-storage-version-migrator-operator/0.log"
May 28 17:46:00.550862 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.550808    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:00.553286 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.553265    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"image-registry-57f746bc59-kvfkq\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") " pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:00.597042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.597005    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvn4l\""
May 28 17:46:00.605190 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.605161    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:00.651972 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.651297    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:00.651972 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.651346    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:00.651972 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:00.651464    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle podName:c24a4791-2753-49c9-8ac0-830b1bcb4747 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:16.651443037 +0000 UTC m=+144.253758651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle") pod "router-default-7b87c96c96-nxhj2" (UID: "c24a4791-2753-49c9-8ac0-830b1bcb4747") : configmap references non-existent config key: service-ca.crt
May 28 17:46:00.654991 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.654956    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24a4791-2753-49c9-8ac0-830b1bcb4747-metrics-certs\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:00.729847 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:00.729813    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:46:00.733015 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:00.732991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01af382_4d8e_4445_9e0a_ff554ca770da.slice/crio-f13934154bac6f2a482008210e7918c5c256e424d90f15fecbb8447ed6df8336 WatchSource:0}: Error finding container f13934154bac6f2a482008210e7918c5c256e424d90f15fecbb8447ed6df8336: Status 404 returned error can't find the container with id f13934154bac6f2a482008210e7918c5c256e424d90f15fecbb8447ed6df8336
May 28 17:46:01.450655 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:01.450624    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" event={"ID":"e01af382-4d8e-4445-9e0a-ff554ca770da","Type":"ContainerStarted","Data":"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"}
May 28 17:46:01.450655 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:01.450657    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" event={"ID":"e01af382-4d8e-4445-9e0a-ff554ca770da","Type":"ContainerStarted","Data":"f13934154bac6f2a482008210e7918c5c256e424d90f15fecbb8447ed6df8336"}
May 28 17:46:01.450853 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:01.450761    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:01.469117 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:01.469068    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" podStartSLOduration=17.469052313 podStartE2EDuration="17.469052313s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:46:01.468154616 +0000 UTC m=+129.070470229" watchObservedRunningTime="2026-05-28 17:46:01.469052313 +0000 UTC m=+129.071367931"
May 28 17:46:01.760847 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:01.760756    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:46:01.761215 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:01.760951    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 17:46:01.761215 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:01.761045    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs podName:ebf68954-31e5-4ab5-88af-146f6093d424 nodeName:}" failed. No retries permitted until 2026-05-28 17:48:03.761027581 +0000 UTC m=+251.363343176 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs") pod "network-metrics-daemon-4tp8t" (UID: "ebf68954-31e5-4ab5-88af-146f6093d424") : secret "metrics-daemon-secret" not found
May 28 17:46:16.283377 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.283343    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmkr"]
May 28 17:46:16.286350 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.286335    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.289075 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.289056    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 17:46:16.289249 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.289231    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 17:46:16.290462 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.290441    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 17:46:16.290551 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.290536    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hm5hn\""
May 28 17:46:16.290601 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.290592    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 17:46:16.299524 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.299501    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmkr"]
May 28 17:46:16.308387 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.308367    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:46:16.312118 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.312088    2566 patch_prober.go:28] interesting pod/image-registry-57f746bc59-kvfkq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 17:46:16.312230 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.312149    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 17:46:16.368311 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.368286    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df01a83d-174e-4acd-9ab1-9c4e0167944e-crio-socket\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.368462 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.368317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df01a83d-174e-4acd-9ab1-9c4e0167944e-data-volume\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.368462 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.368336    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df01a83d-174e-4acd-9ab1-9c4e0167944e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.368462 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.368355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mcm\" (UniqueName: \"kubernetes.io/projected/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-api-access-84mcm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.368462 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.368418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469540    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df01a83d-174e-4acd-9ab1-9c4e0167944e-crio-socket\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469693 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469573    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df01a83d-174e-4acd-9ab1-9c4e0167944e-data-volume\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469693 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469590    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df01a83d-174e-4acd-9ab1-9c4e0167944e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469693 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469609    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84mcm\" (UniqueName: \"kubernetes.io/projected/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-api-access-84mcm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469693 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df01a83d-174e-4acd-9ab1-9c4e0167944e-crio-socket\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469850 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469726    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.469954 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.469938    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df01a83d-174e-4acd-9ab1-9c4e0167944e-data-volume\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.470209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.470181    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.472058 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.472037    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df01a83d-174e-4acd-9ab1-9c4e0167944e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.479567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.479542    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mcm\" (UniqueName: \"kubernetes.io/projected/df01a83d-174e-4acd-9ab1-9c4e0167944e-kube-api-access-84mcm\") pod \"insights-runtime-extractor-6gmkr\" (UID: \"df01a83d-174e-4acd-9ab1-9c4e0167944e\") " pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.595521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.595440    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gmkr"
May 28 17:46:16.671441 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.671415    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:16.672224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.672202    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c24a4791-2753-49c9-8ac0-830b1bcb4747-service-ca-bundle\") pod \"router-default-7b87c96c96-nxhj2\" (UID: \"c24a4791-2753-49c9-8ac0-830b1bcb4747\") " pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:16.682559 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.682534    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j92tm\""
May 28 17:46:16.691415 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.691395    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:16.714566 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.714537    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmkr"]
May 28 17:46:16.717787 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:16.717758    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf01a83d_174e_4acd_9ab1_9c4e0167944e.slice/crio-4e200d3e88fd5641f7923d9b2a3faf6268f126ebbdd62f5d879d8f524d0feacb WatchSource:0}: Error finding container 4e200d3e88fd5641f7923d9b2a3faf6268f126ebbdd62f5d879d8f524d0feacb: Status 404 returned error can't find the container with id 4e200d3e88fd5641f7923d9b2a3faf6268f126ebbdd62f5d879d8f524d0feacb
May 28 17:46:16.831496 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:16.831468    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b87c96c96-nxhj2"]
May 28 17:46:16.834081 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:16.834057    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24a4791_2753_49c9_8ac0_830b1bcb4747.slice/crio-07db50810f2816a9bdabb8566191d915ead1230a58f2ce94fa651799521975eb WatchSource:0}: Error finding container 07db50810f2816a9bdabb8566191d915ead1230a58f2ce94fa651799521975eb: Status 404 returned error can't find the container with id 07db50810f2816a9bdabb8566191d915ead1230a58f2ce94fa651799521975eb
May 28 17:46:17.481757 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.481707    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmkr" event={"ID":"df01a83d-174e-4acd-9ab1-9c4e0167944e","Type":"ContainerStarted","Data":"5817427a7589710d2f64aeed264aabee7d95ca4ff8fcb9dab58f1bbc59cad95b"}
May 28 17:46:17.482131 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.481772    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmkr" event={"ID":"df01a83d-174e-4acd-9ab1-9c4e0167944e","Type":"ContainerStarted","Data":"4e200d3e88fd5641f7923d9b2a3faf6268f126ebbdd62f5d879d8f524d0feacb"}
May 28 17:46:17.483101 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.483076    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b87c96c96-nxhj2" event={"ID":"c24a4791-2753-49c9-8ac0-830b1bcb4747","Type":"ContainerStarted","Data":"32bd1a4dcf171c3edeeb0273a21459b7935da299807961eab3112f2931a3f4d1"}
May 28 17:46:17.483217 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.483111    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b87c96c96-nxhj2" event={"ID":"c24a4791-2753-49c9-8ac0-830b1bcb4747","Type":"ContainerStarted","Data":"07db50810f2816a9bdabb8566191d915ead1230a58f2ce94fa651799521975eb"}
May 28 17:46:17.501146 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.501098    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7b87c96c96-nxhj2" podStartSLOduration=33.501080336 podStartE2EDuration="33.501080336s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:46:17.499730093 +0000 UTC m=+145.102045706" watchObservedRunningTime="2026-05-28 17:46:17.501080336 +0000 UTC m=+145.103395949"
May 28 17:46:17.692377 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.692343    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:17.694954 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:17.694931    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:18.488034 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:18.487995    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmkr" event={"ID":"df01a83d-174e-4acd-9ab1-9c4e0167944e","Type":"ContainerStarted","Data":"bc81050a3ff44ca81231a0e2942d6df7ac61e5ecba284bff00657415dad14d28"}
May 28 17:46:18.488426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:18.488165    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:18.489478 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:18.489446    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b87c96c96-nxhj2"
May 28 17:46:19.492925 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.492889    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmkr" event={"ID":"df01a83d-174e-4acd-9ab1-9c4e0167944e","Type":"ContainerStarted","Data":"0774cf1356b0624e0d367b37e91749f4bcfc08a61ef1f7753e14600921154d0c"}
May 28 17:46:19.511384 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.511339    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6gmkr" podStartSLOduration=1.4472385540000001 podStartE2EDuration="3.511324731s" podCreationTimestamp="2026-05-28 17:46:16 +0000 UTC" firstStartedPulling="2026-05-28 17:46:16.786050263 +0000 UTC m=+144.388365874" lastFinishedPulling="2026-05-28 17:46:18.850136457 +0000 UTC m=+146.452452051" observedRunningTime="2026-05-28 17:46:19.509774254 +0000 UTC m=+147.112089868" watchObservedRunningTime="2026-05-28 17:46:19.511324731 +0000 UTC m=+147.113640344"
May 28 17:46:19.764660 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.764584    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"]
May 28 17:46:19.766360 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.766344    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:19.768735 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.768708    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 17:46:19.768833 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.768718    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xnmf4\""
May 28 17:46:19.776819 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.776796    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"]
May 28 17:46:19.797404 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.797377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n\" (UID: \"d26ecf18-7b02-4929-aebd-259036515317\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:19.898656 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:19.898628    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n\" (UID: \"d26ecf18-7b02-4929-aebd-259036515317\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:19.898821 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:19.898730    2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 28 17:46:19.898821 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:19.898784    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates podName:d26ecf18-7b02-4929-aebd-259036515317 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:20.398770705 +0000 UTC m=+148.001086295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n" (UID: "d26ecf18-7b02-4929-aebd-259036515317") : secret "prometheus-operator-admission-webhook-tls" not found
May 28 17:46:20.402368 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:20.402330    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n\" (UID: \"d26ecf18-7b02-4929-aebd-259036515317\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:20.404938 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:20.404900    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d26ecf18-7b02-4929-aebd-259036515317-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n\" (UID: \"d26ecf18-7b02-4929-aebd-259036515317\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:20.675223 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:20.675131    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:20.797237 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:20.797205    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"]
May 28 17:46:20.801213 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:20.801180    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26ecf18_7b02_4929_aebd_259036515317.slice/crio-340034bfdbe3db4ca12b38cf9bfe21c2a89441f70a256bb9556b6871a927ec31 WatchSource:0}: Error finding container 340034bfdbe3db4ca12b38cf9bfe21c2a89441f70a256bb9556b6871a927ec31: Status 404 returned error can't find the container with id 340034bfdbe3db4ca12b38cf9bfe21c2a89441f70a256bb9556b6871a927ec31
May 28 17:46:21.499684 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:21.499644    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n" event={"ID":"d26ecf18-7b02-4929-aebd-259036515317","Type":"ContainerStarted","Data":"340034bfdbe3db4ca12b38cf9bfe21c2a89441f70a256bb9556b6871a927ec31"}
May 28 17:46:22.502952 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.502912    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n" event={"ID":"d26ecf18-7b02-4929-aebd-259036515317","Type":"ContainerStarted","Data":"b91432558a487261ec6d4113b489dab8834919232e60f9acc5032ee8ef9b198c"}
May 28 17:46:22.503407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.503119    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:22.507978 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.507961    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n"
May 28 17:46:22.517147 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.517101    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n" podStartSLOduration=2.469431286 podStartE2EDuration="3.517089688s" podCreationTimestamp="2026-05-28 17:46:19 +0000 UTC" firstStartedPulling="2026-05-28 17:46:20.803569502 +0000 UTC m=+148.405885108" lastFinishedPulling="2026-05-28 17:46:21.851227908 +0000 UTC m=+149.453543510" observedRunningTime="2026-05-28 17:46:22.516996472 +0000 UTC m=+150.119312085" watchObservedRunningTime="2026-05-28 17:46:22.517089688 +0000 UTC m=+150.119405300"
May 28 17:46:22.828206 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.828125    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"]
May 28 17:46:22.830093 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.830078    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:22.832654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.832632    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 17:46:22.832778 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.832637    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 17:46:22.833737 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.833713    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 17:46:22.833826 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.833754    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 17:46:22.833826 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.833717    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 17:46:22.833826 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.833716    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zh9fw\""
May 28 17:46:22.838238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.838214    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"]
May 28 17:46:22.920468 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.920423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fbace-fc76-4b67-9518-f2857b0052cc-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:22.920641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.920494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzxj\" (UniqueName: \"kubernetes.io/projected/e18fbace-fc76-4b67-9518-f2857b0052cc-kube-api-access-vnzxj\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:22.920641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.920530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:22.920641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:22.920556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.021398 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.021368    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzxj\" (UniqueName: \"kubernetes.io/projected/e18fbace-fc76-4b67-9518-f2857b0052cc-kube-api-access-vnzxj\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.021584 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.021412    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.021584 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.021433    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.021584 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:23.021523    2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 28 17:46:23.021584 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:23.021585    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls podName:e18fbace-fc76-4b67-9518-f2857b0052cc nodeName:}" failed. No retries permitted until 2026-05-28 17:46:23.52156951 +0000 UTC m=+151.123885105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-snmpv" (UID: "e18fbace-fc76-4b67-9518-f2857b0052cc") : secret "prometheus-operator-tls" not found
May 28 17:46:23.021764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.021608    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fbace-fc76-4b67-9518-f2857b0052cc-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.022208 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.022145    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fbace-fc76-4b67-9518-f2857b0052cc-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.024029 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.024004    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.030171 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.030147    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzxj\" (UniqueName: \"kubernetes.io/projected/e18fbace-fc76-4b67-9518-f2857b0052cc-kube-api-access-vnzxj\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.525205 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.525162    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.527746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.527717    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18fbace-fc76-4b67-9518-f2857b0052cc-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-snmpv\" (UID: \"e18fbace-fc76-4b67-9518-f2857b0052cc\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.739868 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.739823    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"
May 28 17:46:23.863131 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:23.863102    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-snmpv"]
May 28 17:46:23.866268 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:23.866241    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18fbace_fc76_4b67_9518_f2857b0052cc.slice/crio-f64b35091f4fe33b8331b66ccf14196c4aaf565193c8bd94792404573fd31999 WatchSource:0}: Error finding container f64b35091f4fe33b8331b66ccf14196c4aaf565193c8bd94792404573fd31999: Status 404 returned error can't find the container with id f64b35091f4fe33b8331b66ccf14196c4aaf565193c8bd94792404573fd31999
May 28 17:46:24.509365 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:24.509322    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv" event={"ID":"e18fbace-fc76-4b67-9518-f2857b0052cc","Type":"ContainerStarted","Data":"f64b35091f4fe33b8331b66ccf14196c4aaf565193c8bd94792404573fd31999"}
May 28 17:46:25.513839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:25.513806    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv" event={"ID":"e18fbace-fc76-4b67-9518-f2857b0052cc","Type":"ContainerStarted","Data":"fa648a3778d133f95fdc065d5e67a174b55519372feb9f4d3a385e7f793439bc"}
May 28 17:46:25.513839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:25.513841    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv" event={"ID":"e18fbace-fc76-4b67-9518-f2857b0052cc","Type":"ContainerStarted","Data":"6e4e8ab58d01eb464fc70b871d0d666e4f9cd1b91cf066597c7faaf207b78354"}
May 28 17:46:25.530117 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:25.530069    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-snmpv" podStartSLOduration=2.267327183 podStartE2EDuration="3.530054443s" podCreationTimestamp="2026-05-28 17:46:22 +0000 UTC" firstStartedPulling="2026-05-28 17:46:23.868246305 +0000 UTC m=+151.470561896" lastFinishedPulling="2026-05-28 17:46:25.130973554 +0000 UTC m=+152.733289156" observedRunningTime="2026-05-28 17:46:25.528660144 +0000 UTC m=+153.130975756" watchObservedRunningTime="2026-05-28 17:46:25.530054443 +0000 UTC m=+153.132370056"
May 28 17:46:26.312933 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:26.312904    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:27.153569 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.153535    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"]
May 28 17:46:27.155688 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.155668    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.159509 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.158592    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tcmkg\""
May 28 17:46:27.159509 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.158630    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 17:46:27.159509 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.158933    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 17:46:27.174866 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.174840    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"]
May 28 17:46:27.176061 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.176038    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"]
May 28 17:46:27.179126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.179098    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.181844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.181824    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p5z2c\""
May 28 17:46:27.182720 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.182686    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 17:46:27.183327 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.183311    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 17:46:27.185366 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.185351    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 17:46:27.188417 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.188400    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kzsdm"]
May 28 17:46:27.192329 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.192311    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.193685 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.193668    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"]
May 28 17:46:27.196244 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.196221    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 17:46:27.196942 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.196922    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sn8gc\""
May 28 17:46:27.197477 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.197222    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 17:46:27.197730 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.197291    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 17:46:27.253542 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.253542 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-sys\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-root\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvc2v\" (UniqueName: \"kubernetes.io/projected/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-api-access-bvc2v\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qfx\" (UniqueName: \"kubernetes.io/projected/e8154bd0-91c9-4bb0-86d7-675da7518820-kube-api-access-x7qfx\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253704    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8154bd0-91c9-4bb0-86d7-675da7518820-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.253749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-metrics-client-ca\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-wtmp\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b5e782ec-6452-4f9c-9124-3819a4879e2d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.253971 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.254227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.253995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.254227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.254051    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-textfile\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.254227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.254071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7m6x\" (UniqueName: \"kubernetes.io/projected/92bb8198-422c-4842-9b16-407bc445a3da-kube-api-access-m7m6x\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355364    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-sys\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355399 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355396    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-root\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355418    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvc2v\" (UniqueName: \"kubernetes.io/projected/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-api-access-bvc2v\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355452    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qfx\" (UniqueName: \"kubernetes.io/projected/e8154bd0-91c9-4bb0-86d7-675da7518820-kube-api-access-x7qfx\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355471    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-sys\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355491    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-root\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355497    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8154bd0-91c9-4bb0-86d7-675da7518820-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.355591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355550    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-metrics-client-ca\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:27.355603    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355603    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:27.355681    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls podName:92bb8198-422c-4842-9b16-407bc445a3da nodeName:}" failed. No retries permitted until 2026-05-28 17:46:27.855659923 +0000 UTC m=+155.457975514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls") pod "node-exporter-kzsdm" (UID: "92bb8198-422c-4842-9b16-407bc445a3da") : secret "node-exporter-tls" not found
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355758    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355803    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-wtmp\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355834    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355864    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.355929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355930    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b5e782ec-6452-4f9c-9124-3819a4879e2d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:27.355951    2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355970    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.355991    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-wtmp\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:27.356017    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls podName:b5e782ec-6452-4f9c-9124-3819a4879e2d nodeName:}" failed. No retries permitted until 2026-05-28 17:46:27.855998298 +0000 UTC m=+155.458313905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-gf584" (UID: "b5e782ec-6452-4f9c-9124-3819a4879e2d") : secret "kube-state-metrics-tls" not found
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356042    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356083    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356123    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-textfile\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356155    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7m6x\" (UniqueName: \"kubernetes.io/projected/92bb8198-422c-4842-9b16-407bc445a3da-kube-api-access-m7m6x\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356200    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356281    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8154bd0-91c9-4bb0-86d7-675da7518820-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.356806 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356330    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-metrics-client-ca\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356806 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356623    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356806 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356640    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b5e782ec-6452-4f9c-9124-3819a4879e2d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356985 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356898    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.356985 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356908    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-textfile\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.356985 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.356910    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e782ec-6452-4f9c-9124-3819a4879e2d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.358227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.358207    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.358849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.358819    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.358985 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.358964    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8154bd0-91c9-4bb0-86d7-675da7518820-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.359212 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.359190    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.364443 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.364421    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7m6x\" (UniqueName: \"kubernetes.io/projected/92bb8198-422c-4842-9b16-407bc445a3da-kube-api-access-m7m6x\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.364571 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.364555    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvc2v\" (UniqueName: \"kubernetes.io/projected/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-api-access-bvc2v\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.364649 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.364632    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qfx\" (UniqueName: \"kubernetes.io/projected/e8154bd0-91c9-4bb0-86d7-675da7518820-kube-api-access-x7qfx\") pod \"openshift-state-metrics-9c959559f-lzrld\" (UID: \"e8154bd0-91c9-4bb0-86d7-675da7518820\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.466704 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.466660    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"
May 28 17:46:27.595321 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.595274    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lzrld"]
May 28 17:46:27.597640 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:27.597613    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8154bd0_91c9_4bb0_86d7_675da7518820.slice/crio-6e07f6bd4369da5d47d485e9ebda70756e5f7d3f24a14296b6c0f836fda2ddc4 WatchSource:0}: Error finding container 6e07f6bd4369da5d47d485e9ebda70756e5f7d3f24a14296b6c0f836fda2ddc4: Status 404 returned error can't find the container with id 6e07f6bd4369da5d47d485e9ebda70756e5f7d3f24a14296b6c0f836fda2ddc4
May 28 17:46:27.859376 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.859272    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:27.859376 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.859379    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.861756 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.861727    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92bb8198-422c-4842-9b16-407bc445a3da-node-exporter-tls\") pod \"node-exporter-kzsdm\" (UID: \"92bb8198-422c-4842-9b16-407bc445a3da\") " pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:27.861869 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:27.861851    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e782ec-6452-4f9c-9124-3819a4879e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-gf584\" (UID: \"b5e782ec-6452-4f9c-9124-3819a4879e2d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:28.113525 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.113159    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"
May 28 17:46:28.118001 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.117975    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kzsdm"
May 28 17:46:28.127542 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:28.127517    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bb8198_422c_4842_9b16_407bc445a3da.slice/crio-b948b4a110dfe41a6127f567a1907d0eb283ac7bf9e0e59238a76abd58be3803 WatchSource:0}: Error finding container b948b4a110dfe41a6127f567a1907d0eb283ac7bf9e0e59238a76abd58be3803: Status 404 returned error can't find the container with id b948b4a110dfe41a6127f567a1907d0eb283ac7bf9e0e59238a76abd58be3803
May 28 17:46:28.234566 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.234524    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:46:28.237668 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.237644    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.240023 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240001    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240237    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240270    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240270    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240351    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240358    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240363    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9hw7f\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240274    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:46:28.240521 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240247    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:46:28.241172 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.240800    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:46:28.242831 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.242810    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584"]
May 28 17:46:28.247050 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:28.247025    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e782ec_6452_4f9c_9124_3819a4879e2d.slice/crio-784bb308b10d97e4829a69e0e8e66d0b07aedc38bbffeee4f4346194070d6a4e WatchSource:0}: Error finding container 784bb308b10d97e4829a69e0e8e66d0b07aedc38bbffeee4f4346194070d6a4e: Status 404 returned error can't find the container with id 784bb308b10d97e4829a69e0e8e66d0b07aedc38bbffeee4f4346194070d6a4e
May 28 17:46:28.250642 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.250622    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:46:28.263772 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263751    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.263891 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l7d8\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.263891 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263827    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263864    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.263999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.264056    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.264076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.264101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.264182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.264262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.264225    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365674 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365591    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365674 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365643    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365699    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365728    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365757    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365784    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365815    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365840    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.365900 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.365894    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366086    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366120    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366180    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366209    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5l7d8\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366556 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366526    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.366687 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:28.366657    2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 28 17:46:28.366799 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:28.366716    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls podName:9ff2eddf-624e-4e74-844f-f0165d98077b nodeName:}" failed. No retries permitted until 2026-05-28 17:46:28.866698373 +0000 UTC m=+156.469013967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b") : secret "alertmanager-main-tls" not found
May 28 17:46:28.367464 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.366959    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.369541 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:28.369284    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle podName:9ff2eddf-624e-4e74-844f-f0165d98077b nodeName:}" failed. No retries permitted until 2026-05-28 17:46:28.869267443 +0000 UTC m=+156.471583045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b") : configmap references non-existent config key: ca-bundle.crt
May 28 17:46:28.369541 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.369376    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.369541 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.369477    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.369776 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.369754    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.370705 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.370664    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.371608 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.371586    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.371891 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.371848    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.372244 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.372225    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.372379 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.372361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.375302 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.375277    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l7d8\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.523320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.523284    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld" event={"ID":"e8154bd0-91c9-4bb0-86d7-675da7518820","Type":"ContainerStarted","Data":"158f04aed1a09e7a77a06cb7e7151fa290f5d68a8a46939ff3d1b233e2588b17"}
May 28 17:46:28.523320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.523323    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld" event={"ID":"e8154bd0-91c9-4bb0-86d7-675da7518820","Type":"ContainerStarted","Data":"27be2b22c84fe3bec079338a7adf0ef46570a94887364ffd28e8811fa0fad0ee"}
May 28 17:46:28.523528 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.523334    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld" event={"ID":"e8154bd0-91c9-4bb0-86d7-675da7518820","Type":"ContainerStarted","Data":"6e07f6bd4369da5d47d485e9ebda70756e5f7d3f24a14296b6c0f836fda2ddc4"}
May 28 17:46:28.524234 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.524209    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzsdm" event={"ID":"92bb8198-422c-4842-9b16-407bc445a3da","Type":"ContainerStarted","Data":"b948b4a110dfe41a6127f567a1907d0eb283ac7bf9e0e59238a76abd58be3803"}
May 28 17:46:28.525106 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.525087    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584" event={"ID":"b5e782ec-6452-4f9c-9124-3819a4879e2d","Type":"ContainerStarted","Data":"784bb308b10d97e4829a69e0e8e66d0b07aedc38bbffeee4f4346194070d6a4e"}
May 28 17:46:28.871721 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.871687    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.871869 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.871742    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.872474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.872387    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:28.874127 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:28.874103    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:29.148740 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.148712    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:46:29.249851 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.249793    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-846bbcd679-8bjwv"]
May 28 17:46:29.259654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.259497    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.263057 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.262359    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 17:46:29.263461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.263298    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 17:46:29.263461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.263298    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8zsrc\""
May 28 17:46:29.263461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.263367    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 17:46:29.263461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.263411    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8bb16a9haa8nu\""
May 28 17:46:29.263942 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.263902    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 17:46:29.264049 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.264030    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 17:46:29.270371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.270329    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846bbcd679-8bjwv"]
May 28 17:46:29.297893 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:29.297833    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jjbxb" podUID="78ab029c-9e9f-4a47-8ffa-f80b058c08ab"
May 28 17:46:29.304023 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:29.303955    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-5dzs6" podUID="d265c80d-d2b6-4855-b5cf-84a70c447d26"
May 28 17:46:29.314824 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.314793    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:46:29.318691 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:29.318666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff2eddf_624e_4e74_844f_f0165d98077b.slice/crio-d631913a3377797a686b6c0b16d576d3f98fa19353c6a7d1a4a766630550dc8b WatchSource:0}: Error finding container d631913a3377797a686b6c0b16d576d3f98fa19353c6a7d1a4a766630550dc8b: Status 404 returned error can't find the container with id d631913a3377797a686b6c0b16d576d3f98fa19353c6a7d1a4a766630550dc8b
May 28 17:46:29.375829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.375752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.375829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.375794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbnq\" (UniqueName: \"kubernetes.io/projected/9c276c1d-1df2-454c-a78b-ada890f0f10d-kube-api-access-xvbnq\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.375866    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.375952    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.375982    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.376009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c276c1d-1df2-454c-a78b-ada890f0f10d-metrics-client-ca\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376163 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.376058    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-grpc-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.376163 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.376097    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477011 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.476963    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477196 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477051    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477256 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477219    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbnq\" (UniqueName: \"kubernetes.io/projected/9c276c1d-1df2-454c-a78b-ada890f0f10d-kube-api-access-xvbnq\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477309 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477298    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477336    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477357    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477463 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477385    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c276c1d-1df2-454c-a78b-ada890f0f10d-metrics-client-ca\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.477463 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.477430    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-grpc-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.478525 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.478470    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c276c1d-1df2-454c-a78b-ada890f0f10d-metrics-client-ca\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.480403 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.480358    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.480403 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.480373    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.480780 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.480754    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.480854 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.480796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.481067 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.481041    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.481183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.481167    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c276c1d-1df2-454c-a78b-ada890f0f10d-secret-grpc-tls\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.485575 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.485544    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbnq\" (UniqueName: \"kubernetes.io/projected/9c276c1d-1df2-454c-a78b-ada890f0f10d-kube-api-access-xvbnq\") pod \"thanos-querier-846bbcd679-8bjwv\" (UID: \"9c276c1d-1df2-454c-a78b-ada890f0f10d\") " pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.530309 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.530276    2566 generic.go:358] "Generic (PLEG): container finished" podID="92bb8198-422c-4842-9b16-407bc445a3da" containerID="2039eb34322c93c40f9a42ba8ff440ec5e84f7e1b248f3109b30140eb0498744" exitCode=0
May 28 17:46:29.530485 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.530353    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzsdm" event={"ID":"92bb8198-422c-4842-9b16-407bc445a3da","Type":"ContainerDied","Data":"2039eb34322c93c40f9a42ba8ff440ec5e84f7e1b248f3109b30140eb0498744"}
May 28 17:46:29.532827 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.532795    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld" event={"ID":"e8154bd0-91c9-4bb0-86d7-675da7518820","Type":"ContainerStarted","Data":"1770575b1ffbf73c357af9e580a6bf8c57aa84ab273501e20477f98f0d9d8f3a"}
May 28 17:46:29.533938 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.533910    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"d631913a3377797a686b6c0b16d576d3f98fa19353c6a7d1a4a766630550dc8b"}
May 28 17:46:29.533938 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.533938    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:46:29.534117 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.533942    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:29.562811 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.562749    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lzrld" podStartSLOduration=1.5102528689999999 podStartE2EDuration="2.562734358s" podCreationTimestamp="2026-05-28 17:46:27 +0000 UTC" firstStartedPulling="2026-05-28 17:46:27.702220631 +0000 UTC m=+155.304536225" lastFinishedPulling="2026-05-28 17:46:28.754702116 +0000 UTC m=+156.357017714" observedRunningTime="2026-05-28 17:46:29.561939827 +0000 UTC m=+157.164255441" watchObservedRunningTime="2026-05-28 17:46:29.562734358 +0000 UTC m=+157.165049975"
May 28 17:46:29.576120 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.576087    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:29.969049 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:29.967479    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846bbcd679-8bjwv"]
May 28 17:46:29.977083 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:29.976999    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c276c1d_1df2_454c_a78b_ada890f0f10d.slice/crio-01ec5fdecf8640b914768457563b0af634272499bccc93bcccdabd444183f940 WatchSource:0}: Error finding container 01ec5fdecf8640b914768457563b0af634272499bccc93bcccdabd444183f940: Status 404 returned error can't find the container with id 01ec5fdecf8640b914768457563b0af634272499bccc93bcccdabd444183f940
May 28 17:46:30.539890 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.539846    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzsdm" event={"ID":"92bb8198-422c-4842-9b16-407bc445a3da","Type":"ContainerStarted","Data":"17575c7a963acbff6f058032043fb1aadaa0ad8c9789e0915a5d1a48c7dc27fe"}
May 28 17:46:30.540381 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.539915    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kzsdm" event={"ID":"92bb8198-422c-4842-9b16-407bc445a3da","Type":"ContainerStarted","Data":"eee531984319f4aba859ee2fa275a8e5e9b1371415ecdbee9ac7047f49e7553b"}
May 28 17:46:30.542069 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.542040    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584" event={"ID":"b5e782ec-6452-4f9c-9124-3819a4879e2d","Type":"ContainerStarted","Data":"af4240e3d51ace89af4fa72997062b03e8bdb959d631896426e364828cc181b8"}
May 28 17:46:30.542186 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.542076    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584" event={"ID":"b5e782ec-6452-4f9c-9124-3819a4879e2d","Type":"ContainerStarted","Data":"8fbcab1d0505c93c4f5af7f7fa98c9ecd47e87024ccdcdf56ccf94d20ec97add"}
May 28 17:46:30.542186 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.542091    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584" event={"ID":"b5e782ec-6452-4f9c-9124-3819a4879e2d","Type":"ContainerStarted","Data":"8e62ae52c38daa35bf0f4963441d6522d512a5518a39c4ef460486c7d263e482"}
May 28 17:46:30.543198 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.543163    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"01ec5fdecf8640b914768457563b0af634272499bccc93bcccdabd444183f940"}
May 28 17:46:30.559499 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.559448    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kzsdm" podStartSLOduration=2.574586721 podStartE2EDuration="3.559433586s" podCreationTimestamp="2026-05-28 17:46:27 +0000 UTC" firstStartedPulling="2026-05-28 17:46:28.129827604 +0000 UTC m=+155.732143196" lastFinishedPulling="2026-05-28 17:46:29.114674459 +0000 UTC m=+156.716990061" observedRunningTime="2026-05-28 17:46:30.557319317 +0000 UTC m=+158.159634931" watchObservedRunningTime="2026-05-28 17:46:30.559433586 +0000 UTC m=+158.161749199"
May 28 17:46:30.574648 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:30.574596    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-gf584" podStartSLOduration=1.988553072 podStartE2EDuration="3.574579849s" podCreationTimestamp="2026-05-28 17:46:27 +0000 UTC" firstStartedPulling="2026-05-28 17:46:28.249127048 +0000 UTC m=+155.851442640" lastFinishedPulling="2026-05-28 17:46:29.835153826 +0000 UTC m=+157.437469417" observedRunningTime="2026-05-28 17:46:30.57348682 +0000 UTC m=+158.175802434" watchObservedRunningTime="2026-05-28 17:46:30.574579849 +0000 UTC m=+158.176895462"
May 28 17:46:31.045978 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:31.045940    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4tp8t" podUID="ebf68954-31e5-4ab5-88af-146f6093d424"
May 28 17:46:31.547203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.547172    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083" exitCode=0
May 28 17:46:31.547552 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.547266    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"}
May 28 17:46:31.942612 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.942580    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"]
May 28 17:46:31.945224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.945189    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:31.948440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.948415    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 17:46:31.948596 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.948524    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-r7bp5\""
May 28 17:46:31.962818 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:31.962788    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"]
May 28 17:46:32.004501 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.004469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451f18da-7913-42c4-ab02-e0b91085ea44-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2q8jh\" (UID: \"451f18da-7913-42c4-ab02-e0b91085ea44\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:32.105346 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.105316    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451f18da-7913-42c4-ab02-e0b91085ea44-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2q8jh\" (UID: \"451f18da-7913-42c4-ab02-e0b91085ea44\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:32.108334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.108307    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451f18da-7913-42c4-ab02-e0b91085ea44-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2q8jh\" (UID: \"451f18da-7913-42c4-ab02-e0b91085ea44\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:32.256916 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.256808    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:32.448019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.447993    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"]
May 28 17:46:32.452681 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:32.452657    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451f18da_7913_42c4_ab02_e0b91085ea44.slice/crio-049fa4af6e6225920af7a58f5cfb5ba9b0912563bb549111d5439d5699c015b8 WatchSource:0}: Error finding container 049fa4af6e6225920af7a58f5cfb5ba9b0912563bb549111d5439d5699c015b8: Status 404 returned error can't find the container with id 049fa4af6e6225920af7a58f5cfb5ba9b0912563bb549111d5439d5699c015b8
May 28 17:46:32.553935 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.553839    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"5f144cfd1c3b297100918125a5071ae537ebf77de254f70eb2f3bd85cbfff5da"}
May 28 17:46:32.553935 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.553909    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"819cc2ad7d0111ce69bec5cd0f6dc16605407b74b29ad0d930aaf9649f8dd6f4"}
May 28 17:46:32.554854 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:32.554829    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh" event={"ID":"451f18da-7913-42c4-ab02-e0b91085ea44","Type":"ContainerStarted","Data":"049fa4af6e6225920af7a58f5cfb5ba9b0912563bb549111d5439d5699c015b8"}
May 28 17:46:33.560520 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:33.560480    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"4c02cf86d563f8e894dca82353ff65b11027478e75a7b19ec975074278dae41d"}
May 28 17:46:34.224347 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.224310    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:46:34.224443 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.224366    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:34.227059 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.227024    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78ab029c-9e9f-4a47-8ffa-f80b058c08ab-metrics-tls\") pod \"dns-default-jjbxb\" (UID: \"78ab029c-9e9f-4a47-8ffa-f80b058c08ab\") " pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:34.227228 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.227210    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c80d-d2b6-4855-b5cf-84a70c447d26-cert\") pod \"ingress-canary-5dzs6\" (UID: \"d265c80d-d2b6-4855-b5cf-84a70c447d26\") " pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:46:34.336469 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.336446    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v9cdg\""
May 28 17:46:34.337643 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.337620    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dtch\""
May 28 17:46:34.344474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.344454    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:34.344560 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.344459    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5dzs6"
May 28 17:46:34.509525 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.509441    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5dzs6"]
May 28 17:46:34.513131 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:34.513100    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd265c80d_d2b6_4855_b5cf_84a70c447d26.slice/crio-54aa07a0e29db0407aee6bc36aabb55cc0beebf7e7b2769506b34614eafeb3a2 WatchSource:0}: Error finding container 54aa07a0e29db0407aee6bc36aabb55cc0beebf7e7b2769506b34614eafeb3a2: Status 404 returned error can't find the container with id 54aa07a0e29db0407aee6bc36aabb55cc0beebf7e7b2769506b34614eafeb3a2
May 28 17:46:34.533739 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.533699    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jjbxb"]
May 28 17:46:34.538967 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:34.538920    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ab029c_9e9f_4a47_8ffa_f80b058c08ab.slice/crio-3e0d0881432875733a4eca880ef030bed0c63c724bcdadb213de97354f582bc8 WatchSource:0}: Error finding container 3e0d0881432875733a4eca880ef030bed0c63c724bcdadb213de97354f582bc8: Status 404 returned error can't find the container with id 3e0d0881432875733a4eca880ef030bed0c63c724bcdadb213de97354f582bc8
May 28 17:46:34.565829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.565803    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh" event={"ID":"451f18da-7913-42c4-ab02-e0b91085ea44","Type":"ContainerStarted","Data":"32d6c1db801cb7b97e5b404a77ae72f1e9a0721fcd0e74dec32d519e068cad54"}
May 28 17:46:34.566190 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.566167    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:34.569746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.569684    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"}
May 28 17:46:34.569746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.569712    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"}
May 28 17:46:34.569746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.569722    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"}
May 28 17:46:34.570048 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.569730    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"}
May 28 17:46:34.571543 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.571524    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh"
May 28 17:46:34.573953 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.573922    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"3ee0d0f186f034d6bc9588462559b082453d57f23e7daecc807a2f0733e38bcf"}
May 28 17:46:34.574057 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.573958    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"4e7949363573c21c15b0931dcbe040ddf7f186b2a356f63ba2e1507917ca676d"}
May 28 17:46:34.574057 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.573999    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" event={"ID":"9c276c1d-1df2-454c-a78b-ada890f0f10d","Type":"ContainerStarted","Data":"0cecd2288887641305f10bb9eb2cbcc085e8eaf2f870f825cc4c37e4163a6457"}
May 28 17:46:34.574162 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.574102    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:34.574723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.574705    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5dzs6" event={"ID":"d265c80d-d2b6-4855-b5cf-84a70c447d26","Type":"ContainerStarted","Data":"54aa07a0e29db0407aee6bc36aabb55cc0beebf7e7b2769506b34614eafeb3a2"}
May 28 17:46:34.575431 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.575409    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjbxb" event={"ID":"78ab029c-9e9f-4a47-8ffa-f80b058c08ab","Type":"ContainerStarted","Data":"3e0d0881432875733a4eca880ef030bed0c63c724bcdadb213de97354f582bc8"}
May 28 17:46:34.581064 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.581026    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2q8jh" podStartSLOduration=1.8049216700000001 podStartE2EDuration="3.581014496s" podCreationTimestamp="2026-05-28 17:46:31 +0000 UTC" firstStartedPulling="2026-05-28 17:46:32.455012602 +0000 UTC m=+160.057328198" lastFinishedPulling="2026-05-28 17:46:34.23110543 +0000 UTC m=+161.833421024" observedRunningTime="2026-05-28 17:46:34.579578783 +0000 UTC m=+162.181894393" watchObservedRunningTime="2026-05-28 17:46:34.581014496 +0000 UTC m=+162.183330091"
May 28 17:46:34.599741 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:34.599697    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv" podStartSLOduration=1.35466384 podStartE2EDuration="5.599683779s" podCreationTimestamp="2026-05-28 17:46:29 +0000 UTC" firstStartedPulling="2026-05-28 17:46:29.982906142 +0000 UTC m=+157.585221746" lastFinishedPulling="2026-05-28 17:46:34.227926077 +0000 UTC m=+161.830241685" observedRunningTime="2026-05-28 17:46:34.59839431 +0000 UTC m=+162.200709923" watchObservedRunningTime="2026-05-28 17:46:34.599683779 +0000 UTC m=+162.201999392"
May 28 17:46:35.583203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:35.583077    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"}
May 28 17:46:35.583203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:35.583124    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerStarted","Data":"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"}
May 28 17:46:35.610322 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:35.610260    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7037491019999997 podStartE2EDuration="7.610242108s" podCreationTimestamp="2026-05-28 17:46:28 +0000 UTC" firstStartedPulling="2026-05-28 17:46:29.321214687 +0000 UTC m=+156.923530278" lastFinishedPulling="2026-05-28 17:46:34.227707679 +0000 UTC m=+161.830023284" observedRunningTime="2026-05-28 17:46:35.608987319 +0000 UTC m=+163.211302933" watchObservedRunningTime="2026-05-28 17:46:35.610242108 +0000 UTC m=+163.212557739"
May 28 17:46:37.591743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.591707    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5dzs6" event={"ID":"d265c80d-d2b6-4855-b5cf-84a70c447d26","Type":"ContainerStarted","Data":"d7b0aed3d4d929a048d9dbc999de07677fd317102edc64da8ebc3638dd37f2da"}
May 28 17:46:37.593296 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.593274    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjbxb" event={"ID":"78ab029c-9e9f-4a47-8ffa-f80b058c08ab","Type":"ContainerStarted","Data":"5f96d4caeb387c06fcff2387ab74c71af9724da2606c9e9b9666196bb876ba49"}
May 28 17:46:37.593404 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.593300    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjbxb" event={"ID":"78ab029c-9e9f-4a47-8ffa-f80b058c08ab","Type":"ContainerStarted","Data":"faed7c00a02e1d40372edf781f6c40ea70cd35560a6d3044859d89fa324336a0"}
May 28 17:46:37.593445 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.593415    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:37.617649 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.617600    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5dzs6" podStartSLOduration=129.593732546 podStartE2EDuration="2m11.617586394s" podCreationTimestamp="2026-05-28 17:44:26 +0000 UTC" firstStartedPulling="2026-05-28 17:46:34.514978067 +0000 UTC m=+162.117293658" lastFinishedPulling="2026-05-28 17:46:36.538831912 +0000 UTC m=+164.141147506" observedRunningTime="2026-05-28 17:46:37.616169479 +0000 UTC m=+165.218485094" watchObservedRunningTime="2026-05-28 17:46:37.617586394 +0000 UTC m=+165.219902006"
May 28 17:46:37.632290 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:37.632240    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jjbxb" podStartSLOduration=129.634512028 podStartE2EDuration="2m11.632223258s" podCreationTimestamp="2026-05-28 17:44:26 +0000 UTC" firstStartedPulling="2026-05-28 17:46:34.541004271 +0000 UTC m=+162.143319866" lastFinishedPulling="2026-05-28 17:46:36.538715505 +0000 UTC m=+164.141031096" observedRunningTime="2026-05-28 17:46:37.630936728 +0000 UTC m=+165.233252344" watchObservedRunningTime="2026-05-28 17:46:37.632223258 +0000 UTC m=+165.234538872"
May 28 17:46:40.589576 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:40.589501    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-846bbcd679-8bjwv"
May 28 17:46:41.327492 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.327421    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerName="registry" containerID="cri-o://ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c" gracePeriod=30
May 28 17:46:41.578035 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.577954    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:41.616194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.616161    2566 generic.go:358] "Generic (PLEG): container finished" podID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerID="ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c" exitCode=0
May 28 17:46:41.616194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.616204    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" event={"ID":"e01af382-4d8e-4445-9e0a-ff554ca770da","Type":"ContainerDied","Data":"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"}
May 28 17:46:41.616717 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.616237    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq" event={"ID":"e01af382-4d8e-4445-9e0a-ff554ca770da","Type":"ContainerDied","Data":"f13934154bac6f2a482008210e7918c5c256e424d90f15fecbb8447ed6df8336"}
May 28 17:46:41.616717 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.616240    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f746bc59-kvfkq"
May 28 17:46:41.616717 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.616255    2566 scope.go:117] "RemoveContainer" containerID="ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"
May 28 17:46:41.625168 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.625150    2566 scope.go:117] "RemoveContainer" containerID="ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"
May 28 17:46:41.625436 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:46:41.625418    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c\": container with ID starting with ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c not found: ID does not exist" containerID="ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"
May 28 17:46:41.625478 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.625444    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c"} err="failed to get container status \"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c\": rpc error: code = NotFound desc = could not find container \"ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c\": container with ID starting with ee2b975472f2462ab4e211b2ae82af7d7c10e1657246930d0080ff5b220f224c not found: ID does not exist"
May 28 17:46:41.693030 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.692993    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693042    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw2xb\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693118    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693150    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693183    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693212    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693260    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693287    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted\") pod \"e01af382-4d8e-4445-9e0a-ff554ca770da\" (UID: \"e01af382-4d8e-4445-9e0a-ff554ca770da\") "
May 28 17:46:41.693625 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693594    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:46:41.693831 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.693789    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:46:41.698088 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.698058    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb" (OuterVolumeSpecName: "kube-api-access-vw2xb") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "kube-api-access-vw2xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:46:41.698088 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.698084    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:46:41.698256 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.698217    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:46:41.698563 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.698522    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:46:41.698563 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.698542    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:46:41.704952 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.704926    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e01af382-4d8e-4445-9e0a-ff554ca770da" (UID: "e01af382-4d8e-4445-9e0a-ff554ca770da"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:46:41.744397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.744358    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-vrkft"]
May 28 17:46:41.744723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.744709    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerName="registry"
May 28 17:46:41.744802 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.744727    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerName="registry"
May 28 17:46:41.744836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.744800    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" containerName="registry"
May 28 17:46:41.749798 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.749774    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:41.752246 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.752222    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 17:46:41.752359 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.752271    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 17:46:41.752359 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.752293    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rswsk\""
May 28 17:46:41.755109 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.755090    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vrkft"]
May 28 17:46:41.794134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794100    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-certificates\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794127    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e01af382-4d8e-4445-9e0a-ff554ca770da-ca-trust-extracted\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794134 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794137    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-image-registry-private-configuration\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794147    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw2xb\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-kube-api-access-vw2xb\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794157    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-registry-tls\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794168    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e01af382-4d8e-4445-9e0a-ff554ca770da-trusted-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794176    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e01af382-4d8e-4445-9e0a-ff554ca770da-installation-pull-secrets\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.794336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.794185    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e01af382-4d8e-4445-9e0a-ff554ca770da-bound-sa-token\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:46:41.895560 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.895477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs2tr\" (UniqueName: \"kubernetes.io/projected/04cb27f4-9c13-4e16-bfb0-413dfb7e6e52-kube-api-access-cs2tr\") pod \"downloads-57bd96b888-vrkft\" (UID: \"04cb27f4-9c13-4e16-bfb0-413dfb7e6e52\") " pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:41.936447 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.936414    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:46:41.942242 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.942218    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57f746bc59-kvfkq"]
May 28 17:46:41.996027 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:41.995989    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs2tr\" (UniqueName: \"kubernetes.io/projected/04cb27f4-9c13-4e16-bfb0-413dfb7e6e52-kube-api-access-cs2tr\") pod \"downloads-57bd96b888-vrkft\" (UID: \"04cb27f4-9c13-4e16-bfb0-413dfb7e6e52\") " pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:42.010771 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:42.010744    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs2tr\" (UniqueName: \"kubernetes.io/projected/04cb27f4-9c13-4e16-bfb0-413dfb7e6e52-kube-api-access-cs2tr\") pod \"downloads-57bd96b888-vrkft\" (UID: \"04cb27f4-9c13-4e16-bfb0-413dfb7e6e52\") " pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:42.059105 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:42.059072    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:42.199290 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:42.199133    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vrkft"]
May 28 17:46:42.201776 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:42.201745    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cb27f4_9c13_4e16_bfb0_413dfb7e6e52.slice/crio-87d434c2a98bdc7e62c5718edad310998f15b46df35b499732e532940afb1944 WatchSource:0}: Error finding container 87d434c2a98bdc7e62c5718edad310998f15b46df35b499732e532940afb1944: Status 404 returned error can't find the container with id 87d434c2a98bdc7e62c5718edad310998f15b46df35b499732e532940afb1944
May 28 17:46:42.620231 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:42.620196    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vrkft" event={"ID":"04cb27f4-9c13-4e16-bfb0-413dfb7e6e52","Type":"ContainerStarted","Data":"87d434c2a98bdc7e62c5718edad310998f15b46df35b499732e532940afb1944"}
May 28 17:46:43.033647 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:43.033611    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01af382-4d8e-4445-9e0a-ff554ca770da" path="/var/lib/kubelet/pods/e01af382-4d8e-4445-9e0a-ff554ca770da/volumes"
May 28 17:46:46.026974 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:46.026944    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:46:47.468931 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.468891    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:46:47.474094 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.474070    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.476865 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.476622    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 17:46:47.476865 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.476778    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 17:46:47.477759 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.477735    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 17:46:47.477981 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.477957    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 17:46:47.479104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.478587    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dm6jg\""
May 28 17:46:47.479104 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.478721    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 17:46:47.480088 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.480067    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:46:47.599102 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.599072    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jjbxb"
May 28 17:46:47.645002 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.644969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.645169 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.645018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.645169 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.645072    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.645169 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.645100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.645169 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.645155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prvd\" (UniqueName: \"kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.645373 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.645194    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746543 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746457    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746543 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746528    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2prvd\" (UniqueName: \"kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746593    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746660    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746764 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746697    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.746932 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.746770    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.747496 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.747448    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.747708 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.747653    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.747708 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.747678    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.749977 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.749953    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.750159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.750139    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.755228 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.755201    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prvd\" (UniqueName: \"kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd\") pod \"console-69cb498b57-lv8kz\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") " pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.786891 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.786850    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:47.939557 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:47.939509    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:46:47.942435 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:47.942394    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d56f6d_e136_4cab_91b8_d9550da0da40.slice/crio-552981c4ec997b91dc8df523e7f923af28926405842104709a6d8992d9a25a9e WatchSource:0}: Error finding container 552981c4ec997b91dc8df523e7f923af28926405842104709a6d8992d9a25a9e: Status 404 returned error can't find the container with id 552981c4ec997b91dc8df523e7f923af28926405842104709a6d8992d9a25a9e
May 28 17:46:48.640504 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:48.640461    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb498b57-lv8kz" event={"ID":"e1d56f6d-e136-4cab-91b8-d9550da0da40","Type":"ContainerStarted","Data":"552981c4ec997b91dc8df523e7f923af28926405842104709a6d8992d9a25a9e"}
May 28 17:46:51.653765 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:51.653722    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb498b57-lv8kz" event={"ID":"e1d56f6d-e136-4cab-91b8-d9550da0da40","Type":"ContainerStarted","Data":"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"}
May 28 17:46:51.670334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:51.670278    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-69cb498b57-lv8kz" podStartSLOduration=1.585820747 podStartE2EDuration="4.670263821s" podCreationTimestamp="2026-05-28 17:46:47 +0000 UTC" firstStartedPulling="2026-05-28 17:46:47.944732183 +0000 UTC m=+175.547047777" lastFinishedPulling="2026-05-28 17:46:51.029175253 +0000 UTC m=+178.631490851" observedRunningTime="2026-05-28 17:46:51.669616072 +0000 UTC m=+179.271931685" watchObservedRunningTime="2026-05-28 17:46:51.670263821 +0000 UTC m=+179.272579437"
May 28 17:46:57.787761 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.787719    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:57.787761 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.787769    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:57.793312 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.793285    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:57.857569 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.857490    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:46:57.859846 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.859820    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.867602 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.867504    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 17:46:57.868393 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.868372    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:46:57.938393 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938352    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938577 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938403    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938577 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938577 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhm9j\" (UniqueName: \"kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938577 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938737 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:57.938737 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:57.938642    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039516 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039480    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039516 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039516    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039582    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039611    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039642    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039945 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039745    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhm9j\" (UniqueName: \"kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.039945 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.039799    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.040507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.040434    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.040638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.040586    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.040638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.040600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.040638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.040588    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.042490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.042467    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.042657 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.042638    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.048127 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.048098    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhm9j\" (UniqueName: \"kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j\") pod \"console-6b78d7c468-dmm7x\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") " pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.172621 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.172526    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:46:58.681284 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:58.681252    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:46:59.026155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.026131    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:46:59.029112 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:46:59.029084    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bc78cb_7e32_4b35_a717_adff0e0970b1.slice/crio-6bb344c272d61266c2e6f014ea9f72f8073112e4fd618a122eeed8dd67817250 WatchSource:0}: Error finding container 6bb344c272d61266c2e6f014ea9f72f8073112e4fd618a122eeed8dd67817250: Status 404 returned error can't find the container with id 6bb344c272d61266c2e6f014ea9f72f8073112e4fd618a122eeed8dd67817250
May 28 17:46:59.681572 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.681532    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vrkft" event={"ID":"04cb27f4-9c13-4e16-bfb0-413dfb7e6e52","Type":"ContainerStarted","Data":"dd4b6b50aa098122b93d9e949979e36af61d3aae3a97dcb9859f5523e33056ff"}
May 28 17:46:59.681766 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.681724    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:59.683625 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.683587    2566 generic.go:358] "Generic (PLEG): container finished" podID="98581b63-98ea-461d-9310-95de1e026120" containerID="9b7e5bd873aae76ccf8b8bc5a0bbf62872feb6a077dba6c963cb2a1073fbffd2" exitCode=0
May 28 17:46:59.683748 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.683696    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j" event={"ID":"98581b63-98ea-461d-9310-95de1e026120","Type":"ContainerDied","Data":"9b7e5bd873aae76ccf8b8bc5a0bbf62872feb6a077dba6c963cb2a1073fbffd2"}
May 28 17:46:59.684068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.684047    2566 scope.go:117] "RemoveContainer" containerID="9b7e5bd873aae76ccf8b8bc5a0bbf62872feb6a077dba6c963cb2a1073fbffd2"
May 28 17:46:59.685781 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.685755    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d7c468-dmm7x" event={"ID":"31bc78cb-7e32-4b35-a717-adff0e0970b1","Type":"ContainerStarted","Data":"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"}
May 28 17:46:59.685844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.685784    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d7c468-dmm7x" event={"ID":"31bc78cb-7e32-4b35-a717-adff0e0970b1","Type":"ContainerStarted","Data":"6bb344c272d61266c2e6f014ea9f72f8073112e4fd618a122eeed8dd67817250"}
May 28 17:46:59.695791 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.695770    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-vrkft"
May 28 17:46:59.701551 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.701498    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-vrkft" podStartSLOduration=1.900608681 podStartE2EDuration="18.701482127s" podCreationTimestamp="2026-05-28 17:46:41 +0000 UTC" firstStartedPulling="2026-05-28 17:46:42.20365706 +0000 UTC m=+169.805972654" lastFinishedPulling="2026-05-28 17:46:59.004530496 +0000 UTC m=+186.606846100" observedRunningTime="2026-05-28 17:46:59.698289323 +0000 UTC m=+187.300604937" watchObservedRunningTime="2026-05-28 17:46:59.701482127 +0000 UTC m=+187.303797742"
May 28 17:46:59.729992 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:46:59.729938    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b78d7c468-dmm7x" podStartSLOduration=2.72991649 podStartE2EDuration="2.72991649s" podCreationTimestamp="2026-05-28 17:46:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:46:59.728553158 +0000 UTC m=+187.330868772" watchObservedRunningTime="2026-05-28 17:46:59.72991649 +0000 UTC m=+187.332232100"
May 28 17:47:00.691618 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:00.691577    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-lfz7j" event={"ID":"98581b63-98ea-461d-9310-95de1e026120","Type":"ContainerStarted","Data":"5421aafd6368260675195be4865a4fbffc07ee51e3b71c7d94ce9084f511a038"}
May 28 17:47:08.172729 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:08.172677    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:47:08.173354 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:08.172751    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:47:08.177702 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:08.177678    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:47:08.722264 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:08.722230    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:47:08.763727 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:08.763689    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:47:33.784002 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:33.783943    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-69cb498b57-lv8kz" podUID="e1d56f6d-e136-4cab-91b8-d9550da0da40" containerName="console" containerID="cri-o://2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9" gracePeriod=15
May 28 17:47:34.065223 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.065195    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69cb498b57-lv8kz_e1d56f6d-e136-4cab-91b8-d9550da0da40/console/0.log"
May 28 17:47:34.065346 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.065259    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:47:34.071775 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.071753    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072181 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072156    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072349 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072332    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072466 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072433    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config" (OuterVolumeSpecName: "console-config") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:47:34.072570 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072556    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072683 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072671    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072811 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072782    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2prvd\" (UniqueName: \"kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd\") pod \"e1d56f6d-e136-4cab-91b8-d9550da0da40\" (UID: \"e1d56f6d-e136-4cab-91b8-d9550da0da40\") "
May 28 17:47:34.072933 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.072909    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:47:34.073307 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.073284    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:47:34.073728 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.073711    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-oauth-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.073844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.073832    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.073955 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.073944    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1d56f6d-e136-4cab-91b8-d9550da0da40-service-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.075197 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.075172    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:34.077140 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.077110    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:34.079501 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.079478    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd" (OuterVolumeSpecName: "kube-api-access-2prvd") pod "e1d56f6d-e136-4cab-91b8-d9550da0da40" (UID: "e1d56f6d-e136-4cab-91b8-d9550da0da40"). InnerVolumeSpecName "kube-api-access-2prvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:47:34.175055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.175025    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2prvd\" (UniqueName: \"kubernetes.io/projected/e1d56f6d-e136-4cab-91b8-d9550da0da40-kube-api-access-2prvd\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.175055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.175054    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.175242 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.175067    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1d56f6d-e136-4cab-91b8-d9550da0da40-console-oauth-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:34.801642 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801610    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69cb498b57-lv8kz_e1d56f6d-e136-4cab-91b8-d9550da0da40/console/0.log"
May 28 17:47:34.802083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801654    2566 generic.go:358] "Generic (PLEG): container finished" podID="e1d56f6d-e136-4cab-91b8-d9550da0da40" containerID="2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9" exitCode=2
May 28 17:47:34.802083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801737    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb498b57-lv8kz"
May 28 17:47:34.802083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801740    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb498b57-lv8kz" event={"ID":"e1d56f6d-e136-4cab-91b8-d9550da0da40","Type":"ContainerDied","Data":"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"}
May 28 17:47:34.802083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801779    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb498b57-lv8kz" event={"ID":"e1d56f6d-e136-4cab-91b8-d9550da0da40","Type":"ContainerDied","Data":"552981c4ec997b91dc8df523e7f923af28926405842104709a6d8992d9a25a9e"}
May 28 17:47:34.802083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.801794    2566 scope.go:117] "RemoveContainer" containerID="2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"
May 28 17:47:34.810504 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.810490    2566 scope.go:117] "RemoveContainer" containerID="2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"
May 28 17:47:34.810761 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:34.810744    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9\": container with ID starting with 2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9 not found: ID does not exist" containerID="2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"
May 28 17:47:34.810809 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.810769    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9"} err="failed to get container status \"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9\": rpc error: code = NotFound desc = could not find container \"2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9\": container with ID starting with 2951ad8653f98dfb0bafd8fc19c8e16c6bb8ec4c23edd5fb0f34170cebf056a9 not found: ID does not exist"
May 28 17:47:34.821561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.821540    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:47:34.825118 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:34.825100    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69cb498b57-lv8kz"]
May 28 17:47:35.031631 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:35.031601    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d56f6d-e136-4cab-91b8-d9550da0da40" path="/var/lib/kubelet/pods/e1d56f6d-e136-4cab-91b8-d9550da0da40/volumes"
May 28 17:47:47.391811 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.391773    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:47.392438 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392382    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="alertmanager" containerID="cri-o://ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed" gracePeriod=120
May 28 17:47:47.392568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392443    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-metric" containerID="cri-o://065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6" gracePeriod=120
May 28 17:47:47.392568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392450    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy" containerID="cri-o://c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7" gracePeriod=120
May 28 17:47:47.392568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392447    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-web" containerID="cri-o://14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2" gracePeriod=120
May 28 17:47:47.392568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392542    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="config-reloader" containerID="cri-o://bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0" gracePeriod=120
May 28 17:47:47.392835 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.392510    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="prom-label-proxy" containerID="cri-o://f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2" gracePeriod=120
May 28 17:47:47.842279 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842240    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2" exitCode=0
May 28 17:47:47.842279 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842265    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7" exitCode=0
May 28 17:47:47.842279 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842273    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0" exitCode=0
May 28 17:47:47.842279 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842281    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed" exitCode=0
May 28 17:47:47.842546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842316    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"}
May 28 17:47:47.842546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842349    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"}
May 28 17:47:47.842546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842360    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"}
May 28 17:47:47.842546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:47.842369    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"}
May 28 17:47:48.740025 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.740002    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.794133 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794096    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794139    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794166    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794213    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794254    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794278    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794302    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l7d8\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794333    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794374    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794398    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794448    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794490    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.794658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.794528    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9ff2eddf-624e-4e74-844f-f0165d98077b\" (UID: \"9ff2eddf-624e-4e74-844f-f0165d98077b\") "
May 28 17:47:48.795494 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.795027    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:47:48.795494 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.795058    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:47:48.796502 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.796462    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:47:48.798057 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.798024    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.798371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.798341    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.798474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.798450    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out" (OuterVolumeSpecName: "config-out") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:47:48.799289 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.799244    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume" (OuterVolumeSpecName: "config-volume") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.799289 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.799278    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:47:48.800062 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.800035    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.800321 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.800296    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.800593 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.800571    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8" (OuterVolumeSpecName: "kube-api-access-5l7d8") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "kube-api-access-5l7d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:47:48.803403 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.803384    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.810502 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.810481    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config" (OuterVolumeSpecName: "web-config") pod "9ff2eddf-624e-4e74-844f-f0165d98077b" (UID: "9ff2eddf-624e-4e74-844f-f0165d98077b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:47:48.847490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847465    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6" exitCode=0
May 28 17:47:48.847490 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847488    2566 generic.go:358] "Generic (PLEG): container finished" podID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerID="14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2" exitCode=0
May 28 17:47:48.847634 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847521    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"}
May 28 17:47:48.847634 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847550    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"}
May 28 17:47:48.847634 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847561    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ff2eddf-624e-4e74-844f-f0165d98077b","Type":"ContainerDied","Data":"d631913a3377797a686b6c0b16d576d3f98fa19353c6a7d1a4a766630550dc8b"}
May 28 17:47:48.847634 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847570    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.847753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.847575    2566 scope.go:117] "RemoveContainer" containerID="f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"
May 28 17:47:48.855741 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.855723    2566 scope.go:117] "RemoveContainer" containerID="065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"
May 28 17:47:48.862691 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.862674    2566 scope.go:117] "RemoveContainer" containerID="c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"
May 28 17:47:48.869374 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.869351    2566 scope.go:117] "RemoveContainer" containerID="14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"
May 28 17:47:48.870907 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.870889    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:48.874743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.874722    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:48.876319 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.876304    2566 scope.go:117] "RemoveContainer" containerID="bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"
May 28 17:47:48.883084 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.883065    2566 scope.go:117] "RemoveContainer" containerID="ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"
May 28 17:47:48.889730 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.889682    2566 scope.go:117] "RemoveContainer" containerID="32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"
May 28 17:47:48.896132 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896113    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896132 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896130    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896141    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896155    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896167    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-cluster-tls-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896176    2566 scope.go:117] "RemoveContainer" containerID="f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"
May 28 17:47:48.896224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896178    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-tls-assets\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896242    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-secret-alertmanager-main-tls\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896257    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-alertmanager-main-db\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896273    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ff2eddf-624e-4e74-844f-f0165d98077b-config-out\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896284    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l7d8\" (UniqueName: \"kubernetes.io/projected/9ff2eddf-624e-4e74-844f-f0165d98077b-kube-api-access-5l7d8\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896293    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-web-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896302    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ff2eddf-624e-4e74-844f-f0165d98077b-config-volume\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896310    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ff2eddf-624e-4e74-844f-f0165d98077b-metrics-client-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:47:48.896654 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.896467    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2\": container with ID starting with f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2 not found: ID does not exist" containerID="f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"
May 28 17:47:48.896654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896487    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"} err="failed to get container status \"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2\": rpc error: code = NotFound desc = could not find container \"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2\": container with ID starting with f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2 not found: ID does not exist"
May 28 17:47:48.896654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896505    2566 scope.go:117] "RemoveContainer" containerID="065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"
May 28 17:47:48.896759 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.896681    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6\": container with ID starting with 065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6 not found: ID does not exist" containerID="065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"
May 28 17:47:48.896759 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896695    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"} err="failed to get container status \"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6\": rpc error: code = NotFound desc = could not find container \"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6\": container with ID starting with 065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6 not found: ID does not exist"
May 28 17:47:48.896759 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896706    2566 scope.go:117] "RemoveContainer" containerID="c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"
May 28 17:47:48.896935 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.896918    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7\": container with ID starting with c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7 not found: ID does not exist" containerID="c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"
May 28 17:47:48.896995 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896941    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"} err="failed to get container status \"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7\": rpc error: code = NotFound desc = could not find container \"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7\": container with ID starting with c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7 not found: ID does not exist"
May 28 17:47:48.896995 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.896953    2566 scope.go:117] "RemoveContainer" containerID="14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"
May 28 17:47:48.897192 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.897170    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2\": container with ID starting with 14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2 not found: ID does not exist" containerID="14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"
May 28 17:47:48.897291 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.897193    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"} err="failed to get container status \"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2\": rpc error: code = NotFound desc = could not find container \"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2\": container with ID starting with 14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2 not found: ID does not exist"
May 28 17:47:48.897291 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.897246    2566 scope.go:117] "RemoveContainer" containerID="bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"
May 28 17:47:48.897592 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.897565    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0\": container with ID starting with bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0 not found: ID does not exist" containerID="bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"
May 28 17:47:48.897951 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.897908    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"} err="failed to get container status \"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0\": rpc error: code = NotFound desc = could not find container \"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0\": container with ID starting with bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0 not found: ID does not exist"
May 28 17:47:48.897951 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.897954    2566 scope.go:117] "RemoveContainer" containerID="ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"
May 28 17:47:48.898355 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.898333    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed\": container with ID starting with ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed not found: ID does not exist" containerID="ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"
May 28 17:47:48.898440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898359    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"} err="failed to get container status \"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed\": rpc error: code = NotFound desc = could not find container \"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed\": container with ID starting with ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed not found: ID does not exist"
May 28 17:47:48.898440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898374    2566 scope.go:117] "RemoveContainer" containerID="32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"
May 28 17:47:48.898649 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:47:48.898631    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083\": container with ID starting with 32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083 not found: ID does not exist" containerID="32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"
May 28 17:47:48.898715 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898653    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"} err="failed to get container status \"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083\": rpc error: code = NotFound desc = could not find container \"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083\": container with ID starting with 32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083 not found: ID does not exist"
May 28 17:47:48.898715 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898678    2566 scope.go:117] "RemoveContainer" containerID="f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"
May 28 17:47:48.898917 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898895    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2"} err="failed to get container status \"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2\": rpc error: code = NotFound desc = could not find container \"f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2\": container with ID starting with f3573f1cf09f3a43224a11b534ac72889910ce1675f2b6bdd67619ae1ff99ef2 not found: ID does not exist"
May 28 17:47:48.898917 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.898916    2566 scope.go:117] "RemoveContainer" containerID="065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"
May 28 17:47:48.899163 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899146    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6"} err="failed to get container status \"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6\": rpc error: code = NotFound desc = could not find container \"065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6\": container with ID starting with 065a44c85ecf9ba2f1228e0e1568d34809c7fead22cf7116785f7826d5175eb6 not found: ID does not exist"
May 28 17:47:48.899227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899165    2566 scope.go:117] "RemoveContainer" containerID="c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"
May 28 17:47:48.899227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899211    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:48.899369 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899352    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7"} err="failed to get container status \"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7\": rpc error: code = NotFound desc = could not find container \"c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7\": container with ID starting with c6ee94cb8e2fc2f5e5bba14b4730e409a6f4dd91251e7e664699af1afa6c4ff7 not found: ID does not exist"
May 28 17:47:48.899474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899371    2566 scope.go:117] "RemoveContainer" containerID="14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"
May 28 17:47:48.899602 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899577    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="config-reloader"
May 28 17:47:48.899602 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899594    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="config-reloader"
May 28 17:47:48.899602 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899603    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-web"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899608    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-web"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899608    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2"} err="failed to get container status \"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2\": rpc error: code = NotFound desc = could not find container \"14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2\": container with ID starting with 14b7809af083b83b08fff0b8bb55d9c076ce4396ecad2aa349253258ee6072e2 not found: ID does not exist"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899635    2566 scope.go:117] "RemoveContainer" containerID="bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899619    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="alertmanager"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899688    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="alertmanager"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899705    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899715    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899728    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="init-config-reloader"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899737    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="init-config-reloader"
May 28 17:47:48.899753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899750    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d56f6d-e136-4cab-91b8-d9550da0da40" containerName="console"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899758    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d56f6d-e136-4cab-91b8-d9550da0da40" containerName="console"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899770    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-metric"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899779    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-metric"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899789    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="prom-label-proxy"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899797    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="prom-label-proxy"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899898    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0"} err="failed to get container status \"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0\": rpc error: code = NotFound desc = could not find container \"bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0\": container with ID starting with bad3e162f23c1e163548d7a9bf1e725fd6da05db12f296736764424665f5b1e0 not found: ID does not exist"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899918    2566 scope.go:117] "RemoveContainer" containerID="ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899930    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="config-reloader"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899946    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="prom-label-proxy"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899960    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="alertmanager"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899969    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1d56f6d-e136-4cab-91b8-d9550da0da40" containerName="console"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899978    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899988    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-web"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.899999    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" containerName="kube-rbac-proxy-metric"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.900192    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed"} err="failed to get container status \"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed\": rpc error: code = NotFound desc = could not find container \"ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed\": container with ID starting with ade672a02d3c04104320743f06379173c1942d043203dc4ab3d571a1c91830ed not found: ID does not exist"
May 28 17:47:48.900271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.900227    2566 scope.go:117] "RemoveContainer" containerID="32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"
May 28 17:47:48.901125 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.900616    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083"} err="failed to get container status \"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083\": rpc error: code = NotFound desc = could not find container \"32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083\": container with ID starting with 32b034069fdcc1044cfc59c328ae4ee9e1c7950cf59f4f4e2f45284016d22083 not found: ID does not exist"
May 28 17:47:48.903618 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.903599    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.906123 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906106    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:47:48.906217 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906122    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:47:48.906217 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906145    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:47:48.906384 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906371    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9hw7f\""
May 28 17:47:48.906432 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906419    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:47:48.906553 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906540    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:47:48.906666 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906654    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:47:48.906805 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906791    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:47:48.906838 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.906817    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:47:48.911436 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.911419    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:47:48.914229 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.914205    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:48.997637 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997548    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-config-out\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.997637 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.997637 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.997637 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997635    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjsvh\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-kube-api-access-kjsvh\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-web-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.997989    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:48.998248 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:48.998047    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.035967 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.035936    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff2eddf-624e-4e74-844f-f0165d98077b" path="/var/lib/kubelet/pods/9ff2eddf-624e-4e74-844f-f0165d98077b/volumes"
May 28 17:47:49.098468 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098437    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-config-out\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098474    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098534    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098684 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098573    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098684 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098613    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjsvh\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-kube-api-access-kjsvh\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098684 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098642    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098684 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098677    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-web-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098912 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098707    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098912 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098739    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098912 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098772    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098912 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098826    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.098912 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098903    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.099181 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.098965    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.099861 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.099833    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.100262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.100232    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fafb1c1-3acc-4eea-b109-35fada09daad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.101659 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.101633    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-config-out\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.101978    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102047    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102047    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102166    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102231    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102719 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102331    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fafb1c1-3acc-4eea-b109-35fada09daad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102719 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102704    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.102854 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.102835    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-web-config\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.104197 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.104173    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fafb1c1-3acc-4eea-b109-35fada09daad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.107940 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.107921    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjsvh\" (UniqueName: \"kubernetes.io/projected/0fafb1c1-3acc-4eea-b109-35fada09daad-kube-api-access-kjsvh\") pod \"alertmanager-main-0\" (UID: \"0fafb1c1-3acc-4eea-b109-35fada09daad\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.213333 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.213297    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:47:49.348591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.348567    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:47:49.350658 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:47:49.350632    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fafb1c1_3acc_4eea_b109_35fada09daad.slice/crio-46a559309387b93cb1697b9d7df79aa35db344706f97a7048884cf3a9a78b15c WatchSource:0}: Error finding container 46a559309387b93cb1697b9d7df79aa35db344706f97a7048884cf3a9a78b15c: Status 404 returned error can't find the container with id 46a559309387b93cb1697b9d7df79aa35db344706f97a7048884cf3a9a78b15c
May 28 17:47:49.853626 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.853585    2566 generic.go:358] "Generic (PLEG): container finished" podID="0fafb1c1-3acc-4eea-b109-35fada09daad" containerID="7ae28451dfd7e4f563be576b3265d8b690c02d2327234c1248570ad421f20101" exitCode=0
May 28 17:47:49.854108 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.853656    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerDied","Data":"7ae28451dfd7e4f563be576b3265d8b690c02d2327234c1248570ad421f20101"}
May 28 17:47:49.854108 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:49.853679    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"46a559309387b93cb1697b9d7df79aa35db344706f97a7048884cf3a9a78b15c"}
May 28 17:47:50.860501 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860456    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"4aa82910a43f59d2556bfac9effc1e169eea4e57d9d63200034005b17b363175"}
May 28 17:47:50.860501 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860502    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"9b87b2b082789945eb8943114fcf9376bc2334d9f25e6090bd34203b2e45bd8b"}
May 28 17:47:50.860924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860512    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"7ed4bd9bac9bc90b5a98d61bce90f3d737f23f7ea377450bc97ece5f7307acf9"}
May 28 17:47:50.860924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860521    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"aea5a55c975f797a52b6defcf857c44aebedd70acb1acfac895bd325b4aebe00"}
May 28 17:47:50.860924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860531    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"71a23a7df68f03e43056c25b6d2a8f13211b72ee1233222eb9e31e309c615bc8"}
May 28 17:47:50.860924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.860539    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fafb1c1-3acc-4eea-b109-35fada09daad","Type":"ContainerStarted","Data":"4943f50b4d95d0c26ad80b6b16c43e00e3dfc0c05aba5efa5fc092e492ece50e"}
May 28 17:47:50.886963 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:50.886916    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.886900541 podStartE2EDuration="2.886900541s" podCreationTimestamp="2026-05-28 17:47:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:47:50.885291137 +0000 UTC m=+238.487606750" watchObservedRunningTime="2026-05-28 17:47:50.886900541 +0000 UTC m=+238.489216153"
May 28 17:47:51.418027 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.417987    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"]
May 28 17:47:51.420579 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.420556    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.423448 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.423418    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 17:47:51.423448 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.423440    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 17:47:51.423614 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.423441    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 17:47:51.423614 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.423441    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 17:47:51.423772 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.423754    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7dqnr\""
May 28 17:47:51.424704 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.424683    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 17:47:51.435532 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.435157    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 17:47:51.437185 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.437156    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"]
May 28 17:47:51.520420 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxb55\" (UniqueName: \"kubernetes.io/projected/f7782e19-f2d1-48f7-b845-6de514cf9850-kube-api-access-vxb55\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520442    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-serving-certs-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520560    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520672 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520706 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520671    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520744 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520718    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-metrics-client-ca\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.520806 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.520793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-federate-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.621856 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621818    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-serving-certs-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621891    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621913    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621931    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621955    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.621979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-metrics-client-ca\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.622002    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-federate-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.622023    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxb55\" (UniqueName: \"kubernetes.io/projected/f7782e19-f2d1-48f7-b845-6de514cf9850-kube-api-access-vxb55\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.622691 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.622660    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-serving-certs-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.623067 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.622924    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.623183 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.623167    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7782e19-f2d1-48f7-b845-6de514cf9850-metrics-client-ca\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.624859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.624777    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.624859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.624843    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-telemeter-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.625050 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.625016    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.625257 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.625159    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7782e19-f2d1-48f7-b845-6de514cf9850-federate-client-tls\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.629668 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.629612    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxb55\" (UniqueName: \"kubernetes.io/projected/f7782e19-f2d1-48f7-b845-6de514cf9850-kube-api-access-vxb55\") pod \"telemeter-client-7589cdd94b-rhjd7\" (UID: \"f7782e19-f2d1-48f7-b845-6de514cf9850\") " pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.737149 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.737118    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"
May 28 17:47:51.882353 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:51.882325    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7589cdd94b-rhjd7"]
May 28 17:47:51.883512 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:47:51.883482    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7782e19_f2d1_48f7_b845_6de514cf9850.slice/crio-bc3bb8c01882b4e4b5bac8b60f7054716b65bf1ebc512ab8cf54e3427ac61ce9 WatchSource:0}: Error finding container bc3bb8c01882b4e4b5bac8b60f7054716b65bf1ebc512ab8cf54e3427ac61ce9: Status 404 returned error can't find the container with id bc3bb8c01882b4e4b5bac8b60f7054716b65bf1ebc512ab8cf54e3427ac61ce9
May 28 17:47:52.879543 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:52.879510    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7" event={"ID":"f7782e19-f2d1-48f7-b845-6de514cf9850","Type":"ContainerStarted","Data":"bc3bb8c01882b4e4b5bac8b60f7054716b65bf1ebc512ab8cf54e3427ac61ce9"}
May 28 17:47:53.884750 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:53.884725    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7" event={"ID":"f7782e19-f2d1-48f7-b845-6de514cf9850","Type":"ContainerStarted","Data":"15fca76c9d6b401c82b732ab5fe7c91bd1d606b80f677fc3e90d15c6536008c0"}
May 28 17:47:53.885050 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:53.884760    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7" event={"ID":"f7782e19-f2d1-48f7-b845-6de514cf9850","Type":"ContainerStarted","Data":"726e6b7af5e80c46f509b13c1315459771fdd69172085068f235acb9305e2854"}
May 28 17:47:54.895299 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:54.895259    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7" event={"ID":"f7782e19-f2d1-48f7-b845-6de514cf9850","Type":"ContainerStarted","Data":"658bbf389b252c89f7e186ea35345196f96c63a769340cf17eb13bf9916987d1"}
May 28 17:47:54.918827 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:54.918779    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7589cdd94b-rhjd7" podStartSLOduration=2.083252992 podStartE2EDuration="3.918765543s" podCreationTimestamp="2026-05-28 17:47:51 +0000 UTC" firstStartedPulling="2026-05-28 17:47:51.885624345 +0000 UTC m=+239.487939950" lastFinishedPulling="2026-05-28 17:47:53.721136908 +0000 UTC m=+241.323452501" observedRunningTime="2026-05-28 17:47:54.917363545 +0000 UTC m=+242.519679150" watchObservedRunningTime="2026-05-28 17:47:54.918765543 +0000 UTC m=+242.521081155"
May 28 17:47:55.608672 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.608630    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:47:55.611392 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.611362    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.623476 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.623450    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnxq8\" (UniqueName: \"kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.656733 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.656583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.757578 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757542    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.757578 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757578    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.757867 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757599    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.757867 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757624    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.757867 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757840    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758056 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.757917    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758056 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.758029    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnxq8\" (UniqueName: \"kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758486 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.758416    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758486 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.758511    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758757 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.758604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.758757 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.758679    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.760308 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.760283    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.760421 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.760344    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.765205 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.765174    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnxq8\" (UniqueName: \"kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8\") pod \"console-688cbb467f-52gpj\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") " pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:55.922456 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:55.922371    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:47:56.054165 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:56.054139    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:47:56.056546 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:47:56.056517    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2abf62_c4de_412b_bf5e_d84dceaf13b6.slice/crio-a04a19e9c037776bee8573c04e74d9697df25a10cab0aba8dd537fb98a086e17 WatchSource:0}: Error finding container a04a19e9c037776bee8573c04e74d9697df25a10cab0aba8dd537fb98a086e17: Status 404 returned error can't find the container with id a04a19e9c037776bee8573c04e74d9697df25a10cab0aba8dd537fb98a086e17
May 28 17:47:56.902575 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:56.902542    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cbb467f-52gpj" event={"ID":"ed2abf62-c4de-412b-bf5e-d84dceaf13b6","Type":"ContainerStarted","Data":"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"}
May 28 17:47:56.902575 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:56.902575    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cbb467f-52gpj" event={"ID":"ed2abf62-c4de-412b-bf5e-d84dceaf13b6","Type":"ContainerStarted","Data":"a04a19e9c037776bee8573c04e74d9697df25a10cab0aba8dd537fb98a086e17"}
May 28 17:47:56.920843 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:47:56.920797    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-688cbb467f-52gpj" podStartSLOduration=1.920783403 podStartE2EDuration="1.920783403s" podCreationTimestamp="2026-05-28 17:47:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:47:56.918738953 +0000 UTC m=+244.521054566" watchObservedRunningTime="2026-05-28 17:47:56.920783403 +0000 UTC m=+244.523099017"
May 28 17:48:03.826279 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:03.826233    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:48:03.828750 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:03.828725    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf68954-31e5-4ab5-88af-146f6093d424-metrics-certs\") pod \"network-metrics-daemon-4tp8t\" (UID: \"ebf68954-31e5-4ab5-88af-146f6093d424\") " pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:48:04.029987 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:04.029955    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wt76\""
May 28 17:48:04.037936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:04.037916    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tp8t"
May 28 17:48:04.160632 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:04.160607    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4tp8t"]
May 28 17:48:04.163028 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:48:04.163001    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf68954_31e5_4ab5_88af_146f6093d424.slice/crio-6f2a6a0b3b7efecb4cf2d40053d3627b6cc3e8127ad050b4bb7145ca02938af0 WatchSource:0}: Error finding container 6f2a6a0b3b7efecb4cf2d40053d3627b6cc3e8127ad050b4bb7145ca02938af0: Status 404 returned error can't find the container with id 6f2a6a0b3b7efecb4cf2d40053d3627b6cc3e8127ad050b4bb7145ca02938af0
May 28 17:48:04.927382 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:04.927344    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tp8t" event={"ID":"ebf68954-31e5-4ab5-88af-146f6093d424","Type":"ContainerStarted","Data":"6f2a6a0b3b7efecb4cf2d40053d3627b6cc3e8127ad050b4bb7145ca02938af0"}
May 28 17:48:05.923099 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.923063    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:48:05.923238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.923115    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:48:05.927455 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.927430    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:48:05.931267 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.931236    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tp8t" event={"ID":"ebf68954-31e5-4ab5-88af-146f6093d424","Type":"ContainerStarted","Data":"2b6a4103b2c59f213d5e10ab927d66571ecc9ecc882e497fe1d9c7837a44df64"}
May 28 17:48:05.931372 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.931276    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tp8t" event={"ID":"ebf68954-31e5-4ab5-88af-146f6093d424","Type":"ContainerStarted","Data":"93c8244929ec2e2975a7dda5136d88f0cce3099347330989fdd5da93e0d374f9"}
May 28 17:48:05.934970 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.934950    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:48:05.958212 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.958164    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4tp8t" podStartSLOduration=251.936514361 podStartE2EDuration="4m12.958151188s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:48:04.164931759 +0000 UTC m=+251.767247354" lastFinishedPulling="2026-05-28 17:48:05.186568586 +0000 UTC m=+252.788884181" observedRunningTime="2026-05-28 17:48:05.95608518 +0000 UTC m=+253.558400793" watchObservedRunningTime="2026-05-28 17:48:05.958151188 +0000 UTC m=+253.560466801"
May 28 17:48:05.998626 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:05.998586    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:48:31.020265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.020228    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b78d7c468-dmm7x" podUID="31bc78cb-7e32-4b35-a717-adff0e0970b1" containerName="console" containerID="cri-o://72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff" gracePeriod=15
May 28 17:48:31.262535 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.262516    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b78d7c468-dmm7x_31bc78cb-7e32-4b35-a717-adff0e0970b1/console/0.log"
May 28 17:48:31.262641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.262575    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:48:31.338204 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338140    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338204 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338189    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338354 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338239    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338354 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338295    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338354 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338330    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338492 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338363    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338492 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338390    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhm9j\" (UniqueName: \"kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j\") pod \"31bc78cb-7e32-4b35-a717-adff0e0970b1\" (UID: \"31bc78cb-7e32-4b35-a717-adff0e0970b1\") "
May 28 17:48:31.338894 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338737    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config" (OuterVolumeSpecName: "console-config") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:48:31.339009 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338976    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:48:31.339009 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338729    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:48:31.339092 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.338868    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:48:31.340419 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.340398    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:48:31.341065 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.341025    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:48:31.341065 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.341032    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j" (OuterVolumeSpecName: "kube-api-access-dhm9j") pod "31bc78cb-7e32-4b35-a717-adff0e0970b1" (UID: "31bc78cb-7e32-4b35-a717-adff0e0970b1"). InnerVolumeSpecName "kube-api-access-dhm9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:48:31.439839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439809    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.439839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439834    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-service-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.439839 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439843    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-trusted-ca-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.440060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439854    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhm9j\" (UniqueName: \"kubernetes.io/projected/31bc78cb-7e32-4b35-a717-adff0e0970b1-kube-api-access-dhm9j\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.440060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439865    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.440060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439891    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bc78cb-7e32-4b35-a717-adff0e0970b1-console-oauth-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:31.440060 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:31.439900    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bc78cb-7e32-4b35-a717-adff0e0970b1-oauth-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:48:32.008858 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.008828    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b78d7c468-dmm7x_31bc78cb-7e32-4b35-a717-adff0e0970b1/console/0.log"
May 28 17:48:32.009055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.008893    2566 generic.go:358] "Generic (PLEG): container finished" podID="31bc78cb-7e32-4b35-a717-adff0e0970b1" containerID="72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff" exitCode=2
May 28 17:48:32.009055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.008957    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d7c468-dmm7x"
May 28 17:48:32.009055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.008959    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d7c468-dmm7x" event={"ID":"31bc78cb-7e32-4b35-a717-adff0e0970b1","Type":"ContainerDied","Data":"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"}
May 28 17:48:32.009055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.008996    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d7c468-dmm7x" event={"ID":"31bc78cb-7e32-4b35-a717-adff0e0970b1","Type":"ContainerDied","Data":"6bb344c272d61266c2e6f014ea9f72f8073112e4fd618a122eeed8dd67817250"}
May 28 17:48:32.009055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.009012    2566 scope.go:117] "RemoveContainer" containerID="72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"
May 28 17:48:32.017461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.017446    2566 scope.go:117] "RemoveContainer" containerID="72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"
May 28 17:48:32.017681 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:48:32.017664    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff\": container with ID starting with 72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff not found: ID does not exist" containerID="72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"
May 28 17:48:32.017740 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.017688    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff"} err="failed to get container status \"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff\": rpc error: code = NotFound desc = could not find container \"72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff\": container with ID starting with 72bf12f4ca1d750b880dfcf8d4ff47547deb1f09944ee409e23737218ab424ff not found: ID does not exist"
May 28 17:48:32.029774 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.029753    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:48:32.032955 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:32.032934    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b78d7c468-dmm7x"]
May 28 17:48:33.030819 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:33.030780    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31bc78cb-7e32-4b35-a717-adff0e0970b1" path="/var/lib/kubelet/pods/31bc78cb-7e32-4b35-a717-adff0e0970b1/volumes"
May 28 17:48:52.950411 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:48:52.950384    2566 kubelet.go:1628] "Image garbage collection succeeded"
May 28 17:49:30.782518 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.782483    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:49:30.783085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.783066    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31bc78cb-7e32-4b35-a717-adff0e0970b1" containerName="console"
May 28 17:49:30.783180 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.783089    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31bc78cb-7e32-4b35-a717-adff0e0970b1" containerName="console"
May 28 17:49:30.783234 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.783181    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="31bc78cb-7e32-4b35-a717-adff0e0970b1" containerName="console"
May 28 17:49:30.786327 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.786307    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.796202 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.796179    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:49:30.929611 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929564    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.929819 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929632    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.929819 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.929819 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929745    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.930033 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwnz7\" (UniqueName: \"kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.930033 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:30.930033 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:30.929970    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030595 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030561    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030732 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030600    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030732 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030712    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030763    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwnz7\" (UniqueName: \"kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030799    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.030836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030830    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.031028 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.030851    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.031424 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.031401    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.031518 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.031450    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.031561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.031536    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.031561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.031547    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.033754 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.033700    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.033754 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.033726    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.038111 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.038089    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwnz7\" (UniqueName: \"kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7\") pod \"console-784bcfc49d-glhtv\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") " pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.096702 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.096670    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:31.229665 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.229637    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:49:31.229985 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:49:31.229961    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8a01aa_068a_4c28_91ae_189efddb825a.slice/crio-a80c055037c92c02612a8c4851cded2fa88833a666d5a8f25f3946e753ab6123 WatchSource:0}: Error finding container a80c055037c92c02612a8c4851cded2fa88833a666d5a8f25f3946e753ab6123: Status 404 returned error can't find the container with id a80c055037c92c02612a8c4851cded2fa88833a666d5a8f25f3946e753ab6123
May 28 17:49:31.231724 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:31.231708    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:49:32.187078 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:32.187043    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bcfc49d-glhtv" event={"ID":"1f8a01aa-068a-4c28-91ae-189efddb825a","Type":"ContainerStarted","Data":"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"}
May 28 17:49:32.187448 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:32.187086    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bcfc49d-glhtv" event={"ID":"1f8a01aa-068a-4c28-91ae-189efddb825a","Type":"ContainerStarted","Data":"a80c055037c92c02612a8c4851cded2fa88833a666d5a8f25f3946e753ab6123"}
May 28 17:49:32.203191 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:32.203141    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-784bcfc49d-glhtv" podStartSLOduration=2.203124418 podStartE2EDuration="2.203124418s" podCreationTimestamp="2026-05-28 17:49:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:49:32.202481375 +0000 UTC m=+339.804796989" watchObservedRunningTime="2026-05-28 17:49:32.203124418 +0000 UTC m=+339.805440031"
May 28 17:49:41.097629 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:41.097522    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:41.097629 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:41.097583    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:41.105967 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:41.105938    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:41.217807 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:41.217783    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:49:41.259328 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:41.259298    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:49:43.894361 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:43.894323    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qxdsq"]
May 28 17:49:43.897821 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:43.897804    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:43.900186 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:43.900158    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 17:49:43.904302 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:43.904282    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxdsq"]
May 28 17:49:44.041161 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.041135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-kubelet-config\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.041318 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.041171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-dbus\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.041318 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.041295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce447f40-6fbb-4402-873a-ff6f2d8258c9-original-pull-secret\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.142632 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.142599    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce447f40-6fbb-4402-873a-ff6f2d8258c9-original-pull-secret\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.142803 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.142656    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-kubelet-config\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.142803 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.142684    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-dbus\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.142803 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.142787    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-kubelet-config\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.142974 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.142843    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce447f40-6fbb-4402-873a-ff6f2d8258c9-dbus\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.145050 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.144994    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce447f40-6fbb-4402-873a-ff6f2d8258c9-original-pull-secret\") pod \"global-pull-secret-syncer-qxdsq\" (UID: \"ce447f40-6fbb-4402-873a-ff6f2d8258c9\") " pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.208039 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.207991    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxdsq"
May 28 17:49:44.334794 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:44.334770    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxdsq"]
May 28 17:49:44.337262 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:49:44.337235    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce447f40_6fbb_4402_873a_ff6f2d8258c9.slice/crio-4a10781ff34c7b20dda5a45fe07dac413510bebb08ab90ae7caaceeedd73a4b1 WatchSource:0}: Error finding container 4a10781ff34c7b20dda5a45fe07dac413510bebb08ab90ae7caaceeedd73a4b1: Status 404 returned error can't find the container with id 4a10781ff34c7b20dda5a45fe07dac413510bebb08ab90ae7caaceeedd73a4b1
May 28 17:49:45.228193 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:45.228153    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxdsq" event={"ID":"ce447f40-6fbb-4402-873a-ff6f2d8258c9","Type":"ContainerStarted","Data":"4a10781ff34c7b20dda5a45fe07dac413510bebb08ab90ae7caaceeedd73a4b1"}
May 28 17:49:49.244360 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:49.244326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxdsq" event={"ID":"ce447f40-6fbb-4402-873a-ff6f2d8258c9","Type":"ContainerStarted","Data":"94bbd7a04efc0bf576fc5bf45537f495d74915eaf0f69e3d8650500913b0bcfd"}
May 28 17:49:49.259392 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:49:49.259341    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qxdsq" podStartSLOduration=2.003947838 podStartE2EDuration="6.259323862s" podCreationTimestamp="2026-05-28 17:49:43 +0000 UTC" firstStartedPulling="2026-05-28 17:49:44.339027528 +0000 UTC m=+351.941343119" lastFinishedPulling="2026-05-28 17:49:48.594403544 +0000 UTC m=+356.196719143" observedRunningTime="2026-05-28 17:49:49.258197247 +0000 UTC m=+356.860512869" watchObservedRunningTime="2026-05-28 17:49:49.259323862 +0000 UTC m=+356.861639477"
May 28 17:50:06.282285 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.282221    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-688cbb467f-52gpj" podUID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" containerName="console" containerID="cri-o://81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514" gracePeriod=15
May 28 17:50:06.517830 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.517803    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688cbb467f-52gpj_ed2abf62-c4de-412b-bf5e-d84dceaf13b6/console/0.log"
May 28 17:50:06.517961 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.517862    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:50:06.631841 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631770    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.631841 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631836    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnxq8\" (UniqueName: \"kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631854    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631925    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631943    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631971    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.631994    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert\") pod \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\" (UID: \"ed2abf62-c4de-412b-bf5e-d84dceaf13b6\") "
May 28 17:50:06.632322 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.632281    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:50:06.632435 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.632385    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config" (OuterVolumeSpecName: "console-config") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:50:06.632435 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.632393    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:50:06.632510 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.632452    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:50:06.634222 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.634199    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:50:06.634712 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.634682    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:50:06.634821 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.634688    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8" (OuterVolumeSpecName: "kube-api-access-pnxq8") pod "ed2abf62-c4de-412b-bf5e-d84dceaf13b6" (UID: "ed2abf62-c4de-412b-bf5e-d84dceaf13b6"). InnerVolumeSpecName "kube-api-access-pnxq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:50:06.733253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733222    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-oauth-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733248    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-service-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733258    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnxq8\" (UniqueName: \"kubernetes.io/projected/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-kube-api-access-pnxq8\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733268    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733277    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733286    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-trusted-ca-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:06.733470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:06.733294    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2abf62-c4de-412b-bf5e-d84dceaf13b6-console-oauth-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:07.297766 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297685    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688cbb467f-52gpj_ed2abf62-c4de-412b-bf5e-d84dceaf13b6/console/0.log"
May 28 17:50:07.297766 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297723    2566 generic.go:358] "Generic (PLEG): container finished" podID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" containerID="81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514" exitCode=2
May 28 17:50:07.298275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297788    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cbb467f-52gpj"
May 28 17:50:07.298275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297796    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cbb467f-52gpj" event={"ID":"ed2abf62-c4de-412b-bf5e-d84dceaf13b6","Type":"ContainerDied","Data":"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"}
May 28 17:50:07.298275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297821    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cbb467f-52gpj" event={"ID":"ed2abf62-c4de-412b-bf5e-d84dceaf13b6","Type":"ContainerDied","Data":"a04a19e9c037776bee8573c04e74d9697df25a10cab0aba8dd537fb98a086e17"}
May 28 17:50:07.298275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.297835    2566 scope.go:117] "RemoveContainer" containerID="81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"
May 28 17:50:07.306402 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.306386    2566 scope.go:117] "RemoveContainer" containerID="81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"
May 28 17:50:07.306690 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:50:07.306670    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514\": container with ID starting with 81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514 not found: ID does not exist" containerID="81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"
May 28 17:50:07.306760 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.306701    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514"} err="failed to get container status \"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514\": rpc error: code = NotFound desc = could not find container \"81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514\": container with ID starting with 81928552e16a4df25829ad3588b06dd503edec714af4138a7b45cb147d2a8514 not found: ID does not exist"
May 28 17:50:07.314633 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.314610    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:50:07.319947 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:07.319928    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688cbb467f-52gpj"]
May 28 17:50:09.031317 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:09.031281    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" path="/var/lib/kubelet/pods/ed2abf62-c4de-412b-bf5e-d84dceaf13b6/volumes"
May 28 17:50:10.879163 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.879129    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"]
May 28 17:50:10.879523 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.879447    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" containerName="console"
May 28 17:50:10.879523 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.879459    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" containerName="console"
May 28 17:50:10.879523 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.879511    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed2abf62-c4de-412b-bf5e-d84dceaf13b6" containerName="console"
May 28 17:50:10.882529 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.882512    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:10.885866 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.885843    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:50:10.886015 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.885845    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:50:10.886919 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.886906    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:50:10.891598 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.891577    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"]
May 28 17:50:10.965841 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.965818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:10.965989 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.965855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:10.965989 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:10.965932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmh6k\" (UniqueName: \"kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.066477 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.066444    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmh6k\" (UniqueName: \"kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.066662 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.066508    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.066662 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.066535    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.066897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.066851    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.066995 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.066929    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.075164 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.075143    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmh6k\" (UniqueName: \"kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.192862 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.192837    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:11.320896 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:11.320808    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"]
May 28 17:50:11.323644 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:11.323615    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda707ffac_7bdf_45df_9983_5317d09b76d4.slice/crio-0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae WatchSource:0}: Error finding container 0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae: Status 404 returned error can't find the container with id 0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae
May 28 17:50:12.317427 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:12.317380    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd" event={"ID":"a707ffac-7bdf-45df-9983-5317d09b76d4","Type":"ContainerStarted","Data":"0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae"}
May 28 17:50:18.338138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:18.338055    2566 generic.go:358] "Generic (PLEG): container finished" podID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerID="c115a58199a70ef50d6a7b7778860b9973c85d82b17439add2a46c10152ea303" exitCode=0
May 28 17:50:18.338138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:18.338094    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd" event={"ID":"a707ffac-7bdf-45df-9983-5317d09b76d4","Type":"ContainerDied","Data":"c115a58199a70ef50d6a7b7778860b9973c85d82b17439add2a46c10152ea303"}
May 28 17:50:21.349591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:21.349513    2566 generic.go:358] "Generic (PLEG): container finished" podID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerID="d1d1c37d9880d9a468cd7f519b9e878dfa0841712a4d2c7bd60804aa57065399" exitCode=0
May 28 17:50:21.349591 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:21.349585    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd" event={"ID":"a707ffac-7bdf-45df-9983-5317d09b76d4","Type":"ContainerDied","Data":"d1d1c37d9880d9a468cd7f519b9e878dfa0841712a4d2c7bd60804aa57065399"}
May 28 17:50:27.371147 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:27.371052    2566 generic.go:358] "Generic (PLEG): container finished" podID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerID="31d18e1e1f5cf54c9ffcb803a59dda0835b41e66f93c721b858b122b94237696" exitCode=0
May 28 17:50:27.371477 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:27.371149    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd" event={"ID":"a707ffac-7bdf-45df-9983-5317d09b76d4","Type":"ContainerDied","Data":"31d18e1e1f5cf54c9ffcb803a59dda0835b41e66f93c721b858b122b94237696"}
May 28 17:50:28.505407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.505384    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:28.632176 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.632090    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util\") pod \"a707ffac-7bdf-45df-9983-5317d09b76d4\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") "
May 28 17:50:28.632176 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.632173    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmh6k\" (UniqueName: \"kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k\") pod \"a707ffac-7bdf-45df-9983-5317d09b76d4\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") "
May 28 17:50:28.632407 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.632204    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle\") pod \"a707ffac-7bdf-45df-9983-5317d09b76d4\" (UID: \"a707ffac-7bdf-45df-9983-5317d09b76d4\") "
May 28 17:50:28.633075 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.633046    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle" (OuterVolumeSpecName: "bundle") pod "a707ffac-7bdf-45df-9983-5317d09b76d4" (UID: "a707ffac-7bdf-45df-9983-5317d09b76d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:50:28.634466 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.634444    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k" (OuterVolumeSpecName: "kube-api-access-qmh6k") pod "a707ffac-7bdf-45df-9983-5317d09b76d4" (UID: "a707ffac-7bdf-45df-9983-5317d09b76d4"). InnerVolumeSpecName "kube-api-access-qmh6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:50:28.638083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.638060    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util" (OuterVolumeSpecName: "util") pod "a707ffac-7bdf-45df-9983-5317d09b76d4" (UID: "a707ffac-7bdf-45df-9983-5317d09b76d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:50:28.732859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.732825    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmh6k\" (UniqueName: \"kubernetes.io/projected/a707ffac-7bdf-45df-9983-5317d09b76d4-kube-api-access-qmh6k\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:28.732859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.732855    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:28.732859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:28.732866    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a707ffac-7bdf-45df-9983-5317d09b76d4-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:29.378253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:29.378171    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd" event={"ID":"a707ffac-7bdf-45df-9983-5317d09b76d4","Type":"ContainerDied","Data":"0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae"}
May 28 17:50:29.378253 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:29.378202    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9sjqd"
May 28 17:50:29.378430 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:29.378208    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f3dcfb4b353843e40587e6d29fe124d73c448d8768b168b44cf81f481a2dfae"
May 28 17:50:33.723549 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723512    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"]
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723820    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="util"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723830    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="util"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723846    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="pull"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723851    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="pull"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723857    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="extract"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723863    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="extract"
May 28 17:50:33.723937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.723935    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a707ffac-7bdf-45df-9983-5317d09b76d4" containerName="extract"
May 28 17:50:33.726716 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.726700    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.729248 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.729209    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 17:50:33.729370 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.729256    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 17:50:33.729370 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.729315    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d8pt8\""
May 28 17:50:33.738223 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.738197    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"]
May 28 17:50:33.873113 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.873075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9prhv\" (UniqueName: \"kubernetes.io/projected/7b712c97-57ac-4965-b3db-338bab8e445a-kube-api-access-9prhv\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.873265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.873122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b712c97-57ac-4965-b3db-338bab8e445a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.974216 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.974139    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9prhv\" (UniqueName: \"kubernetes.io/projected/7b712c97-57ac-4965-b3db-338bab8e445a-kube-api-access-9prhv\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.974216 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.974181    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b712c97-57ac-4965-b3db-338bab8e445a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.974531 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.974515    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b712c97-57ac-4965-b3db-338bab8e445a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:33.981682 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:33.981656    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9prhv\" (UniqueName: \"kubernetes.io/projected/7b712c97-57ac-4965-b3db-338bab8e445a-kube-api-access-9prhv\") pod \"cert-manager-operator-controller-manager-54b9655956-zqzbz\" (UID: \"7b712c97-57ac-4965-b3db-338bab8e445a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:34.035888 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:34.035851    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"
May 28 17:50:34.172150 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:34.172110    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz"]
May 28 17:50:34.175671 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:34.175641    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b712c97_57ac_4965_b3db_338bab8e445a.slice/crio-575b3630c0e2381319b2b1837e2f890b55b9849329857055481f6a2f9df15ae5 WatchSource:0}: Error finding container 575b3630c0e2381319b2b1837e2f890b55b9849329857055481f6a2f9df15ae5: Status 404 returned error can't find the container with id 575b3630c0e2381319b2b1837e2f890b55b9849329857055481f6a2f9df15ae5
May 28 17:50:34.393936 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:34.393836    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz" event={"ID":"7b712c97-57ac-4965-b3db-338bab8e445a","Type":"ContainerStarted","Data":"575b3630c0e2381319b2b1837e2f890b55b9849329857055481f6a2f9df15ae5"}
May 28 17:50:36.402336 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:36.402300    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz" event={"ID":"7b712c97-57ac-4965-b3db-338bab8e445a","Type":"ContainerStarted","Data":"97cfb8e52934f7375eafa01089979024279e47291d6a218d7558e1dc43da8f44"}
May 28 17:50:36.426045 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:36.425999    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zqzbz" podStartSLOduration=1.935751013 podStartE2EDuration="3.425985683s" podCreationTimestamp="2026-05-28 17:50:33 +0000 UTC" firstStartedPulling="2026-05-28 17:50:34.179036953 +0000 UTC m=+401.781352547" lastFinishedPulling="2026-05-28 17:50:35.669271622 +0000 UTC m=+403.271587217" observedRunningTime="2026-05-28 17:50:36.42434887 +0000 UTC m=+404.026664484" watchObservedRunningTime="2026-05-28 17:50:36.425985683 +0000 UTC m=+404.028301296"
May 28 17:50:38.070671 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.070633    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"]
May 28 17:50:38.073040 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.073024    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.075906 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.075863    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:50:38.075906 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.075868    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:50:38.077217 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.077204    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:50:38.082656 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.082627    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"]
May 28 17:50:38.104539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.104509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.104638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.104560    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.104638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.104593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8nqt\" (UniqueName: \"kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.206020 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.205990    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.206153 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.206033    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8nqt\" (UniqueName: \"kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.206153 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.206102    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.206363 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.206343    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.206440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.206409    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.216506 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.216479    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8nqt\" (UniqueName: \"kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.383670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.383591    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:38.508271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:38.508245    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"]
May 28 17:50:38.510238 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:38.510205    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b54f29_15c6_4d94_9c99_48c730250c2b.slice/crio-8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67 WatchSource:0}: Error finding container 8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67: Status 404 returned error can't find the container with id 8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67
May 28 17:50:39.414349 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:39.414313    2566 generic.go:358] "Generic (PLEG): container finished" podID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerID="de04f1236919a62b433a20d2ab83351af202b4a3141344f0bbc7034d62747e50" exitCode=0
May 28 17:50:39.414700 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:39.414356    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898" event={"ID":"47b54f29-15c6-4d94-9c99-48c730250c2b","Type":"ContainerDied","Data":"de04f1236919a62b433a20d2ab83351af202b4a3141344f0bbc7034d62747e50"}
May 28 17:50:39.414700 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:39.414386    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898" event={"ID":"47b54f29-15c6-4d94-9c99-48c730250c2b","Type":"ContainerStarted","Data":"8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67"}
May 28 17:50:40.177105 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.177073    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6fhsm"]
May 28 17:50:40.179999 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.179977    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.182859 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.182835    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 17:50:40.182990 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.182909    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 17:50:40.188651 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.188629    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6fhsm"]
May 28 17:50:40.221136 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.221106    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.221294 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.221162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2wz\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-kube-api-access-vf2wz\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.322482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.322448    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.322646 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.322499    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2wz\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-kube-api-access-vf2wz\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.333225 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.333191    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.333387 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.333360    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2wz\" (UniqueName: \"kubernetes.io/projected/1757aef4-3589-4ce9-b005-b69917a097df-kube-api-access-vf2wz\") pod \"cert-manager-cainjector-68b757865b-6fhsm\" (UID: \"1757aef4-3589-4ce9-b005-b69917a097df\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.499467 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.499432    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm"
May 28 17:50:40.644551 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:40.644501    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6fhsm"]
May 28 17:50:40.647510 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:40.647453    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1757aef4_3589_4ce9_b005_b69917a097df.slice/crio-018b952eca3f5e90092a6dc0213bb6c0f23ba5fef81b958dd1b9c70c9b6361ec WatchSource:0}: Error finding container 018b952eca3f5e90092a6dc0213bb6c0f23ba5fef81b958dd1b9c70c9b6361ec: Status 404 returned error can't find the container with id 018b952eca3f5e90092a6dc0213bb6c0f23ba5fef81b958dd1b9c70c9b6361ec
May 28 17:50:41.422623 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:41.422578    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm" event={"ID":"1757aef4-3589-4ce9-b005-b69917a097df","Type":"ContainerStarted","Data":"018b952eca3f5e90092a6dc0213bb6c0f23ba5fef81b958dd1b9c70c9b6361ec"}
May 28 17:50:42.427713 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:42.427675    2566 generic.go:358] "Generic (PLEG): container finished" podID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerID="0e0310e049c207b536385db7db97d4397318b1deae2fe2335fa5f00fb0dce480" exitCode=0
May 28 17:50:42.428148 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:42.427770    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898" event={"ID":"47b54f29-15c6-4d94-9c99-48c730250c2b","Type":"ContainerDied","Data":"0e0310e049c207b536385db7db97d4397318b1deae2fe2335fa5f00fb0dce480"}
May 28 17:50:43.433442 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:43.433406    2566 generic.go:358] "Generic (PLEG): container finished" podID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerID="aebec73525773e7cb7ee81cfe77aa247c1134e9e3f55fc067da526033b8ac115" exitCode=0
May 28 17:50:43.433858 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:43.433490    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898" event={"ID":"47b54f29-15c6-4d94-9c99-48c730250c2b","Type":"ContainerDied","Data":"aebec73525773e7cb7ee81cfe77aa247c1134e9e3f55fc067da526033b8ac115"}
May 28 17:50:44.190289 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.190249    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-54tp5"]
May 28 17:50:44.193725 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.193704    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.196635 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.196617    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sw5lr\""
May 28 17:50:44.201035 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.201007    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-54tp5"]
May 28 17:50:44.258029 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.257995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgnf\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-kube-api-access-wjgnf\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.258195 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.258064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.359295 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.359256    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.359457 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.359343    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgnf\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-kube-api-access-wjgnf\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.367108 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.367071    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.367224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.367117    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgnf\" (UniqueName: \"kubernetes.io/projected/7127e30e-c116-48ef-9b36-670bb17b68ce-kube-api-access-wjgnf\") pod \"cert-manager-webhook-587ccfb98-54tp5\" (UID: \"7127e30e-c116-48ef-9b36-670bb17b68ce\") " pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.438717 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.438679    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm" event={"ID":"1757aef4-3589-4ce9-b005-b69917a097df","Type":"ContainerStarted","Data":"1848cbed0f7bff4fff9b7d882c9dc9fd4357e92e08b7218d736b35e902b3b542"}
May 28 17:50:44.456247 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.456153    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-6fhsm" podStartSLOduration=1.291700188 podStartE2EDuration="4.456130575s" podCreationTimestamp="2026-05-28 17:50:40 +0000 UTC" firstStartedPulling="2026-05-28 17:50:40.649314837 +0000 UTC m=+408.251630434" lastFinishedPulling="2026-05-28 17:50:43.813745215 +0000 UTC m=+411.416060821" observedRunningTime="2026-05-28 17:50:44.454018168 +0000 UTC m=+412.056333782" watchObservedRunningTime="2026-05-28 17:50:44.456130575 +0000 UTC m=+412.058446190"
May 28 17:50:44.504202 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.504165    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:44.578141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.578097    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:44.648397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.648257    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-54tp5"]
May 28 17:50:44.650451 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:44.650417    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7127e30e_c116_48ef_9b36_670bb17b68ce.slice/crio-25a8787efeaf4b875495c9357f88c462bd7b4a9f74ff8fdad100ea37fe0a9647 WatchSource:0}: Error finding container 25a8787efeaf4b875495c9357f88c462bd7b4a9f74ff8fdad100ea37fe0a9647: Status 404 returned error can't find the container with id 25a8787efeaf4b875495c9357f88c462bd7b4a9f74ff8fdad100ea37fe0a9647
May 28 17:50:44.662437 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.662415    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8nqt\" (UniqueName: \"kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt\") pod \"47b54f29-15c6-4d94-9c99-48c730250c2b\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") "
May 28 17:50:44.662546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.662534    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle\") pod \"47b54f29-15c6-4d94-9c99-48c730250c2b\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") "
May 28 17:50:44.662622 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.662560    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util\") pod \"47b54f29-15c6-4d94-9c99-48c730250c2b\" (UID: \"47b54f29-15c6-4d94-9c99-48c730250c2b\") "
May 28 17:50:44.662965 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.662938    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle" (OuterVolumeSpecName: "bundle") pod "47b54f29-15c6-4d94-9c99-48c730250c2b" (UID: "47b54f29-15c6-4d94-9c99-48c730250c2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:50:44.664617 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.664598    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt" (OuterVolumeSpecName: "kube-api-access-k8nqt") pod "47b54f29-15c6-4d94-9c99-48c730250c2b" (UID: "47b54f29-15c6-4d94-9c99-48c730250c2b"). InnerVolumeSpecName "kube-api-access-k8nqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:50:44.667151 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.667118    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util" (OuterVolumeSpecName: "util") pod "47b54f29-15c6-4d94-9c99-48c730250c2b" (UID: "47b54f29-15c6-4d94-9c99-48c730250c2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:50:44.764155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.764073    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:44.764155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.764103    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b54f29-15c6-4d94-9c99-48c730250c2b-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:44.764155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:44.764113    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8nqt\" (UniqueName: \"kubernetes.io/projected/47b54f29-15c6-4d94-9c99-48c730250c2b-kube-api-access-k8nqt\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:50:45.443992 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.443955    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898" event={"ID":"47b54f29-15c6-4d94-9c99-48c730250c2b","Type":"ContainerDied","Data":"8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67"}
May 28 17:50:45.443992 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.443989    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2898"
May 28 17:50:45.444522 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.443993    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aed5f2f5b77a647b13ff43be12add5d63a3a7551cbff839a3231fc1ffa1cd67"
May 28 17:50:45.445503 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.445475    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5" event={"ID":"7127e30e-c116-48ef-9b36-670bb17b68ce","Type":"ContainerStarted","Data":"37066a15f24404d2eb30396daaae45bf5817855641c6455faf0dc7c437362e07"}
May 28 17:50:45.445665 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.445508    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5" event={"ID":"7127e30e-c116-48ef-9b36-670bb17b68ce","Type":"ContainerStarted","Data":"25a8787efeaf4b875495c9357f88c462bd7b4a9f74ff8fdad100ea37fe0a9647"}
May 28 17:50:45.445665 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.445561    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:45.463102 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:45.463054    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5" podStartSLOduration=1.463043821 podStartE2EDuration="1.463043821s" podCreationTimestamp="2026-05-28 17:50:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:50:45.460447786 +0000 UTC m=+413.062763392" watchObservedRunningTime="2026-05-28 17:50:45.463043821 +0000 UTC m=+413.065359433"
May 28 17:50:51.451374 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:51.451343    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-54tp5"
May 28 17:50:54.874469 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874431    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"]
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874776    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="util"
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874788    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="util"
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874795    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="pull"
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874800    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="pull"
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874818    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="extract"
May 28 17:50:54.874849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874825    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="extract"
May 28 17:50:54.875072 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.874891    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="47b54f29-15c6-4d94-9c99-48c730250c2b" containerName="extract"
May 28 17:50:54.949461 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.949425    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"]
May 28 17:50:54.949630 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.949530    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:54.952509 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.952482    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 17:50:54.953604 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.953584    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 17:50:54.953701 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:54.953600    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-27kvc\""
May 28 17:50:55.051192 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.051162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccadcca-01a4-4341-be33-0d6f29382cf2-tmp\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.051343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.051214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wfh\" (UniqueName: \"kubernetes.io/projected/7ccadcca-01a4-4341-be33-0d6f29382cf2-kube-api-access-z8wfh\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.152524 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.152445    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wfh\" (UniqueName: \"kubernetes.io/projected/7ccadcca-01a4-4341-be33-0d6f29382cf2-kube-api-access-z8wfh\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.152524 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.152522    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccadcca-01a4-4341-be33-0d6f29382cf2-tmp\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.152857 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.152841    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ccadcca-01a4-4341-be33-0d6f29382cf2-tmp\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.164577 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.164555    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wfh\" (UniqueName: \"kubernetes.io/projected/7ccadcca-01a4-4341-be33-0d6f29382cf2-kube-api-access-z8wfh\") pod \"openshift-lws-operator-bfc7f696d-nfhdj\" (UID: \"7ccadcca-01a4-4341-be33-0d6f29382cf2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.259363 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.259330    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"
May 28 17:50:55.387126 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.387049    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj"]
May 28 17:50:55.389462 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:50:55.389436    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ccadcca_01a4_4341_be33_0d6f29382cf2.slice/crio-7e3043227923b36936bd7bb3f1023fd39dcfdbcf9f996c6406e136aba5777d2f WatchSource:0}: Error finding container 7e3043227923b36936bd7bb3f1023fd39dcfdbcf9f996c6406e136aba5777d2f: Status 404 returned error can't find the container with id 7e3043227923b36936bd7bb3f1023fd39dcfdbcf9f996c6406e136aba5777d2f
May 28 17:50:55.481980 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:55.481952    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj" event={"ID":"7ccadcca-01a4-4341-be33-0d6f29382cf2","Type":"ContainerStarted","Data":"7e3043227923b36936bd7bb3f1023fd39dcfdbcf9f996c6406e136aba5777d2f"}
May 28 17:50:58.494992 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:58.494903    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj" event={"ID":"7ccadcca-01a4-4341-be33-0d6f29382cf2","Type":"ContainerStarted","Data":"cd0a109dcd6e34bc68c98d2a189cddc2840ce4077a4cd5cde22f03d2f2e8ef1f"}
May 28 17:50:58.510340 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:50:58.510298    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-nfhdj" podStartSLOduration=1.680858568 podStartE2EDuration="4.510286389s" podCreationTimestamp="2026-05-28 17:50:54 +0000 UTC" firstStartedPulling="2026-05-28 17:50:55.391157892 +0000 UTC m=+422.993473489" lastFinishedPulling="2026-05-28 17:50:58.220585716 +0000 UTC m=+425.822901310" observedRunningTime="2026-05-28 17:50:58.50935161 +0000 UTC m=+426.111667222" watchObservedRunningTime="2026-05-28 17:50:58.510286389 +0000 UTC m=+426.112602003"
May 28 17:51:02.655607 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.655577    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"]
May 28 17:51:02.658638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.658620    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.661179 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.661149    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:51:02.661179 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.661164    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:51:02.661342 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.661159    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:51:02.665229 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.665204    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"]
May 28 17:51:02.720813 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.720779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.720983 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.720822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.720983 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.720931    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7j8\" (UniqueName: \"kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.821794 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.821759    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.821970 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.821805    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.821970 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.821900    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7j8\" (UniqueName: \"kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.822176 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.822159    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.822224 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.822206    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.830465 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.830439    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7j8\" (UniqueName: \"kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:02.968468 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:02.968442    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:03.103811 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:03.103778    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"]
May 28 17:51:03.108225 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:03.108195    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4c2b6a_45d8_42b2_ba79_f711661805a6.slice/crio-b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d WatchSource:0}: Error finding container b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d: Status 404 returned error can't find the container with id b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d
May 28 17:51:03.513557 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:03.513522    2566 generic.go:358] "Generic (PLEG): container finished" podID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerID="7af778865251c61476dbb860ac21a9735ec8ea31fdc390e5ce58d268c103c19f" exitCode=0
May 28 17:51:03.513743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:03.513604    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4" event={"ID":"de4c2b6a-45d8-42b2-ba79-f711661805a6","Type":"ContainerDied","Data":"7af778865251c61476dbb860ac21a9735ec8ea31fdc390e5ce58d268c103c19f"}
May 28 17:51:03.513743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:03.513644    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4" event={"ID":"de4c2b6a-45d8-42b2-ba79-f711661805a6","Type":"ContainerStarted","Data":"b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d"}
May 28 17:51:04.519102 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:04.519066    2566 generic.go:358] "Generic (PLEG): container finished" podID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerID="527e166dbe0bdaedb6f999ebbedf6bf17f28694a3690d1aeac1e0aff676cda0f" exitCode=0
May 28 17:51:04.519465 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:04.519158    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4" event={"ID":"de4c2b6a-45d8-42b2-ba79-f711661805a6","Type":"ContainerDied","Data":"527e166dbe0bdaedb6f999ebbedf6bf17f28694a3690d1aeac1e0aff676cda0f"}
May 28 17:51:05.524798 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:05.524756    2566 generic.go:358] "Generic (PLEG): container finished" podID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerID="4c03daf39d240f0576700579043935e5e24c9e1ce545b73a3c5fad0a5053fca6" exitCode=0
May 28 17:51:05.525251 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:05.524845    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4" event={"ID":"de4c2b6a-45d8-42b2-ba79-f711661805a6","Type":"ContainerDied","Data":"4c03daf39d240f0576700579043935e5e24c9e1ce545b73a3c5fad0a5053fca6"}
May 28 17:51:06.657100 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.657073    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:06.756141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.756107    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util\") pod \"de4c2b6a-45d8-42b2-ba79-f711661805a6\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") "
May 28 17:51:06.756362 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.756201    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle\") pod \"de4c2b6a-45d8-42b2-ba79-f711661805a6\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") "
May 28 17:51:06.756362 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.756220    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn7j8\" (UniqueName: \"kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8\") pod \"de4c2b6a-45d8-42b2-ba79-f711661805a6\" (UID: \"de4c2b6a-45d8-42b2-ba79-f711661805a6\") "
May 28 17:51:06.757061 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.757029    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle" (OuterVolumeSpecName: "bundle") pod "de4c2b6a-45d8-42b2-ba79-f711661805a6" (UID: "de4c2b6a-45d8-42b2-ba79-f711661805a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:06.758735 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.758704    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8" (OuterVolumeSpecName: "kube-api-access-tn7j8") pod "de4c2b6a-45d8-42b2-ba79-f711661805a6" (UID: "de4c2b6a-45d8-42b2-ba79-f711661805a6"). InnerVolumeSpecName "kube-api-access-tn7j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:51:06.762231 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.762205    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util" (OuterVolumeSpecName: "util") pod "de4c2b6a-45d8-42b2-ba79-f711661805a6" (UID: "de4c2b6a-45d8-42b2-ba79-f711661805a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:06.856870 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.856787    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:06.856870 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.856814    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de4c2b6a-45d8-42b2-ba79-f711661805a6-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:06.856870 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:06.856824    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn7j8\" (UniqueName: \"kubernetes.io/projected/de4c2b6a-45d8-42b2-ba79-f711661805a6-kube-api-access-tn7j8\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:07.533411 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:07.533372    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4" event={"ID":"de4c2b6a-45d8-42b2-ba79-f711661805a6","Type":"ContainerDied","Data":"b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d"}
May 28 17:51:07.533411 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:07.533409    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1cbf504ba669af4365142dd086d3cb16180af9aa163ab1315c503ed60fdef3d"
May 28 17:51:07.533620 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:07.533426    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5j7jm4"
May 28 17:51:12.659558 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659468    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"]
May 28 17:51:12.659947 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659930    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="util"
May 28 17:51:12.660010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659950    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="util"
May 28 17:51:12.660010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659961    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="extract"
May 28 17:51:12.660010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659966    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="extract"
May 28 17:51:12.660010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.659996    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="pull"
May 28 17:51:12.660010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.660005    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="pull"
May 28 17:51:12.660151 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.660075    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="de4c2b6a-45d8-42b2-ba79-f711661805a6" containerName="extract"
May 28 17:51:12.662286 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.662271    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.664922 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.664902    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:51:12.666196 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.666175    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:51:12.666254 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.666205    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:51:12.671970 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.671944    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"]
May 28 17:51:12.807931 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.807899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnsng\" (UniqueName: \"kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.808099 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.807943    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.808099 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.808000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.909371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.909339    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.909533 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.909489    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnsng\" (UniqueName: \"kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.909610 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.909534    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.909724 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.909705    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.909765 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.909755    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.923834 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.923807    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnsng\" (UniqueName: \"kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:12.972439 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:12.972412    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:13.109216 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:13.109148    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"]
May 28 17:51:13.111590 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:13.111550    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77144c5_612f_4706_a5c6_7226e0b5a81b.slice/crio-99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec WatchSource:0}: Error finding container 99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec: Status 404 returned error can't find the container with id 99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec
May 28 17:51:13.553951 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:13.553922    2566 generic.go:358] "Generic (PLEG): container finished" podID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerID="10e25caa99064fc889d9d19161caca16a4bc591092859068f52ef58d0236d7b3" exitCode=0
May 28 17:51:13.554112 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:13.554000    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk" event={"ID":"a77144c5-612f-4706-a5c6-7226e0b5a81b","Type":"ContainerDied","Data":"10e25caa99064fc889d9d19161caca16a4bc591092859068f52ef58d0236d7b3"}
May 28 17:51:13.554112 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:13.554040    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk" event={"ID":"a77144c5-612f-4706-a5c6-7226e0b5a81b","Type":"ContainerStarted","Data":"99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec"}
May 28 17:51:14.543289 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.543195    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"]
May 28 17:51:14.545609 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.545586    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.549479 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.549460    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 17:51:14.549638 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.549620    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bpqhj\""
May 28 17:51:14.549714 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.549654    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 17:51:14.549829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.549756    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 17:51:14.549974 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.549955    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 17:51:14.558664 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.558643    2566 generic.go:358] "Generic (PLEG): container finished" podID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerID="71cb508188dd01f2d222e5f10b22dca871f363754446472bb9d458991f71ad88" exitCode=0
May 28 17:51:14.558748 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.558728    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk" event={"ID":"a77144c5-612f-4706-a5c6-7226e0b5a81b","Type":"ContainerDied","Data":"71cb508188dd01f2d222e5f10b22dca871f363754446472bb9d458991f71ad88"}
May 28 17:51:14.572415 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.572393    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"]
May 28 17:51:14.625798 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.625757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqdqj\" (UniqueName: \"kubernetes.io/projected/7486569b-213b-4d73-b3bd-d8e1df01631b-kube-api-access-xqdqj\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.625962 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.625902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.625962 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.625936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.726967 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.726937    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.727106 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.726979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.727106 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.727060    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdqj\" (UniqueName: \"kubernetes.io/projected/7486569b-213b-4d73-b3bd-d8e1df01631b-kube-api-access-xqdqj\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.729570 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.729543    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.729668 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.729624    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7486569b-213b-4d73-b3bd-d8e1df01631b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.735686 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.735665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqdqj\" (UniqueName: \"kubernetes.io/projected/7486569b-213b-4d73-b3bd-d8e1df01631b-kube-api-access-xqdqj\") pod \"opendatahub-operator-controller-manager-65fbbfd459-8ndh6\" (UID: \"7486569b-213b-4d73-b3bd-d8e1df01631b\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:14.856922 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:14.856815    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:15.001715 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:15.001664    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"]
May 28 17:51:15.004675 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:15.004635    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7486569b_213b_4d73_b3bd_d8e1df01631b.slice/crio-02d691af82db5fccad273d208b6edd80617baeffbac094f97153309ba7ab7512 WatchSource:0}: Error finding container 02d691af82db5fccad273d208b6edd80617baeffbac094f97153309ba7ab7512: Status 404 returned error can't find the container with id 02d691af82db5fccad273d208b6edd80617baeffbac094f97153309ba7ab7512
May 28 17:51:15.566087 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:15.565976    2566 generic.go:358] "Generic (PLEG): container finished" podID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerID="3552451ea09802d8bf3f3e104fd9c43618957deb91a6b28bca2c30469305c9a8" exitCode=0
May 28 17:51:15.566087 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:15.566073    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk" event={"ID":"a77144c5-612f-4706-a5c6-7226e0b5a81b","Type":"ContainerDied","Data":"3552451ea09802d8bf3f3e104fd9c43618957deb91a6b28bca2c30469305c9a8"}
May 28 17:51:15.567562 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:15.567525    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6" event={"ID":"7486569b-213b-4d73-b3bd-d8e1df01631b","Type":"ContainerStarted","Data":"02d691af82db5fccad273d208b6edd80617baeffbac094f97153309ba7ab7512"}
May 28 17:51:17.489302 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.489278    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:17.576641 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.576613    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk" event={"ID":"a77144c5-612f-4706-a5c6-7226e0b5a81b","Type":"ContainerDied","Data":"99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec"}
May 28 17:51:17.576746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.576650    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99891dae3d3d2dfe60ae043ae2f5af6a2022108526475dd1bc51f0d4d52a40ec"
May 28 17:51:17.576746 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.576660    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9dp4tk"
May 28 17:51:17.578232 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.578212    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:17.600371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.600326    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6" podStartSLOduration=1.101876775 podStartE2EDuration="3.600309657s" podCreationTimestamp="2026-05-28 17:51:14 +0000 UTC" firstStartedPulling="2026-05-28 17:51:15.007854445 +0000 UTC m=+442.610170039" lastFinishedPulling="2026-05-28 17:51:17.506287327 +0000 UTC m=+445.108602921" observedRunningTime="2026-05-28 17:51:17.600103125 +0000 UTC m=+445.202418738" watchObservedRunningTime="2026-05-28 17:51:17.600309657 +0000 UTC m=+445.202625271"
May 28 17:51:17.651363 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.651333    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnsng\" (UniqueName: \"kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng\") pod \"a77144c5-612f-4706-a5c6-7226e0b5a81b\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") "
May 28 17:51:17.651522 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.651384    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util\") pod \"a77144c5-612f-4706-a5c6-7226e0b5a81b\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") "
May 28 17:51:17.651522 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.651498    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle\") pod \"a77144c5-612f-4706-a5c6-7226e0b5a81b\" (UID: \"a77144c5-612f-4706-a5c6-7226e0b5a81b\") "
May 28 17:51:17.652515 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.652484    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle" (OuterVolumeSpecName: "bundle") pod "a77144c5-612f-4706-a5c6-7226e0b5a81b" (UID: "a77144c5-612f-4706-a5c6-7226e0b5a81b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:17.653820 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.653795    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng" (OuterVolumeSpecName: "kube-api-access-fnsng") pod "a77144c5-612f-4706-a5c6-7226e0b5a81b" (UID: "a77144c5-612f-4706-a5c6-7226e0b5a81b"). InnerVolumeSpecName "kube-api-access-fnsng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:51:17.658098 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.658075    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util" (OuterVolumeSpecName: "util") pod "a77144c5-612f-4706-a5c6-7226e0b5a81b" (UID: "a77144c5-612f-4706-a5c6-7226e0b5a81b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:17.753265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.753178    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:17.753265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.753212    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnsng\" (UniqueName: \"kubernetes.io/projected/a77144c5-612f-4706-a5c6-7226e0b5a81b-kube-api-access-fnsng\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:17.753265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:17.753223    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77144c5-612f-4706-a5c6-7226e0b5a81b-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:18.583774 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:18.583736    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6" event={"ID":"7486569b-213b-4d73-b3bd-d8e1df01631b","Type":"ContainerStarted","Data":"2d22e8c21532a55f59acd36a18f97754c67d8f88bdb47e7ab5768b13ed2fa2d3"}
May 28 17:51:29.589379 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:29.589349    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-8ndh6"
May 28 17:51:32.384769 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.384734    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"]
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385124    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="extract"
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385136    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="extract"
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385149    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="util"
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385155    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="util"
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385169    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="pull"
May 28 17:51:32.385187 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385178    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="pull"
May 28 17:51:32.385371 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.385228    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a77144c5-612f-4706-a5c6-7226e0b5a81b" containerName="extract"
May 28 17:51:32.388184 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.388166    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.390680 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.390658    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:51:32.391067 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.391048    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:51:32.391857 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.391841    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:51:32.399167 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.399146    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"]
May 28 17:51:32.478328 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.478297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.478491 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.478345    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgqrd\" (UniqueName: \"kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.478491 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.478451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.579361 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.579330    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgqrd\" (UniqueName: \"kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.579512 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.579390    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.579512 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.579424    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.579726 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.579711    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.579793 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.579775    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.591217 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.591186    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgqrd\" (UniqueName: \"kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.697716 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.697691    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:32.844422 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:32.844392    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33b7a80_1a4e_4cc7_a1c8_7b70645dc695.slice/crio-e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273 WatchSource:0}: Error finding container e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273: Status 404 returned error can't find the container with id e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273
May 28 17:51:32.845636 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.845606    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"]
May 28 17:51:32.999930 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:32.999848    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"]
May 28 17:51:33.002141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.002126    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.005196 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.005173    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 17:51:33.006278 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.006258    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x89mj\""
May 28 17:51:33.006278 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.006258    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 17:51:33.017002 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.016976    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"]
May 28 17:51:33.083214 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.083176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.083214 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.083215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tmp\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.083385 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.083340    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2xk\" (UniqueName: \"kubernetes.io/projected/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-kube-api-access-nx2xk\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.185001 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.184961    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.185203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.185033    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tmp\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.185203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.185106    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2xk\" (UniqueName: \"kubernetes.io/projected/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-kube-api-access-nx2xk\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.187537 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.187512    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tmp\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.187782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.187762    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.192795 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.192776    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2xk\" (UniqueName: \"kubernetes.io/projected/bba8bc6e-2449-4fc4-a9ae-ae03df655e8d-kube-api-access-nx2xk\") pod \"kube-auth-proxy-69d5fd6c96-sqrcz\" (UID: \"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.311963 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.311833    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"
May 28 17:51:33.447061 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.447030    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz"]
May 28 17:51:33.449018 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:33.448993    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba8bc6e_2449_4fc4_a9ae_ae03df655e8d.slice/crio-f7d58f36f2ee899a5040fcf1058d83b9b85ac243010c1068a042eb9e71666da1 WatchSource:0}: Error finding container f7d58f36f2ee899a5040fcf1058d83b9b85ac243010c1068a042eb9e71666da1: Status 404 returned error can't find the container with id f7d58f36f2ee899a5040fcf1058d83b9b85ac243010c1068a042eb9e71666da1
May 28 17:51:33.640613 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.640579    2566 generic.go:358] "Generic (PLEG): container finished" podID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerID="80763e7fdc3d96d098eefef39894744cf11eb09bbd7dd7d0f1f37ca49d0178a9" exitCode=0
May 28 17:51:33.640777 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.640674    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q" event={"ID":"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695","Type":"ContainerDied","Data":"80763e7fdc3d96d098eefef39894744cf11eb09bbd7dd7d0f1f37ca49d0178a9"}
May 28 17:51:33.640777 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.640712    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q" event={"ID":"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695","Type":"ContainerStarted","Data":"e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273"}
May 28 17:51:33.641919 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:33.641869    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz" event={"ID":"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d","Type":"ContainerStarted","Data":"f7d58f36f2ee899a5040fcf1058d83b9b85ac243010c1068a042eb9e71666da1"}
May 28 17:51:35.652474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.652377    2566 generic.go:358] "Generic (PLEG): container finished" podID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerID="3301bd0726f50796391eaa1669b8828cc91aa145de0fa5bf93e4deee0250f3ae" exitCode=0
May 28 17:51:35.652474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.652460    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q" event={"ID":"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695","Type":"ContainerDied","Data":"3301bd0726f50796391eaa1669b8828cc91aa145de0fa5bf93e4deee0250f3ae"}
May 28 17:51:35.973508 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.973469    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vgvct"]
May 28 17:51:35.976740 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.976709    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:35.979439 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.979403    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 17:51:35.979545 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.979409    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7gnzr\""
May 28 17:51:35.985225 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:35.984057    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vgvct"]
May 28 17:51:36.112193 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.112161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.112381 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.112318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4gnd\" (UniqueName: \"kubernetes.io/projected/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-kube-api-access-n4gnd\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.213233 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.213191    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4gnd\" (UniqueName: \"kubernetes.io/projected/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-kube-api-access-n4gnd\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.213417 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.213310    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.213490 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:36.213469    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 17:51:36.213562 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:36.213551    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert podName:2ebea2ff-cd18-4da1-9642-06e64c70bf7d nodeName:}" failed. No retries permitted until 2026-05-28 17:51:36.713528621 +0000 UTC m=+464.315844220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert") pod "odh-model-controller-858dbf95b8-vgvct" (UID: "2ebea2ff-cd18-4da1-9642-06e64c70bf7d") : secret "odh-model-controller-webhook-cert" not found
May 28 17:51:36.223154 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.223125    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4gnd\" (UniqueName: \"kubernetes.io/projected/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-kube-api-access-n4gnd\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.658663 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.658634    2566 generic.go:358] "Generic (PLEG): container finished" podID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerID="929fc1db24406707cd733c6948caf76246af21ef4edc8a67f310d85afc296e27" exitCode=0
May 28 17:51:36.659055 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.658723    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q" event={"ID":"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695","Type":"ContainerDied","Data":"929fc1db24406707cd733c6948caf76246af21ef4edc8a67f310d85afc296e27"}
May 28 17:51:36.716782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:36.716755    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:36.716950 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:36.716932    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 17:51:36.717028 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:36.717013    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert podName:2ebea2ff-cd18-4da1-9642-06e64c70bf7d nodeName:}" failed. No retries permitted until 2026-05-28 17:51:37.716990004 +0000 UTC m=+465.319305601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert") pod "odh-model-controller-858dbf95b8-vgvct" (UID: "2ebea2ff-cd18-4da1-9642-06e64c70bf7d") : secret "odh-model-controller-webhook-cert" not found
May 28 17:51:37.664179 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.664139    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz" event={"ID":"bba8bc6e-2449-4fc4-a9ae-ae03df655e8d","Type":"ContainerStarted","Data":"c8f71abe5d7bbb16543cb486a122b5892e99d2958276b3b4109d95ca287f5f34"}
May 28 17:51:37.679681 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.679540    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-sqrcz" podStartSLOduration=2.485867052 podStartE2EDuration="5.679524469s" podCreationTimestamp="2026-05-28 17:51:32 +0000 UTC" firstStartedPulling="2026-05-28 17:51:33.450836614 +0000 UTC m=+461.053152209" lastFinishedPulling="2026-05-28 17:51:36.644494008 +0000 UTC m=+464.246809626" observedRunningTime="2026-05-28 17:51:37.679167906 +0000 UTC m=+465.281483519" watchObservedRunningTime="2026-05-28 17:51:37.679524469 +0000 UTC m=+465.281840085"
May 28 17:51:37.725540 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.725492    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:37.728029 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.728005    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ebea2ff-cd18-4da1-9642-06e64c70bf7d-cert\") pod \"odh-model-controller-858dbf95b8-vgvct\" (UID: \"2ebea2ff-cd18-4da1-9642-06e64c70bf7d\") " pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:37.797012 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.796905    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:37.824366 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.824333    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:37.826570 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.826547    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle\") pod \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") "
May 28 17:51:37.826699 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.826633    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgqrd\" (UniqueName: \"kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd\") pod \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") "
May 28 17:51:37.826762 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.826721    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util\") pod \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\" (UID: \"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695\") "
May 28 17:51:37.827477 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.827445    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle" (OuterVolumeSpecName: "bundle") pod "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" (UID: "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:37.828857 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.828834    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd" (OuterVolumeSpecName: "kube-api-access-lgqrd") pod "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" (UID: "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695"). InnerVolumeSpecName "kube-api-access-lgqrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:51:37.834812 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.834777    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util" (OuterVolumeSpecName: "util") pod "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" (UID: "f33b7a80-1a4e-4cc7-a1c8-7b70645dc695"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:37.927686 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.927615    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:37.927686 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.927641    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:37.927686 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.927650    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgqrd\" (UniqueName: \"kubernetes.io/projected/f33b7a80-1a4e-4cc7-a1c8-7b70645dc695-kube-api-access-lgqrd\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:37.933275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:37.933253    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vgvct"]
May 28 17:51:37.935333 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:37.935301    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebea2ff_cd18_4da1_9642_06e64c70bf7d.slice/crio-9b4aef71f70085c639f285fa872b36227e096de3320c01674028fbfaf24b3a42 WatchSource:0}: Error finding container 9b4aef71f70085c639f285fa872b36227e096de3320c01674028fbfaf24b3a42: Status 404 returned error can't find the container with id 9b4aef71f70085c639f285fa872b36227e096de3320c01674028fbfaf24b3a42
May 28 17:51:38.669955 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:38.669912    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" event={"ID":"2ebea2ff-cd18-4da1-9642-06e64c70bf7d","Type":"ContainerStarted","Data":"9b4aef71f70085c639f285fa872b36227e096de3320c01674028fbfaf24b3a42"}
May 28 17:51:38.672159 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:38.672132    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q"
May 28 17:51:38.672292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:38.672150    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835m928q" event={"ID":"f33b7a80-1a4e-4cc7-a1c8-7b70645dc695","Type":"ContainerDied","Data":"e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273"}
May 28 17:51:38.672292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:38.672183    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e89f8b3a86e62fa985ef790b4825225d55d68c6670d8e0cc79c6df65e433c273"
May 28 17:51:40.681116 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:40.681080    2566 generic.go:358] "Generic (PLEG): container finished" podID="2ebea2ff-cd18-4da1-9642-06e64c70bf7d" containerID="0540e1da1eb3331acbc3b4170d9eb4e18353dab36929d5b297f338cfe4076dd3" exitCode=1
May 28 17:51:40.681499 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:40.681167    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" event={"ID":"2ebea2ff-cd18-4da1-9642-06e64c70bf7d","Type":"ContainerDied","Data":"0540e1da1eb3331acbc3b4170d9eb4e18353dab36929d5b297f338cfe4076dd3"}
May 28 17:51:40.681499 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:40.681339    2566 scope.go:117] "RemoveContainer" containerID="0540e1da1eb3331acbc3b4170d9eb4e18353dab36929d5b297f338cfe4076dd3"
May 28 17:51:41.686920 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.686854    2566 generic.go:358] "Generic (PLEG): container finished" podID="2ebea2ff-cd18-4da1-9642-06e64c70bf7d" containerID="2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c" exitCode=1
May 28 17:51:41.687341 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.686946    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" event={"ID":"2ebea2ff-cd18-4da1-9642-06e64c70bf7d","Type":"ContainerDied","Data":"2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c"}
May 28 17:51:41.687341 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.686991    2566 scope.go:117] "RemoveContainer" containerID="0540e1da1eb3331acbc3b4170d9eb4e18353dab36929d5b297f338cfe4076dd3"
May 28 17:51:41.687341 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.687193    2566 scope.go:117] "RemoveContainer" containerID="2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c"
May 28 17:51:41.687462 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:41.687439    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vgvct_opendatahub(2ebea2ff-cd18-4da1-9642-06e64c70bf7d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" podUID="2ebea2ff-cd18-4da1-9642-06e64c70bf7d"
May 28 17:51:41.755853 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.755818    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-p5xcs"]
May 28 17:51:41.756388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756367    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="pull"
May 28 17:51:41.756388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756390    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="pull"
May 28 17:51:41.756539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756412    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="util"
May 28 17:51:41.756539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756422    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="util"
May 28 17:51:41.756539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756431    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="extract"
May 28 17:51:41.756539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756439    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="extract"
May 28 17:51:41.756539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.756519    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="f33b7a80-1a4e-4cc7-a1c8-7b70645dc695" containerName="extract"
May 28 17:51:41.760822 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.760800    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:41.763237 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.763217    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 17:51:41.763373 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.763350    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tjd5p\""
May 28 17:51:41.767716 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.767695    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-p5xcs"]
May 28 17:51:41.857431 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.857396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:41.857582 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.857442    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmvl\" (UniqueName: \"kubernetes.io/projected/64611b7f-9bac-4d8f-b1fe-d84602dcd355-kube-api-access-4xmvl\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:41.958305 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.958273    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:41.958597 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:41.958435    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 17:51:41.958696 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:41.958662    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert podName:64611b7f-9bac-4d8f-b1fe-d84602dcd355 nodeName:}" failed. No retries permitted until 2026-05-28 17:51:42.458637637 +0000 UTC m=+470.060953239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert") pod "kserve-controller-manager-856948b99f-p5xcs" (UID: "64611b7f-9bac-4d8f-b1fe-d84602dcd355") : secret "kserve-webhook-server-cert" not found
May 28 17:51:41.958696 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.958570    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmvl\" (UniqueName: \"kubernetes.io/projected/64611b7f-9bac-4d8f-b1fe-d84602dcd355-kube-api-access-4xmvl\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:41.973767 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:41.973737    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmvl\" (UniqueName: \"kubernetes.io/projected/64611b7f-9bac-4d8f-b1fe-d84602dcd355-kube-api-access-4xmvl\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:42.461987 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:42.461959    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:42.464474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:42.464455    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64611b7f-9bac-4d8f-b1fe-d84602dcd355-cert\") pod \"kserve-controller-manager-856948b99f-p5xcs\" (UID: \"64611b7f-9bac-4d8f-b1fe-d84602dcd355\") " pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:42.674941 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:42.674906    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:42.693001 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:42.692972    2566 scope.go:117] "RemoveContainer" containerID="2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c"
May 28 17:51:42.693377 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:42.693284    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vgvct_opendatahub(2ebea2ff-cd18-4da1-9642-06e64c70bf7d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" podUID="2ebea2ff-cd18-4da1-9642-06e64c70bf7d"
May 28 17:51:42.811857 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:42.811828    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-p5xcs"]
May 28 17:51:42.814174 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:42.814148    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64611b7f_9bac_4d8f_b1fe_d84602dcd355.slice/crio-e9b650ec6f82ae8ba4d9c93742f4f11e74fa58426a5c65e56e2a38f88968aae2 WatchSource:0}: Error finding container e9b650ec6f82ae8ba4d9c93742f4f11e74fa58426a5c65e56e2a38f88968aae2: Status 404 returned error can't find the container with id e9b650ec6f82ae8ba4d9c93742f4f11e74fa58426a5c65e56e2a38f88968aae2
May 28 17:51:43.696742 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:43.696705    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs" event={"ID":"64611b7f-9bac-4d8f-b1fe-d84602dcd355","Type":"ContainerStarted","Data":"e9b650ec6f82ae8ba4d9c93742f4f11e74fa58426a5c65e56e2a38f88968aae2"}
May 28 17:51:46.476226 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.476191    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"]
May 28 17:51:46.479014 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.478992    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.482693 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.482671    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-drmgd\""
May 28 17:51:46.483917 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.483900    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 17:51:46.483982 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.483899    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 17:51:46.494312 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.494287    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"]
May 28 17:51:46.501593 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.501568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.501699 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.501659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.501753 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.501696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgls\" (UniqueName: \"kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.603220 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.603139    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.603220 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.603214    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.603395 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.603239    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgls\" (UniqueName: \"kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.603542 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.603518    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.603581 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.603530    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.621666 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.621636    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgls\" (UniqueName: \"kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.711090 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.711056    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs" event={"ID":"64611b7f-9bac-4d8f-b1fe-d84602dcd355","Type":"ContainerStarted","Data":"6530663e1d3dea1c593621a145a75239d944398181c4e788c3d8e5c745413583"}
May 28 17:51:46.711265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.711180    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:51:46.741245 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.741193    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs" podStartSLOduration=2.266956789 podStartE2EDuration="5.741178193s" podCreationTimestamp="2026-05-28 17:51:41 +0000 UTC" firstStartedPulling="2026-05-28 17:51:42.815915155 +0000 UTC m=+470.418230747" lastFinishedPulling="2026-05-28 17:51:46.290136557 +0000 UTC m=+473.892452151" observedRunningTime="2026-05-28 17:51:46.738193765 +0000 UTC m=+474.340509379" watchObservedRunningTime="2026-05-28 17:51:46.741178193 +0000 UTC m=+474.343493805"
May 28 17:51:46.789726 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.789692    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:46.972863 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:46.972825    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"]
May 28 17:51:46.977689 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:46.977656    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4e3c03_6da0_4595_a346_af0d36dd764c.slice/crio-67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694 WatchSource:0}: Error finding container 67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694: Status 404 returned error can't find the container with id 67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694
May 28 17:51:47.715905 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:47.715843    2566 generic.go:358] "Generic (PLEG): container finished" podID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerID="a03d821acae6576e58bfe8606a38749d2315cb3e53ee2d6526af0aa883e38a17" exitCode=0
May 28 17:51:47.716271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:47.715910    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r" event={"ID":"1a4e3c03-6da0-4595-a346-af0d36dd764c","Type":"ContainerDied","Data":"a03d821acae6576e58bfe8606a38749d2315cb3e53ee2d6526af0aa883e38a17"}
May 28 17:51:47.716271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:47.715946    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r" event={"ID":"1a4e3c03-6da0-4595-a346-af0d36dd764c","Type":"ContainerStarted","Data":"67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694"}
May 28 17:51:47.797203 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:47.797174    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:47.797560 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:47.797547    2566 scope.go:117] "RemoveContainer" containerID="2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c"
May 28 17:51:47.797748 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:51:47.797731    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vgvct_opendatahub(2ebea2ff-cd18-4da1-9642-06e64c70bf7d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" podUID="2ebea2ff-cd18-4da1-9642-06e64c70bf7d"
May 28 17:51:48.075478 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.075383    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"]
May 28 17:51:48.081294 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.081259    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.083972 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.083948    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 17:51:48.084546 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.084529    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 17:51:48.085072 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.085052    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6cpz6\""
May 28 17:51:48.098745 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.098726    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"]
May 28 17:51:48.114944 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.114919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzm8g\" (UniqueName: \"kubernetes.io/projected/41cd5070-487a-432b-9231-4cf9f329903b-kube-api-access-xzm8g\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.115057 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.114983    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/41cd5070-487a-432b-9231-4cf9f329903b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.216151 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.216117    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzm8g\" (UniqueName: \"kubernetes.io/projected/41cd5070-487a-432b-9231-4cf9f329903b-kube-api-access-xzm8g\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.216291 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.216195    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/41cd5070-487a-432b-9231-4cf9f329903b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.218724 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.218692    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/41cd5070-487a-432b-9231-4cf9f329903b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.229776 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.229753    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzm8g\" (UniqueName: \"kubernetes.io/projected/41cd5070-487a-432b-9231-4cf9f329903b-kube-api-access-xzm8g\") pod \"servicemesh-operator3-55f49c5f94-mhhmf\" (UID: \"41cd5070-487a-432b-9231-4cf9f329903b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.393115 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.393018    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:48.527803 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.527774    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"]
May 28 17:51:48.530639 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:51:48.530609    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cd5070_487a_432b_9231_4cf9f329903b.slice/crio-bb577f186752328e410d2c066e6d2024707e44737bdc0786d12bd9eb2a0cc9ed WatchSource:0}: Error finding container bb577f186752328e410d2c066e6d2024707e44737bdc0786d12bd9eb2a0cc9ed: Status 404 returned error can't find the container with id bb577f186752328e410d2c066e6d2024707e44737bdc0786d12bd9eb2a0cc9ed
May 28 17:51:48.721463 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:48.721432    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf" event={"ID":"41cd5070-487a-432b-9231-4cf9f329903b","Type":"ContainerStarted","Data":"bb577f186752328e410d2c066e6d2024707e44737bdc0786d12bd9eb2a0cc9ed"}
May 28 17:51:49.727992 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:49.727959    2566 generic.go:358] "Generic (PLEG): container finished" podID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerID="4ae57b59929a3e60662187110a74c50f213a4d2b54da79eedda2ddc00a2b576d" exitCode=0
May 28 17:51:49.728395 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:49.728003    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r" event={"ID":"1a4e3c03-6da0-4595-a346-af0d36dd764c","Type":"ContainerDied","Data":"4ae57b59929a3e60662187110a74c50f213a4d2b54da79eedda2ddc00a2b576d"}
May 28 17:51:50.734613 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:50.734569    2566 generic.go:358] "Generic (PLEG): container finished" podID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerID="f3c33bfe55c4ffeaebb98e4ffede6d33e243b361f67114d527f06aa6552c2d74" exitCode=0
May 28 17:51:50.735149 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:50.734699    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r" event={"ID":"1a4e3c03-6da0-4595-a346-af0d36dd764c","Type":"ContainerDied","Data":"f3c33bfe55c4ffeaebb98e4ffede6d33e243b361f67114d527f06aa6552c2d74"}
May 28 17:51:51.740017 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.739978    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf" event={"ID":"41cd5070-487a-432b-9231-4cf9f329903b","Type":"ContainerStarted","Data":"8a27fa495e9428a31bc569e5e34bae6b8fc3233e08acbedb95d0ccf3ed34aece"}
May 28 17:51:51.762193 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.762108    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf" podStartSLOduration=1.227463598 podStartE2EDuration="3.762087937s" podCreationTimestamp="2026-05-28 17:51:48 +0000 UTC" firstStartedPulling="2026-05-28 17:51:48.534217342 +0000 UTC m=+476.136532936" lastFinishedPulling="2026-05-28 17:51:51.068841683 +0000 UTC m=+478.671157275" observedRunningTime="2026-05-28 17:51:51.758865006 +0000 UTC m=+479.361180620" watchObservedRunningTime="2026-05-28 17:51:51.762087937 +0000 UTC m=+479.364403551"
May 28 17:51:51.869749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.869728    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:51.950470 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.950434    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util\") pod \"1a4e3c03-6da0-4595-a346-af0d36dd764c\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") "
May 28 17:51:51.950627 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.950517    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jgls\" (UniqueName: \"kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls\") pod \"1a4e3c03-6da0-4595-a346-af0d36dd764c\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") "
May 28 17:51:51.950627 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.950538    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle\") pod \"1a4e3c03-6da0-4595-a346-af0d36dd764c\" (UID: \"1a4e3c03-6da0-4595-a346-af0d36dd764c\") "
May 28 17:51:51.951469 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.951442    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle" (OuterVolumeSpecName: "bundle") pod "1a4e3c03-6da0-4595-a346-af0d36dd764c" (UID: "1a4e3c03-6da0-4595-a346-af0d36dd764c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:51.952782 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.952758    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls" (OuterVolumeSpecName: "kube-api-access-4jgls") pod "1a4e3c03-6da0-4595-a346-af0d36dd764c" (UID: "1a4e3c03-6da0-4595-a346-af0d36dd764c"). InnerVolumeSpecName "kube-api-access-4jgls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:51:51.955711 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:51.955685    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util" (OuterVolumeSpecName: "util") pod "1a4e3c03-6da0-4595-a346-af0d36dd764c" (UID: "1a4e3c03-6da0-4595-a346-af0d36dd764c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:51:52.051485 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.051389    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jgls\" (UniqueName: \"kubernetes.io/projected/1a4e3c03-6da0-4595-a346-af0d36dd764c-kube-api-access-4jgls\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:52.051485 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.051430    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:52.051485 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.051443    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a4e3c03-6da0-4595-a346-af0d36dd764c-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:51:52.745674 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.745646    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r"
May 28 17:51:52.746046 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.745644    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axcf6r" event={"ID":"1a4e3c03-6da0-4595-a346-af0d36dd764c","Type":"ContainerDied","Data":"67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694"}
May 28 17:51:52.746046 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.745798    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67198d3127926d16abd50ddfc7ed68e1a6e0ca20ef352e6fd4b87dfc7361c694"
May 28 17:51:52.746141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:52.746041    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:51:57.797713 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:57.797680    2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:57.798146 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:57.798069    2566 scope.go:117] "RemoveContainer" containerID="2d28166e03ed941a2f0c3cab2b1716ea6a9164fada30f98c7cf8eb2c553ee51c"
May 28 17:51:58.771422 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:58.771386    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" event={"ID":"2ebea2ff-cd18-4da1-9642-06e64c70bf7d","Type":"ContainerStarted","Data":"f7337b72a981d267f9e28fdde88ff36b5a2917fe382a923c9491e9029e1bd45b"}
May 28 17:51:58.771611 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:58.771594    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:51:58.792617 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:51:58.792573    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct" podStartSLOduration=3.625663145 podStartE2EDuration="23.792556437s" podCreationTimestamp="2026-05-28 17:51:35 +0000 UTC" firstStartedPulling="2026-05-28 17:51:37.936737114 +0000 UTC m=+465.539052709" lastFinishedPulling="2026-05-28 17:51:58.10363041 +0000 UTC m=+485.705946001" observedRunningTime="2026-05-28 17:51:58.791831095 +0000 UTC m=+486.394146716" watchObservedRunningTime="2026-05-28 17:51:58.792556437 +0000 UTC m=+486.394872052"
May 28 17:52:02.594732 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.594696    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"]
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595077    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="util"
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595088    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="util"
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595108    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="pull"
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595114    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="pull"
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595122    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="extract"
May 28 17:52:02.595138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595127    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="extract"
May 28 17:52:02.595375 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.595183    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a4e3c03-6da0-4595-a346-af0d36dd764c" containerName="extract"
May 28 17:52:02.597852 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.597833    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.600298 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.600277    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 17:52:02.600644 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.600620    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 17:52:02.600644 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.600633    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 17:52:02.600767 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.600639    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 17:52:02.600767 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.600666    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nw9kp\""
May 28 17:52:02.610980 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.610949    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"]
May 28 17:52:02.644018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.643990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644172 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644172 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644043    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644172 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644172 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76r68\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-kube-api-access-76r68\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644247    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.644388 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.644282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/910ef0a9-b655-4de1-aa0a-2690d164d97b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.745662 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745627    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.745662 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745670    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/910ef0a9-b655-4de1-aa0a-2690d164d97b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.745927 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745736    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.745927 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745756    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.745927 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745772    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.746083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745929    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.746083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.745979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76r68\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-kube-api-access-76r68\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.746961 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.746934    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.748320 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.748299    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.748428 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.748414    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.748541 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.748520    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.748824 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.748807    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/910ef0a9-b655-4de1-aa0a-2690d164d97b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.759631 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.759591    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.759749 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.759645    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76r68\" (UniqueName: \"kubernetes.io/projected/910ef0a9-b655-4de1-aa0a-2690d164d97b-kube-api-access-76r68\") pod \"istiod-openshift-gateway-798958bb55-cjnw9\" (UID: \"910ef0a9-b655-4de1-aa0a-2690d164d97b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:02.907985 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:02.907870    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:03.060031 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:03.059999    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"]
May 28 17:52:03.060984 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:52:03.060949    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910ef0a9_b655_4de1_aa0a_2690d164d97b.slice/crio-17bd1b4b9e95265558c76d9c72981e6ce388b07d6d15bc4840764bf4461a5aa8 WatchSource:0}: Error finding container 17bd1b4b9e95265558c76d9c72981e6ce388b07d6d15bc4840764bf4461a5aa8: Status 404 returned error can't find the container with id 17bd1b4b9e95265558c76d9c72981e6ce388b07d6d15bc4840764bf4461a5aa8
May 28 17:52:03.751615 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:03.751585    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-mhhmf"
May 28 17:52:03.799262 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:03.799214    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9" event={"ID":"910ef0a9-b655-4de1-aa0a-2690d164d97b","Type":"ContainerStarted","Data":"17bd1b4b9e95265558c76d9c72981e6ce388b07d6d15bc4840764bf4461a5aa8"}
May 28 17:52:06.210714 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:06.210671    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 28 17:52:06.211025 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:06.210765    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 28 17:52:06.813927 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:06.813868    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9" event={"ID":"910ef0a9-b655-4de1-aa0a-2690d164d97b","Type":"ContainerStarted","Data":"8723deb6409691259beb1c7311f5fd5486ee5b91afcfc6504fc5ba84dc4021a0"}
May 28 17:52:06.814155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:06.814005    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:06.838440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:06.838380    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9" podStartSLOduration=1.690951788 podStartE2EDuration="4.838366295s" podCreationTimestamp="2026-05-28 17:52:02 +0000 UTC" firstStartedPulling="2026-05-28 17:52:03.062960833 +0000 UTC m=+490.665276424" lastFinishedPulling="2026-05-28 17:52:06.210375329 +0000 UTC m=+493.812690931" observedRunningTime="2026-05-28 17:52:06.836387343 +0000 UTC m=+494.438702956" watchObservedRunningTime="2026-05-28 17:52:06.838366295 +0000 UTC m=+494.440681908"
May 28 17:52:07.821118 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:07.821088    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-cjnw9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 28 17:52:07.821474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:07.821138    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9" podUID="910ef0a9-b655-4de1-aa0a-2690d164d97b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 17:52:09.777006 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:09.776975    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-vgvct"
May 28 17:52:10.820368 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:10.820332    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cjnw9"
May 28 17:52:17.721793 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:17.721753    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-p5xcs"
May 28 17:52:49.572849 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.572772    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"]
May 28 17:52:49.575536 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.575516    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.585022 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.585003    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cfxjz\""
May 28 17:52:49.585108 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.585039    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 17:52:49.585108 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.585096    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 17:52:49.598243 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.598221    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"]
May 28 17:52:49.644381 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.644350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.644496 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.644433    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.644538 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.644516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4sdf\" (UniqueName: \"kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.745988 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.745962    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.746082 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.745998    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.746082 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.746057    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4sdf\" (UniqueName: \"kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.746440 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.746413    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.746479 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.746424    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.758433 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.758411    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4sdf\" (UniqueName: \"kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:49.884858 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:49.884765    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:50.037605 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.037579    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"]
May 28 17:52:50.039288 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:52:50.039260    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f6031d_c385_4da0_9221_4b2c529606d6.slice/crio-2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2 WatchSource:0}: Error finding container 2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2: Status 404 returned error can't find the container with id 2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2
May 28 17:52:50.318943 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.318909    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"]
May 28 17:52:50.321451 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.321434    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.350723 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.350698    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"]
May 28 17:52:50.352605 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.352582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.352709 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.352640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.352709 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.352694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89zq\" (UniqueName: \"kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.453245 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.453207    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.453410 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.453300    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f89zq\" (UniqueName: \"kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.453410 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.453362    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.453647 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.453626    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.453729 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.453702    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.470144 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.470121    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89zq\" (UniqueName: \"kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.630624 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.630591    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:50.719343 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.719305    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"]
May 28 17:52:50.722699 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.722675    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.739845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.739822    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"]
May 28 17:52:50.756421 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.756393    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.756566 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.756436    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.756566 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.756522    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfkbf\" (UniqueName: \"kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.801916 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.801896    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"]
May 28 17:52:50.803911 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:52:50.803857    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd8df0f_f2b4_4c97_98c7_e01f4b2281ac.slice/crio-6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584 WatchSource:0}: Error finding container 6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584: Status 404 returned error can't find the container with id 6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584
May 28 17:52:50.857303 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.857280    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.857395 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.857313    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.857473 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.857454    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfkbf\" (UniqueName: \"kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.857617 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.857600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.857685 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.857636    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.878939 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.878904    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfkbf\" (UniqueName: \"kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:50.999921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.999840    2566 generic.go:358] "Generic (PLEG): container finished" podID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerID="5a496a77c7329acf8331db547e367951477ca44859d82be028ee9109c969d55b" exitCode=0
May 28 17:52:50.999921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.999906    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb" event={"ID":"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac","Type":"ContainerDied","Data":"5a496a77c7329acf8331db547e367951477ca44859d82be028ee9109c969d55b"}
May 28 17:52:51.000061 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:50.999942    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb" event={"ID":"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac","Type":"ContainerStarted","Data":"6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584"}
May 28 17:52:51.001456 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.001435    2566 generic.go:358] "Generic (PLEG): container finished" podID="17f6031d-c385-4da0-9221-4b2c529606d6" containerID="bb307b5ccaa1bd0d24b2f614389116d29f05b51d8304a529f6371c20c1089a59" exitCode=0
May 28 17:52:51.001552 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.001519    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp" event={"ID":"17f6031d-c385-4da0-9221-4b2c529606d6","Type":"ContainerDied","Data":"bb307b5ccaa1bd0d24b2f614389116d29f05b51d8304a529f6371c20c1089a59"}
May 28 17:52:51.001552 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.001546    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp" event={"ID":"17f6031d-c385-4da0-9221-4b2c529606d6","Type":"ContainerStarted","Data":"2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2"}
May 28 17:52:51.036157 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.036131    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:51.215648 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.215622    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"]
May 28 17:52:51.217240 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:52:51.217218    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b8fb0a_7999_4efc_bd26_6ee8a80c914b.slice/crio-75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6 WatchSource:0}: Error finding container 75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6: Status 404 returned error can't find the container with id 75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6
May 28 17:52:51.246793 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.246767    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"]
May 28 17:52:51.249698 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.249683    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.362326 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.362282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7nww\" (UniqueName: \"kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.362483 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.362349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.362573 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.362512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.364067 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.364039    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"]
May 28 17:52:51.463845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.463812    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7nww\" (UniqueName: \"kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.464042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.463856    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.464042 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.463898    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.464226 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.464206    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.464275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.464243    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.473994 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.473976    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7nww\" (UniqueName: \"kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.567222 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.567140    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:51.748556 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:51.748520    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"]
May 28 17:52:51.759116 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:52:51.759085    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1abdc1_f2a4_417b_a9d3_09dd96e51ff8.slice/crio-b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83 WatchSource:0}: Error finding container b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83: Status 404 returned error can't find the container with id b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83
May 28 17:52:52.010268 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.010233    2566 generic.go:358] "Generic (PLEG): container finished" podID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerID="ca67ae81263135cfc16170d3929d88f0b6c5524d337e41c4763731775a0e544c" exitCode=0
May 28 17:52:52.010448 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.010313    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb" event={"ID":"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac","Type":"ContainerDied","Data":"ca67ae81263135cfc16170d3929d88f0b6c5524d337e41c4763731775a0e544c"}
May 28 17:52:52.011728 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.011704    2566 generic.go:358] "Generic (PLEG): container finished" podID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerID="3a90d72bb63959a3ad8e44c29fdb799c585eaa7cbc452d288945710a2334aad7" exitCode=0
May 28 17:52:52.011844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.011800    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr" event={"ID":"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b","Type":"ContainerDied","Data":"3a90d72bb63959a3ad8e44c29fdb799c585eaa7cbc452d288945710a2334aad7"}
May 28 17:52:52.011844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.011826    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr" event={"ID":"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b","Type":"ContainerStarted","Data":"75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6"}
May 28 17:52:52.013563 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.013540    2566 generic.go:358] "Generic (PLEG): container finished" podID="17f6031d-c385-4da0-9221-4b2c529606d6" containerID="d338dfd360beaee27b315a1826efbd10e1490ddaf3af9061a5fa1ac15dc98865" exitCode=0
May 28 17:52:52.013696 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.013620    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp" event={"ID":"17f6031d-c385-4da0-9221-4b2c529606d6","Type":"ContainerDied","Data":"d338dfd360beaee27b315a1826efbd10e1490ddaf3af9061a5fa1ac15dc98865"}
May 28 17:52:52.015058 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.015039    2566 generic.go:358] "Generic (PLEG): container finished" podID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerID="5564acef8b99a7cd1d0ab5568c3e079a1c4d1636a0372e9178ff2511de3657a1" exitCode=0
May 28 17:52:52.015209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.015130    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh" event={"ID":"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8","Type":"ContainerDied","Data":"5564acef8b99a7cd1d0ab5568c3e079a1c4d1636a0372e9178ff2511de3657a1"}
May 28 17:52:52.015209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:52.015171    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh" event={"ID":"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8","Type":"ContainerStarted","Data":"b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83"}
May 28 17:52:53.021130 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.021101    2566 generic.go:358] "Generic (PLEG): container finished" podID="17f6031d-c385-4da0-9221-4b2c529606d6" containerID="f3a2c2b0572380b07fe4a1c42053e664651543077940332ce1b617c1cbd935e4" exitCode=0
May 28 17:52:53.021474 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.021175    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp" event={"ID":"17f6031d-c385-4da0-9221-4b2c529606d6","Type":"ContainerDied","Data":"f3a2c2b0572380b07fe4a1c42053e664651543077940332ce1b617c1cbd935e4"}
May 28 17:52:53.022769 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.022748    2566 generic.go:358] "Generic (PLEG): container finished" podID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerID="d080a4fdbb2a005a8f61b88a8c65d5fe0603f8dc5b9469ecce3ba9436cb56dd7" exitCode=0
May 28 17:52:53.022869 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.022830    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh" event={"ID":"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8","Type":"ContainerDied","Data":"d080a4fdbb2a005a8f61b88a8c65d5fe0603f8dc5b9469ecce3ba9436cb56dd7"}
May 28 17:52:53.025066 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.025034    2566 generic.go:358] "Generic (PLEG): container finished" podID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerID="6333f44456d4cf7ee24fdfef734175a2da1ae2f76e35d5ff12df61fe27bb20ee" exitCode=0
May 28 17:52:53.025176 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.025104    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb" event={"ID":"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac","Type":"ContainerDied","Data":"6333f44456d4cf7ee24fdfef734175a2da1ae2f76e35d5ff12df61fe27bb20ee"}
May 28 17:52:53.027158 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.027133    2566 generic.go:358] "Generic (PLEG): container finished" podID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerID="19ce4953d298bebec8957d8854bb0661ac903a3e78a6e1624e4f0e4c4c3bf19a" exitCode=0
May 28 17:52:53.032478 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:53.032456    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr" event={"ID":"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b","Type":"ContainerDied","Data":"19ce4953d298bebec8957d8854bb0661ac903a3e78a6e1624e4f0e4c4c3bf19a"}
May 28 17:52:54.033567 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.033537    2566 generic.go:358] "Generic (PLEG): container finished" podID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerID="d9d04a8cdbe3f91580a59ca75007d0be7ab6a7648ab838e1b8447e039ccf67f9" exitCode=0
May 28 17:52:54.034038 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.033621    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr" event={"ID":"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b","Type":"ContainerDied","Data":"d9d04a8cdbe3f91580a59ca75007d0be7ab6a7648ab838e1b8447e039ccf67f9"}
May 28 17:52:54.035505 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.035476    2566 generic.go:358] "Generic (PLEG): container finished" podID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerID="b774ce4c8bad8daf6f115ed2bdc9cbb13d92943b40f0fe7a5fbd83400f62f86c" exitCode=0
May 28 17:52:54.035629 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.035503    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh" event={"ID":"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8","Type":"ContainerDied","Data":"b774ce4c8bad8daf6f115ed2bdc9cbb13d92943b40f0fe7a5fbd83400f62f86c"}
May 28 17:52:54.179831 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.179810    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:54.201275 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.201256    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:54.290422 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290346    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4sdf\" (UniqueName: \"kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf\") pod \"17f6031d-c385-4da0-9221-4b2c529606d6\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") "
May 28 17:52:54.290422 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290377    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f89zq\" (UniqueName: \"kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq\") pod \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") "
May 28 17:52:54.290422 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290410    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util\") pod \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") "
May 28 17:52:54.290695 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290431    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle\") pod \"17f6031d-c385-4da0-9221-4b2c529606d6\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") "
May 28 17:52:54.290695 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290457    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle\") pod \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\" (UID: \"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac\") "
May 28 17:52:54.290695 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.290505    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util\") pod \"17f6031d-c385-4da0-9221-4b2c529606d6\" (UID: \"17f6031d-c385-4da0-9221-4b2c529606d6\") "
May 28 17:52:54.291111 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.291079    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle" (OuterVolumeSpecName: "bundle") pod "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" (UID: "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:54.291415 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.291390    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle" (OuterVolumeSpecName: "bundle") pod "17f6031d-c385-4da0-9221-4b2c529606d6" (UID: "17f6031d-c385-4da0-9221-4b2c529606d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:54.292836 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.292812    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq" (OuterVolumeSpecName: "kube-api-access-f89zq") pod "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" (UID: "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac"). InnerVolumeSpecName "kube-api-access-f89zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:52:54.293051 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.292992    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf" (OuterVolumeSpecName: "kube-api-access-n4sdf") pod "17f6031d-c385-4da0-9221-4b2c529606d6" (UID: "17f6031d-c385-4da0-9221-4b2c529606d6"). InnerVolumeSpecName "kube-api-access-n4sdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:52:54.295533 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.295494    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util" (OuterVolumeSpecName: "util") pod "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" (UID: "ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:54.297007 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.296987    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util" (OuterVolumeSpecName: "util") pod "17f6031d-c385-4da0-9221-4b2c529606d6" (UID: "17f6031d-c385-4da0-9221-4b2c529606d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:54.391402 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391376    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:54.391402 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391402    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:54.391561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391415    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:54.391561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391428    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f6031d-c385-4da0-9221-4b2c529606d6-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:54.391561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391438    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4sdf\" (UniqueName: \"kubernetes.io/projected/17f6031d-c385-4da0-9221-4b2c529606d6-kube-api-access-n4sdf\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:54.391561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:54.391446    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f89zq\" (UniqueName: \"kubernetes.io/projected/ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac-kube-api-access-f89zq\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.041962 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.041851    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb" event={"ID":"ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac","Type":"ContainerDied","Data":"6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584"}
May 28 17:52:55.041962 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.041911    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bc5f90287df465fafb9ba4d1e2d22dbdb360a5b369c685f4e8f46c7bab1c584"
May 28 17:52:55.041962 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.041936    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb"
May 28 17:52:55.044020 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.043992    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp" event={"ID":"17f6031d-c385-4da0-9221-4b2c529606d6","Type":"ContainerDied","Data":"2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2"}
May 28 17:52:55.044127 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.044026    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e8b11bb409b8db4b4bc06a956ebf5c5b50741293c534d58169aaf29bb0c1ce2"
May 28 17:52:55.044127 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.043998    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp"
May 28 17:52:55.175966 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.175945    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:55.202152 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.202124    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:55.296921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296821    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util\") pod \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") "
May 28 17:52:55.296921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296849    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle\") pod \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") "
May 28 17:52:55.296921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296866    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util\") pod \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") "
May 28 17:52:55.296921 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296911    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfkbf\" (UniqueName: \"kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf\") pod \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\" (UID: \"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b\") "
May 28 17:52:55.297237 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296943    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle\") pod \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") "
May 28 17:52:55.297237 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.296992    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7nww\" (UniqueName: \"kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww\") pod \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\" (UID: \"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8\") "
May 28 17:52:55.297401 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.297361    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle" (OuterVolumeSpecName: "bundle") pod "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" (UID: "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:55.297745 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.297719    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle" (OuterVolumeSpecName: "bundle") pod "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" (UID: "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:55.299658 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.299631    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww" (OuterVolumeSpecName: "kube-api-access-s7nww") pod "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" (UID: "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8"). InnerVolumeSpecName "kube-api-access-s7nww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:52:55.299748 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.299669    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf" (OuterVolumeSpecName: "kube-api-access-zfkbf") pod "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" (UID: "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b"). InnerVolumeSpecName "kube-api-access-zfkbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:52:55.302625 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.302600    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util" (OuterVolumeSpecName: "util") pod "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" (UID: "9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:55.302949 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.302930    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util" (OuterVolumeSpecName: "util") pod "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" (UID: "d9b8fb0a-7999-4efc-bd26-6ee8a80c914b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:52:55.398473 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398445    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.398473 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398471    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.398473 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398480    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-util\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.398690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398490    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfkbf\" (UniqueName: \"kubernetes.io/projected/d9b8fb0a-7999-4efc-bd26-6ee8a80c914b-kube-api-access-zfkbf\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.398690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398500    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:55.398690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:55.398508    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7nww\" (UniqueName: \"kubernetes.io/projected/9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8-kube-api-access-s7nww\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:52:56.049453 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.049360    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr" event={"ID":"d9b8fb0a-7999-4efc-bd26-6ee8a80c914b","Type":"ContainerDied","Data":"75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6"}
May 28 17:52:56.049453 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.049378    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr"
May 28 17:52:56.049453 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.049395    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75b34b2a8e217bc8c57c67c1108373671365c58569a0cb14fd4edc5877e6c0d6"
May 28 17:52:56.051216 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.051184    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh"
May 28 17:52:56.051331 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.051185    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh" event={"ID":"9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8","Type":"ContainerDied","Data":"b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83"}
May 28 17:52:56.051331 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:52:56.051295    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b31c10c9644dc71d3f8dbcb2746bbf5a1eeeefffe5edaddee898392e04151e83"
May 28 17:53:06.225937 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.225898    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"]
May 28 17:53:06.226295 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226287    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="pull"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226299    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="pull"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226308    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="extract"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226313    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="extract"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226325    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="pull"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226331    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="pull"
May 28 17:53:06.226334 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226336    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="pull"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226341    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="pull"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226350    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226355    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226360    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226365    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226370    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226376    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226388    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226395    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226406    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="pull"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226411    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="pull"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226418    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226423    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226431    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226435    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226443    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226451    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="util"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226501    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9b8fb0a-7999-4efc-bd26-6ee8a80c914b" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226511    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226518    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8" containerName="extract"
May 28 17:53:06.226670 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.226529    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="17f6031d-c385-4da0-9221-4b2c529606d6" containerName="extract"
May 28 17:53:06.230284 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.230260    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:06.237557 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:53:06.237527    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-operator-controller-manager-dockercfg-qs7wz\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qs7wz\"" type="*v1.Secret"
May 28 17:53:06.248915 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.248895    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 17:53:06.249735 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.249720    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 17:53:06.250654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.250633    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 17:53:06.292284 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.292242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxvfv\" (UniqueName: \"kubernetes.io/projected/751c9870-58db-47cd-b1a9-4cfda5067176-kube-api-access-sxvfv\") pod \"dns-operator-controller-manager-648d5c98bc-l74ck\" (UID: \"751c9870-58db-47cd-b1a9-4cfda5067176\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:06.296395 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.296362    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"]
May 28 17:53:06.394085 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.394049    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxvfv\" (UniqueName: \"kubernetes.io/projected/751c9870-58db-47cd-b1a9-4cfda5067176-kube-api-access-sxvfv\") pod \"dns-operator-controller-manager-648d5c98bc-l74ck\" (UID: \"751c9870-58db-47cd-b1a9-4cfda5067176\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:06.457449 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:06.457417    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxvfv\" (UniqueName: \"kubernetes.io/projected/751c9870-58db-47cd-b1a9-4cfda5067176-kube-api-access-sxvfv\") pod \"dns-operator-controller-manager-648d5c98bc-l74ck\" (UID: \"751c9870-58db-47cd-b1a9-4cfda5067176\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:07.268561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:07.268529    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qs7wz\""
May 28 17:53:07.271410 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:07.271393    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:07.419191 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:07.419162    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"]
May 28 17:53:07.420807 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:53:07.420782    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751c9870_58db_47cd_b1a9_4cfda5067176.slice/crio-6d578d9b8a0792a25da78b28164f6a0b01a5ceb1760708c1742d78d3a1f7d381 WatchSource:0}: Error finding container 6d578d9b8a0792a25da78b28164f6a0b01a5ceb1760708c1742d78d3a1f7d381: Status 404 returned error can't find the container with id 6d578d9b8a0792a25da78b28164f6a0b01a5ceb1760708c1742d78d3a1f7d381
May 28 17:53:08.101539 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:08.101506    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck" event={"ID":"751c9870-58db-47cd-b1a9-4cfda5067176","Type":"ContainerStarted","Data":"6d578d9b8a0792a25da78b28164f6a0b01a5ceb1760708c1742d78d3a1f7d381"}
May 28 17:53:09.476489 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.476451    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"]
May 28 17:53:09.479840 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.479817    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:09.488739 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.488712    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d6v42\""
May 28 17:53:09.514252 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.514220    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"]
May 28 17:53:09.626227 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.626182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpj9\" (UniqueName: \"kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9\") pod \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" (UID: \"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:09.726919 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.726840    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpj9\" (UniqueName: \"kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9\") pod \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" (UID: \"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:09.740928 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.740867    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpj9\" (UniqueName: \"kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9\") pod \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" (UID: \"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:09.792676 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.792652    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:09.954468 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:53:09.954434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0813852d_bcf5_4e88_8777_4aaa8a0ebbe0.slice/crio-3a14da2aa3d59c358529092287b96123b410b2ad80c40e00a65d11f5509ef733 WatchSource:0}: Error finding container 3a14da2aa3d59c358529092287b96123b410b2ad80c40e00a65d11f5509ef733: Status 404 returned error can't find the container with id 3a14da2aa3d59c358529092287b96123b410b2ad80c40e00a65d11f5509ef733
May 28 17:53:09.954468 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:09.954459    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"]
May 28 17:53:10.111850 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:10.111756    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck" event={"ID":"751c9870-58db-47cd-b1a9-4cfda5067176","Type":"ContainerStarted","Data":"4ef3ae76aab7638f86baf83936dcb27c0ae646593910f87d466b17c6abbc8a67"}
May 28 17:53:10.111850 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:10.111807    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:10.112938 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:10.112912    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" event={"ID":"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0","Type":"ContainerStarted","Data":"3a14da2aa3d59c358529092287b96123b410b2ad80c40e00a65d11f5509ef733"}
May 28 17:53:10.169580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:10.169535    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck" podStartSLOduration=1.9074145900000001 podStartE2EDuration="4.169523647s" podCreationTimestamp="2026-05-28 17:53:06 +0000 UTC" firstStartedPulling="2026-05-28 17:53:07.423115846 +0000 UTC m=+555.025431440" lastFinishedPulling="2026-05-28 17:53:09.685224895 +0000 UTC m=+557.287540497" observedRunningTime="2026-05-28 17:53:10.167178614 +0000 UTC m=+557.769494228" watchObservedRunningTime="2026-05-28 17:53:10.169523647 +0000 UTC m=+557.771839258"
May 28 17:53:12.123914 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:12.123805    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" event={"ID":"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0","Type":"ContainerStarted","Data":"50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2"}
May 28 17:53:12.124246 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:12.123925    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:12.166728 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:12.166646    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" podStartSLOduration=1.361011698 podStartE2EDuration="3.1666307s" podCreationTimestamp="2026-05-28 17:53:09 +0000 UTC" firstStartedPulling="2026-05-28 17:53:09.956608887 +0000 UTC m=+557.558924481" lastFinishedPulling="2026-05-28 17:53:11.76222789 +0000 UTC m=+559.364543483" observedRunningTime="2026-05-28 17:53:12.163817913 +0000 UTC m=+559.766133524" watchObservedRunningTime="2026-05-28 17:53:12.1666307 +0000 UTC m=+559.768946312"
May 28 17:53:21.120924 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:21.120889    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l74ck"
May 28 17:53:23.129942 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:23.129912    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:33.443368 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.443327    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"]
May 28 17:53:33.443766 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.443653    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" containerName="manager" containerID="cri-o://50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2" gracePeriod=2
May 28 17:53:33.449845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.449816    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"]
May 28 17:53:33.483772 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.483740    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"]
May 28 17:53:33.484178 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.484163    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" containerName="manager"
May 28 17:53:33.484178 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.484177    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" containerName="manager"
May 28 17:53:33.484328 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.484249    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" containerName="manager"
May 28 17:53:33.487460 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.487439    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:33.491424 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.491394    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:33.531086 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.531058    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"]
May 28 17:53:33.531229 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.531169    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvsw\" (UniqueName: \"kubernetes.io/projected/175a29f5-c088-4a81-a1e3-b635b7abf211-kube-api-access-hpvsw\") pod \"limitador-operator-controller-manager-85c4996f8c-gvlw7\" (UID: \"175a29f5-c088-4a81-a1e3-b635b7abf211\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:33.631579 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.631547    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvsw\" (UniqueName: \"kubernetes.io/projected/175a29f5-c088-4a81-a1e3-b635b7abf211-kube-api-access-hpvsw\") pod \"limitador-operator-controller-manager-85c4996f8c-gvlw7\" (UID: \"175a29f5-c088-4a81-a1e3-b635b7abf211\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:33.644071 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.644041    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvsw\" (UniqueName: \"kubernetes.io/projected/175a29f5-c088-4a81-a1e3-b635b7abf211-kube-api-access-hpvsw\") pod \"limitador-operator-controller-manager-85c4996f8c-gvlw7\" (UID: \"175a29f5-c088-4a81-a1e3-b635b7abf211\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:33.684193 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.684173    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:33.694194 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.694133    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:33.731987 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.731948    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrpj9\" (UniqueName: \"kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9\") pod \"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0\" (UID: \"0813852d-bcf5-4e88-8777-4aaa8a0ebbe0\") "
May 28 17:53:33.734018 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.733994    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9" (OuterVolumeSpecName: "kube-api-access-xrpj9") pod "0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" (UID: "0813852d-bcf5-4e88-8777-4aaa8a0ebbe0"). InnerVolumeSpecName "kube-api-access-xrpj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:53:33.820386 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.820349    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:33.832508 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.832488    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrpj9\" (UniqueName: \"kubernetes.io/projected/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0-kube-api-access-xrpj9\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:53:33.968324 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:33.968296    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"]
May 28 17:53:33.968734 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:53:33.968709    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175a29f5_c088_4a81_a1e3_b635b7abf211.slice/crio-13f22e80bb09382c381a6ad6e40c5ab46f2c9de2bbb0cc9cb171611aa03f4c42 WatchSource:0}: Error finding container 13f22e80bb09382c381a6ad6e40c5ab46f2c9de2bbb0cc9cb171611aa03f4c42: Status 404 returned error can't find the container with id 13f22e80bb09382c381a6ad6e40c5ab46f2c9de2bbb0cc9cb171611aa03f4c42
May 28 17:53:34.209758 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.209722    2566 generic.go:358] "Generic (PLEG): container finished" podID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" containerID="50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2" exitCode=0
May 28 17:53:34.209947 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.209768    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q"
May 28 17:53:34.209947 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.209812    2566 scope.go:117] "RemoveContainer" containerID="50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2"
May 28 17:53:34.211480 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.211443    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7" event={"ID":"175a29f5-c088-4a81-a1e3-b635b7abf211","Type":"ContainerStarted","Data":"18cbadad6d23d855fd096a22d86c49373b9f32cf8ba7f584494c78e46061a75b"}
May 28 17:53:34.211596 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.211485    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7" event={"ID":"175a29f5-c088-4a81-a1e3-b635b7abf211","Type":"ContainerStarted","Data":"13f22e80bb09382c381a6ad6e40c5ab46f2c9de2bbb0cc9cb171611aa03f4c42"}
May 28 17:53:34.211596 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.211522    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:34.213093 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.213067    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:34.215548 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.215495    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:34.219103 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.219086    2566 scope.go:117] "RemoveContainer" containerID="50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2"
May 28 17:53:34.219354 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:53:34.219337    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2\": container with ID starting with 50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2 not found: ID does not exist" containerID="50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2"
May 28 17:53:34.219404 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.219362    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2"} err="failed to get container status \"50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2\": rpc error: code = NotFound desc = could not find container \"50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2\": container with ID starting with 50d56bda060deb3aa40cbaaed095784694187ac3492983ffe5e76eba1945cdc2 not found: ID does not exist"
May 28 17:53:34.251292 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.251262    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:34.949237 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.949177    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7" podStartSLOduration=1.949157282 podStartE2EDuration="1.949157282s" podCreationTimestamp="2026-05-28 17:53:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:53:34.249036862 +0000 UTC m=+581.851352474" watchObservedRunningTime="2026-05-28 17:53:34.949157282 +0000 UTC m=+582.551472897"
May 28 17:53:34.951258 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.951234    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 17:53:34.955980 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.955964    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:34.965096 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.965077    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ljqb\""
May 28 17:53:34.973482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:34.973461    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 17:53:35.002012 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.001982    2566 status_manager.go:895] "Failed to get status for pod" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bfp7q" err="pods \"limitador-operator-controller-manager-85c4996f8c-bfp7q\" is forbidden: User \"system:node:ip-10-0-137-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-72.ec2.internal' and this object"
May 28 17:53:35.031675 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.031649    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0813852d-bcf5-4e88-8777-4aaa8a0ebbe0" path="/var/lib/kubelet/pods/0813852d-bcf5-4e88-8777-4aaa8a0ebbe0/volumes"
May 28 17:53:35.041397 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.041377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjrw\" (UniqueName: \"kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.041498 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.041457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.141852 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.141822    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.141997 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.141928    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjrw\" (UniqueName: \"kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.142197 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.142178    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.151919 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.151863    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjrw\" (UniqueName: \"kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fjfpn\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.267044 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.266976    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:35.424235 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:35.424211    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 17:53:35.425669 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:53:35.425646    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65802175_d2b3_4e56_aca8_ad8743d4593a.slice/crio-e22f32dde7d99eebdd86b29054d55a3c42a8a50b2c9ec0608c8507c2f74f6be8 WatchSource:0}: Error finding container e22f32dde7d99eebdd86b29054d55a3c42a8a50b2c9ec0608c8507c2f74f6be8: Status 404 returned error can't find the container with id e22f32dde7d99eebdd86b29054d55a3c42a8a50b2c9ec0608c8507c2f74f6be8
May 28 17:53:36.223404 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:36.223343    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" event={"ID":"65802175-d2b3-4e56-aca8-ad8743d4593a","Type":"ContainerStarted","Data":"e22f32dde7d99eebdd86b29054d55a3c42a8a50b2c9ec0608c8507c2f74f6be8"}
May 28 17:53:40.250991 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:40.250951    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" event={"ID":"65802175-d2b3-4e56-aca8-ad8743d4593a","Type":"ContainerStarted","Data":"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"}
May 28 17:53:40.251373 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:40.251017    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:53:40.287193 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:40.287142    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" podStartSLOduration=2.268529982 podStartE2EDuration="6.287129075s" podCreationTimestamp="2026-05-28 17:53:34 +0000 UTC" firstStartedPulling="2026-05-28 17:53:35.428806813 +0000 UTC m=+583.031122403" lastFinishedPulling="2026-05-28 17:53:39.447405895 +0000 UTC m=+587.049721496" observedRunningTime="2026-05-28 17:53:40.28321535 +0000 UTC m=+587.885530960" watchObservedRunningTime="2026-05-28 17:53:40.287129075 +0000 UTC m=+587.889444687"
May 28 17:53:45.219109 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:45.219075    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvlw7"
May 28 17:53:51.257970 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:53:51.257940    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 17:54:51.312293 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.312257    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:54:51.315155 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.315135    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:51.317889 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.317847    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dk44f\""
May 28 17:54:51.318010 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.317848    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 17:54:51.324016 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.323993    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:54:51.433932 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.433857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rcdf\" (UniqueName: \"kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf\") pod \"maas-controller-767984c98c-mrxhf\" (UID: \"d5a736c5-95e4-4a21-bb51-10b948d2c6ab\") " pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:51.465739 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.465712    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:54:51.468265 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.468244    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:51.476478 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.476457    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:54:51.535124 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.535093    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rcdf\" (UniqueName: \"kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf\") pod \"maas-controller-767984c98c-mrxhf\" (UID: \"d5a736c5-95e4-4a21-bb51-10b948d2c6ab\") " pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:51.543300 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.543271    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rcdf\" (UniqueName: \"kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf\") pod \"maas-controller-767984c98c-mrxhf\" (UID: \"d5a736c5-95e4-4a21-bb51-10b948d2c6ab\") " pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:51.626905 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.626820    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:51.635918 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.635858    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzxk\" (UniqueName: \"kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk\") pod \"maas-controller-57554dbf74-8mbjf\" (UID: \"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba\") " pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:51.737438 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.737407    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzxk\" (UniqueName: \"kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk\") pod \"maas-controller-57554dbf74-8mbjf\" (UID: \"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba\") " pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:51.746507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.746475    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzxk\" (UniqueName: \"kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk\") pod \"maas-controller-57554dbf74-8mbjf\" (UID: \"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba\") " pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:51.756945 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.756925    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:54:51.759667 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:54:51.759640    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a736c5_95e4_4a21_bb51_10b948d2c6ab.slice/crio-ec0a99f77197c006680056f20a89e7e5ba10b0762ad5161f40ead05ab11be201 WatchSource:0}: Error finding container ec0a99f77197c006680056f20a89e7e5ba10b0762ad5161f40ead05ab11be201: Status 404 returned error can't find the container with id ec0a99f77197c006680056f20a89e7e5ba10b0762ad5161f40ead05ab11be201
May 28 17:54:51.761021 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.761004    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:54:51.780161 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.780137    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:51.910310 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:51.910285    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:54:51.911750 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:54:51.911717    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf8dc04_77fb_42e6_81ea_3353a5fc6fba.slice/crio-7651450aedfb74767e2488f3d19cf945c0da72170ae1729abadbb4be7b20c0da WatchSource:0}: Error finding container 7651450aedfb74767e2488f3d19cf945c0da72170ae1729abadbb4be7b20c0da: Status 404 returned error can't find the container with id 7651450aedfb74767e2488f3d19cf945c0da72170ae1729abadbb4be7b20c0da
May 28 17:54:52.565498 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:52.565461    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-8mbjf" event={"ID":"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba","Type":"ContainerStarted","Data":"7651450aedfb74767e2488f3d19cf945c0da72170ae1729abadbb4be7b20c0da"}
May 28 17:54:52.567068 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:52.567013    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-767984c98c-mrxhf" event={"ID":"d5a736c5-95e4-4a21-bb51-10b948d2c6ab","Type":"ContainerStarted","Data":"ec0a99f77197c006680056f20a89e7e5ba10b0762ad5161f40ead05ab11be201"}
May 28 17:54:54.360274 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.360249    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 17:54:54.577460 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.577426    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-767984c98c-mrxhf" event={"ID":"d5a736c5-95e4-4a21-bb51-10b948d2c6ab","Type":"ContainerStarted","Data":"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"}
May 28 17:54:54.577643 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.577503    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:54:54.578829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.578805    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-8mbjf" event={"ID":"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba","Type":"ContainerStarted","Data":"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"}
May 28 17:54:54.578983 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.578921    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:54:54.595913 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.595847    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-767984c98c-mrxhf" podStartSLOduration=0.999388511 podStartE2EDuration="3.595833487s" podCreationTimestamp="2026-05-28 17:54:51 +0000 UTC" firstStartedPulling="2026-05-28 17:54:51.761124846 +0000 UTC m=+659.363440439" lastFinishedPulling="2026-05-28 17:54:54.357569821 +0000 UTC m=+661.959885415" observedRunningTime="2026-05-28 17:54:54.593675636 +0000 UTC m=+662.195991249" watchObservedRunningTime="2026-05-28 17:54:54.595833487 +0000 UTC m=+662.198149145"
May 28 17:54:54.613943 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:54:54.613845    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-57554dbf74-8mbjf" podStartSLOduration=1.163503191 podStartE2EDuration="3.613833924s" podCreationTimestamp="2026-05-28 17:54:51 +0000 UTC" firstStartedPulling="2026-05-28 17:54:51.913238387 +0000 UTC m=+659.515553981" lastFinishedPulling="2026-05-28 17:54:54.36356912 +0000 UTC m=+661.965884714" observedRunningTime="2026-05-28 17:54:54.612531658 +0000 UTC m=+662.214847270" watchObservedRunningTime="2026-05-28 17:54:54.613833924 +0000 UTC m=+662.216149553"
May 28 17:55:05.588853 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.588823    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:55:05.589464 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.588889    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:55:05.645898 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.645835    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:55:05.646109 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.646067    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-767984c98c-mrxhf" podUID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" containerName="manager" containerID="cri-o://3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7" gracePeriod=30
May 28 17:55:05.898747 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.898726    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:55:05.964076 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.964044    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rcdf\" (UniqueName: \"kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf\") pod \"d5a736c5-95e4-4a21-bb51-10b948d2c6ab\" (UID: \"d5a736c5-95e4-4a21-bb51-10b948d2c6ab\") "
May 28 17:55:05.966233 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:05.966203    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf" (OuterVolumeSpecName: "kube-api-access-5rcdf") pod "d5a736c5-95e4-4a21-bb51-10b948d2c6ab" (UID: "d5a736c5-95e4-4a21-bb51-10b948d2c6ab"). InnerVolumeSpecName "kube-api-access-5rcdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:55:06.064773 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.064748    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rcdf\" (UniqueName: \"kubernetes.io/projected/d5a736c5-95e4-4a21-bb51-10b948d2c6ab-kube-api-access-5rcdf\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:55:06.630113 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.630081    2566 generic.go:358] "Generic (PLEG): container finished" podID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" containerID="3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7" exitCode=0
May 28 17:55:06.630484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.630204    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-767984c98c-mrxhf"
May 28 17:55:06.630484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.630215    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-767984c98c-mrxhf" event={"ID":"d5a736c5-95e4-4a21-bb51-10b948d2c6ab","Type":"ContainerDied","Data":"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"}
May 28 17:55:06.630484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.630254    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-767984c98c-mrxhf" event={"ID":"d5a736c5-95e4-4a21-bb51-10b948d2c6ab","Type":"ContainerDied","Data":"ec0a99f77197c006680056f20a89e7e5ba10b0762ad5161f40ead05ab11be201"}
May 28 17:55:06.630484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.630274    2566 scope.go:117] "RemoveContainer" containerID="3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"
May 28 17:55:06.639897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.639865    2566 scope.go:117] "RemoveContainer" containerID="3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"
May 28 17:55:06.640120 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:55:06.640105    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7\": container with ID starting with 3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7 not found: ID does not exist" containerID="3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"
May 28 17:55:06.640173 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.640128    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7"} err="failed to get container status \"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7\": rpc error: code = NotFound desc = could not find container \"3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7\": container with ID starting with 3b5730fcfda46b3aea07d8eef1ef803d634f7372b195ac3658e658d37b5b8fc7 not found: ID does not exist"
May 28 17:55:06.651673 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.651651    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:55:06.655779 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:06.655760    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-767984c98c-mrxhf"]
May 28 17:55:07.032540 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:07.032509    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" path="/var/lib/kubelet/pods/d5a736c5-95e4-4a21-bb51-10b948d2c6ab/volumes"
May 28 17:55:25.534982 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.534952    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-dddbc4f6f-ss45t"]
May 28 17:55:25.535428 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.535413    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" containerName="manager"
May 28 17:55:25.535473 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.535430    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" containerName="manager"
May 28 17:55:25.535507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.535499    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5a736c5-95e4-4a21-bb51-10b948d2c6ab" containerName="manager"
May 28 17:55:25.538594 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.538574    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.540908 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.540887    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 17:55:25.541213 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.541119    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k2j7x\""
May 28 17:55:25.548550 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.548530    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-dddbc4f6f-ss45t"]
May 28 17:55:25.632632 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.632601    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-248gh\" (UniqueName: \"kubernetes.io/projected/558b1b3e-b884-4f64-8665-7f2cfb4c387c-kube-api-access-248gh\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.632765 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.632658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558b1b3e-b884-4f64-8665-7f2cfb4c387c-maas-api-tls\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.733156 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.733128    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-248gh\" (UniqueName: \"kubernetes.io/projected/558b1b3e-b884-4f64-8665-7f2cfb4c387c-kube-api-access-248gh\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.733337 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.733178    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558b1b3e-b884-4f64-8665-7f2cfb4c387c-maas-api-tls\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.735685 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.735658    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558b1b3e-b884-4f64-8665-7f2cfb4c387c-maas-api-tls\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.741770 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.741749    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-248gh\" (UniqueName: \"kubernetes.io/projected/558b1b3e-b884-4f64-8665-7f2cfb4c387c-kube-api-access-248gh\") pod \"maas-api-dddbc4f6f-ss45t\" (UID: \"558b1b3e-b884-4f64-8665-7f2cfb4c387c\") " pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.851171 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.851078    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:25.924603 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.924546    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"]
May 28 17:55:25.928953 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.928928    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:25.931654 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.931633    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 17:55:25.931801 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.931689    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pfmhc\""
May 28 17:55:25.938738 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.938692    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"]
May 28 17:55:25.993178 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:25.993133    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-dddbc4f6f-ss45t"]
May 28 17:55:25.999135 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:55:25.999103    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558b1b3e_b884_4f64_8665_7f2cfb4c387c.slice/crio-19b5c541b59c54ab860cfeca5cc8ac68e0ee221a5cde9ee9482d8f6902d9dddf WatchSource:0}: Error finding container 19b5c541b59c54ab860cfeca5cc8ac68e0ee221a5cde9ee9482d8f6902d9dddf: Status 404 returned error can't find the container with id 19b5c541b59c54ab860cfeca5cc8ac68e0ee221a5cde9ee9482d8f6902d9dddf
May 28 17:55:26.035866 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.035830    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65w68\" (UniqueName: \"kubernetes.io/projected/c93ac562-1a46-42cd-991f-0e97811328dd-kube-api-access-65w68\") pod \"payload-processing-58b6c8fdc7-fzm5l\" (UID: \"c93ac562-1a46-42cd-991f-0e97811328dd\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:26.137426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.137342    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65w68\" (UniqueName: \"kubernetes.io/projected/c93ac562-1a46-42cd-991f-0e97811328dd-kube-api-access-65w68\") pod \"payload-processing-58b6c8fdc7-fzm5l\" (UID: \"c93ac562-1a46-42cd-991f-0e97811328dd\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:26.146286 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.146260    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65w68\" (UniqueName: \"kubernetes.io/projected/c93ac562-1a46-42cd-991f-0e97811328dd-kube-api-access-65w68\") pod \"payload-processing-58b6c8fdc7-fzm5l\" (UID: \"c93ac562-1a46-42cd-991f-0e97811328dd\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:26.241447 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.241403    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:26.379515 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.379489    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"]
May 28 17:55:26.380102 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:55:26.380060    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93ac562_1a46_42cd_991f_0e97811328dd.slice/crio-f32f2e73b3c7befd6c84d36e54d4b3f16141a36e7f90a5043bcdbd62502fd0ba WatchSource:0}: Error finding container f32f2e73b3c7befd6c84d36e54d4b3f16141a36e7f90a5043bcdbd62502fd0ba: Status 404 returned error can't find the container with id f32f2e73b3c7befd6c84d36e54d4b3f16141a36e7f90a5043bcdbd62502fd0ba
May 28 17:55:26.718933 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.718866    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-dddbc4f6f-ss45t" event={"ID":"558b1b3e-b884-4f64-8665-7f2cfb4c387c","Type":"ContainerStarted","Data":"19b5c541b59c54ab860cfeca5cc8ac68e0ee221a5cde9ee9482d8f6902d9dddf"}
May 28 17:55:26.720365 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:26.720326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l" event={"ID":"c93ac562-1a46-42cd-991f-0e97811328dd","Type":"ContainerStarted","Data":"f32f2e73b3c7befd6c84d36e54d4b3f16141a36e7f90a5043bcdbd62502fd0ba"}
May 28 17:55:28.732035 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.731993    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-dddbc4f6f-ss45t" event={"ID":"558b1b3e-b884-4f64-8665-7f2cfb4c387c","Type":"ContainerStarted","Data":"c9293068823b3cd312d6bb577bb86ab470cd9d758c62e5cd605c135d1d28a1e8"}
May 28 17:55:28.732484 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.732106    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:28.733559 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.733539    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l" event={"ID":"c93ac562-1a46-42cd-991f-0e97811328dd","Type":"ContainerStarted","Data":"8f7b65f103663c7d019c90930bb9b108b9c2a4b6b756992a3f36fcc8b09782f1"}
May 28 17:55:28.733695 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.733678    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:28.749789 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.749748    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-dddbc4f6f-ss45t" podStartSLOduration=1.7728985499999999 podStartE2EDuration="3.749735798s" podCreationTimestamp="2026-05-28 17:55:25 +0000 UTC" firstStartedPulling="2026-05-28 17:55:26.000706163 +0000 UTC m=+693.603021772" lastFinishedPulling="2026-05-28 17:55:27.977543424 +0000 UTC m=+695.579859020" observedRunningTime="2026-05-28 17:55:28.747950658 +0000 UTC m=+696.350266272" watchObservedRunningTime="2026-05-28 17:55:28.749735798 +0000 UTC m=+696.352051411"
May 28 17:55:28.762550 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:28.762500    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l" podStartSLOduration=2.1701729419999998 podStartE2EDuration="3.762487026s" podCreationTimestamp="2026-05-28 17:55:25 +0000 UTC" firstStartedPulling="2026-05-28 17:55:26.382661053 +0000 UTC m=+693.984976659" lastFinishedPulling="2026-05-28 17:55:27.974975139 +0000 UTC m=+695.577290743" observedRunningTime="2026-05-28 17:55:28.76221873 +0000 UTC m=+696.364534346" watchObservedRunningTime="2026-05-28 17:55:28.762487026 +0000 UTC m=+696.364802639"
May 28 17:55:34.742956 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:34.742927    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-dddbc4f6f-ss45t"
May 28 17:55:39.740230 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:39.740202    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fzm5l"
May 28 17:55:56.697911 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.697857    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"]
May 28 17:55:56.700648 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.700625    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.704387 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.704364    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 17:55:56.704507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.704405    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 17:55:56.704507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.704374    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7wjbl\""
May 28 17:55:56.704507 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.704374    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 28 17:55:56.711238 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.711363 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711262    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.711363 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.711482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711375    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.711482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711432    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.711482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.711465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwpl\" (UniqueName: \"kubernetes.io/projected/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kube-api-access-jmwpl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.713241 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.713219    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"]
May 28 17:55:56.812410 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812378    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812426    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812568 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812516    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwpl\" (UniqueName: \"kubernetes.io/projected/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kube-api-access-jmwpl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812640 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812574    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812640 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812627    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812726 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812661    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812856 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812826    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.812994 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.812977    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.813083 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.813064    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.814829 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.814808    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.815101 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.815084    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:56.820719 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:56.820701    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwpl\" (UniqueName: \"kubernetes.io/projected/2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937-kube-api-access-jmwpl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9\" (UID: \"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:57.011929 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:57.011828    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:55:57.164120 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:57.164091    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"]
May 28 17:55:57.165100 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:55:57.165075    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3aa2f3_10e6_4ecb_8cd9_cf06807c7937.slice/crio-48ed14a7b493e10535c2ad1fa0682424fd73b124797f959a13e4b3dee9e5719f WatchSource:0}: Error finding container 48ed14a7b493e10535c2ad1fa0682424fd73b124797f959a13e4b3dee9e5719f: Status 404 returned error can't find the container with id 48ed14a7b493e10535c2ad1fa0682424fd73b124797f959a13e4b3dee9e5719f
May 28 17:55:57.858564 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:55:57.858523    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9" event={"ID":"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937","Type":"ContainerStarted","Data":"48ed14a7b493e10535c2ad1fa0682424fd73b124797f959a13e4b3dee9e5719f"}
May 28 17:56:02.885737 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:02.885637    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9" event={"ID":"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937","Type":"ContainerStarted","Data":"8dad4c61cc65b497ecf0ec9cc5a1be6a8ee66d7e40632e6731af81124937b229"}
May 28 17:56:08.920158 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:08.920121    2566 generic.go:358] "Generic (PLEG): container finished" podID="2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937" containerID="8dad4c61cc65b497ecf0ec9cc5a1be6a8ee66d7e40632e6731af81124937b229" exitCode=0
May 28 17:56:08.920561 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:08.920196    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9" event={"ID":"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937","Type":"ContainerDied","Data":"8dad4c61cc65b497ecf0ec9cc5a1be6a8ee66d7e40632e6731af81124937b229"}
May 28 17:56:10.933482 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:10.933449    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9" event={"ID":"2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937","Type":"ContainerStarted","Data":"f88b79511269fd17451c614285424222d34588d825c76f4d28fed3610f64a6ae"}
May 28 17:56:10.933856 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:10.933670    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:56:10.952323 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:10.952267    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9" podStartSLOduration=2.007816265 podStartE2EDuration="14.9522494s" podCreationTimestamp="2026-05-28 17:55:56 +0000 UTC" firstStartedPulling="2026-05-28 17:55:57.166922344 +0000 UTC m=+724.769237938" lastFinishedPulling="2026-05-28 17:56:10.111355474 +0000 UTC m=+737.713671073" observedRunningTime="2026-05-28 17:56:10.94976024 +0000 UTC m=+738.552075862" watchObservedRunningTime="2026-05-28 17:56:10.9522494 +0000 UTC m=+738.554565014"
May 28 17:56:18.987551 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:18.987516    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"]
May 28 17:56:18.993778 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:18.993747    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:18.996901 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:18.996810    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 17:56:19.001822 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.001793    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"]
May 28 17:56:19.133052 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.133209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.133209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133094    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.133209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.133209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjb8t\" (UniqueName: \"kubernetes.io/projected/21441f71-3f54-4143-9efb-4f483fdde384-kube-api-access-sjb8t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.133209 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.133206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21441f71-3f54-4143-9efb-4f483fdde384-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.234627 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234589    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.234802 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234659    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.234802 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234722    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.234802 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234754    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.234802 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234785    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjb8t\" (UniqueName: \"kubernetes.io/projected/21441f71-3f54-4143-9efb-4f483fdde384-kube-api-access-sjb8t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.235066 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234836    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21441f71-3f54-4143-9efb-4f483fdde384-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.235066 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.234985    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.235066 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.235039    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.235166 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.235077    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.237999 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.237938    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21441f71-3f54-4143-9efb-4f483fdde384-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.238103 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.238050    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21441f71-3f54-4143-9efb-4f483fdde384-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.248373 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.248325    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjb8t\" (UniqueName: \"kubernetes.io/projected/21441f71-3f54-4143-9efb-4f483fdde384-kube-api-access-sjb8t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5zh55\" (UID: \"21441f71-3f54-4143-9efb-4f483fdde384\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.307655 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.307619    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:19.458910 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.458856    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"]
May 28 17:56:19.459824 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:56:19.459788    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21441f71_3f54_4143_9efb_4f483fdde384.slice/crio-b93e358949d60b36f4eb3b612441a2f6e636e0929162f683946ab2477a19b5e3 WatchSource:0}: Error finding container b93e358949d60b36f4eb3b612441a2f6e636e0929162f683946ab2477a19b5e3: Status 404 returned error can't find the container with id b93e358949d60b36f4eb3b612441a2f6e636e0929162f683946ab2477a19b5e3
May 28 17:56:19.974615 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.974575    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55" event={"ID":"21441f71-3f54-4143-9efb-4f483fdde384","Type":"ContainerStarted","Data":"cb42f84054422e17ed0231936cd1dc6bbad3265243fe1e67511ba01903b506db"}
May 28 17:56:19.974615 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:19.974613    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55" event={"ID":"21441f71-3f54-4143-9efb-4f483fdde384","Type":"ContainerStarted","Data":"b93e358949d60b36f4eb3b612441a2f6e636e0929162f683946ab2477a19b5e3"}
May 28 17:56:21.957314 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:21.957270    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9"
May 28 17:56:24.998682 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:24.998646    2566 generic.go:358] "Generic (PLEG): container finished" podID="21441f71-3f54-4143-9efb-4f483fdde384" containerID="cb42f84054422e17ed0231936cd1dc6bbad3265243fe1e67511ba01903b506db" exitCode=0
May 28 17:56:24.999025 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:24.998720    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55" event={"ID":"21441f71-3f54-4143-9efb-4f483fdde384","Type":"ContainerDied","Data":"cb42f84054422e17ed0231936cd1dc6bbad3265243fe1e67511ba01903b506db"}
May 28 17:56:26.004548 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:26.004516    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55" event={"ID":"21441f71-3f54-4143-9efb-4f483fdde384","Type":"ContainerStarted","Data":"521790b17e6ff303f50097afb5fae431bc96204a47f73290bd469dde0fe1d10f"}
May 28 17:56:26.004913 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:26.004736    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:56:26.023827 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:26.023781    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55" podStartSLOduration=7.766587351 podStartE2EDuration="8.023765027s" podCreationTimestamp="2026-05-28 17:56:18 +0000 UTC" firstStartedPulling="2026-05-28 17:56:24.999372378 +0000 UTC m=+752.601687972" lastFinishedPulling="2026-05-28 17:56:25.256550048 +0000 UTC m=+752.858865648" observedRunningTime="2026-05-28 17:56:26.021608632 +0000 UTC m=+753.623924245" watchObservedRunningTime="2026-05-28 17:56:26.023765027 +0000 UTC m=+753.626080642"
May 28 17:56:37.021429 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:56:37.021402    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5zh55"
May 28 17:58:00.575364 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:00.575326    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:58:00.575852 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:00.575542    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-57554dbf74-8mbjf" podUID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" containerName="manager" containerID="cri-o://d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50" gracePeriod=30
May 28 17:58:00.829118 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:00.829060    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:58:00.976322 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:00.976290    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgzxk\" (UniqueName: \"kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk\") pod \"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba\" (UID: \"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba\") "
May 28 17:58:00.978523 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:00.978496    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk" (OuterVolumeSpecName: "kube-api-access-bgzxk") pod "3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" (UID: "3cf8dc04-77fb-42e6-81ea-3353a5fc6fba"). InnerVolumeSpecName "kube-api-access-bgzxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:58:01.077255 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.077230    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgzxk\" (UniqueName: \"kubernetes.io/projected/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba-kube-api-access-bgzxk\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:01.424497 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.424463    2566 generic.go:358] "Generic (PLEG): container finished" podID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" containerID="d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50" exitCode=0
May 28 17:58:01.424690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.424529    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-8mbjf"
May 28 17:58:01.424690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.424553    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-8mbjf" event={"ID":"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba","Type":"ContainerDied","Data":"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"}
May 28 17:58:01.424690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.424602    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-8mbjf" event={"ID":"3cf8dc04-77fb-42e6-81ea-3353a5fc6fba","Type":"ContainerDied","Data":"7651450aedfb74767e2488f3d19cf945c0da72170ae1729abadbb4be7b20c0da"}
May 28 17:58:01.424690 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.424621    2566 scope.go:117] "RemoveContainer" containerID="d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"
May 28 17:58:01.434106 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.434087    2566 scope.go:117] "RemoveContainer" containerID="d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"
May 28 17:58:01.434366 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:58:01.434347    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50\": container with ID starting with d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50 not found: ID does not exist" containerID="d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"
May 28 17:58:01.434426 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.434377    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50"} err="failed to get container status \"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50\": rpc error: code = NotFound desc = could not find container \"d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50\": container with ID starting with d1d87efbb06ab3dc09ead565119489a4b2850cfbf84644c680171d0f8cbc3c50 not found: ID does not exist"
May 28 17:58:01.442865 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.442839    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:58:01.446643 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:01.446621    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57554dbf74-8mbjf"]
May 28 17:58:03.033220 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:03.033188    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" path="/var/lib/kubelet/pods/3cf8dc04-77fb-42e6-81ea-3353a5fc6fba/volumes"
May 28 17:58:05.941947 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.941907    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c897f8d65-fzgt2"]
May 28 17:58:05.942412 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.942398    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" containerName="manager"
May 28 17:58:05.942455 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.942414    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" containerName="manager"
May 28 17:58:05.942522 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.942511    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="3cf8dc04-77fb-42e6-81ea-3353a5fc6fba" containerName="manager"
May 28 17:58:05.944682 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.944660    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:05.956037 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:05.956010    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c897f8d65-fzgt2"]
May 28 17:58:06.125968 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.125937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.125968 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.125974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-oauth-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.126249 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.125995    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.126249 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.126072    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kwbj\" (UniqueName: \"kubernetes.io/projected/aa512b91-7bdf-4ace-814e-8ac4e04590a7-kube-api-access-8kwbj\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.126249 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.126167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-service-ca\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.126249 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.126197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-oauth-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.126422 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.126257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-trusted-ca-bundle\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227499    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227540    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-oauth-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227580 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227570    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227598    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kwbj\" (UniqueName: \"kubernetes.io/projected/aa512b91-7bdf-4ace-814e-8ac4e04590a7-kube-api-access-8kwbj\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227638    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-service-ca\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227661    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-oauth-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.227845 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.227696    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-trusted-ca-bundle\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.228369 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.228344    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-service-ca\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.228516 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.228489    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-oauth-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.228588 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.228495    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.228645 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.228611    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa512b91-7bdf-4ace-814e-8ac4e04590a7-trusted-ca-bundle\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.230632 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.230610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-oauth-config\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.230844 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.230824    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa512b91-7bdf-4ace-814e-8ac4e04590a7-console-serving-cert\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.237019 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.236996    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kwbj\" (UniqueName: \"kubernetes.io/projected/aa512b91-7bdf-4ace-814e-8ac4e04590a7-kube-api-access-8kwbj\") pod \"console-5c897f8d65-fzgt2\" (UID: \"aa512b91-7bdf-4ace-814e-8ac4e04590a7\") " pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.255178 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.255155    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:06.394611 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.394584    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c897f8d65-fzgt2"]
May 28 17:58:06.396904 ip-10-0-137-72 kubenswrapper[2566]: W0528 17:58:06.396851    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa512b91_7bdf_4ace_814e_8ac4e04590a7.slice/crio-e87ac35ead185973f7c898e772c6b1387a6a1edd25f6517b5a38954a5b56e21a WatchSource:0}: Error finding container e87ac35ead185973f7c898e772c6b1387a6a1edd25f6517b5a38954a5b56e21a: Status 404 returned error can't find the container with id e87ac35ead185973f7c898e772c6b1387a6a1edd25f6517b5a38954a5b56e21a
May 28 17:58:06.450835 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:06.450803    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c897f8d65-fzgt2" event={"ID":"aa512b91-7bdf-4ace-814e-8ac4e04590a7","Type":"ContainerStarted","Data":"e87ac35ead185973f7c898e772c6b1387a6a1edd25f6517b5a38954a5b56e21a"}
May 28 17:58:07.456138 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:07.456103    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c897f8d65-fzgt2" event={"ID":"aa512b91-7bdf-4ace-814e-8ac4e04590a7","Type":"ContainerStarted","Data":"01a7ac6ae2dcb740b420e4549a6cc3d2ac2b3aab87e17d65856cb8c90e1e8c28"}
May 28 17:58:07.475897 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:07.475829    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c897f8d65-fzgt2" podStartSLOduration=2.475814627 podStartE2EDuration="2.475814627s" podCreationTimestamp="2026-05-28 17:58:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:58:07.474166623 +0000 UTC m=+855.076482236" watchObservedRunningTime="2026-05-28 17:58:07.475814627 +0000 UTC m=+855.078130240"
May 28 17:58:16.255585 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:16.255544    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:16.255585 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:16.255588    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:16.260467 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:16.260444    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:16.506616 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:16.506531    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c897f8d65-fzgt2"
May 28 17:58:16.557411 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:16.557379    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:58:41.585969 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.585870    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-784bcfc49d-glhtv" podUID="1f8a01aa-068a-4c28-91ae-189efddb825a" containerName="console" containerID="cri-o://1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb" gracePeriod=15
May 28 17:58:41.830141 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.830114    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784bcfc49d-glhtv_1f8a01aa-068a-4c28-91ae-189efddb825a/console/0.log"
May 28 17:58:41.830271 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.830189    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:58:41.951559 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951529    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.951743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951613    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwnz7\" (UniqueName: \"kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.951743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951662    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.951743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951693    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.951743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951716    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.951743 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951740    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.952077 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.951763    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert\") pod \"1f8a01aa-068a-4c28-91ae-189efddb825a\" (UID: \"1f8a01aa-068a-4c28-91ae-189efddb825a\") "
May 28 17:58:41.952412 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.952384    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:58:41.952575 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.952447    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:58:41.952786 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.952678    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:58:41.952907 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.952830    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config" (OuterVolumeSpecName: "console-config") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:58:41.954311 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.954287    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:58:41.954311 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.954289    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7" (OuterVolumeSpecName: "kube-api-access-jwnz7") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "kube-api-access-jwnz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:58:41.954434 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:41.954352    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f8a01aa-068a-4c28-91ae-189efddb825a" (UID: "1f8a01aa-068a-4c28-91ae-189efddb825a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:58:42.053298 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053262    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-console-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053298 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053292    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-oauth-config\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053298 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053302    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-service-ca\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053530 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053312    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-trusted-ca-bundle\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053530 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053321    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8a01aa-068a-4c28-91ae-189efddb825a-oauth-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053530 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053330    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8a01aa-068a-4c28-91ae-189efddb825a-console-serving-cert\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.053530 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.053339    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwnz7\" (UniqueName: \"kubernetes.io/projected/1f8a01aa-068a-4c28-91ae-189efddb825a-kube-api-access-jwnz7\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 17:58:42.616626 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616604    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784bcfc49d-glhtv_1f8a01aa-068a-4c28-91ae-189efddb825a/console/0.log"
May 28 17:58:42.616959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616641    2566 generic.go:358] "Generic (PLEG): container finished" podID="1f8a01aa-068a-4c28-91ae-189efddb825a" containerID="1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb" exitCode=2
May 28 17:58:42.616959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616687    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bcfc49d-glhtv" event={"ID":"1f8a01aa-068a-4c28-91ae-189efddb825a","Type":"ContainerDied","Data":"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"}
May 28 17:58:42.616959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616709    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784bcfc49d-glhtv" event={"ID":"1f8a01aa-068a-4c28-91ae-189efddb825a","Type":"ContainerDied","Data":"a80c055037c92c02612a8c4851cded2fa88833a666d5a8f25f3946e753ab6123"}
May 28 17:58:42.616959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616733    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784bcfc49d-glhtv"
May 28 17:58:42.616959 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.616732    2566 scope.go:117] "RemoveContainer" containerID="1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"
May 28 17:58:42.626974 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.626950    2566 scope.go:117] "RemoveContainer" containerID="1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"
May 28 17:58:42.627224 ip-10-0-137-72 kubenswrapper[2566]: E0528 17:58:42.627206    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb\": container with ID starting with 1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb not found: ID does not exist" containerID="1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"
May 28 17:58:42.627291 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.627231    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb"} err="failed to get container status \"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb\": rpc error: code = NotFound desc = could not find container \"1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb\": container with ID starting with 1def8c4ebc5c59b6ce784c9b919edce9cb49299978735427a04350e1aec28fbb not found: ID does not exist"
May 28 17:58:42.640023 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.640002    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:58:42.645895 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:42.645851    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784bcfc49d-glhtv"]
May 28 17:58:43.034181 ip-10-0-137-72 kubenswrapper[2566]: I0528 17:58:43.034142    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f8a01aa-068a-4c28-91ae-189efddb825a" path="/var/lib/kubelet/pods/1f8a01aa-068a-4c28-91ae-189efddb825a/volumes"
May 28 18:08:17.260077 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.260038    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 18:08:17.260622 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.260281    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" podUID="65802175-d2b3-4e56-aca8-ad8743d4593a" containerName="manager" containerID="cri-o://0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76" gracePeriod=10
May 28 18:08:17.523451 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.523381    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 18:08:17.622618 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.622584    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume\") pod \"65802175-d2b3-4e56-aca8-ad8743d4593a\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") "
May 28 18:08:17.622818 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.622660    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwjrw\" (UniqueName: \"kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw\") pod \"65802175-d2b3-4e56-aca8-ad8743d4593a\" (UID: \"65802175-d2b3-4e56-aca8-ad8743d4593a\") "
May 28 18:08:17.623053 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.623022    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65802175-d2b3-4e56-aca8-ad8743d4593a" (UID: "65802175-d2b3-4e56-aca8-ad8743d4593a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:08:17.624996 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.624914    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw" (OuterVolumeSpecName: "kube-api-access-nwjrw") pod "65802175-d2b3-4e56-aca8-ad8743d4593a" (UID: "65802175-d2b3-4e56-aca8-ad8743d4593a"). InnerVolumeSpecName "kube-api-access-nwjrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:08:17.723405 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.723374    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65802175-d2b3-4e56-aca8-ad8743d4593a-extensions-socket-volume\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 18:08:17.723405 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:17.723402    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwjrw\" (UniqueName: \"kubernetes.io/projected/65802175-d2b3-4e56-aca8-ad8743d4593a-kube-api-access-nwjrw\") on node \"ip-10-0-137-72.ec2.internal\" DevicePath \"\""
May 28 18:08:18.140296 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.140261    2566 generic.go:358] "Generic (PLEG): container finished" podID="65802175-d2b3-4e56-aca8-ad8743d4593a" containerID="0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76" exitCode=0
May 28 18:08:18.140482 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.140299    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" event={"ID":"65802175-d2b3-4e56-aca8-ad8743d4593a","Type":"ContainerDied","Data":"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"}
May 28 18:08:18.140482 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.140326    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"
May 28 18:08:18.140482 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.140337    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn" event={"ID":"65802175-d2b3-4e56-aca8-ad8743d4593a","Type":"ContainerDied","Data":"e22f32dde7d99eebdd86b29054d55a3c42a8a50b2c9ec0608c8507c2f74f6be8"}
May 28 18:08:18.140482 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.140354    2566 scope.go:117] "RemoveContainer" containerID="0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"
May 28 18:08:18.150795 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.150775    2566 scope.go:117] "RemoveContainer" containerID="0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"
May 28 18:08:18.151100 ip-10-0-137-72 kubenswrapper[2566]: E0528 18:08:18.151078    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76\": container with ID starting with 0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76 not found: ID does not exist" containerID="0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"
May 28 18:08:18.151167 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.151112    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76"} err="failed to get container status \"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76\": rpc error: code = NotFound desc = could not find container \"0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76\": container with ID starting with 0e29142163e0c0ee75d05795a06405d6e4744ff5a61ed11ffde2b09232458e76 not found: ID does not exist"
May 28 18:08:18.164370 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.164244    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 18:08:18.167123 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:18.167099    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fjfpn"]
May 28 18:08:19.032760 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:08:19.032728    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65802175-d2b3-4e56-aca8-ad8743d4593a" path="/var/lib/kubelet/pods/65802175-d2b3-4e56-aca8-ad8743d4593a/volumes"
May 28 18:09:23.335488 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.335402    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"]
May 28 18:09:23.336020 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.335998    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65802175-d2b3-4e56-aca8-ad8743d4593a" containerName="manager"
May 28 18:09:23.336020 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.336013    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="65802175-d2b3-4e56-aca8-ad8743d4593a" containerName="manager"
May 28 18:09:23.336140 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.336030    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8a01aa-068a-4c28-91ae-189efddb825a" containerName="console"
May 28 18:09:23.336140 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.336036    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8a01aa-068a-4c28-91ae-189efddb825a" containerName="console"
May 28 18:09:23.336140 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.336114    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="65802175-d2b3-4e56-aca8-ad8743d4593a" containerName="manager"
May 28 18:09:23.336140 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.336122    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f8a01aa-068a-4c28-91ae-189efddb825a" containerName="console"
May 28 18:09:23.339553 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.339529    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.342358 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.342335    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ljqb\""
May 28 18:09:23.350368 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.350343    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"]
May 28 18:09:23.449344 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.449310    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6xtr\" (UniqueName: \"kubernetes.io/projected/203a47f4-1679-42ad-a82f-6a030d2461c4-kube-api-access-l6xtr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.449514 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.449373    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/203a47f4-1679-42ad-a82f-6a030d2461c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.550742 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.550703    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/203a47f4-1679-42ad-a82f-6a030d2461c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.550867 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.550810    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6xtr\" (UniqueName: \"kubernetes.io/projected/203a47f4-1679-42ad-a82f-6a030d2461c4-kube-api-access-l6xtr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.551106 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.551085    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/203a47f4-1679-42ad-a82f-6a030d2461c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.560421 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.560391    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6xtr\" (UniqueName: \"kubernetes.io/projected/203a47f4-1679-42ad-a82f-6a030d2461c4-kube-api-access-l6xtr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6z2tq\" (UID: \"203a47f4-1679-42ad-a82f-6a030d2461c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.651919 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.651804    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:23.798778 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.798750    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"]
May 28 18:09:23.801046 ip-10-0-137-72 kubenswrapper[2566]: W0528 18:09:23.801014    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203a47f4_1679_42ad_a82f_6a030d2461c4.slice/crio-0b5fef9488c180d45a953bdf3d31e4e538be299aeede2c2087906e51ee6fd339 WatchSource:0}: Error finding container 0b5fef9488c180d45a953bdf3d31e4e538be299aeede2c2087906e51ee6fd339: Status 404 returned error can't find the container with id 0b5fef9488c180d45a953bdf3d31e4e538be299aeede2c2087906e51ee6fd339
May 28 18:09:23.803900 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:23.803867    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:09:24.435393 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:24.435354    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq" event={"ID":"203a47f4-1679-42ad-a82f-6a030d2461c4","Type":"ContainerStarted","Data":"50657df98254a0341fa9ead0bc257d4c67caa58213ec11628dfca9bd6ab7e997"}
May 28 18:09:24.435393 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:24.435394    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq" event={"ID":"203a47f4-1679-42ad-a82f-6a030d2461c4","Type":"ContainerStarted","Data":"0b5fef9488c180d45a953bdf3d31e4e538be299aeede2c2087906e51ee6fd339"}
May 28 18:09:24.435969 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:24.435456    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:09:24.458998 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:24.458949    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq" podStartSLOduration=1.4589352660000001 podStartE2EDuration="1.458935266s" podCreationTimestamp="2026-05-28 18:09:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:09:24.455018054 +0000 UTC m=+1532.057333686" watchObservedRunningTime="2026-05-28 18:09:24.458935266 +0000 UTC m=+1532.061250878"
May 28 18:09:35.441649 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:09:35.441610    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6z2tq"
May 28 18:19:08.917803 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:08.917768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-p5xcs_64611b7f-9bac-4d8f-b1fe-d84602dcd355/manager/0.log"
May 28 18:19:09.037483 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:09.037457    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-dddbc4f6f-ss45t_558b1b3e-b884-4f64-8665-7f2cfb4c387c/maas-api/0.log"
May 28 18:19:09.511924 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:09.511895    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vgvct_2ebea2ff-cd18-4da1-9642-06e64c70bf7d/manager/2.log"
May 28 18:19:09.746289 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:09.746260    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65fbbfd459-8ndh6_7486569b-213b-4d73-b3bd-d8e1df01631b/manager/0.log"
May 28 18:19:10.716069 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.716034    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/util/0.log"
May 28 18:19:10.721732 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.721698    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/pull/0.log"
May 28 18:19:10.727397 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.727357    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/extract/0.log"
May 28 18:19:10.831760 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.831736    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/util/0.log"
May 28 18:19:10.837470 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.837448    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/pull/0.log"
May 28 18:19:10.843172 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.843151    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/extract/0.log"
May 28 18:19:10.958771 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.958734    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/pull/0.log"
May 28 18:19:10.964519 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.964467    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/extract/0.log"
May 28 18:19:10.969894 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:10.969823    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/util/0.log"
May 28 18:19:11.083487 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:11.083456    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/pull/0.log"
May 28 18:19:11.089360 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:11.089325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/extract/0.log"
May 28 18:19:11.095296 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:11.095279    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/util/0.log"
May 28 18:19:11.443089 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:11.443053    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l74ck_751c9870-58db-47cd-b1a9-4cfda5067176/manager/0.log"
May 28 18:19:11.777867 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:11.777792    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6z2tq_203a47f4-1679-42ad-a82f-6a030d2461c4/manager/0.log"
May 28 18:19:12.007707 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:12.007680    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-gvlw7_175a29f5-c088-4a81-a1e3-b635b7abf211/manager/0.log"
May 28 18:19:12.469364 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:12.469335    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cjnw9_910ef0a9-b655-4de1-aa0a-2690d164d97b/discovery/0.log"
May 28 18:19:12.696633 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:12.696603    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5fd6c96-sqrcz_bba8bc6e-2449-4fc4-a9ae-ae03df655e8d/kube-auth-proxy/0.log"
May 28 18:19:12.936321 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:12.936241    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fzm5l_c93ac562-1a46-42cd-991f-0e97811328dd/payload-processing/0.log"
May 28 18:19:13.049638 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:13.049608    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b87c96c96-nxhj2_c24a4791-2753-49c9-8ac0-830b1bcb4747/router/0.log"
May 28 18:19:13.636944 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:13.636919    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5zh55_21441f71-3f54-4143-9efb-4f483fdde384/main/0.log"
May 28 18:19:13.643106 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:13.643063    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5zh55_21441f71-3f54-4143-9efb-4f483fdde384/storage-initializer/0.log"
May 28 18:19:13.878046 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:13.878021    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9_2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937/storage-initializer/0.log"
May 28 18:19:13.884205 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:13.884183    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-52mr9_2a3aa2f3-10e6-4ecb-8cd9-cf06807c7937/main/0.log"
May 28 18:19:20.683409 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:20.683367    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qxdsq_ce447f40-6fbb-4402-873a-ff6f2d8258c9/global-pull-secret-syncer/0.log"
May 28 18:19:20.795948 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:20.795914    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jg5wq_640355f2-a1ca-40cf-a0ca-9408de6159e5/konnectivity-agent/0.log"
May 28 18:19:20.866967 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:20.866933    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-72.ec2.internal_70500e0cbc178c2892ee8356da629133/haproxy/0.log"
May 28 18:19:24.567312 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.567279    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/extract/0.log"
May 28 18:19:24.592392 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.592360    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/util/0.log"
May 28 18:19:24.615695 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.615669    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bpzqr_d9b8fb0a-7999-4efc-bd26-6ee8a80c914b/pull/0.log"
May 28 18:19:24.649631 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.649599    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/extract/0.log"
May 28 18:19:24.678986 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.678964    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/util/0.log"
May 28 18:19:24.721403 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.721380    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rlqsb_ffd8df0f-f2b4-4c97-98c7-e01f4b2281ac/pull/0.log"
May 28 18:19:24.784647 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.784562    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/extract/0.log"
May 28 18:19:24.825433 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.825408    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/util/0.log"
May 28 18:19:24.848037 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.848006    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738j9qp_17f6031d-c385-4da0-9221-4b2c529606d6/pull/0.log"
May 28 18:19:24.872928 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.872898    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/extract/0.log"
May 28 18:19:24.895234 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.895208    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/util/0.log"
May 28 18:19:24.916981 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:24.916958    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14cwwh_9b1abdc1-f2a4-417b-a9d3-09dd96e51ff8/pull/0.log"
May 28 18:19:25.308455 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:25.308426    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l74ck_751c9870-58db-47cd-b1a9-4cfda5067176/manager/0.log"
May 28 18:19:25.434000 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:25.433966    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6z2tq_203a47f4-1679-42ad-a82f-6a030d2461c4/manager/0.log"
May 28 18:19:25.516603 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:25.516573    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-gvlw7_175a29f5-c088-4a81-a1e3-b635b7abf211/manager/0.log"
May 28 18:19:27.008739 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.008657    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/alertmanager/0.log"
May 28 18:19:27.032199 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.032176    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/config-reloader/0.log"
May 28 18:19:27.056400 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.056363    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/kube-rbac-proxy-web/0.log"
May 28 18:19:27.082429 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.082400    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/kube-rbac-proxy/0.log"
May 28 18:19:27.106086 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.106059    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/kube-rbac-proxy-metric/0.log"
May 28 18:19:27.128808 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.128786    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/prom-label-proxy/0.log"
May 28 18:19:27.151483 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.151456    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0fafb1c1-3acc-4eea-b109-35fada09daad/init-config-reloader/0.log"
May 28 18:19:27.223346 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.223316    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gf584_b5e782ec-6452-4f9c-9124-3819a4879e2d/kube-state-metrics/0.log"
May 28 18:19:27.256559 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.256527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gf584_b5e782ec-6452-4f9c-9124-3819a4879e2d/kube-rbac-proxy-main/0.log"
May 28 18:19:27.292711 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.292627    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-gf584_b5e782ec-6452-4f9c-9124-3819a4879e2d/kube-rbac-proxy-self/0.log"
May 28 18:19:27.347768 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.347739    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-2q8jh_451f18da-7913-42c4-ab02-e0b91085ea44/monitoring-plugin/0.log"
May 28 18:19:27.535318 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.535291    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzsdm_92bb8198-422c-4842-9b16-407bc445a3da/node-exporter/0.log"
May 28 18:19:27.557774 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.557707    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzsdm_92bb8198-422c-4842-9b16-407bc445a3da/kube-rbac-proxy/0.log"
May 28 18:19:27.578456 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.578435    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kzsdm_92bb8198-422c-4842-9b16-407bc445a3da/init-textfile/0.log"
May 28 18:19:27.602783 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.602760    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lzrld_e8154bd0-91c9-4bb0-86d7-675da7518820/kube-rbac-proxy-main/0.log"
May 28 18:19:27.622340 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.622308    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lzrld_e8154bd0-91c9-4bb0-86d7-675da7518820/kube-rbac-proxy-self/0.log"
May 28 18:19:27.643429 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.643406    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lzrld_e8154bd0-91c9-4bb0-86d7-675da7518820/openshift-state-metrics/0.log"
May 28 18:19:27.825309 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.825231    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-snmpv_e18fbace-fc76-4b67-9518-f2857b0052cc/prometheus-operator/0.log"
May 28 18:19:27.843646 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.843614    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-snmpv_e18fbace-fc76-4b67-9518-f2857b0052cc/kube-rbac-proxy/0.log"
May 28 18:19:27.866860 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.866821    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9dp4n_d26ecf18-7b02-4929-aebd-259036515317/prometheus-operator-admission-webhook/0.log"
May 28 18:19:27.891953 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.891919    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7589cdd94b-rhjd7_f7782e19-f2d1-48f7-b845-6de514cf9850/telemeter-client/0.log"
May 28 18:19:27.911184 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.911163    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7589cdd94b-rhjd7_f7782e19-f2d1-48f7-b845-6de514cf9850/reload/0.log"
May 28 18:19:27.933132 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.933108    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7589cdd94b-rhjd7_f7782e19-f2d1-48f7-b845-6de514cf9850/kube-rbac-proxy/0.log"
May 28 18:19:27.963228 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.963208    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/thanos-query/0.log"
May 28 18:19:27.985041 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:27.985019    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/kube-rbac-proxy-web/0.log"
May 28 18:19:28.006685 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:28.006663    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/kube-rbac-proxy/0.log"
May 28 18:19:28.030146 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:28.030125    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/prom-label-proxy/0.log"
May 28 18:19:28.052644 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:28.052626    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/kube-rbac-proxy-rules/0.log"
May 28 18:19:28.074785 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:28.074745    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846bbcd679-8bjwv_9c276c1d-1df2-454c-a78b-ada890f0f10d/kube-rbac-proxy-metrics/0.log"
May 28 18:19:29.213974 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.213943    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"]
May 28 18:19:29.216549 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.216532    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.219224 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.219198    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v62rz\"/\"default-dockercfg-kgtl6\""
May 28 18:19:29.219365 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.219325    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v62rz\"/\"openshift-service-ca.crt\""
May 28 18:19:29.219365 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.219345    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v62rz\"/\"kube-root-ca.crt\""
May 28 18:19:29.224073 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.224051    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"]
May 28 18:19:29.357752 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.357723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-sys\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.357752 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.357754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-proc\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.358059 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.357773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-podres\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.358059 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.357797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnqlz\" (UniqueName: \"kubernetes.io/projected/4bb8845b-347a-47db-bdfe-40f27ed7e978-kube-api-access-mnqlz\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.358059 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.357950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-lib-modules\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459224 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459194    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-lib-modules\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459296    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-sys\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459318    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-proc\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459340    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-podres\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459366    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnqlz\" (UniqueName: \"kubernetes.io/projected/4bb8845b-347a-47db-bdfe-40f27ed7e978-kube-api-access-mnqlz\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459389    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-sys\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459416 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459397    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-proc\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459662 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459393    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-lib-modules\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.459662 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.459518    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bb8845b-347a-47db-bdfe-40f27ed7e978-podres\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.467415 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.467363    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnqlz\" (UniqueName: \"kubernetes.io/projected/4bb8845b-347a-47db-bdfe-40f27ed7e978-kube-api-access-mnqlz\") pod \"perf-node-gather-daemonset-5qpr9\" (UID: \"4bb8845b-347a-47db-bdfe-40f27ed7e978\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.528661 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.528637    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:29.671326 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.671301    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"]
May 28 18:19:29.673074 ip-10-0-137-72 kubenswrapper[2566]: W0528 18:19:29.673041    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4bb8845b_347a_47db_bdfe_40f27ed7e978.slice/crio-2ada98f387e495e73d821e305a178a0897dc58770d16d9f53aa43fb1b9575a79 WatchSource:0}: Error finding container 2ada98f387e495e73d821e305a178a0897dc58770d16d9f53aa43fb1b9575a79: Status 404 returned error can't find the container with id 2ada98f387e495e73d821e305a178a0897dc58770d16d9f53aa43fb1b9575a79
May 28 18:19:29.674776 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:29.674758    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:19:30.071923 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.071802    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9" event={"ID":"4bb8845b-347a-47db-bdfe-40f27ed7e978","Type":"ContainerStarted","Data":"af5fd203207e7623dd441628c5974c2a242b6e8621990ccdfc2b3214a99defda"}
May 28 18:19:30.071923 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.071841    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9" event={"ID":"4bb8845b-347a-47db-bdfe-40f27ed7e978","Type":"ContainerStarted","Data":"2ada98f387e495e73d821e305a178a0897dc58770d16d9f53aa43fb1b9575a79"}
May 28 18:19:30.072123 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.071929    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:30.087360 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.087314    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9" podStartSLOduration=1.08730043 podStartE2EDuration="1.08730043s" podCreationTimestamp="2026-05-28 18:19:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:19:30.087019949 +0000 UTC m=+2137.689335563" watchObservedRunningTime="2026-05-28 18:19:30.08730043 +0000 UTC m=+2137.689616043"
May 28 18:19:30.126547 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.126520    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c897f8d65-fzgt2_aa512b91-7bdf-4ace-814e-8ac4e04590a7/console/0.log"
May 28 18:19:30.157538 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.157508    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-vrkft_04cb27f4-9c13-4e16-bfb0-413dfb7e6e52/download-server/0.log"
May 28 18:19:30.636074 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:30.636042    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-nkfts_02e840c8-91a8-42f8-a2d7-26c48dc97853/volume-data-source-validator/0.log"
May 28 18:19:31.496608 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:31.496582    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jjbxb_78ab029c-9e9f-4a47-8ffa-f80b058c08ab/dns/0.log"
May 28 18:19:31.518036 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:31.518006    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jjbxb_78ab029c-9e9f-4a47-8ffa-f80b058c08ab/kube-rbac-proxy/0.log"
May 28 18:19:31.629590 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:31.629558    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzvts_e2d350eb-aaba-4257-b10f-9fafd3d2f119/dns-node-resolver/0.log"
May 28 18:19:32.145985 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:32.145957    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8lsd6_6fdb331b-6643-474c-8f05-18ebf190a5a1/node-ca/0.log"
May 28 18:19:33.025068 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:33.025036    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cjnw9_910ef0a9-b655-4de1-aa0a-2690d164d97b/discovery/0.log"
May 28 18:19:33.064758 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:33.064724    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5fd6c96-sqrcz_bba8bc6e-2449-4fc4-a9ae-ae03df655e8d/kube-auth-proxy/0.log"
May 28 18:19:33.183583 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:33.183544    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fzm5l_c93ac562-1a46-42cd-991f-0e97811328dd/payload-processing/0.log"
May 28 18:19:33.203765 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:33.203740    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b87c96c96-nxhj2_c24a4791-2753-49c9-8ac0-830b1bcb4747/router/0.log"
May 28 18:19:33.698867 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:33.698836    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5dzs6_d265c80d-d2b6-4855-b5cf-84a70c447d26/serve-healthcheck-canary/0.log"
May 28 18:19:34.220069 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:34.220040    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmkr_df01a83d-174e-4acd-9ab1-9c4e0167944e/kube-rbac-proxy/0.log"
May 28 18:19:34.239400 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:34.239375    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmkr_df01a83d-174e-4acd-9ab1-9c4e0167944e/exporter/0.log"
May 28 18:19:34.259516 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:34.259490    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmkr_df01a83d-174e-4acd-9ab1-9c4e0167944e/extractor/0.log"
May 28 18:19:36.086087 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.086061    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-5qpr9"
May 28 18:19:36.209954 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.209919    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-p5xcs_64611b7f-9bac-4d8f-b1fe-d84602dcd355/manager/0.log"
May 28 18:19:36.241374 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.241346    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-dddbc4f6f-ss45t_558b1b3e-b884-4f64-8665-7f2cfb4c387c/maas-api/0.log"
May 28 18:19:36.433828 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.433749    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vgvct_2ebea2ff-cd18-4da1-9642-06e64c70bf7d/manager/1.log"
May 28 18:19:36.446654 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.446624    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vgvct_2ebea2ff-cd18-4da1-9642-06e64c70bf7d/manager/2.log"
May 28 18:19:36.508701 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:36.508677    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65fbbfd459-8ndh6_7486569b-213b-4d73-b3bd-d8e1df01631b/manager/0.log"
May 28 18:19:37.675462 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:37.675429    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-nfhdj_7ccadcca-01a4-4341-be33-0d6f29382cf2/openshift-lws-operator/0.log"
May 28 18:19:42.431235 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:42.431147    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-lfz7j_98581b63-98ea-461d-9310-95de1e026120/kube-storage-version-migrator-operator/1.log"
May 28 18:19:42.432239 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:42.432217    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-lfz7j_98581b63-98ea-461d-9310-95de1e026120/kube-storage-version-migrator-operator/0.log"
May 28 18:19:43.680467 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.680439    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/kube-multus-additional-cni-plugins/0.log"
May 28 18:19:43.701672 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.701650    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/egress-router-binary-copy/0.log"
May 28 18:19:43.722917 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.722895    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/cni-plugins/0.log"
May 28 18:19:43.743824 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.743797    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/bond-cni-plugin/0.log"
May 28 18:19:43.763580 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.763557    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/routeoverride-cni/0.log"
May 28 18:19:43.783710 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.783688    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/whereabouts-cni-bincopy/0.log"
May 28 18:19:43.803497 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.803475    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ccx2_8c4a7d7f-49a9-4e90-922b-1bbd9785b56e/whereabouts-cni/0.log"
May 28 18:19:43.995807 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:43.995777    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hhdtw_f253f198-f451-4072-9b36-337145fd4e38/kube-multus/0.log"
May 28 18:19:44.044942 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:44.044914    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4tp8t_ebf68954-31e5-4ab5-88af-146f6093d424/network-metrics-daemon/0.log"
May 28 18:19:44.069832 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:44.069806    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4tp8t_ebf68954-31e5-4ab5-88af-146f6093d424/kube-rbac-proxy/0.log"
May 28 18:19:45.613382 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.613356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/ovn-controller/0.log"
May 28 18:19:45.638982 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.638958    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/ovn-acl-logging/0.log"
May 28 18:19:45.659114 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.659092    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/kube-rbac-proxy-node/0.log"
May 28 18:19:45.677511 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.677487    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/kube-rbac-proxy-ovn-metrics/0.log"
May 28 18:19:45.695129 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.695106    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/northd/0.log"
May 28 18:19:45.716528 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.716506    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/nbdb/0.log"
May 28 18:19:45.736008 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.735987    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/sbdb/0.log"
May 28 18:19:45.834295 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:45.834261    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sphfp_c212ad0c-d183-48c7-aae9-e0d9075b4806/ovnkube-controller/0.log"
May 28 18:19:46.964688 ip-10-0-137-72 kubenswrapper[2566]: I0528 18:19:46.964654    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4zvgt_81fdbfb7-10e6-4d61-9ac2-2aad97241518/network-check-target-container/0.log"